Sep 18 23:56:28.828422 ip-10-0-130-53 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 18 23:56:28.828435 ip-10-0-130-53 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 18 23:56:28.828442 ip-10-0-130-53 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 18 23:56:28.828595 ip-10-0-130-53 systemd[1]: Failed to start Kubernetes Kubelet. Sep 18 23:56:40.178780 ip-10-0-130-53 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Sep 18 23:56:40.178796 ip-10-0-130-53 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 1f30e8dacc4a4c9eac6fe7de1c3a7091 -- Sep 18 23:58:26.506219 ip-10-0-130-53 systemd[1]: Starting Kubernetes Kubelet... Sep 18 23:58:29.829813 ip-10-0-130-53 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 18 23:58:29.829813 ip-10-0-130-53 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 18 23:58:29.829813 ip-10-0-130-53 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 18 23:58:29.829813 ip-10-0-130-53 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 18 23:58:29.830675 ip-10-0-130-53 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 18 23:58:29.830675 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.830452 2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 18 23:58:29.834936 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.834916 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 23:58:29.834936 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.834935 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 23:58:29.835017 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.834941 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 23:58:29.835017 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.834945 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 23:58:29.835017 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.834948 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 23:58:29.835017 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.834952 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 23:58:29.835017 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.834955 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 23:58:29.835017 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.834959 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 23:58:29.835017 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.834962 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 23:58:29.835017 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.834965 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 23:58:29.835017 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.834968 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 23:58:29.835017 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.834972 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 23:58:29.835017 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.834975 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 23:58:29.835017 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.834978 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 23:58:29.835017 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.834981 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 23:58:29.835017 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.834991 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 23:58:29.835017 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.834994 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 23:58:29.835017 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.834997 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 23:58:29.835017 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.835000 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 23:58:29.835017 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.835003 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 23:58:29.835017 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.835006 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 23:58:29.835514 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.835009 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 23:58:29.835514 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.835012 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 23:58:29.835514 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.835015 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 23:58:29.835514 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.835019 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 23:58:29.835514 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.835022 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 23:58:29.835514 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.835025 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 23:58:29.835514 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.835028 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 23:58:29.835514 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.835032 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 23:58:29.835514 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.835035 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 23:58:29.835514 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.835038 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 23:58:29.835514 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.835042 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 23:58:29.835514 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.835048 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 23:58:29.835514 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.835052 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 23:58:29.835514 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.835057 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 23:58:29.835514 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.835060 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 23:58:29.835514 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.835063 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 23:58:29.835514 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.835066 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 23:58:29.835514 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.835069 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 23:58:29.835514 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.835073 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 23:58:29.836041 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.835076 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 23:58:29.836041 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.835079 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 23:58:29.836041 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.835081 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 23:58:29.836041 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.835084 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 23:58:29.836041 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.835087 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 23:58:29.836041 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.835089 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 23:58:29.836041 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.835092 2579 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 23:58:29.836041 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.835095 2579 feature_gate.go:328] unrecognized feature gate: Example Sep 18 23:58:29.836041 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.835098 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 23:58:29.836041 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.835100 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 23:58:29.836041 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.835103 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 23:58:29.836041 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.835106 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 23:58:29.836041 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.835109 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 23:58:29.836041 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.835112 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 23:58:29.836041 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.835116 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 23:58:29.836041 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.835119 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 23:58:29.836041 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.835122 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 23:58:29.836041 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.835125 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 23:58:29.836041 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.835128 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 23:58:29.836041 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.835131 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 23:58:29.836041 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.835134 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 23:58:29.836614 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.835137 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 23:58:29.836614 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.835140 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 23:58:29.836614 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.835142 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 23:58:29.836614 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.835145 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 23:58:29.836614 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.835148 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 23:58:29.836614 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.835151 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 23:58:29.836614 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.835153 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 23:58:29.836614 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.835156 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 23:58:29.836614 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.835159 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 23:58:29.836614 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.835161 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 23:58:29.836614 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.835166 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 23:58:29.836614 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.835169 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 23:58:29.836614 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.835172 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 23:58:29.836614 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.835174 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 23:58:29.836614 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.835177 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 23:58:29.836614 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.835180 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 23:58:29.836614 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.835183 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 23:58:29.836614 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.835186 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 23:58:29.836614 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.835189 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 23:58:29.836614 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.835192 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 23:58:29.837171 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.835194 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 23:58:29.837171 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.835197 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 23:58:29.837171 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.835200 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 23:58:29.837171 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.835202 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 23:58:29.837171 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.835205 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 23:58:29.837171 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.835208 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 23:58:29.837171 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.835211 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 23:58:29.837171 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.835214 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 23:58:29.837171 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.835218 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 23:58:29.837171 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.835222 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 23:58:29.837171 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.835225 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 23:58:29.837171 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.835228 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 23:58:29.837171 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.835231 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 23:58:29.837171 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.835235 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 23:58:29.837171 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.835238 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 23:58:29.837171 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.835241 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 23:58:29.837171 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.835243 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 23:58:29.837171 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.835246 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 23:58:29.837171 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836022 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 23:58:29.837171 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836030 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 23:58:29.837719 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836034 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 23:58:29.837719 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836037 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 23:58:29.837719 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836041 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 23:58:29.837719 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836045 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 23:58:29.837719 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836048 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 23:58:29.837719 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836051 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 23:58:29.837719 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836054 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 23:58:29.837719 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836057 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 23:58:29.837719 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836061 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 23:58:29.837719 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836064 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 23:58:29.837719 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836067 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 23:58:29.837719 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836070 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 23:58:29.837719 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836073 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 23:58:29.837719 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836076 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 23:58:29.837719 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836079 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 23:58:29.837719 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836082 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 23:58:29.837719 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836085 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 23:58:29.837719 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836088 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 23:58:29.837719 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836091 2579 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 23:58:29.837719 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836094 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 23:58:29.838334 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836097 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 23:58:29.838334 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836100 2579 feature_gate.go:328] unrecognized feature gate: Example Sep 18 23:58:29.838334 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836103 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 23:58:29.838334 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836106 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 23:58:29.838334 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836109 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 23:58:29.838334 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836111 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 23:58:29.838334 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836114 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 23:58:29.838334 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836117 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 23:58:29.838334 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836120 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 23:58:29.838334 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836123 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 23:58:29.838334 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836126 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 23:58:29.838334 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836128 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 23:58:29.838334 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836131 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 23:58:29.838334 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836135 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 23:58:29.838334 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836137 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 23:58:29.838334 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836140 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 23:58:29.838334 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836144 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 23:58:29.838334 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836147 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 23:58:29.838334 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836150 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 23:58:29.838334 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836153 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 23:58:29.838938 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836155 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 23:58:29.838938 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836158 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 23:58:29.838938 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836161 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 23:58:29.838938 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836164 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 23:58:29.838938 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836167 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 23:58:29.838938 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836169 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 23:58:29.838938 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836172 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 23:58:29.838938 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836175 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 23:58:29.838938 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836178 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 23:58:29.838938 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836181 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 23:58:29.838938 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836184 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 23:58:29.838938 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836187 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 23:58:29.838938 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836190 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 23:58:29.838938 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836194 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 23:58:29.838938 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836196 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 23:58:29.838938 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836199 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 23:58:29.838938 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836202 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 23:58:29.838938 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836205 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 23:58:29.838938 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836208 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 23:58:29.839467 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836211 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 23:58:29.839467 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836215 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 23:58:29.839467 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836220 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 23:58:29.839467 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836225 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 23:58:29.839467 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836229 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 23:58:29.839467 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836233 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 23:58:29.839467 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836237 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 23:58:29.839467 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836240 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 23:58:29.839467 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836243 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 23:58:29.839467 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836246 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 23:58:29.839467 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836251 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 23:58:29.839467 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836254 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 23:58:29.839467 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836258 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 23:58:29.839467 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836260 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 23:58:29.839467 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836263 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 23:58:29.839467 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836266 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 23:58:29.839467 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836269 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 23:58:29.839467 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836272 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 23:58:29.839467 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836274 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 23:58:29.840003 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836277 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 23:58:29.840003 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836280 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 23:58:29.840003 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836292 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 23:58:29.840003 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836296 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 23:58:29.840003 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836299 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 23:58:29.840003 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836302 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 23:58:29.840003 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836305 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 23:58:29.840003 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836308 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 23:58:29.840003 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836311 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 23:58:29.840003 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836314 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 23:58:29.840003 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836317 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 23:58:29.840003 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836320 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 23:58:29.840003 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836322 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 23:58:29.840003 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836325 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 23:58:29.840003 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836328 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 23:58:29.840003 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836330 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 23:58:29.840003 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836334 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 23:58:29.840003 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836338 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 23:58:29.840003 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836341 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 23:58:29.840534 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836768 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 23:58:29.840534 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836773 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 23:58:29.840534 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836776 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 23:58:29.840534 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836779 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 23:58:29.840534 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836783 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 23:58:29.840534 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836786 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 23:58:29.840534 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836789 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 23:58:29.840534 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836792 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 23:58:29.840534 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836795 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 23:58:29.840534 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836798 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 23:58:29.840534 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836801 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 23:58:29.840534 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836804 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 23:58:29.840534 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836807 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 23:58:29.840534 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836810 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 23:58:29.840534 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836812 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 23:58:29.840534 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836815 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 23:58:29.840534 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836818 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 23:58:29.840534 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836821 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 23:58:29.840534 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836841 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 23:58:29.841060 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836846 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 23:58:29.841060 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836850 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 23:58:29.841060 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836854 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 23:58:29.841060 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836856 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 23:58:29.841060 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836860 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 23:58:29.841060 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836865 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 23:58:29.841060 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836868 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 23:58:29.841060 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836872 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 23:58:29.841060 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836875 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 23:58:29.841060 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836878 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 23:58:29.841060 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836881 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 23:58:29.841060 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836883 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 23:58:29.841060 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836887 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 23:58:29.841060 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836890 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 23:58:29.841060 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836893 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 23:58:29.841060 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836895 2579 feature_gate.go:328] unrecognized feature gate: Example Sep 18 23:58:29.841060 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836898 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 23:58:29.841060 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836901 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 23:58:29.841060 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836905 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 23:58:29.841613 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836908 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 23:58:29.841613 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836910 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 23:58:29.841613 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836913 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 23:58:29.841613 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836916 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 23:58:29.841613 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836918 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 23:58:29.841613 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836921 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 23:58:29.841613 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836926 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 23:58:29.841613 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836930 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 23:58:29.841613 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836933 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 23:58:29.841613 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836936 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 23:58:29.841613 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836942 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 23:58:29.841613 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836946 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 23:58:29.841613 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836948 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 23:58:29.841613 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836951 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 23:58:29.841613 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836954 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 23:58:29.841613 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836957 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 23:58:29.841613 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836960 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 23:58:29.841613 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836963 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 23:58:29.841613 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836966 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 23:58:29.842138 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836969 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 23:58:29.842138 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836972 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 23:58:29.842138 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836975 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 23:58:29.842138 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836978 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 23:58:29.842138 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836980 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 23:58:29.842138 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836983 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 23:58:29.842138 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836986 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 23:58:29.842138 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836989 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 23:58:29.842138 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836992 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 23:58:29.842138 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836995 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 23:58:29.842138 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.836998 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 23:58:29.842138 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.837001 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 23:58:29.842138 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.837003 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 23:58:29.842138 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.837007 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 23:58:29.842138 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.837011 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 23:58:29.842138 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.837013 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 23:58:29.842138 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.837016 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 23:58:29.842138 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.837019 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 23:58:29.842138 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.837022 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 23:58:29.842635 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.837024 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 23:58:29.842635 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.837027 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 23:58:29.842635 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.837030 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 23:58:29.842635 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.837033 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 23:58:29.842635 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.837037 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 23:58:29.842635 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.837040 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 23:58:29.842635 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.837044 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 23:58:29.842635 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.837047 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 23:58:29.842635 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.837050 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 23:58:29.842635 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.837053 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 23:58:29.842635 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.837057 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 23:58:29.842635 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.837060 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 23:58:29.842635 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.837063 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 23:58:29.842635 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.837066 2579 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 23:58:29.842635 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.837070 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 23:58:29.842635 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.837072 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 23:58:29.842635 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.837075 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 23:58:29.842635 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.837078 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 23:58:29.842635 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.837081 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 23:58:29.842635 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.837084 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 23:58:29.843182 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.837087 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 23:58:29.843182 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.837090 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 23:58:29.843182 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.837093 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 23:58:29.843182 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837178 2579 flags.go:64] FLAG: --address="0.0.0.0" Sep 18 23:58:29.843182 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837213 2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 18 23:58:29.843182 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837220 2579 flags.go:64] FLAG: --anonymous-auth="true" Sep 18 23:58:29.843182 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837224 2579 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 18 23:58:29.843182 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837230 2579 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 18 23:58:29.843182 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837234 2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 18 23:58:29.843182 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837239 2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 18 23:58:29.843182 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837244 2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 18 23:58:29.843182 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837248 2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 18 23:58:29.843182 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837251 2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 18 23:58:29.843182 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837255 2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 18 23:58:29.843182 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837258 2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 18 23:58:29.843182 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837262 2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 18 23:58:29.843182 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837267 2579 flags.go:64] FLAG: --cgroup-root="" Sep 18 23:58:29.843182 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837270 2579 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 18 23:58:29.843182 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837273 2579 flags.go:64] FLAG: --client-ca-file="" Sep 18 23:58:29.843182 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837276 2579 flags.go:64] FLAG: --cloud-provider="external" Sep 18 23:58:29.843182 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837280 2579 flags.go:64] FLAG: --cluster-dns="[]" Sep 18 23:58:29.843182 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837285 2579 flags.go:64] FLAG: --cluster-domain="" Sep 18 23:58:29.843182 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837288 2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 18 23:58:29.843182 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837291 2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 18 23:58:29.843821 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837295 2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 18 23:58:29.843821 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837299 2579 flags.go:64] FLAG: --container-log-max-files="5" Sep 18 23:58:29.843821 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837303 2579 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 18 23:58:29.843821 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837306 2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 18 23:58:29.843821 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837309 2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 18 23:58:29.843821 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837313 2579 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 18 23:58:29.843821 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837316 2579 flags.go:64] FLAG: --contention-profiling="false" Sep 18 23:58:29.843821 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837320 2579 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 18 23:58:29.843821 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837323 2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 18 23:58:29.843821 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837326 2579 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 18 23:58:29.843821 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837330 2579 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 18 23:58:29.843821 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837335 2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 18 23:58:29.843821 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837338 2579 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 18 23:58:29.843821 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837341 2579 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 18 23:58:29.843821 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837344 2579 flags.go:64] FLAG: --enable-load-reader="false" Sep 18 23:58:29.843821 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837348 2579 flags.go:64] FLAG: --enable-server="true" Sep 18 23:58:29.843821 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837352 2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 18 23:58:29.843821 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837357 2579 flags.go:64] FLAG: --event-burst="100" Sep 18 23:58:29.843821 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837360 2579 flags.go:64] FLAG: --event-qps="50" Sep 18 23:58:29.843821 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837363 2579 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 18 23:58:29.843821 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837367 2579 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 18 23:58:29.843821 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837370 2579 flags.go:64] FLAG: --eviction-hard="" Sep 18 23:58:29.843821 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837374 2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 18 23:58:29.843821 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837377 2579 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 18 23:58:29.844463 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837383 2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 18 23:58:29.844463 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837387 2579 flags.go:64] FLAG: --eviction-soft="" Sep 18 23:58:29.844463 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837390 2579 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 18 23:58:29.844463 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837393 2579 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 18 23:58:29.844463 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837397 2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 18 23:58:29.844463 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837400 2579 flags.go:64] FLAG: --experimental-mounter-path="" Sep 18 23:58:29.844463 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837405 2579 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 18 23:58:29.844463 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837408 2579 flags.go:64] FLAG: --fail-swap-on="true" Sep 18 23:58:29.844463 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837412 2579 flags.go:64] FLAG: --feature-gates="" Sep 18 23:58:29.844463 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837416 2579 flags.go:64] FLAG: --file-check-frequency="20s" Sep 18 23:58:29.844463 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837420 2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 18 23:58:29.844463 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837423 2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 18 23:58:29.844463 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837427 2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 18 23:58:29.844463 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837430 2579 flags.go:64] FLAG: --healthz-port="10248" Sep 18 23:58:29.844463 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837433 2579 flags.go:64] FLAG: --help="false" Sep 18 23:58:29.844463 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837437 2579 flags.go:64] FLAG: --hostname-override="ip-10-0-130-53.ec2.internal" Sep 18 23:58:29.844463 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837440 2579 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 18 23:58:29.844463 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837444 2579 flags.go:64] FLAG: --http-check-frequency="20s" Sep 18 23:58:29.844463 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837447 2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 18 23:58:29.844463 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837450 2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 18 23:58:29.844463 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837454 2579 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 18 23:58:29.844463 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837457 2579 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 18 23:58:29.844463 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837460 2579 flags.go:64] FLAG: --image-service-endpoint="" Sep 18 23:58:29.845251 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837464 2579 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 18 23:58:29.845251 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837467 2579 flags.go:64] FLAG: --kube-api-burst="100" Sep 18 23:58:29.845251 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837470 2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 18 23:58:29.845251 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837474 2579 flags.go:64] FLAG: --kube-api-qps="50" Sep 18 23:58:29.845251 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837477 2579 flags.go:64] FLAG: --kube-reserved="" Sep 18 23:58:29.845251 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837481 2579 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 18 23:58:29.845251 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837484 2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 18 23:58:29.845251 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837487 2579 flags.go:64] FLAG: --kubelet-cgroups="" Sep 18 23:58:29.845251 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837490 2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 18 23:58:29.845251 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837495 2579 flags.go:64] FLAG: --lock-file="" Sep 18 23:58:29.845251 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837498 2579 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 18 23:58:29.845251 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837501 2579 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 18 23:58:29.845251 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837505 2579 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 18 23:58:29.845251 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837511 2579 flags.go:64] FLAG: --log-json-split-stream="false" Sep 18 23:58:29.845251 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837514 2579 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 18 23:58:29.845251 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837518 2579 flags.go:64] FLAG: --log-text-split-stream="false" Sep 18 23:58:29.845251 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837522 2579 flags.go:64] FLAG: --logging-format="text" Sep 18 23:58:29.845251 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837525 2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 18 23:58:29.845251 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837529 2579 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 18 23:58:29.845251 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837532 2579 flags.go:64] FLAG: --manifest-url="" Sep 18 23:58:29.845251 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837535 2579 flags.go:64] FLAG: --manifest-url-header="" Sep 18 23:58:29.845251 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837540 2579 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 18 23:58:29.845251 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837543 2579 flags.go:64] FLAG: --max-open-files="1000000" Sep 18 23:58:29.845251 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837548 2579 flags.go:64] FLAG: --max-pods="110" Sep 18 23:58:29.845251 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837551 2579 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 18 23:58:29.845954 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837555 2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 18 23:58:29.845954 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837558 2579 flags.go:64] FLAG: --memory-manager-policy="None" Sep 18 23:58:29.845954 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837561 2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 18 23:58:29.845954 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837565 2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 18 23:58:29.845954 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837568 2579 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 18 23:58:29.845954 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837571 2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 18 23:58:29.845954 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837580 2579 flags.go:64] FLAG: --node-status-max-images="50" Sep 18 23:58:29.845954 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837583 2579 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 18 23:58:29.845954 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837586 2579 flags.go:64] FLAG: --oom-score-adj="-999" Sep 18 23:58:29.845954 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837590 2579 flags.go:64] FLAG: --pod-cidr="" Sep 18 23:58:29.845954 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837594 2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc" Sep 18 23:58:29.845954 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837600 2579 flags.go:64] FLAG: --pod-manifest-path="" Sep 18 23:58:29.845954 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837603 2579 flags.go:64] FLAG: --pod-max-pids="-1" Sep 18 23:58:29.845954 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837607 2579 flags.go:64] FLAG: --pods-per-core="0" Sep 18 23:58:29.845954 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837611 2579 flags.go:64] FLAG: --port="10250" Sep 18 23:58:29.845954 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837614 2579 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 18 23:58:29.845954 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837617 2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0260472eee0d51708" Sep 18 23:58:29.845954 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837622 2579 flags.go:64] FLAG: --qos-reserved="" Sep 18 23:58:29.845954 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837625 2579 flags.go:64] FLAG: --read-only-port="10255" Sep 18 23:58:29.845954 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837628 2579 flags.go:64] FLAG: --register-node="true" Sep 18 23:58:29.845954 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837632 2579 flags.go:64] FLAG: --register-with-taints="" Sep 18 23:58:29.845954 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837636 2579 flags.go:64] FLAG: --registry-burst="10" Sep 18 23:58:29.845954 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837640 2579 flags.go:64] FLAG: --registry-qps="5" Sep 18 23:58:29.845954 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837644 2579 flags.go:64] FLAG: --reserved-cpus="" Sep 18 23:58:29.846621 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837647 2579 flags.go:64] FLAG: --reserved-memory="" Sep 18 23:58:29.846621 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837651 2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 18 23:58:29.846621 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837654 2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 18 23:58:29.846621 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837658 2579 flags.go:64] FLAG: --rotate-certificates="false" Sep 18 23:58:29.846621 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837661 2579 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 18 23:58:29.846621 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837664 2579 flags.go:64] FLAG: --runonce="false" Sep 18 23:58:29.846621 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837667 2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 18 23:58:29.846621 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837670 2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 18 23:58:29.846621 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837674 2579 flags.go:64] FLAG: --seccomp-default="false" Sep 18 23:58:29.846621 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837677 2579 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 18 23:58:29.846621 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837680 2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 18 23:58:29.846621 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837683 2579 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 18 23:58:29.846621 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837687 2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 18 23:58:29.846621 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837691 2579 flags.go:64] FLAG: --storage-driver-password="root" Sep 18 23:58:29.846621 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837694 2579 flags.go:64] FLAG: --storage-driver-secure="false" Sep 18 23:58:29.846621 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837697 2579 flags.go:64] FLAG: --storage-driver-table="stats" Sep 18 23:58:29.846621 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837700 2579 flags.go:64] FLAG: --storage-driver-user="root" Sep 18 23:58:29.846621 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837703 2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 18 23:58:29.846621 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837706 2579 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 18 23:58:29.846621 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837710 2579 flags.go:64] FLAG: --system-cgroups="" Sep 18 23:58:29.846621 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837713 2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 18 23:58:29.846621 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837719 2579 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 18 23:58:29.846621 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837722 2579 flags.go:64] FLAG: --tls-cert-file="" Sep 18 23:58:29.846621 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837725 2579 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 18 23:58:29.846621 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837730 2579 flags.go:64] FLAG: --tls-min-version="" Sep 18 23:58:29.847309 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837735 2579 flags.go:64] FLAG: --tls-private-key-file="" Sep 18 23:58:29.847309 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837738 2579 flags.go:64] FLAG: --topology-manager-policy="none" Sep 18 23:58:29.847309 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837742 2579 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 18 23:58:29.847309 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837745 2579 flags.go:64] FLAG: --topology-manager-scope="container" Sep 18 23:58:29.847309 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837748 2579 flags.go:64] FLAG: --v="2" Sep 18 23:58:29.847309 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837755 2579 flags.go:64] FLAG: --version="false" Sep 18 23:58:29.847309 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837760 2579 flags.go:64] FLAG: --vmodule="" Sep 18 23:58:29.847309 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837764 2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 18 23:58:29.847309 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.837767 2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 18 23:58:29.847309 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.837909 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 23:58:29.847309 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.837913 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 23:58:29.847309 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.837916 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 23:58:29.847309 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.837919 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 23:58:29.847309 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.837922 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 23:58:29.847309 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.837926 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 23:58:29.847309 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.837928 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 23:58:29.847309 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.837931 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 23:58:29.847309 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.837934 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 23:58:29.847309 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.837937 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 23:58:29.847309 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.837940 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 23:58:29.847309 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.837943 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 23:58:29.847309 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.837946 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 23:58:29.847945 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.837948 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 23:58:29.847945 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.837951 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 23:58:29.847945 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.837954 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 23:58:29.847945 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.837957 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 23:58:29.847945 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.837960 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 23:58:29.847945 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.837963 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 23:58:29.847945 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.837966 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 23:58:29.847945 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.837969 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 23:58:29.847945 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.837972 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 23:58:29.847945 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.837975 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 23:58:29.847945 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.837978 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 23:58:29.847945 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.837981 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 23:58:29.847945 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.837984 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 23:58:29.847945 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.837987 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 23:58:29.847945 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.837990 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 23:58:29.847945 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.837995 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 23:58:29.847945 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.837998 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 23:58:29.847945 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.838002 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 23:58:29.847945 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.838006 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 23:58:29.847945 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.838010 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 23:58:29.848480 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.838013 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 23:58:29.848480 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.838015 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 23:58:29.848480 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.838018 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 23:58:29.848480 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.838021 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 23:58:29.848480 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.838024 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 23:58:29.848480 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.838026 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 23:58:29.848480 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.838029 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 23:58:29.848480 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.838032 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 23:58:29.848480 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.838035 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 23:58:29.848480 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.838038 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 23:58:29.848480 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.838041 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 23:58:29.848480 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.838043 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 23:58:29.848480 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.838046 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 23:58:29.848480 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.838049 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 23:58:29.848480 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.838052 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 23:58:29.848480 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.838055 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 23:58:29.848480 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.838057 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 23:58:29.848480 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.838060 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 23:58:29.848480 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.838063 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 23:58:29.848480 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.838066 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 23:58:29.849092 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.838069 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 23:58:29.849092 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.838072 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 23:58:29.849092 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.838076 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 23:58:29.849092 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.838079 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 23:58:29.849092 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.838082 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 23:58:29.849092 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.838085 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 23:58:29.849092 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.838088 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 23:58:29.849092 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.838094 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 23:58:29.849092 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.838098 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 23:58:29.849092 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.838102 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 23:58:29.849092 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.838105 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 23:58:29.849092 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.838108 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 23:58:29.849092 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.838111 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 23:58:29.849092 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.838114 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 23:58:29.849092 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.838117 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 23:58:29.849092 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.838120 2579 feature_gate.go:328] unrecognized feature gate: Example Sep 18 23:58:29.849092 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.838123 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 23:58:29.849092 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.838126 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 23:58:29.849603 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.838129 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 23:58:29.849603 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.838131 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 23:58:29.849603 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.838134 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 23:58:29.849603 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.838137 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 23:58:29.849603 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.838140 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 23:58:29.849603 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.838143 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 23:58:29.849603 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.838145 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 23:58:29.849603 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.838148 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 23:58:29.849603 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.838151 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 23:58:29.849603 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.838154 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 23:58:29.849603 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.838156 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 23:58:29.849603 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.838159 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 23:58:29.849603 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.838162 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 23:58:29.849603 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.838165 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 23:58:29.849603 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.838168 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 23:58:29.849603 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.838171 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 23:58:29.849603 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.838174 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 23:58:29.849603 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.838177 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 23:58:29.849603 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.838179 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 23:58:29.849603 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.838182 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 23:58:29.850175 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.838185 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 23:58:29.850175 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.838189 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 23:58:29.850175 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.838192 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 23:58:29.850175 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.838195 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 23:58:29.850175 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.838197 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 23:58:29.850175 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.838200 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 23:58:29.850175 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.838203 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 23:58:29.850175 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.838206 2579 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 23:58:29.850175 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.838790 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 18 23:58:29.850175 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.846291 2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 18 23:58:29.850175 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.846307 2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 18 23:58:29.850175 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.846330 2579 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 18 23:58:29.850175 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.846339 2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 18 23:58:29.850175 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846401 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 23:58:29.850175 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846406 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 23:58:29.850600 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846409 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 23:58:29.850600 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846413 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 23:58:29.850600 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846416 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 23:58:29.850600 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846419 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 23:58:29.850600 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846423 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 23:58:29.850600 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846427 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 23:58:29.850600 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846430 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 23:58:29.850600 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846433 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 23:58:29.850600 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846436 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 23:58:29.850600 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846439 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 23:58:29.850600 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846443 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 23:58:29.850600 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846446 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 23:58:29.850600 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846449 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 23:58:29.850600 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846453 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 23:58:29.850600 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846456 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 23:58:29.850600 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846459 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 23:58:29.850600 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846462 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 23:58:29.850600 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846465 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 23:58:29.850600 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846468 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 23:58:29.850600 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846471 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 23:58:29.851152 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846474 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 23:58:29.851152 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846477 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 23:58:29.851152 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846480 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 23:58:29.851152 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846483 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 23:58:29.851152 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846486 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 23:58:29.851152 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846489 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 23:58:29.851152 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846492 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 23:58:29.851152 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846496 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 23:58:29.851152 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846500 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 23:58:29.851152 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846502 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 23:58:29.851152 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846506 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 23:58:29.851152 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846509 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 23:58:29.851152 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846512 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 23:58:29.851152 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846515 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 23:58:29.851152 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846523 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 23:58:29.851152 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846528 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 23:58:29.851152 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846531 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 23:58:29.851152 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846535 2579 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 23:58:29.851152 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846538 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 23:58:29.851152 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846541 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 23:58:29.851709 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846544 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 23:58:29.851709 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846547 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 23:58:29.851709 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846550 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 23:58:29.851709 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846553 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 23:58:29.851709 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846556 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 23:58:29.851709 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846559 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 23:58:29.851709 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846562 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 23:58:29.851709 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846565 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 23:58:29.851709 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846568 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 23:58:29.851709 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846571 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 23:58:29.851709 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846575 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 23:58:29.851709 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846579 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 23:58:29.851709 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846582 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 23:58:29.851709 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846585 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 23:58:29.851709 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846588 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 23:58:29.851709 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846591 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 23:58:29.851709 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846594 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 23:58:29.851709 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846597 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 23:58:29.851709 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846601 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 23:58:29.852305 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846604 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 23:58:29.852305 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846607 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 23:58:29.852305 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846611 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 23:58:29.852305 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846614 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 23:58:29.852305 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846617 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 23:58:29.852305 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846621 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 23:58:29.852305 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846625 2579 feature_gate.go:328] unrecognized feature gate: Example Sep 18 23:58:29.852305 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846628 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 23:58:29.852305 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846631 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 23:58:29.852305 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846635 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 23:58:29.852305 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846638 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 23:58:29.852305 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846641 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 23:58:29.852305 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846643 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 23:58:29.852305 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846646 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 23:58:29.852305 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846649 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 23:58:29.852305 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846652 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 23:58:29.852305 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846655 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 23:58:29.852305 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846658 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 23:58:29.852305 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846661 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 23:58:29.852305 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846664 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 23:58:29.852901 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846667 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 23:58:29.852901 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846670 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 23:58:29.852901 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846672 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 23:58:29.852901 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846675 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 23:58:29.852901 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846678 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 23:58:29.852901 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846681 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 23:58:29.852901 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846684 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 23:58:29.852901 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846687 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 23:58:29.852901 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846690 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 23:58:29.852901 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846693 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 23:58:29.852901 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846696 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 23:58:29.852901 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846699 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 23:58:29.852901 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846702 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 23:58:29.852901 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846705 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 23:58:29.852901 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846708 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 23:58:29.852901 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846711 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 23:58:29.852901 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846714 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 23:58:29.852901 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846717 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 23:58:29.853642 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.846722 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 18 23:58:29.853642 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846874 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 23:58:29.853642 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846880 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 23:58:29.853642 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846884 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 23:58:29.853642 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846888 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 23:58:29.853642 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846891 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 23:58:29.853642 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846894 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 23:58:29.853642 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846898 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 23:58:29.853642 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846901 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 23:58:29.853642 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846904 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 23:58:29.853642 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846907 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 23:58:29.853642 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846910 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 23:58:29.853642 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846913 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 23:58:29.853642 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846916 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 23:58:29.853642 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846919 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 23:58:29.854277 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846922 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 23:58:29.854277 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846924 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 23:58:29.854277 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846927 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 23:58:29.854277 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846930 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 23:58:29.854277 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846933 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 23:58:29.854277 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846936 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 23:58:29.854277 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846939 2579 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 23:58:29.854277 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846942 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 23:58:29.854277 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846944 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 23:58:29.854277 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846947 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 23:58:29.854277 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846950 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 23:58:29.854277 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846954 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 23:58:29.854277 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846957 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 23:58:29.854277 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846960 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 23:58:29.854277 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846963 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 23:58:29.854277 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846966 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 23:58:29.854277 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846969 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 23:58:29.854277 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846972 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 23:58:29.854277 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846975 2579 feature_gate.go:328] unrecognized feature gate: Example Sep 18 23:58:29.854277 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846978 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 23:58:29.854950 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846981 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 23:58:29.854950 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846983 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 23:58:29.854950 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846986 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 23:58:29.854950 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846989 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 23:58:29.854950 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846992 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 23:58:29.854950 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846995 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 23:58:29.854950 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.846997 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 23:58:29.854950 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.847000 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 23:58:29.854950 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.847003 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 23:58:29.854950 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.847006 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 23:58:29.854950 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.847011 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 23:58:29.854950 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.847015 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 23:58:29.854950 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.847018 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 23:58:29.854950 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.847021 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 23:58:29.854950 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.847024 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 23:58:29.854950 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.847027 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 23:58:29.854950 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.847030 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 23:58:29.854950 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.847033 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 23:58:29.854950 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.847036 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 23:58:29.855472 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.847039 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 23:58:29.855472 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.847043 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 23:58:29.855472 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.847047 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 23:58:29.855472 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.847050 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 23:58:29.855472 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.847053 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 23:58:29.855472 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.847056 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 23:58:29.855472 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.847059 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 23:58:29.855472 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.847063 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 23:58:29.855472 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.847066 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 23:58:29.855472 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.847070 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 23:58:29.855472 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.847073 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 23:58:29.855472 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.847077 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 23:58:29.855472 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.847080 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 23:58:29.855472 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.847083 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 23:58:29.855472 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.847085 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 23:58:29.855472 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.847088 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 23:58:29.855472 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.847091 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 23:58:29.855472 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.847094 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 23:58:29.855472 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.847097 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 23:58:29.856025 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.847100 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 23:58:29.856025 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.847103 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 23:58:29.856025 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.847105 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 23:58:29.856025 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.847108 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 23:58:29.856025 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.847111 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 23:58:29.856025 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.847114 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 23:58:29.856025 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.847117 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 23:58:29.856025 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.847120 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 23:58:29.856025 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.847123 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 23:58:29.856025 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.847126 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 23:58:29.856025 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.847129 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 23:58:29.856025 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.847132 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 23:58:29.856025 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.847135 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 23:58:29.856025 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.847138 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 23:58:29.856025 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.847141 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 23:58:29.856025 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.847144 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 23:58:29.856025 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.847146 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 23:58:29.856025 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.847149 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 23:58:29.856025 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.847153 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 23:58:29.856025 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.847156 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 23:58:29.856674 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.847159 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 23:58:29.856674 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.847162 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 23:58:29.856674 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.847165 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 23:58:29.856674 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.847167 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 23:58:29.856674 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.847170 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 23:58:29.856674 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.847173 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 23:58:29.856674 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:29.847176 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 23:58:29.856674 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.847181 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 18 23:58:29.856674 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.847298 2579 server.go:962] "Client rotation is on, will bootstrap in background" Sep 18 23:58:29.856674 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.849453 2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 18 23:58:29.856674 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.850301 2579 server.go:1019] "Starting client certificate rotation" Sep 18 23:58:29.856674 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.850407 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 18 23:58:29.856674 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.850450 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 18 23:58:29.857142 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.852498 2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 18 23:58:29.857142 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.856115 2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 18 23:58:29.865841 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.865805 2579 log.go:25] "Validated CRI v1 runtime API" Sep 18 23:58:29.867599 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.867582 2579 log.go:25] "Validated CRI v1 image API" Sep 18 23:58:29.868477 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.868458 2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 18 23:58:29.872969 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.872946 2579 fs.go:135] Filesystem UUIDs: map[4f543c9c-6193-4ffe-827a-b7aac054124e:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 b79433ab-9f32-4c55-bee4-e35ba2fd5c1b:/dev/nvme0n1p4] Sep 18 23:58:29.873041 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.872967 2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 18 23:58:29.877546 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.877426 2579 manager.go:216] Machine: {Timestamp:2026-09-18 23:58:29.876885874 +0000 UTC m=+1.853094347 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3081061 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ead5c100ee35b706f5cc828521706 SystemUUID:ec2ead5c-100e-e35b-706f-5cc828521706 BootID:1f30e8da-cc4a-4c9e-ac6f-e7de1c3a7091 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:d7:d9:ed:af Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:d7:d9:ed:af Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ae:92:92:b2:1b:be Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 18 23:58:29.877546 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.877540 2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 18 23:58:29.877729 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.877623 2579 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 18 23:58:29.879184 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.879158 2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 18 23:58:29.879377 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.879186 2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-53.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 18 23:58:29.880559 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.880540 2579 topology_manager.go:138] "Creating topology manager with none policy" Sep 18 23:58:29.880639 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.880562 2579 container_manager_linux.go:309] "Creating device plugin manager" Sep 18 23:58:29.880639 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.880574 2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 18 23:58:29.880639 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.880589 2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 18 23:58:29.882027 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.882014 2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 18 23:58:29.885653 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.885636 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 18 23:58:29.886087 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.886073 2579 state_mem.go:36] "Initialized new in-memory state store" Sep 18 23:58:29.886226 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.886215 2579 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 18 23:58:29.886299 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.886258 2579 kubelet.go:486] "Attempting to sync node with API server" Sep 18 23:58:29.886299 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.886274 2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 18 23:58:29.886299 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.886290 2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 18 23:58:29.886431 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.886307 2579 kubelet.go:398] "Adding apiserver pod source" Sep 18 23:58:29.886431 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.886321 2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 18 23:58:29.886860 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.886845 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 18 23:58:29.886941 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.886879 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 18 23:58:29.890294 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.890266 2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1" Sep 18 23:58:29.893029 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.893013 2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 18 23:58:29.893115 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.893049 2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 18 23:58:29.894156 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.894144 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 18 23:58:29.894198 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.894162 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 18 23:58:29.894198 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.894169 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 18 23:58:29.894198 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.894175 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 18 23:58:29.894198 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.894184 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 18 23:58:29.894198 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.894190 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 18 23:58:29.894348 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.894204 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 18 23:58:29.894348 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.894211 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 18 23:58:29.894348 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.894219 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 18 23:58:29.894348 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.894225 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 18 23:58:29.894348 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.894235 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 18 23:58:29.894348 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.894241 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 18 23:58:29.894348 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.894265 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 18 23:58:29.894348 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.894271 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 18 23:58:29.898648 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.898625 2579 server.go:1268] "Started kubelet" Sep 18 23:58:29.898732 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.898708 2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 18 23:58:29.898788 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.898727 2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 18 23:58:29.898854 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.898796 2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-53.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 18 23:58:29.898854 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.898821 2579 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 18 23:58:29.899036 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:29.899011 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 18 23:58:29.899163 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:29.899141 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-53.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 18 23:58:29.899688 ip-10-0-130-53 systemd[1]: Started Kubernetes Kubelet. Sep 18 23:58:29.900542 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.899929 2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 18 23:58:29.900542 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.900084 2579 server.go:310] "Adding debug handlers to kubelet server" Sep 18 23:58:29.904969 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:29.904947 2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 18 23:58:29.907116 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.907097 2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 18 23:58:29.907116 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.907108 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 18 23:58:29.907297 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:29.907276 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-53.ec2.internal\" not found" Sep 18 23:58:29.907733 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.907716 2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 18 23:58:29.907837 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.907718 2579 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 18 23:58:29.907837 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.907772 2579 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 18 23:58:29.907942 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.907868 2579 reconstruct.go:97] "Volume reconstruction finished" Sep 18 23:58:29.907942 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.907881 2579 reconciler.go:29] "Reconciler: start to sync state" Sep 18 23:58:29.908158 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.908143 2579 factory.go:55] Registering systemd factory Sep 18 23:58:29.908158 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.908159 2579 factory.go:223] Registration of the systemd container factory successfully Sep 18 23:58:29.908415 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.908396 2579 factory.go:153] Registering CRI-O factory Sep 18 23:58:29.908415 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.908419 2579 factory.go:223] Registration of the crio container factory successfully Sep 18 23:58:29.908556 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.908474 2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 18 23:58:29.908556 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.908492 2579 factory.go:103] Registering Raw factory Sep 18 23:58:29.908556 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.908503 2579 manager.go:1196] Started watching for new ooms in manager Sep 18 23:58:29.909117 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.909096 2579 manager.go:349] Starting recovery of all containers Sep 18 23:58:29.909236 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:29.909215 2579 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-53.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 18 23:58:29.909296 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:29.909282 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 18 23:58:29.912278 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.912257 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-576gm" Sep 18 23:58:29.931134 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.931107 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-576gm" Sep 18 23:58:29.935384 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.935335 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 18 23:58:29.940359 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.940335 2579 manager.go:354] Recovery completed Sep 18 23:58:29.945053 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.945039 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 23:58:29.946992 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.946976 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-53.ec2.internal" event="NodeHasSufficientMemory" Sep 18 23:58:29.947060 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.947009 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-53.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 23:58:29.947060 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.947024 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-53.ec2.internal" event="NodeHasSufficientPID" Sep 18 23:58:29.947651 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.947634 2579 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 18 23:58:29.947651 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.947651 2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 18 23:58:29.947790 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.947643 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 23:58:29.947790 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.947670 2579 state_mem.go:36] "Initialized new in-memory state store" Sep 18 23:58:29.948377 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.948360 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-53.ec2.internal" event="NodeHasSufficientMemory" Sep 18 23:58:29.948431 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.948393 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-53.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 23:58:29.948431 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.948406 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-53.ec2.internal" event="NodeHasSufficientPID" Sep 18 23:58:29.949990 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.949976 2579 policy_none.go:49] "None policy: Start" Sep 18 23:58:29.950057 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.949995 2579 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 18 23:58:29.950057 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.950009 2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 18 23:58:29.952234 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.952221 2579 policy_none.go:47] "Start" Sep 18 23:58:29.991506 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.991482 2579 manager.go:337] "Starting Device Plugin manager" Sep 18 23:58:30.007243 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:29.991616 2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 18 23:58:30.007243 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.991629 2579 server.go:87] "Starting device plugin registration server" Sep 18 23:58:30.007243 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.991907 2579 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 18 23:58:30.007243 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.991928 2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 18 23:58:30.007243 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.992002 2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 18 23:58:30.007243 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.992089 2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 18 23:58:30.007243 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:29.992099 2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 18 23:58:30.007243 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:29.992697 2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 18 23:58:30.007243 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:29.992743 2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-53.ec2.internal\" not found" Sep 18 23:58:30.070574 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:30.070540 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 18 23:58:30.070753 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:30.070611 2579 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 18 23:58:30.070753 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:30.070643 2579 kubelet.go:2448] "Starting kubelet main sync loop" Sep 18 23:58:30.070753 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:30.070691 2579 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 18 23:58:30.073326 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:30.073302 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 23:58:30.092718 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:30.092657 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 23:58:30.093649 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:30.093632 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-53.ec2.internal" event="NodeHasSufficientMemory" Sep 18 23:58:30.093720 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:30.093663 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-53.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 23:58:30.093720 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:30.093674 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-53.ec2.internal" event="NodeHasSufficientPID" Sep 18 23:58:30.093720 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:30.093709 2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-53.ec2.internal" Sep 18 23:58:30.101713 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:30.101698 2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-53.ec2.internal" Sep 18 23:58:30.101762 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:30.101722 2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-53.ec2.internal\": node \"ip-10-0-130-53.ec2.internal\" not found" Sep 18 23:58:30.118576 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:30.118556 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-53.ec2.internal\" not found" Sep 18 23:58:30.174207 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:30.174161 2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-53.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-53.ec2.internal"] Sep 18 23:58:30.174390 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:30.174316 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 23:58:30.175447 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:30.175429 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-53.ec2.internal" event="NodeHasSufficientMemory" Sep 18 23:58:30.175557 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:30.175461 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-53.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 23:58:30.175557 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:30.175475 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-53.ec2.internal" event="NodeHasSufficientPID" Sep 18 23:58:30.178176 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:30.178160 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 23:58:30.178313 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:30.178299 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-53.ec2.internal" Sep 18 23:58:30.178363 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:30.178330 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 23:58:30.179070 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:30.179055 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-53.ec2.internal" event="NodeHasSufficientMemory" Sep 18 23:58:30.179139 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:30.179082 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-53.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 23:58:30.179139 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:30.179092 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-53.ec2.internal" event="NodeHasSufficientPID" Sep 18 23:58:30.179139 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:30.179104 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-53.ec2.internal" event="NodeHasSufficientMemory" Sep 18 23:58:30.179139 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:30.179131 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-53.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 23:58:30.179282 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:30.179144 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-53.ec2.internal" event="NodeHasSufficientPID" Sep 18 23:58:30.181628 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:30.181613 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-53.ec2.internal" Sep 18 23:58:30.181677 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:30.181650 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 23:58:30.182580 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:30.182561 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-53.ec2.internal" event="NodeHasSufficientMemory" Sep 18 23:58:30.182638 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:30.182605 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-53.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 23:58:30.182677 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:30.182629 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-53.ec2.internal" event="NodeHasSufficientPID" Sep 18 23:58:30.202672 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:30.202646 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-53.ec2.internal\" not found" node="ip-10-0-130-53.ec2.internal" Sep 18 23:58:30.207451 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:30.207435 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-53.ec2.internal\" not found" node="ip-10-0-130-53.ec2.internal" Sep 18 23:58:30.209647 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:30.209630 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6c8d92999cd8bd3edaf2f2f126532e2e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-53.ec2.internal\" (UID: \"6c8d92999cd8bd3edaf2f2f126532e2e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-53.ec2.internal" Sep 18 23:58:30.209700 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:30.209655 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6c8d92999cd8bd3edaf2f2f126532e2e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-53.ec2.internal\" (UID: \"6c8d92999cd8bd3edaf2f2f126532e2e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-53.ec2.internal" Sep 18 23:58:30.209700 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:30.209675 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/16b0fef0d964298ff4a2b765bfad6222-config\") pod \"kube-apiserver-proxy-ip-10-0-130-53.ec2.internal\" (UID: \"16b0fef0d964298ff4a2b765bfad6222\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-53.ec2.internal" Sep 18 23:58:30.219184 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:30.219166 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-53.ec2.internal\" not found" Sep 18 23:58:30.310223 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:30.310192 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6c8d92999cd8bd3edaf2f2f126532e2e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-53.ec2.internal\" (UID: \"6c8d92999cd8bd3edaf2f2f126532e2e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-53.ec2.internal" Sep 18 23:58:30.310223 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:30.310226 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6c8d92999cd8bd3edaf2f2f126532e2e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-53.ec2.internal\" (UID: \"6c8d92999cd8bd3edaf2f2f126532e2e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-53.ec2.internal" Sep 18 23:58:30.310386 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:30.310244 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/16b0fef0d964298ff4a2b765bfad6222-config\") pod \"kube-apiserver-proxy-ip-10-0-130-53.ec2.internal\" (UID: \"16b0fef0d964298ff4a2b765bfad6222\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-53.ec2.internal" Sep 18 23:58:30.310386 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:30.310306 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6c8d92999cd8bd3edaf2f2f126532e2e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-53.ec2.internal\" (UID: \"6c8d92999cd8bd3edaf2f2f126532e2e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-53.ec2.internal" Sep 18 23:58:30.310386 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:30.310372 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6c8d92999cd8bd3edaf2f2f126532e2e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-53.ec2.internal\" (UID: \"6c8d92999cd8bd3edaf2f2f126532e2e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-53.ec2.internal" Sep 18 23:58:30.310494 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:30.310405 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/16b0fef0d964298ff4a2b765bfad6222-config\") pod \"kube-apiserver-proxy-ip-10-0-130-53.ec2.internal\" (UID: \"16b0fef0d964298ff4a2b765bfad6222\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-53.ec2.internal" Sep 18 23:58:30.319515 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:30.319486 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-53.ec2.internal\" not found" Sep 18 23:58:30.419718 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:30.419672 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-53.ec2.internal\" not found" Sep 18 23:58:30.513721 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:30.513682 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-53.ec2.internal" Sep 18 23:58:30.513832 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:30.513726 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-53.ec2.internal" Sep 18 23:58:30.520340 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:30.520289 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-53.ec2.internal\" not found" Sep 18 23:58:30.620446 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:30.620409 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-53.ec2.internal\" not found" Sep 18 23:58:30.721428 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:30.721340 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-53.ec2.internal\" not found" Sep 18 23:58:30.822118 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:30.822077 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-53.ec2.internal\" not found" Sep 18 23:58:30.848613 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:30.848578 2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 23:58:30.850298 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:30.850273 2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 18 23:58:30.850416 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:30.850398 2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 18 23:58:30.922180 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:30.922145 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-53.ec2.internal\" not found" Sep 18 23:58:30.938544 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:30.938492 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-17 23:53:30 +0000 UTC" deadline="2028-04-18 07:19:05.185175597 +0000 UTC" Sep 18 23:58:30.938544 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:30.938541 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13855h20m34.246638355s" Sep 18 23:58:31.023064 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:31.022881 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-53.ec2.internal\" not found" Sep 18 23:58:31.123694 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:31.123655 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-53.ec2.internal\" not found" Sep 18 23:58:31.200576 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:31.200538 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c8d92999cd8bd3edaf2f2f126532e2e.slice/crio-ae0672cc8d6800a65f7fc11e8beb198c0ed559e12185a707160af960198ebf69 WatchSource:0}: Error finding container ae0672cc8d6800a65f7fc11e8beb198c0ed559e12185a707160af960198ebf69: Status 404 returned error can't find the container with id ae0672cc8d6800a65f7fc11e8beb198c0ed559e12185a707160af960198ebf69 Sep 18 23:58:31.201138 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:31.201124 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16b0fef0d964298ff4a2b765bfad6222.slice/crio-f56764a8bee8c0f6f4aa63659c19acd8023cd414542d9b711711e414119a0a8f WatchSource:0}: Error finding container f56764a8bee8c0f6f4aa63659c19acd8023cd414542d9b711711e414119a0a8f: Status 404 returned error can't find the container with id f56764a8bee8c0f6f4aa63659c19acd8023cd414542d9b711711e414119a0a8f Sep 18 23:58:31.206548 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.206526 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 18 23:58:31.224170 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:31.224145 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-53.ec2.internal\" not found" Sep 18 23:58:31.300981 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.300896 2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 23:58:31.307782 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.307739 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-53.ec2.internal" Sep 18 23:58:31.320919 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.320899 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 18 23:58:31.321778 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.321751 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-53.ec2.internal" Sep 18 23:58:31.327480 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.327462 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 18 23:58:31.424109 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.424078 2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 23:58:31.889391 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.889360 2579 apiserver.go:52] "Watching apiserver" Sep 18 23:58:31.896481 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.896296 2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 18 23:58:31.896900 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.896737 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-dhgxl","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n42dv","openshift-cluster-node-tuning-operator/tuned-ndc7h","openshift-image-registry/node-ca-qlfrm","openshift-multus/multus-c2k4w","openshift-multus/network-metrics-daemon-tvsd7","openshift-network-diagnostics/network-check-target-zcsgq","openshift-network-operator/iptables-alerter-rkngj","kube-system/konnectivity-agent-hb5v7","kube-system/kube-apiserver-proxy-ip-10-0-130-53.ec2.internal","openshift-dns/node-resolver-pz7c5","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-53.ec2.internal","openshift-multus/multus-additional-cni-plugins-99rrr","openshift-ovn-kubernetes/ovnkube-node-6j92q"] Sep 18 23:58:31.899638 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.899586 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zcsgq" Sep 18 23:58:31.899786 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:31.899680 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zcsgq" podUID="3b5234a6-7648-434b-ab71-66239b3e1158" Sep 18 23:58:31.901916 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.901748 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-99rrr" Sep 18 23:58:31.911703 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.909372 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 18 23:58:31.911703 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.909422 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-q67ct\"" Sep 18 23:58:31.911703 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.909677 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 18 23:58:31.911703 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.909817 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 18 23:58:31.911703 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.909986 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 18 23:58:31.911703 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.909682 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 18 23:58:31.911703 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.910210 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ndc7h" Sep 18 23:58:31.911703 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.910258 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qlfrm" Sep 18 23:58:31.911703 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.910307 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 18 23:58:31.911703 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.910985 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-c2k4w" Sep 18 23:58:31.912622 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.912604 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 18 23:58:31.912748 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.912730 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tvsd7" Sep 18 23:58:31.912861 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:31.912838 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tvsd7" podUID="4319f89f-3b39-4c12-8ca8-3e3cf20d5b84" Sep 18 23:58:31.915237 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.913445 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 18 23:58:31.915237 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.913772 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 18 23:58:31.915237 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.913824 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 18 23:58:31.915237 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.913929 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zd2sm\"" Sep 18 23:58:31.915237 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.913970 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-5gl2h\"" Sep 18 23:58:31.915237 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.914102 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 18 23:58:31.915237 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.914297 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rj8nk\"" Sep 18 23:58:31.915237 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.914604 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 18 23:58:31.915683 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.915534 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hb5v7" Sep 18 23:58:31.919445 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.919422 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 18 23:58:31.919535 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.919490 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-mlgcs\"" Sep 18 23:58:31.919683 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.919664 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 18 23:58:31.919813 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.919716 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhgxl" Sep 18 23:58:31.919889 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:31.919815 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhgxl" podUID="2fa576fe-0727-4d71-9477-d92c65eedf38" Sep 18 23:58:31.921687 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.921667 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n42dv" Sep 18 23:58:31.922248 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.922074 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2e265fcc-098a-4a75-88b3-9917741344ef-etc-sysconfig\") pod \"tuned-ndc7h\" (UID: \"2e265fcc-098a-4a75-88b3-9917741344ef\") " pod="openshift-cluster-node-tuning-operator/tuned-ndc7h" Sep 18 23:58:31.922248 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.922109 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c366c450-b973-4a84-b562-b1970ebf743e-cnibin\") pod \"multus-additional-cni-plugins-99rrr\" (UID: \"c366c450-b973-4a84-b562-b1970ebf743e\") " pod="openshift-multus/multus-additional-cni-plugins-99rrr" Sep 18 23:58:31.922248 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.922138 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tdtk\" (UniqueName: \"kubernetes.io/projected/2e265fcc-098a-4a75-88b3-9917741344ef-kube-api-access-9tdtk\") pod \"tuned-ndc7h\" (UID: \"2e265fcc-098a-4a75-88b3-9917741344ef\") " pod="openshift-cluster-node-tuning-operator/tuned-ndc7h" Sep 18 23:58:31.922248 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.922164 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614-host-var-lib-kubelet\") pod \"multus-c2k4w\" (UID: \"a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614\") " pod="openshift-multus/multus-c2k4w" Sep 18 23:58:31.922248 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.922188 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614-host-run-multus-certs\") pod \"multus-c2k4w\" (UID: \"a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614\") " pod="openshift-multus/multus-c2k4w" Sep 18 23:58:31.922248 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.922212 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614-etc-kubernetes\") pod \"multus-c2k4w\" (UID: \"a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614\") " pod="openshift-multus/multus-c2k4w" Sep 18 23:58:31.922628 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.922253 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lv7kw\" (UniqueName: \"kubernetes.io/projected/a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614-kube-api-access-lv7kw\") pod \"multus-c2k4w\" (UID: \"a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614\") " pod="openshift-multus/multus-c2k4w" Sep 18 23:58:31.922628 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.922295 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614-hostroot\") pod \"multus-c2k4w\" (UID: \"a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614\") " pod="openshift-multus/multus-c2k4w" Sep 18 23:58:31.922628 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.922334 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614-multus-daemon-config\") pod \"multus-c2k4w\" (UID: \"a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614\") " pod="openshift-multus/multus-c2k4w" Sep 18 23:58:31.922628 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.922359 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4319f89f-3b39-4c12-8ca8-3e3cf20d5b84-metrics-certs\") pod \"network-metrics-daemon-tvsd7\" (UID: \"4319f89f-3b39-4c12-8ca8-3e3cf20d5b84\") " pod="openshift-multus/network-metrics-daemon-tvsd7" Sep 18 23:58:31.922628 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.922403 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lc7j6\" (UniqueName: \"kubernetes.io/projected/4319f89f-3b39-4c12-8ca8-3e3cf20d5b84-kube-api-access-lc7j6\") pod \"network-metrics-daemon-tvsd7\" (UID: \"4319f89f-3b39-4c12-8ca8-3e3cf20d5b84\") " pod="openshift-multus/network-metrics-daemon-tvsd7" Sep 18 23:58:31.922628 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.922429 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2e265fcc-098a-4a75-88b3-9917741344ef-host\") pod \"tuned-ndc7h\" (UID: \"2e265fcc-098a-4a75-88b3-9917741344ef\") " pod="openshift-cluster-node-tuning-operator/tuned-ndc7h" Sep 18 23:58:31.922628 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.922453 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2e265fcc-098a-4a75-88b3-9917741344ef-etc-modprobe-d\") pod \"tuned-ndc7h\" (UID: \"2e265fcc-098a-4a75-88b3-9917741344ef\") " pod="openshift-cluster-node-tuning-operator/tuned-ndc7h" Sep 18 23:58:31.922628 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.922476 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2e265fcc-098a-4a75-88b3-9917741344ef-sys\") pod \"tuned-ndc7h\" (UID: \"2e265fcc-098a-4a75-88b3-9917741344ef\") " pod="openshift-cluster-node-tuning-operator/tuned-ndc7h" Sep 18 23:58:31.922628 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.922522 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614-multus-socket-dir-parent\") pod \"multus-c2k4w\" (UID: \"a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614\") " pod="openshift-multus/multus-c2k4w" Sep 18 23:58:31.922628 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.922549 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c366c450-b973-4a84-b562-b1970ebf743e-cni-binary-copy\") pod \"multus-additional-cni-plugins-99rrr\" (UID: \"c366c450-b973-4a84-b562-b1970ebf743e\") " pod="openshift-multus/multus-additional-cni-plugins-99rrr" Sep 18 23:58:31.922628 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.922576 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614-cnibin\") pod \"multus-c2k4w\" (UID: \"a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614\") " pod="openshift-multus/multus-c2k4w" Sep 18 23:58:31.922628 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.922602 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614-multus-conf-dir\") pod \"multus-c2k4w\" (UID: \"a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614\") " pod="openshift-multus/multus-c2k4w" Sep 18 23:58:31.922628 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.922627 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e265fcc-098a-4a75-88b3-9917741344ef-etc-kubernetes\") pod \"tuned-ndc7h\" (UID: \"2e265fcc-098a-4a75-88b3-9917741344ef\") " pod="openshift-cluster-node-tuning-operator/tuned-ndc7h" Sep 18 23:58:31.923795 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.922652 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c366c450-b973-4a84-b562-b1970ebf743e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-99rrr\" (UID: \"c366c450-b973-4a84-b562-b1970ebf743e\") " pod="openshift-multus/multus-additional-cni-plugins-99rrr" Sep 18 23:58:31.923795 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.922678 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2e265fcc-098a-4a75-88b3-9917741344ef-etc-sysctl-conf\") pod \"tuned-ndc7h\" (UID: \"2e265fcc-098a-4a75-88b3-9917741344ef\") " pod="openshift-cluster-node-tuning-operator/tuned-ndc7h" Sep 18 23:58:31.923795 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.922737 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cdff8643-b1e0-4122-8a03-906835642896-serviceca\") pod \"node-ca-qlfrm\" (UID: \"cdff8643-b1e0-4122-8a03-906835642896\") " pod="openshift-image-registry/node-ca-qlfrm" Sep 18 23:58:31.923795 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.922767 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614-system-cni-dir\") pod \"multus-c2k4w\" (UID: \"a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614\") " pod="openshift-multus/multus-c2k4w" Sep 18 23:58:31.923795 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.922850 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2e265fcc-098a-4a75-88b3-9917741344ef-etc-sysctl-d\") pod \"tuned-ndc7h\" (UID: \"2e265fcc-098a-4a75-88b3-9917741344ef\") " pod="openshift-cluster-node-tuning-operator/tuned-ndc7h" Sep 18 23:58:31.923795 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.922887 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2e265fcc-098a-4a75-88b3-9917741344ef-lib-modules\") pod \"tuned-ndc7h\" (UID: \"2e265fcc-098a-4a75-88b3-9917741344ef\") " pod="openshift-cluster-node-tuning-operator/tuned-ndc7h" Sep 18 23:58:31.923795 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.922945 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2e265fcc-098a-4a75-88b3-9917741344ef-etc-tuned\") pod \"tuned-ndc7h\" (UID: \"2e265fcc-098a-4a75-88b3-9917741344ef\") " pod="openshift-cluster-node-tuning-operator/tuned-ndc7h" Sep 18 23:58:31.923795 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.922978 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614-cni-binary-copy\") pod \"multus-c2k4w\" (UID: \"a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614\") " pod="openshift-multus/multus-c2k4w" Sep 18 23:58:31.923795 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.923027 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614-host-run-netns\") pod \"multus-c2k4w\" (UID: \"a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614\") " pod="openshift-multus/multus-c2k4w" Sep 18 23:58:31.923795 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.923056 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e265fcc-098a-4a75-88b3-9917741344ef-var-lib-kubelet\") pod \"tuned-ndc7h\" (UID: \"2e265fcc-098a-4a75-88b3-9917741344ef\") " pod="openshift-cluster-node-tuning-operator/tuned-ndc7h" Sep 18 23:58:31.923795 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.923097 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e265fcc-098a-4a75-88b3-9917741344ef-tmp\") pod \"tuned-ndc7h\" (UID: \"2e265fcc-098a-4a75-88b3-9917741344ef\") " pod="openshift-cluster-node-tuning-operator/tuned-ndc7h" Sep 18 23:58:31.923795 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.923153 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hfnt\" (UniqueName: \"kubernetes.io/projected/3b5234a6-7648-434b-ab71-66239b3e1158-kube-api-access-9hfnt\") pod \"network-check-target-zcsgq\" (UID: \"3b5234a6-7648-434b-ab71-66239b3e1158\") " pod="openshift-network-diagnostics/network-check-target-zcsgq" Sep 18 23:58:31.923795 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.923180 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c366c450-b973-4a84-b562-b1970ebf743e-system-cni-dir\") pod \"multus-additional-cni-plugins-99rrr\" (UID: \"c366c450-b973-4a84-b562-b1970ebf743e\") " pod="openshift-multus/multus-additional-cni-plugins-99rrr" Sep 18 23:58:31.923795 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.923218 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c366c450-b973-4a84-b562-b1970ebf743e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-99rrr\" (UID: \"c366c450-b973-4a84-b562-b1970ebf743e\") " pod="openshift-multus/multus-additional-cni-plugins-99rrr" Sep 18 23:58:31.923795 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.923244 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c366c450-b973-4a84-b562-b1970ebf743e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-99rrr\" (UID: \"c366c450-b973-4a84-b562-b1970ebf743e\") " pod="openshift-multus/multus-additional-cni-plugins-99rrr" Sep 18 23:58:31.923795 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.923270 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2e265fcc-098a-4a75-88b3-9917741344ef-etc-systemd\") pod \"tuned-ndc7h\" (UID: \"2e265fcc-098a-4a75-88b3-9917741344ef\") " pod="openshift-cluster-node-tuning-operator/tuned-ndc7h" Sep 18 23:58:31.924605 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.923302 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2e265fcc-098a-4a75-88b3-9917741344ef-run\") pod \"tuned-ndc7h\" (UID: \"2e265fcc-098a-4a75-88b3-9917741344ef\") " pod="openshift-cluster-node-tuning-operator/tuned-ndc7h" Sep 18 23:58:31.924605 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.923334 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cdff8643-b1e0-4122-8a03-906835642896-host\") pod \"node-ca-qlfrm\" (UID: \"cdff8643-b1e0-4122-8a03-906835642896\") " pod="openshift-image-registry/node-ca-qlfrm" Sep 18 23:58:31.924605 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.923356 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkclx\" (UniqueName: \"kubernetes.io/projected/cdff8643-b1e0-4122-8a03-906835642896-kube-api-access-gkclx\") pod \"node-ca-qlfrm\" (UID: \"cdff8643-b1e0-4122-8a03-906835642896\") " pod="openshift-image-registry/node-ca-qlfrm" Sep 18 23:58:31.924605 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.923374 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614-multus-cni-dir\") pod \"multus-c2k4w\" (UID: \"a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614\") " pod="openshift-multus/multus-c2k4w" Sep 18 23:58:31.924605 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.923416 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614-host-run-k8s-cni-cncf-io\") pod \"multus-c2k4w\" (UID: \"a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614\") " pod="openshift-multus/multus-c2k4w" Sep 18 23:58:31.924605 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.923470 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614-host-var-lib-cni-bin\") pod \"multus-c2k4w\" (UID: \"a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614\") " pod="openshift-multus/multus-c2k4w" Sep 18 23:58:31.924605 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.923510 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614-host-var-lib-cni-multus\") pod \"multus-c2k4w\" (UID: \"a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614\") " pod="openshift-multus/multus-c2k4w" Sep 18 23:58:31.924605 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.923555 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhhzn\" (UniqueName: \"kubernetes.io/projected/c366c450-b973-4a84-b562-b1970ebf743e-kube-api-access-vhhzn\") pod \"multus-additional-cni-plugins-99rrr\" (UID: \"c366c450-b973-4a84-b562-b1970ebf743e\") " pod="openshift-multus/multus-additional-cni-plugins-99rrr" Sep 18 23:58:31.924605 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.923760 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 18 23:58:31.924605 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.924027 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-t94r9\"" Sep 18 23:58:31.924605 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.924030 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 18 23:58:31.924605 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.924156 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 18 23:58:31.925216 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.924973 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 18 23:58:31.926637 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.926547 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6j92q" Sep 18 23:58:31.930785 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.928945 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 18 23:58:31.930785 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.929106 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 18 23:58:31.930785 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.929202 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-btxx4\"" Sep 18 23:58:31.930785 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.929324 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 18 23:58:31.930785 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.929472 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 18 23:58:31.930785 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.929523 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 18 23:58:31.930785 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.929717 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 18 23:58:31.930785 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.929784 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pz7c5" Sep 18 23:58:31.932072 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.932050 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-nnln5\"" Sep 18 23:58:31.932173 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.932049 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rkngj" Sep 18 23:58:31.932735 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.932557 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 18 23:58:31.932735 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.932560 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 18 23:58:31.934300 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.934275 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 18 23:58:31.934678 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.934510 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 18 23:58:31.935196 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.934967 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 18 23:58:31.935196 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.935044 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-kqppx\"" Sep 18 23:58:31.947651 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.947631 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-6992m" Sep 18 23:58:31.955270 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:31.955250 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-6992m" Sep 18 23:58:32.008893 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.008866 2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 18 23:58:32.023773 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.023741 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/63261a0e-67b8-40f6-99a7-5254c014c189-device-dir\") pod \"aws-ebs-csi-driver-node-n42dv\" (UID: \"63261a0e-67b8-40f6-99a7-5254c014c189\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n42dv" Sep 18 23:58:32.023913 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.023784 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/558d514a-4560-4e46-96af-e19cb4d741f8-node-log\") pod \"ovnkube-node-6j92q\" (UID: \"558d514a-4560-4e46-96af-e19cb4d741f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6j92q" Sep 18 23:58:32.023913 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.023822 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/558d514a-4560-4e46-96af-e19cb4d741f8-log-socket\") pod \"ovnkube-node-6j92q\" (UID: \"558d514a-4560-4e46-96af-e19cb4d741f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6j92q" Sep 18 23:58:32.023913 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.023875 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e265fcc-098a-4a75-88b3-9917741344ef-etc-kubernetes\") pod \"tuned-ndc7h\" (UID: \"2e265fcc-098a-4a75-88b3-9917741344ef\") " pod="openshift-cluster-node-tuning-operator/tuned-ndc7h" Sep 18 23:58:32.024084 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.023945 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e265fcc-098a-4a75-88b3-9917741344ef-etc-kubernetes\") pod \"tuned-ndc7h\" (UID: \"2e265fcc-098a-4a75-88b3-9917741344ef\") " pod="openshift-cluster-node-tuning-operator/tuned-ndc7h" Sep 18 23:58:32.024084 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.023974 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c366c450-b973-4a84-b562-b1970ebf743e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-99rrr\" (UID: \"c366c450-b973-4a84-b562-b1970ebf743e\") " pod="openshift-multus/multus-additional-cni-plugins-99rrr" Sep 18 23:58:32.024084 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.024028 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cdff8643-b1e0-4122-8a03-906835642896-serviceca\") pod \"node-ca-qlfrm\" (UID: \"cdff8643-b1e0-4122-8a03-906835642896\") " pod="openshift-image-registry/node-ca-qlfrm" Sep 18 23:58:32.024084 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.024056 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/63261a0e-67b8-40f6-99a7-5254c014c189-registration-dir\") pod \"aws-ebs-csi-driver-node-n42dv\" (UID: \"63261a0e-67b8-40f6-99a7-5254c014c189\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n42dv" Sep 18 23:58:32.024292 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.024108 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8e7fd7f0-d5f2-4928-a6de-c7d241bd6b7c-hosts-file\") pod \"node-resolver-pz7c5\" (UID: \"8e7fd7f0-d5f2-4928-a6de-c7d241bd6b7c\") " pod="openshift-dns/node-resolver-pz7c5" Sep 18 23:58:32.024292 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.024133 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/558d514a-4560-4e46-96af-e19cb4d741f8-host-run-netns\") pod \"ovnkube-node-6j92q\" (UID: \"558d514a-4560-4e46-96af-e19cb4d741f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6j92q" Sep 18 23:58:32.024292 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.024160 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2e265fcc-098a-4a75-88b3-9917741344ef-etc-sysctl-d\") pod \"tuned-ndc7h\" (UID: \"2e265fcc-098a-4a75-88b3-9917741344ef\") " pod="openshift-cluster-node-tuning-operator/tuned-ndc7h" Sep 18 23:58:32.024292 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.024186 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2e265fcc-098a-4a75-88b3-9917741344ef-lib-modules\") pod \"tuned-ndc7h\" (UID: \"2e265fcc-098a-4a75-88b3-9917741344ef\") " pod="openshift-cluster-node-tuning-operator/tuned-ndc7h" Sep 18 23:58:32.024292 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.024248 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2e265fcc-098a-4a75-88b3-9917741344ef-etc-tuned\") pod \"tuned-ndc7h\" (UID: \"2e265fcc-098a-4a75-88b3-9917741344ef\") " pod="openshift-cluster-node-tuning-operator/tuned-ndc7h" Sep 18 23:58:32.024292 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.024270 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614-host-run-netns\") pod \"multus-c2k4w\" (UID: \"a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614\") " pod="openshift-multus/multus-c2k4w" Sep 18 23:58:32.024292 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.024290 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrb5b\" (UniqueName: \"kubernetes.io/projected/63261a0e-67b8-40f6-99a7-5254c014c189-kube-api-access-wrb5b\") pod \"aws-ebs-csi-driver-node-n42dv\" (UID: \"63261a0e-67b8-40f6-99a7-5254c014c189\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n42dv" Sep 18 23:58:32.024659 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.024307 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/558d514a-4560-4e46-96af-e19cb4d741f8-systemd-units\") pod \"ovnkube-node-6j92q\" (UID: \"558d514a-4560-4e46-96af-e19cb4d741f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6j92q" Sep 18 23:58:32.024659 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.024350 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2e265fcc-098a-4a75-88b3-9917741344ef-etc-sysctl-d\") pod \"tuned-ndc7h\" (UID: \"2e265fcc-098a-4a75-88b3-9917741344ef\") " pod="openshift-cluster-node-tuning-operator/tuned-ndc7h" Sep 18 23:58:32.024659 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.024356 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/558d514a-4560-4e46-96af-e19cb4d741f8-var-lib-openvswitch\") pod \"ovnkube-node-6j92q\" (UID: \"558d514a-4560-4e46-96af-e19cb4d741f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6j92q" Sep 18 23:58:32.024659 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.024389 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/558d514a-4560-4e46-96af-e19cb4d741f8-etc-openvswitch\") pod \"ovnkube-node-6j92q\" (UID: \"558d514a-4560-4e46-96af-e19cb4d741f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6j92q" Sep 18 23:58:32.024659 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.024416 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e265fcc-098a-4a75-88b3-9917741344ef-var-lib-kubelet\") pod \"tuned-ndc7h\" (UID: \"2e265fcc-098a-4a75-88b3-9917741344ef\") " pod="openshift-cluster-node-tuning-operator/tuned-ndc7h" Sep 18 23:58:32.024659 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.024410 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c366c450-b973-4a84-b562-b1970ebf743e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-99rrr\" (UID: \"c366c450-b973-4a84-b562-b1970ebf743e\") " pod="openshift-multus/multus-additional-cni-plugins-99rrr" Sep 18 23:58:32.024659 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.024478 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614-host-run-netns\") pod \"multus-c2k4w\" (UID: \"a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614\") " pod="openshift-multus/multus-c2k4w" Sep 18 23:58:32.024659 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.024532 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2e265fcc-098a-4a75-88b3-9917741344ef-lib-modules\") pod \"tuned-ndc7h\" (UID: \"2e265fcc-098a-4a75-88b3-9917741344ef\") " pod="openshift-cluster-node-tuning-operator/tuned-ndc7h" Sep 18 23:58:32.024659 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.024541 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e265fcc-098a-4a75-88b3-9917741344ef-var-lib-kubelet\") pod \"tuned-ndc7h\" (UID: \"2e265fcc-098a-4a75-88b3-9917741344ef\") " pod="openshift-cluster-node-tuning-operator/tuned-ndc7h" Sep 18 23:58:32.024659 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.024560 2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 18 23:58:32.024659 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.024582 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c366c450-b973-4a84-b562-b1970ebf743e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-99rrr\" (UID: \"c366c450-b973-4a84-b562-b1970ebf743e\") " pod="openshift-multus/multus-additional-cni-plugins-99rrr" Sep 18 23:58:32.025282 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.024791 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614-multus-cni-dir\") pod \"multus-c2k4w\" (UID: \"a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614\") " pod="openshift-multus/multus-c2k4w" Sep 18 23:58:32.025282 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.024820 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614-hostroot\") pod \"multus-c2k4w\" (UID: \"a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614\") " pod="openshift-multus/multus-c2k4w" Sep 18 23:58:32.025282 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.024842 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614-multus-daemon-config\") pod \"multus-c2k4w\" (UID: \"a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614\") " pod="openshift-multus/multus-c2k4w" Sep 18 23:58:32.025282 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.024916 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/63261a0e-67b8-40f6-99a7-5254c014c189-socket-dir\") pod \"aws-ebs-csi-driver-node-n42dv\" (UID: \"63261a0e-67b8-40f6-99a7-5254c014c189\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n42dv" Sep 18 23:58:32.025282 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.024955 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/558d514a-4560-4e46-96af-e19cb4d741f8-host-slash\") pod \"ovnkube-node-6j92q\" (UID: \"558d514a-4560-4e46-96af-e19cb4d741f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6j92q" Sep 18 23:58:32.025282 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.024974 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cdff8643-b1e0-4122-8a03-906835642896-serviceca\") pod \"node-ca-qlfrm\" (UID: \"cdff8643-b1e0-4122-8a03-906835642896\") " pod="openshift-image-registry/node-ca-qlfrm" Sep 18 23:58:32.025282 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.024982 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2e265fcc-098a-4a75-88b3-9917741344ef-run\") pod \"tuned-ndc7h\" (UID: \"2e265fcc-098a-4a75-88b3-9917741344ef\") " pod="openshift-cluster-node-tuning-operator/tuned-ndc7h" Sep 18 23:58:32.025282 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.025031 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkclx\" (UniqueName: \"kubernetes.io/projected/cdff8643-b1e0-4122-8a03-906835642896-kube-api-access-gkclx\") pod \"node-ca-qlfrm\" (UID: \"cdff8643-b1e0-4122-8a03-906835642896\") " pod="openshift-image-registry/node-ca-qlfrm" Sep 18 23:58:32.025282 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.025054 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614-host-run-k8s-cni-cncf-io\") pod \"multus-c2k4w\" (UID: \"a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614\") " pod="openshift-multus/multus-c2k4w" Sep 18 23:58:32.025282 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.025077 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/70a2849d-3338-436b-9bdf-e136af4ae1b9-agent-certs\") pod \"konnectivity-agent-hb5v7\" (UID: \"70a2849d-3338-436b-9bdf-e136af4ae1b9\") " pod="kube-system/konnectivity-agent-hb5v7" Sep 18 23:58:32.025282 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.025098 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614-multus-cni-dir\") pod \"multus-c2k4w\" (UID: \"a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614\") " pod="openshift-multus/multus-c2k4w" Sep 18 23:58:32.025282 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.025099 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/558d514a-4560-4e46-96af-e19cb4d741f8-host-kubelet\") pod \"ovnkube-node-6j92q\" (UID: \"558d514a-4560-4e46-96af-e19cb4d741f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6j92q" Sep 18 23:58:32.025282 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.025138 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2e265fcc-098a-4a75-88b3-9917741344ef-etc-sysconfig\") pod \"tuned-ndc7h\" (UID: \"2e265fcc-098a-4a75-88b3-9917741344ef\") " pod="openshift-cluster-node-tuning-operator/tuned-ndc7h" Sep 18 23:58:32.025282 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.025152 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2e265fcc-098a-4a75-88b3-9917741344ef-run\") pod \"tuned-ndc7h\" (UID: \"2e265fcc-098a-4a75-88b3-9917741344ef\") " pod="openshift-cluster-node-tuning-operator/tuned-ndc7h" Sep 18 23:58:32.025282 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.025157 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c366c450-b973-4a84-b562-b1970ebf743e-cnibin\") pod \"multus-additional-cni-plugins-99rrr\" (UID: \"c366c450-b973-4a84-b562-b1970ebf743e\") " pod="openshift-multus/multus-additional-cni-plugins-99rrr" Sep 18 23:58:32.025282 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.025177 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tdtk\" (UniqueName: \"kubernetes.io/projected/2e265fcc-098a-4a75-88b3-9917741344ef-kube-api-access-9tdtk\") pod \"tuned-ndc7h\" (UID: \"2e265fcc-098a-4a75-88b3-9917741344ef\") " pod="openshift-cluster-node-tuning-operator/tuned-ndc7h" Sep 18 23:58:32.025282 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.025184 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614-hostroot\") pod \"multus-c2k4w\" (UID: \"a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614\") " pod="openshift-multus/multus-c2k4w" Sep 18 23:58:32.026017 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.025184 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c366c450-b973-4a84-b562-b1970ebf743e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-99rrr\" (UID: \"c366c450-b973-4a84-b562-b1970ebf743e\") " pod="openshift-multus/multus-additional-cni-plugins-99rrr" Sep 18 23:58:32.026017 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.025221 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c366c450-b973-4a84-b562-b1970ebf743e-cnibin\") pod \"multus-additional-cni-plugins-99rrr\" (UID: \"c366c450-b973-4a84-b562-b1970ebf743e\") " pod="openshift-multus/multus-additional-cni-plugins-99rrr" Sep 18 23:58:32.026017 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.025245 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614-host-run-k8s-cni-cncf-io\") pod \"multus-c2k4w\" (UID: \"a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614\") " pod="openshift-multus/multus-c2k4w" Sep 18 23:58:32.026017 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.025251 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lv7kw\" (UniqueName: \"kubernetes.io/projected/a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614-kube-api-access-lv7kw\") pod \"multus-c2k4w\" (UID: \"a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614\") " pod="openshift-multus/multus-c2k4w" Sep 18 23:58:32.026017 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.025277 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/63261a0e-67b8-40f6-99a7-5254c014c189-etc-selinux\") pod \"aws-ebs-csi-driver-node-n42dv\" (UID: \"63261a0e-67b8-40f6-99a7-5254c014c189\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n42dv" Sep 18 23:58:32.026017 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.025256 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2e265fcc-098a-4a75-88b3-9917741344ef-etc-sysconfig\") pod \"tuned-ndc7h\" (UID: \"2e265fcc-098a-4a75-88b3-9917741344ef\") " pod="openshift-cluster-node-tuning-operator/tuned-ndc7h" Sep 18 23:58:32.026017 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.025432 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/558d514a-4560-4e46-96af-e19cb4d741f8-run-openvswitch\") pod \"ovnkube-node-6j92q\" (UID: \"558d514a-4560-4e46-96af-e19cb4d741f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6j92q" Sep 18 23:58:32.026017 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.025486 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614-multus-daemon-config\") pod \"multus-c2k4w\" (UID: \"a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614\") " pod="openshift-multus/multus-c2k4w" Sep 18 23:58:32.026017 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.025577 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/43d55fed-7cdc-4df4-b6c2-45eb0f9571bf-iptables-alerter-script\") pod \"iptables-alerter-rkngj\" (UID: \"43d55fed-7cdc-4df4-b6c2-45eb0f9571bf\") " pod="openshift-network-operator/iptables-alerter-rkngj" Sep 18 23:58:32.026017 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.025608 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2fa576fe-0727-4d71-9477-d92c65eedf38-kubelet-config\") pod \"global-pull-secret-syncer-dhgxl\" (UID: \"2fa576fe-0727-4d71-9477-d92c65eedf38\") " pod="kube-system/global-pull-secret-syncer-dhgxl" Sep 18 23:58:32.026017 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.025633 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/558d514a-4560-4e46-96af-e19cb4d741f8-env-overrides\") pod \"ovnkube-node-6j92q\" (UID: \"558d514a-4560-4e46-96af-e19cb4d741f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6j92q" Sep 18 23:58:32.026017 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.025658 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2fa576fe-0727-4d71-9477-d92c65eedf38-dbus\") pod \"global-pull-secret-syncer-dhgxl\" (UID: \"2fa576fe-0727-4d71-9477-d92c65eedf38\") " pod="kube-system/global-pull-secret-syncer-dhgxl" Sep 18 23:58:32.026017 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.025676 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c366c450-b973-4a84-b562-b1970ebf743e-cni-binary-copy\") pod \"multus-additional-cni-plugins-99rrr\" (UID: \"c366c450-b973-4a84-b562-b1970ebf743e\") " pod="openshift-multus/multus-additional-cni-plugins-99rrr" Sep 18 23:58:32.026017 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.025704 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614-multus-conf-dir\") pod \"multus-c2k4w\" (UID: \"a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614\") " pod="openshift-multus/multus-c2k4w" Sep 18 23:58:32.026017 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.025730 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/63261a0e-67b8-40f6-99a7-5254c014c189-sys-fs\") pod \"aws-ebs-csi-driver-node-n42dv\" (UID: \"63261a0e-67b8-40f6-99a7-5254c014c189\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n42dv" Sep 18 23:58:32.026017 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.025779 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614-multus-conf-dir\") pod \"multus-c2k4w\" (UID: \"a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614\") " pod="openshift-multus/multus-c2k4w" Sep 18 23:58:32.026017 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.025812 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2e265fcc-098a-4a75-88b3-9917741344ef-etc-sysctl-conf\") pod \"tuned-ndc7h\" (UID: \"2e265fcc-098a-4a75-88b3-9917741344ef\") " pod="openshift-cluster-node-tuning-operator/tuned-ndc7h" Sep 18 23:58:32.026817 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.025841 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614-system-cni-dir\") pod \"multus-c2k4w\" (UID: \"a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614\") " pod="openshift-multus/multus-c2k4w" Sep 18 23:58:32.026817 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.025889 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/558d514a-4560-4e46-96af-e19cb4d741f8-host-cni-bin\") pod \"ovnkube-node-6j92q\" (UID: \"558d514a-4560-4e46-96af-e19cb4d741f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6j92q" Sep 18 23:58:32.026817 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.025914 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/558d514a-4560-4e46-96af-e19cb4d741f8-host-cni-netd\") pod \"ovnkube-node-6j92q\" (UID: \"558d514a-4560-4e46-96af-e19cb4d741f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6j92q" Sep 18 23:58:32.026817 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.025951 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614-cni-binary-copy\") pod \"multus-c2k4w\" (UID: \"a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614\") " pod="openshift-multus/multus-c2k4w" Sep 18 23:58:32.026817 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.025970 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2e265fcc-098a-4a75-88b3-9917741344ef-etc-sysctl-conf\") pod \"tuned-ndc7h\" (UID: \"2e265fcc-098a-4a75-88b3-9917741344ef\") " pod="openshift-cluster-node-tuning-operator/tuned-ndc7h" Sep 18 23:58:32.026817 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.025970 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614-system-cni-dir\") pod \"multus-c2k4w\" (UID: \"a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614\") " pod="openshift-multus/multus-c2k4w" Sep 18 23:58:32.026817 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.025988 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/558d514a-4560-4e46-96af-e19cb4d741f8-run-ovn\") pod \"ovnkube-node-6j92q\" (UID: \"558d514a-4560-4e46-96af-e19cb4d741f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6j92q" Sep 18 23:58:32.026817 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.026025 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnncj\" (UniqueName: \"kubernetes.io/projected/558d514a-4560-4e46-96af-e19cb4d741f8-kube-api-access-mnncj\") pod \"ovnkube-node-6j92q\" (UID: \"558d514a-4560-4e46-96af-e19cb4d741f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6j92q" Sep 18 23:58:32.026817 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.026055 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e265fcc-098a-4a75-88b3-9917741344ef-tmp\") pod \"tuned-ndc7h\" (UID: \"2e265fcc-098a-4a75-88b3-9917741344ef\") " pod="openshift-cluster-node-tuning-operator/tuned-ndc7h" Sep 18 23:58:32.026817 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.026109 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hfnt\" (UniqueName: \"kubernetes.io/projected/3b5234a6-7648-434b-ab71-66239b3e1158-kube-api-access-9hfnt\") pod \"network-check-target-zcsgq\" (UID: \"3b5234a6-7648-434b-ab71-66239b3e1158\") " pod="openshift-network-diagnostics/network-check-target-zcsgq" Sep 18 23:58:32.026817 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.026193 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c366c450-b973-4a84-b562-b1970ebf743e-system-cni-dir\") pod \"multus-additional-cni-plugins-99rrr\" (UID: \"c366c450-b973-4a84-b562-b1970ebf743e\") " pod="openshift-multus/multus-additional-cni-plugins-99rrr" Sep 18 23:58:32.026817 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.026195 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c366c450-b973-4a84-b562-b1970ebf743e-cni-binary-copy\") pod \"multus-additional-cni-plugins-99rrr\" (UID: \"c366c450-b973-4a84-b562-b1970ebf743e\") " pod="openshift-multus/multus-additional-cni-plugins-99rrr" Sep 18 23:58:32.026817 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.026283 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c366c450-b973-4a84-b562-b1970ebf743e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-99rrr\" (UID: \"c366c450-b973-4a84-b562-b1970ebf743e\") " pod="openshift-multus/multus-additional-cni-plugins-99rrr" Sep 18 23:58:32.026817 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.026312 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614-host-var-lib-cni-bin\") pod \"multus-c2k4w\" (UID: \"a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614\") " pod="openshift-multus/multus-c2k4w" Sep 18 23:58:32.026817 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.026381 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614-host-var-lib-cni-multus\") pod \"multus-c2k4w\" (UID: \"a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614\") " pod="openshift-multus/multus-c2k4w" Sep 18 23:58:32.026817 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.026409 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614-cni-binary-copy\") pod \"multus-c2k4w\" (UID: \"a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614\") " pod="openshift-multus/multus-c2k4w" Sep 18 23:58:32.026817 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.026418 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lc7j6\" (UniqueName: \"kubernetes.io/projected/4319f89f-3b39-4c12-8ca8-3e3cf20d5b84-kube-api-access-lc7j6\") pod \"network-metrics-daemon-tvsd7\" (UID: \"4319f89f-3b39-4c12-8ca8-3e3cf20d5b84\") " pod="openshift-multus/network-metrics-daemon-tvsd7" Sep 18 23:58:32.027704 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.026425 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614-host-var-lib-cni-bin\") pod \"multus-c2k4w\" (UID: \"a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614\") " pod="openshift-multus/multus-c2k4w" Sep 18 23:58:32.027704 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.026471 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c366c450-b973-4a84-b562-b1970ebf743e-system-cni-dir\") pod \"multus-additional-cni-plugins-99rrr\" (UID: \"c366c450-b973-4a84-b562-b1970ebf743e\") " pod="openshift-multus/multus-additional-cni-plugins-99rrr" Sep 18 23:58:32.027704 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.026497 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2e265fcc-098a-4a75-88b3-9917741344ef-etc-systemd\") pod \"tuned-ndc7h\" (UID: \"2e265fcc-098a-4a75-88b3-9917741344ef\") " pod="openshift-cluster-node-tuning-operator/tuned-ndc7h" Sep 18 23:58:32.027704 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.026513 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614-host-var-lib-cni-multus\") pod \"multus-c2k4w\" (UID: \"a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614\") " pod="openshift-multus/multus-c2k4w" Sep 18 23:58:32.027704 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.026617 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cdff8643-b1e0-4122-8a03-906835642896-host\") pod \"node-ca-qlfrm\" (UID: \"cdff8643-b1e0-4122-8a03-906835642896\") " pod="openshift-image-registry/node-ca-qlfrm" Sep 18 23:58:32.027704 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.026663 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cdff8643-b1e0-4122-8a03-906835642896-host\") pod \"node-ca-qlfrm\" (UID: \"cdff8643-b1e0-4122-8a03-906835642896\") " pod="openshift-image-registry/node-ca-qlfrm" Sep 18 23:58:32.027704 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.026663 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2e265fcc-098a-4a75-88b3-9917741344ef-etc-systemd\") pod \"tuned-ndc7h\" (UID: \"2e265fcc-098a-4a75-88b3-9917741344ef\") " pod="openshift-cluster-node-tuning-operator/tuned-ndc7h" Sep 18 23:58:32.027704 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.026671 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614-host-run-multus-certs\") pod \"multus-c2k4w\" (UID: \"a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614\") " pod="openshift-multus/multus-c2k4w" Sep 18 23:58:32.027704 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.026716 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614-host-run-multus-certs\") pod \"multus-c2k4w\" (UID: \"a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614\") " pod="openshift-multus/multus-c2k4w" Sep 18 23:58:32.027704 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.026758 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/70a2849d-3338-436b-9bdf-e136af4ae1b9-konnectivity-ca\") pod \"konnectivity-agent-hb5v7\" (UID: \"70a2849d-3338-436b-9bdf-e136af4ae1b9\") " pod="kube-system/konnectivity-agent-hb5v7" Sep 18 23:58:32.027704 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.026792 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/558d514a-4560-4e46-96af-e19cb4d741f8-run-systemd\") pod \"ovnkube-node-6j92q\" (UID: \"558d514a-4560-4e46-96af-e19cb4d741f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6j92q" Sep 18 23:58:32.027704 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.026838 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/558d514a-4560-4e46-96af-e19cb4d741f8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6j92q\" (UID: \"558d514a-4560-4e46-96af-e19cb4d741f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6j92q" Sep 18 23:58:32.027704 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.026858 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c366c450-b973-4a84-b562-b1970ebf743e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-99rrr\" (UID: \"c366c450-b973-4a84-b562-b1970ebf743e\") " pod="openshift-multus/multus-additional-cni-plugins-99rrr" Sep 18 23:58:32.027704 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.026881 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/558d514a-4560-4e46-96af-e19cb4d741f8-ovn-node-metrics-cert\") pod \"ovnkube-node-6j92q\" (UID: \"558d514a-4560-4e46-96af-e19cb4d741f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6j92q" Sep 18 23:58:32.027704 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.026915 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/558d514a-4560-4e46-96af-e19cb4d741f8-ovnkube-script-lib\") pod \"ovnkube-node-6j92q\" (UID: \"558d514a-4560-4e46-96af-e19cb4d741f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6j92q" Sep 18 23:58:32.027704 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.026954 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhhzn\" (UniqueName: \"kubernetes.io/projected/c366c450-b973-4a84-b562-b1970ebf743e-kube-api-access-vhhzn\") pod \"multus-additional-cni-plugins-99rrr\" (UID: \"c366c450-b973-4a84-b562-b1970ebf743e\") " pod="openshift-multus/multus-additional-cni-plugins-99rrr" Sep 18 23:58:32.027704 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.026993 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614-host-var-lib-kubelet\") pod \"multus-c2k4w\" (UID: \"a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614\") " pod="openshift-multus/multus-c2k4w" Sep 18 23:58:32.028659 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.027115 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614-etc-kubernetes\") pod \"multus-c2k4w\" (UID: \"a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614\") " pod="openshift-multus/multus-c2k4w" Sep 18 23:58:32.028659 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.027136 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614-host-var-lib-kubelet\") pod \"multus-c2k4w\" (UID: \"a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614\") " pod="openshift-multus/multus-c2k4w" Sep 18 23:58:32.028659 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.027177 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4319f89f-3b39-4c12-8ca8-3e3cf20d5b84-metrics-certs\") pod \"network-metrics-daemon-tvsd7\" (UID: \"4319f89f-3b39-4c12-8ca8-3e3cf20d5b84\") " pod="openshift-multus/network-metrics-daemon-tvsd7" Sep 18 23:58:32.028659 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.027205 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e7fd7f0-d5f2-4928-a6de-c7d241bd6b7c-tmp-dir\") pod \"node-resolver-pz7c5\" (UID: \"8e7fd7f0-d5f2-4928-a6de-c7d241bd6b7c\") " pod="openshift-dns/node-resolver-pz7c5" Sep 18 23:58:32.028659 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.027258 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4c75c\" (UniqueName: \"kubernetes.io/projected/8e7fd7f0-d5f2-4928-a6de-c7d241bd6b7c-kube-api-access-4c75c\") pod \"node-resolver-pz7c5\" (UID: \"8e7fd7f0-d5f2-4928-a6de-c7d241bd6b7c\") " pod="openshift-dns/node-resolver-pz7c5" Sep 18 23:58:32.028659 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.027256 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614-etc-kubernetes\") pod \"multus-c2k4w\" (UID: \"a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614\") " pod="openshift-multus/multus-c2k4w" Sep 18 23:58:32.028659 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:32.027291 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 23:58:32.028659 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.027291 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/43d55fed-7cdc-4df4-b6c2-45eb0f9571bf-host-slash\") pod \"iptables-alerter-rkngj\" (UID: \"43d55fed-7cdc-4df4-b6c2-45eb0f9571bf\") " pod="openshift-network-operator/iptables-alerter-rkngj" Sep 18 23:58:32.028659 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.027326 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/558d514a-4560-4e46-96af-e19cb4d741f8-host-run-ovn-kubernetes\") pod \"ovnkube-node-6j92q\" (UID: \"558d514a-4560-4e46-96af-e19cb4d741f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6j92q" Sep 18 23:58:32.028659 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:32.027371 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4319f89f-3b39-4c12-8ca8-3e3cf20d5b84-metrics-certs podName:4319f89f-3b39-4c12-8ca8-3e3cf20d5b84 nodeName:}" failed. No retries permitted until 2026-09-18 23:58:32.527338309 +0000 UTC m=+4.503546778 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4319f89f-3b39-4c12-8ca8-3e3cf20d5b84-metrics-certs") pod "network-metrics-daemon-tvsd7" (UID: "4319f89f-3b39-4c12-8ca8-3e3cf20d5b84") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 23:58:32.028659 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.027390 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2e265fcc-098a-4a75-88b3-9917741344ef-host\") pod \"tuned-ndc7h\" (UID: \"2e265fcc-098a-4a75-88b3-9917741344ef\") " pod="openshift-cluster-node-tuning-operator/tuned-ndc7h" Sep 18 23:58:32.028659 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.027416 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2e265fcc-098a-4a75-88b3-9917741344ef-etc-modprobe-d\") pod \"tuned-ndc7h\" (UID: \"2e265fcc-098a-4a75-88b3-9917741344ef\") " pod="openshift-cluster-node-tuning-operator/tuned-ndc7h" Sep 18 23:58:32.028659 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.027438 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2e265fcc-098a-4a75-88b3-9917741344ef-sys\") pod \"tuned-ndc7h\" (UID: \"2e265fcc-098a-4a75-88b3-9917741344ef\") " pod="openshift-cluster-node-tuning-operator/tuned-ndc7h" Sep 18 23:58:32.028659 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.027461 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614-multus-socket-dir-parent\") pod \"multus-c2k4w\" (UID: \"a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614\") " pod="openshift-multus/multus-c2k4w" Sep 18 23:58:32.028659 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.027488 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z72gb\" (UniqueName: \"kubernetes.io/projected/43d55fed-7cdc-4df4-b6c2-45eb0f9571bf-kube-api-access-z72gb\") pod \"iptables-alerter-rkngj\" (UID: \"43d55fed-7cdc-4df4-b6c2-45eb0f9571bf\") " pod="openshift-network-operator/iptables-alerter-rkngj" Sep 18 23:58:32.028659 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.027515 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2fa576fe-0727-4d71-9477-d92c65eedf38-original-pull-secret\") pod \"global-pull-secret-syncer-dhgxl\" (UID: \"2fa576fe-0727-4d71-9477-d92c65eedf38\") " pod="kube-system/global-pull-secret-syncer-dhgxl" Sep 18 23:58:32.028659 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.027542 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2e265fcc-098a-4a75-88b3-9917741344ef-host\") pod \"tuned-ndc7h\" (UID: \"2e265fcc-098a-4a75-88b3-9917741344ef\") " pod="openshift-cluster-node-tuning-operator/tuned-ndc7h" Sep 18 23:58:32.029575 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.027543 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/558d514a-4560-4e46-96af-e19cb4d741f8-ovnkube-config\") pod \"ovnkube-node-6j92q\" (UID: \"558d514a-4560-4e46-96af-e19cb4d741f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6j92q" Sep 18 23:58:32.029575 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.027594 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614-multus-socket-dir-parent\") pod \"multus-c2k4w\" (UID: \"a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614\") " pod="openshift-multus/multus-c2k4w" Sep 18 23:58:32.029575 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.027608 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614-cnibin\") pod \"multus-c2k4w\" (UID: \"a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614\") " pod="openshift-multus/multus-c2k4w" Sep 18 23:58:32.029575 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.027636 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/63261a0e-67b8-40f6-99a7-5254c014c189-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n42dv\" (UID: \"63261a0e-67b8-40f6-99a7-5254c014c189\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n42dv" Sep 18 23:58:32.029575 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.027648 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2e265fcc-098a-4a75-88b3-9917741344ef-sys\") pod \"tuned-ndc7h\" (UID: \"2e265fcc-098a-4a75-88b3-9917741344ef\") " pod="openshift-cluster-node-tuning-operator/tuned-ndc7h" Sep 18 23:58:32.029575 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.027639 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2e265fcc-098a-4a75-88b3-9917741344ef-etc-modprobe-d\") pod \"tuned-ndc7h\" (UID: \"2e265fcc-098a-4a75-88b3-9917741344ef\") " pod="openshift-cluster-node-tuning-operator/tuned-ndc7h" Sep 18 23:58:32.029575 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.027738 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614-cnibin\") pod \"multus-c2k4w\" (UID: \"a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614\") " pod="openshift-multus/multus-c2k4w" Sep 18 23:58:32.030187 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.030034 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2e265fcc-098a-4a75-88b3-9917741344ef-etc-tuned\") pod \"tuned-ndc7h\" (UID: \"2e265fcc-098a-4a75-88b3-9917741344ef\") " pod="openshift-cluster-node-tuning-operator/tuned-ndc7h" Sep 18 23:58:32.031298 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:32.031275 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 23:58:32.031410 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:32.031304 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 23:58:32.031410 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:32.031320 2579 projected.go:196] Error preparing data for projected volume kube-api-access-9hfnt for pod openshift-network-diagnostics/network-check-target-zcsgq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 23:58:32.031581 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:32.031409 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3b5234a6-7648-434b-ab71-66239b3e1158-kube-api-access-9hfnt podName:3b5234a6-7648-434b-ab71-66239b3e1158 nodeName:}" failed. No retries permitted until 2026-09-18 23:58:32.531374464 +0000 UTC m=+4.507582943 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-9hfnt" (UniqueName: "kubernetes.io/projected/3b5234a6-7648-434b-ab71-66239b3e1158-kube-api-access-9hfnt") pod "network-check-target-zcsgq" (UID: "3b5234a6-7648-434b-ab71-66239b3e1158") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 23:58:32.032162 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.031897 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e265fcc-098a-4a75-88b3-9917741344ef-tmp\") pod \"tuned-ndc7h\" (UID: \"2e265fcc-098a-4a75-88b3-9917741344ef\") " pod="openshift-cluster-node-tuning-operator/tuned-ndc7h" Sep 18 23:58:32.034721 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.034697 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkclx\" (UniqueName: \"kubernetes.io/projected/cdff8643-b1e0-4122-8a03-906835642896-kube-api-access-gkclx\") pod \"node-ca-qlfrm\" (UID: \"cdff8643-b1e0-4122-8a03-906835642896\") " pod="openshift-image-registry/node-ca-qlfrm" Sep 18 23:58:32.035303 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.035279 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhhzn\" (UniqueName: \"kubernetes.io/projected/c366c450-b973-4a84-b562-b1970ebf743e-kube-api-access-vhhzn\") pod \"multus-additional-cni-plugins-99rrr\" (UID: \"c366c450-b973-4a84-b562-b1970ebf743e\") " pod="openshift-multus/multus-additional-cni-plugins-99rrr" Sep 18 23:58:32.036295 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.036275 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lc7j6\" (UniqueName: \"kubernetes.io/projected/4319f89f-3b39-4c12-8ca8-3e3cf20d5b84-kube-api-access-lc7j6\") pod \"network-metrics-daemon-tvsd7\" (UID: \"4319f89f-3b39-4c12-8ca8-3e3cf20d5b84\") " pod="openshift-multus/network-metrics-daemon-tvsd7" Sep 18 23:58:32.036398 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.036305 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tdtk\" (UniqueName: \"kubernetes.io/projected/2e265fcc-098a-4a75-88b3-9917741344ef-kube-api-access-9tdtk\") pod \"tuned-ndc7h\" (UID: \"2e265fcc-098a-4a75-88b3-9917741344ef\") " pod="openshift-cluster-node-tuning-operator/tuned-ndc7h" Sep 18 23:58:32.037659 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.037627 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lv7kw\" (UniqueName: \"kubernetes.io/projected/a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614-kube-api-access-lv7kw\") pod \"multus-c2k4w\" (UID: \"a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614\") " pod="openshift-multus/multus-c2k4w" Sep 18 23:58:32.076964 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.076872 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-53.ec2.internal" event={"ID":"16b0fef0d964298ff4a2b765bfad6222","Type":"ContainerStarted","Data":"f56764a8bee8c0f6f4aa63659c19acd8023cd414542d9b711711e414119a0a8f"} Sep 18 23:58:32.078321 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.078286 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-53.ec2.internal" event={"ID":"6c8d92999cd8bd3edaf2f2f126532e2e","Type":"ContainerStarted","Data":"ae0672cc8d6800a65f7fc11e8beb198c0ed559e12185a707160af960198ebf69"} Sep 18 23:58:32.128273 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.128246 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/63261a0e-67b8-40f6-99a7-5254c014c189-socket-dir\") pod \"aws-ebs-csi-driver-node-n42dv\" (UID: \"63261a0e-67b8-40f6-99a7-5254c014c189\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n42dv" Sep 18 23:58:32.128273 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.128275 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/558d514a-4560-4e46-96af-e19cb4d741f8-host-slash\") pod \"ovnkube-node-6j92q\" (UID: \"558d514a-4560-4e46-96af-e19cb4d741f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6j92q" Sep 18 23:58:32.128526 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.128300 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/70a2849d-3338-436b-9bdf-e136af4ae1b9-agent-certs\") pod \"konnectivity-agent-hb5v7\" (UID: \"70a2849d-3338-436b-9bdf-e136af4ae1b9\") " pod="kube-system/konnectivity-agent-hb5v7" Sep 18 23:58:32.128526 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.128335 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/558d514a-4560-4e46-96af-e19cb4d741f8-host-kubelet\") pod \"ovnkube-node-6j92q\" (UID: \"558d514a-4560-4e46-96af-e19cb4d741f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6j92q" Sep 18 23:58:32.128526 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.128367 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/63261a0e-67b8-40f6-99a7-5254c014c189-etc-selinux\") pod \"aws-ebs-csi-driver-node-n42dv\" (UID: \"63261a0e-67b8-40f6-99a7-5254c014c189\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n42dv" Sep 18 23:58:32.128526 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.128391 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/558d514a-4560-4e46-96af-e19cb4d741f8-host-slash\") pod \"ovnkube-node-6j92q\" (UID: \"558d514a-4560-4e46-96af-e19cb4d741f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6j92q" Sep 18 23:58:32.128526 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.128407 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/558d514a-4560-4e46-96af-e19cb4d741f8-run-openvswitch\") pod \"ovnkube-node-6j92q\" (UID: \"558d514a-4560-4e46-96af-e19cb4d741f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6j92q" Sep 18 23:58:32.128526 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.128433 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/43d55fed-7cdc-4df4-b6c2-45eb0f9571bf-iptables-alerter-script\") pod \"iptables-alerter-rkngj\" (UID: \"43d55fed-7cdc-4df4-b6c2-45eb0f9571bf\") " pod="openshift-network-operator/iptables-alerter-rkngj" Sep 18 23:58:32.128526 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.128451 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/63261a0e-67b8-40f6-99a7-5254c014c189-socket-dir\") pod \"aws-ebs-csi-driver-node-n42dv\" (UID: \"63261a0e-67b8-40f6-99a7-5254c014c189\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n42dv" Sep 18 23:58:32.128526 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.128457 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2fa576fe-0727-4d71-9477-d92c65eedf38-kubelet-config\") pod \"global-pull-secret-syncer-dhgxl\" (UID: \"2fa576fe-0727-4d71-9477-d92c65eedf38\") " pod="kube-system/global-pull-secret-syncer-dhgxl" Sep 18 23:58:32.128526 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.128476 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/558d514a-4560-4e46-96af-e19cb4d741f8-host-kubelet\") pod \"ovnkube-node-6j92q\" (UID: \"558d514a-4560-4e46-96af-e19cb4d741f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6j92q" Sep 18 23:58:32.128526 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.128505 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/558d514a-4560-4e46-96af-e19cb4d741f8-env-overrides\") pod \"ovnkube-node-6j92q\" (UID: \"558d514a-4560-4e46-96af-e19cb4d741f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6j92q" Sep 18 23:58:32.128526 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.128509 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2fa576fe-0727-4d71-9477-d92c65eedf38-kubelet-config\") pod \"global-pull-secret-syncer-dhgxl\" (UID: \"2fa576fe-0727-4d71-9477-d92c65eedf38\") " pod="kube-system/global-pull-secret-syncer-dhgxl" Sep 18 23:58:32.128526 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.128510 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/63261a0e-67b8-40f6-99a7-5254c014c189-etc-selinux\") pod \"aws-ebs-csi-driver-node-n42dv\" (UID: \"63261a0e-67b8-40f6-99a7-5254c014c189\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n42dv" Sep 18 23:58:32.129163 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.128547 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/558d514a-4560-4e46-96af-e19cb4d741f8-run-openvswitch\") pod \"ovnkube-node-6j92q\" (UID: \"558d514a-4560-4e46-96af-e19cb4d741f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6j92q" Sep 18 23:58:32.129163 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.128582 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2fa576fe-0727-4d71-9477-d92c65eedf38-dbus\") pod \"global-pull-secret-syncer-dhgxl\" (UID: \"2fa576fe-0727-4d71-9477-d92c65eedf38\") " pod="kube-system/global-pull-secret-syncer-dhgxl" Sep 18 23:58:32.129163 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.128624 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/63261a0e-67b8-40f6-99a7-5254c014c189-sys-fs\") pod \"aws-ebs-csi-driver-node-n42dv\" (UID: \"63261a0e-67b8-40f6-99a7-5254c014c189\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n42dv" Sep 18 23:58:32.129163 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.128655 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/558d514a-4560-4e46-96af-e19cb4d741f8-host-cni-bin\") pod \"ovnkube-node-6j92q\" (UID: \"558d514a-4560-4e46-96af-e19cb4d741f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6j92q" Sep 18 23:58:32.129163 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.128664 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2fa576fe-0727-4d71-9477-d92c65eedf38-dbus\") pod \"global-pull-secret-syncer-dhgxl\" (UID: \"2fa576fe-0727-4d71-9477-d92c65eedf38\") " pod="kube-system/global-pull-secret-syncer-dhgxl" Sep 18 23:58:32.129163 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.128682 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/558d514a-4560-4e46-96af-e19cb4d741f8-host-cni-netd\") pod \"ovnkube-node-6j92q\" (UID: \"558d514a-4560-4e46-96af-e19cb4d741f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6j92q" Sep 18 23:58:32.129163 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.128710 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/558d514a-4560-4e46-96af-e19cb4d741f8-run-ovn\") pod \"ovnkube-node-6j92q\" (UID: \"558d514a-4560-4e46-96af-e19cb4d741f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6j92q" Sep 18 23:58:32.129163 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.128740 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnncj\" (UniqueName: \"kubernetes.io/projected/558d514a-4560-4e46-96af-e19cb4d741f8-kube-api-access-mnncj\") pod \"ovnkube-node-6j92q\" (UID: \"558d514a-4560-4e46-96af-e19cb4d741f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6j92q" Sep 18 23:58:32.129163 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.128744 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/63261a0e-67b8-40f6-99a7-5254c014c189-sys-fs\") pod \"aws-ebs-csi-driver-node-n42dv\" (UID: \"63261a0e-67b8-40f6-99a7-5254c014c189\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n42dv" Sep 18 23:58:32.129163 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.128768 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/558d514a-4560-4e46-96af-e19cb4d741f8-run-ovn\") pod \"ovnkube-node-6j92q\" (UID: \"558d514a-4560-4e46-96af-e19cb4d741f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6j92q" Sep 18 23:58:32.129163 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.128808 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/558d514a-4560-4e46-96af-e19cb4d741f8-host-cni-bin\") pod \"ovnkube-node-6j92q\" (UID: \"558d514a-4560-4e46-96af-e19cb4d741f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6j92q" Sep 18 23:58:32.129163 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.128820 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/70a2849d-3338-436b-9bdf-e136af4ae1b9-konnectivity-ca\") pod \"konnectivity-agent-hb5v7\" (UID: \"70a2849d-3338-436b-9bdf-e136af4ae1b9\") " pod="kube-system/konnectivity-agent-hb5v7" Sep 18 23:58:32.129163 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.128841 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/558d514a-4560-4e46-96af-e19cb4d741f8-host-cni-netd\") pod \"ovnkube-node-6j92q\" (UID: \"558d514a-4560-4e46-96af-e19cb4d741f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6j92q" Sep 18 23:58:32.129163 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.128852 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/558d514a-4560-4e46-96af-e19cb4d741f8-run-systemd\") pod \"ovnkube-node-6j92q\" (UID: \"558d514a-4560-4e46-96af-e19cb4d741f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6j92q" Sep 18 23:58:32.129163 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.128967 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/558d514a-4560-4e46-96af-e19cb4d741f8-run-systemd\") pod \"ovnkube-node-6j92q\" (UID: \"558d514a-4560-4e46-96af-e19cb4d741f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6j92q" Sep 18 23:58:32.129163 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.128985 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/558d514a-4560-4e46-96af-e19cb4d741f8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6j92q\" (UID: \"558d514a-4560-4e46-96af-e19cb4d741f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6j92q" Sep 18 23:58:32.129163 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.129034 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/558d514a-4560-4e46-96af-e19cb4d741f8-ovn-node-metrics-cert\") pod \"ovnkube-node-6j92q\" (UID: \"558d514a-4560-4e46-96af-e19cb4d741f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6j92q" Sep 18 23:58:32.130029 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.129061 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/558d514a-4560-4e46-96af-e19cb4d741f8-ovnkube-script-lib\") pod \"ovnkube-node-6j92q\" (UID: \"558d514a-4560-4e46-96af-e19cb4d741f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6j92q" Sep 18 23:58:32.130029 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.129093 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/558d514a-4560-4e46-96af-e19cb4d741f8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6j92q\" (UID: \"558d514a-4560-4e46-96af-e19cb4d741f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6j92q" Sep 18 23:58:32.130029 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.129122 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/558d514a-4560-4e46-96af-e19cb4d741f8-env-overrides\") pod \"ovnkube-node-6j92q\" (UID: \"558d514a-4560-4e46-96af-e19cb4d741f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6j92q" Sep 18 23:58:32.130029 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.129146 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e7fd7f0-d5f2-4928-a6de-c7d241bd6b7c-tmp-dir\") pod \"node-resolver-pz7c5\" (UID: \"8e7fd7f0-d5f2-4928-a6de-c7d241bd6b7c\") " pod="openshift-dns/node-resolver-pz7c5" Sep 18 23:58:32.130029 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.129176 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4c75c\" (UniqueName: \"kubernetes.io/projected/8e7fd7f0-d5f2-4928-a6de-c7d241bd6b7c-kube-api-access-4c75c\") pod \"node-resolver-pz7c5\" (UID: \"8e7fd7f0-d5f2-4928-a6de-c7d241bd6b7c\") " pod="openshift-dns/node-resolver-pz7c5" Sep 18 23:58:32.130029 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.129197 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/43d55fed-7cdc-4df4-b6c2-45eb0f9571bf-iptables-alerter-script\") pod \"iptables-alerter-rkngj\" (UID: \"43d55fed-7cdc-4df4-b6c2-45eb0f9571bf\") " pod="openshift-network-operator/iptables-alerter-rkngj" Sep 18 23:58:32.130029 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.129202 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/43d55fed-7cdc-4df4-b6c2-45eb0f9571bf-host-slash\") pod \"iptables-alerter-rkngj\" (UID: \"43d55fed-7cdc-4df4-b6c2-45eb0f9571bf\") " pod="openshift-network-operator/iptables-alerter-rkngj" Sep 18 23:58:32.130029 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.129236 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/43d55fed-7cdc-4df4-b6c2-45eb0f9571bf-host-slash\") pod \"iptables-alerter-rkngj\" (UID: \"43d55fed-7cdc-4df4-b6c2-45eb0f9571bf\") " pod="openshift-network-operator/iptables-alerter-rkngj" Sep 18 23:58:32.130029 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.129259 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/558d514a-4560-4e46-96af-e19cb4d741f8-host-run-ovn-kubernetes\") pod \"ovnkube-node-6j92q\" (UID: \"558d514a-4560-4e46-96af-e19cb4d741f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6j92q" Sep 18 23:58:32.130029 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.129295 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z72gb\" (UniqueName: \"kubernetes.io/projected/43d55fed-7cdc-4df4-b6c2-45eb0f9571bf-kube-api-access-z72gb\") pod \"iptables-alerter-rkngj\" (UID: \"43d55fed-7cdc-4df4-b6c2-45eb0f9571bf\") " pod="openshift-network-operator/iptables-alerter-rkngj" Sep 18 23:58:32.130029 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.129323 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2fa576fe-0727-4d71-9477-d92c65eedf38-original-pull-secret\") pod \"global-pull-secret-syncer-dhgxl\" (UID: \"2fa576fe-0727-4d71-9477-d92c65eedf38\") " pod="kube-system/global-pull-secret-syncer-dhgxl" Sep 18 23:58:32.130029 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.129349 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/558d514a-4560-4e46-96af-e19cb4d741f8-ovnkube-config\") pod \"ovnkube-node-6j92q\" (UID: \"558d514a-4560-4e46-96af-e19cb4d741f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6j92q" Sep 18 23:58:32.130029 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.129381 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/63261a0e-67b8-40f6-99a7-5254c014c189-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n42dv\" (UID: \"63261a0e-67b8-40f6-99a7-5254c014c189\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n42dv" Sep 18 23:58:32.130029 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.129411 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/63261a0e-67b8-40f6-99a7-5254c014c189-device-dir\") pod \"aws-ebs-csi-driver-node-n42dv\" (UID: \"63261a0e-67b8-40f6-99a7-5254c014c189\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n42dv" Sep 18 23:58:32.130029 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.129435 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/558d514a-4560-4e46-96af-e19cb4d741f8-node-log\") pod \"ovnkube-node-6j92q\" (UID: \"558d514a-4560-4e46-96af-e19cb4d741f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6j92q" Sep 18 23:58:32.130029 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.129462 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/558d514a-4560-4e46-96af-e19cb4d741f8-log-socket\") pod \"ovnkube-node-6j92q\" (UID: \"558d514a-4560-4e46-96af-e19cb4d741f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6j92q" Sep 18 23:58:32.130029 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.129491 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/63261a0e-67b8-40f6-99a7-5254c014c189-registration-dir\") pod \"aws-ebs-csi-driver-node-n42dv\" (UID: \"63261a0e-67b8-40f6-99a7-5254c014c189\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n42dv" Sep 18 23:58:32.130943 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:32.129500 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 23:58:32.130943 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.129517 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8e7fd7f0-d5f2-4928-a6de-c7d241bd6b7c-hosts-file\") pod \"node-resolver-pz7c5\" (UID: \"8e7fd7f0-d5f2-4928-a6de-c7d241bd6b7c\") " pod="openshift-dns/node-resolver-pz7c5" Sep 18 23:58:32.130943 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.129503 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/63261a0e-67b8-40f6-99a7-5254c014c189-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n42dv\" (UID: \"63261a0e-67b8-40f6-99a7-5254c014c189\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n42dv" Sep 18 23:58:32.130943 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:32.130015 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fa576fe-0727-4d71-9477-d92c65eedf38-original-pull-secret podName:2fa576fe-0727-4d71-9477-d92c65eedf38 nodeName:}" failed. No retries permitted until 2026-09-18 23:58:32.629988134 +0000 UTC m=+4.606196604 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2fa576fe-0727-4d71-9477-d92c65eedf38-original-pull-secret") pod "global-pull-secret-syncer-dhgxl" (UID: "2fa576fe-0727-4d71-9477-d92c65eedf38") : object "kube-system"/"original-pull-secret" not registered Sep 18 23:58:32.130943 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.129497 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e7fd7f0-d5f2-4928-a6de-c7d241bd6b7c-tmp-dir\") pod \"node-resolver-pz7c5\" (UID: \"8e7fd7f0-d5f2-4928-a6de-c7d241bd6b7c\") " pod="openshift-dns/node-resolver-pz7c5" Sep 18 23:58:32.130943 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.129539 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/558d514a-4560-4e46-96af-e19cb4d741f8-host-run-ovn-kubernetes\") pod \"ovnkube-node-6j92q\" (UID: \"558d514a-4560-4e46-96af-e19cb4d741f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6j92q" Sep 18 23:58:32.130943 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.130301 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8e7fd7f0-d5f2-4928-a6de-c7d241bd6b7c-hosts-file\") pod \"node-resolver-pz7c5\" (UID: \"8e7fd7f0-d5f2-4928-a6de-c7d241bd6b7c\") " pod="openshift-dns/node-resolver-pz7c5" Sep 18 23:58:32.130943 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.130732 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/558d514a-4560-4e46-96af-e19cb4d741f8-ovnkube-config\") pod \"ovnkube-node-6j92q\" (UID: \"558d514a-4560-4e46-96af-e19cb4d741f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6j92q" Sep 18 23:58:32.130943 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.130806 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/63261a0e-67b8-40f6-99a7-5254c014c189-device-dir\") pod \"aws-ebs-csi-driver-node-n42dv\" (UID: \"63261a0e-67b8-40f6-99a7-5254c014c189\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n42dv" Sep 18 23:58:32.131433 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.129569 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/558d514a-4560-4e46-96af-e19cb4d741f8-log-socket\") pod \"ovnkube-node-6j92q\" (UID: \"558d514a-4560-4e46-96af-e19cb4d741f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6j92q" Sep 18 23:58:32.131433 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.131111 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/70a2849d-3338-436b-9bdf-e136af4ae1b9-konnectivity-ca\") pod \"konnectivity-agent-hb5v7\" (UID: \"70a2849d-3338-436b-9bdf-e136af4ae1b9\") " pod="kube-system/konnectivity-agent-hb5v7" Sep 18 23:58:32.131433 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.131203 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/558d514a-4560-4e46-96af-e19cb4d741f8-ovnkube-script-lib\") pod \"ovnkube-node-6j92q\" (UID: \"558d514a-4560-4e46-96af-e19cb4d741f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6j92q" Sep 18 23:58:32.131433 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.131293 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/558d514a-4560-4e46-96af-e19cb4d741f8-node-log\") pod \"ovnkube-node-6j92q\" (UID: \"558d514a-4560-4e46-96af-e19cb4d741f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6j92q" Sep 18 23:58:32.131625 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.131444 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/63261a0e-67b8-40f6-99a7-5254c014c189-registration-dir\") pod \"aws-ebs-csi-driver-node-n42dv\" (UID: \"63261a0e-67b8-40f6-99a7-5254c014c189\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n42dv" Sep 18 23:58:32.131625 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.131580 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/558d514a-4560-4e46-96af-e19cb4d741f8-host-run-netns\") pod \"ovnkube-node-6j92q\" (UID: \"558d514a-4560-4e46-96af-e19cb4d741f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6j92q" Sep 18 23:58:32.131729 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.131637 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrb5b\" (UniqueName: \"kubernetes.io/projected/63261a0e-67b8-40f6-99a7-5254c014c189-kube-api-access-wrb5b\") pod \"aws-ebs-csi-driver-node-n42dv\" (UID: \"63261a0e-67b8-40f6-99a7-5254c014c189\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n42dv" Sep 18 23:58:32.131729 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.131685 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/558d514a-4560-4e46-96af-e19cb4d741f8-systemd-units\") pod \"ovnkube-node-6j92q\" (UID: \"558d514a-4560-4e46-96af-e19cb4d741f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6j92q" Sep 18 23:58:32.131729 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.131722 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/558d514a-4560-4e46-96af-e19cb4d741f8-var-lib-openvswitch\") pod \"ovnkube-node-6j92q\" (UID: \"558d514a-4560-4e46-96af-e19cb4d741f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6j92q" Sep 18 23:58:32.131911 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.131763 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/558d514a-4560-4e46-96af-e19cb4d741f8-etc-openvswitch\") pod \"ovnkube-node-6j92q\" (UID: \"558d514a-4560-4e46-96af-e19cb4d741f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6j92q" Sep 18 23:58:32.131911 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.131898 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/558d514a-4560-4e46-96af-e19cb4d741f8-etc-openvswitch\") pod \"ovnkube-node-6j92q\" (UID: \"558d514a-4560-4e46-96af-e19cb4d741f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6j92q" Sep 18 23:58:32.132004 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.131959 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/558d514a-4560-4e46-96af-e19cb4d741f8-systemd-units\") pod \"ovnkube-node-6j92q\" (UID: \"558d514a-4560-4e46-96af-e19cb4d741f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6j92q" Sep 18 23:58:32.132004 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.131972 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/558d514a-4560-4e46-96af-e19cb4d741f8-var-lib-openvswitch\") pod \"ovnkube-node-6j92q\" (UID: \"558d514a-4560-4e46-96af-e19cb4d741f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6j92q" Sep 18 23:58:32.132004 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.131640 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/558d514a-4560-4e46-96af-e19cb4d741f8-host-run-netns\") pod \"ovnkube-node-6j92q\" (UID: \"558d514a-4560-4e46-96af-e19cb4d741f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6j92q" Sep 18 23:58:32.134638 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.134226 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/70a2849d-3338-436b-9bdf-e136af4ae1b9-agent-certs\") pod \"konnectivity-agent-hb5v7\" (UID: \"70a2849d-3338-436b-9bdf-e136af4ae1b9\") " pod="kube-system/konnectivity-agent-hb5v7" Sep 18 23:58:32.134905 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.134880 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/558d514a-4560-4e46-96af-e19cb4d741f8-ovn-node-metrics-cert\") pod \"ovnkube-node-6j92q\" (UID: \"558d514a-4560-4e46-96af-e19cb4d741f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6j92q" Sep 18 23:58:32.136955 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.136935 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnncj\" (UniqueName: \"kubernetes.io/projected/558d514a-4560-4e46-96af-e19cb4d741f8-kube-api-access-mnncj\") pod \"ovnkube-node-6j92q\" (UID: \"558d514a-4560-4e46-96af-e19cb4d741f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6j92q" Sep 18 23:58:32.137056 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.137041 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4c75c\" (UniqueName: \"kubernetes.io/projected/8e7fd7f0-d5f2-4928-a6de-c7d241bd6b7c-kube-api-access-4c75c\") pod \"node-resolver-pz7c5\" (UID: \"8e7fd7f0-d5f2-4928-a6de-c7d241bd6b7c\") " pod="openshift-dns/node-resolver-pz7c5" Sep 18 23:58:32.141242 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.141193 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z72gb\" (UniqueName: \"kubernetes.io/projected/43d55fed-7cdc-4df4-b6c2-45eb0f9571bf-kube-api-access-z72gb\") pod \"iptables-alerter-rkngj\" (UID: \"43d55fed-7cdc-4df4-b6c2-45eb0f9571bf\") " pod="openshift-network-operator/iptables-alerter-rkngj" Sep 18 23:58:32.141987 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.141968 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrb5b\" (UniqueName: \"kubernetes.io/projected/63261a0e-67b8-40f6-99a7-5254c014c189-kube-api-access-wrb5b\") pod \"aws-ebs-csi-driver-node-n42dv\" (UID: \"63261a0e-67b8-40f6-99a7-5254c014c189\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n42dv" Sep 18 23:58:32.224152 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.224110 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-99rrr" Sep 18 23:58:32.233742 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.233719 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ndc7h" Sep 18 23:58:32.243924 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.243901 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qlfrm" Sep 18 23:58:32.251939 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.251917 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-c2k4w" Sep 18 23:58:32.260776 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.260743 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hb5v7" Sep 18 23:58:32.269747 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.269725 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n42dv" Sep 18 23:58:32.286727 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.286700 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6j92q" Sep 18 23:58:32.305634 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.305611 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pz7c5" Sep 18 23:58:32.311667 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.311647 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rkngj" Sep 18 23:58:32.412979 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.412908 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 23:58:32.534894 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.534855 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hfnt\" (UniqueName: \"kubernetes.io/projected/3b5234a6-7648-434b-ab71-66239b3e1158-kube-api-access-9hfnt\") pod \"network-check-target-zcsgq\" (UID: \"3b5234a6-7648-434b-ab71-66239b3e1158\") " pod="openshift-network-diagnostics/network-check-target-zcsgq" Sep 18 23:58:32.535097 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.534901 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4319f89f-3b39-4c12-8ca8-3e3cf20d5b84-metrics-certs\") pod \"network-metrics-daemon-tvsd7\" (UID: \"4319f89f-3b39-4c12-8ca8-3e3cf20d5b84\") " pod="openshift-multus/network-metrics-daemon-tvsd7" Sep 18 23:58:32.535097 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:32.535039 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 23:58:32.535097 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:32.535053 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 23:58:32.535097 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:32.535075 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 23:58:32.535097 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:32.535086 2579 projected.go:196] Error preparing data for projected volume kube-api-access-9hfnt for pod openshift-network-diagnostics/network-check-target-zcsgq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 23:58:32.535360 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:32.535105 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4319f89f-3b39-4c12-8ca8-3e3cf20d5b84-metrics-certs podName:4319f89f-3b39-4c12-8ca8-3e3cf20d5b84 nodeName:}" failed. No retries permitted until 2026-09-18 23:58:33.535084683 +0000 UTC m=+5.511293152 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4319f89f-3b39-4c12-8ca8-3e3cf20d5b84-metrics-certs") pod "network-metrics-daemon-tvsd7" (UID: "4319f89f-3b39-4c12-8ca8-3e3cf20d5b84") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 23:58:32.535360 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:32.535138 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3b5234a6-7648-434b-ab71-66239b3e1158-kube-api-access-9hfnt podName:3b5234a6-7648-434b-ab71-66239b3e1158 nodeName:}" failed. No retries permitted until 2026-09-18 23:58:33.535123621 +0000 UTC m=+5.511332069 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-9hfnt" (UniqueName: "kubernetes.io/projected/3b5234a6-7648-434b-ab71-66239b3e1158-kube-api-access-9hfnt") pod "network-check-target-zcsgq" (UID: "3b5234a6-7648-434b-ab71-66239b3e1158") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 23:58:32.635748 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.635708 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2fa576fe-0727-4d71-9477-d92c65eedf38-original-pull-secret\") pod \"global-pull-secret-syncer-dhgxl\" (UID: \"2fa576fe-0727-4d71-9477-d92c65eedf38\") " pod="kube-system/global-pull-secret-syncer-dhgxl" Sep 18 23:58:32.635965 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:32.635904 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 23:58:32.636025 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:32.635993 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fa576fe-0727-4d71-9477-d92c65eedf38-original-pull-secret podName:2fa576fe-0727-4d71-9477-d92c65eedf38 nodeName:}" failed. No retries permitted until 2026-09-18 23:58:33.635971256 +0000 UTC m=+5.612179713 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2fa576fe-0727-4d71-9477-d92c65eedf38-original-pull-secret") pod "global-pull-secret-syncer-dhgxl" (UID: "2fa576fe-0727-4d71-9477-d92c65eedf38") : object "kube-system"/"original-pull-secret" not registered Sep 18 23:58:32.960544 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.960487 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 23:53:32 +0000 UTC" deadline="2028-04-02 19:30:38.651943047 +0000 UTC" Sep 18 23:58:32.960544 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:32.960535 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13483h32m5.691410842s" Sep 18 23:58:33.071865 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:33.071832 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zcsgq" Sep 18 23:58:33.071865 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:33.071854 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhgxl" Sep 18 23:58:33.072117 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:33.071959 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zcsgq" podUID="3b5234a6-7648-434b-ab71-66239b3e1158" Sep 18 23:58:33.072117 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:33.072084 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhgxl" podUID="2fa576fe-0727-4d71-9477-d92c65eedf38" Sep 18 23:58:33.158542 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:33.158515 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63261a0e_67b8_40f6_99a7_5254c014c189.slice/crio-67f3fe5d47bb9354d14f11353613193ec314f71b6e058e5efd29f82d71d4da08 WatchSource:0}: Error finding container 67f3fe5d47bb9354d14f11353613193ec314f71b6e058e5efd29f82d71d4da08: Status 404 returned error can't find the container with id 67f3fe5d47bb9354d14f11353613193ec314f71b6e058e5efd29f82d71d4da08 Sep 18 23:58:33.160370 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:33.160269 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5e78d3a_6dc9_4904_ba1d_fedfcf5f8614.slice/crio-ce30cfe0da51dceeda2202f953a4adc0f43574a1ab90c3d51f7895a6d00b444f WatchSource:0}: Error finding container ce30cfe0da51dceeda2202f953a4adc0f43574a1ab90c3d51f7895a6d00b444f: Status 404 returned error can't find the container with id ce30cfe0da51dceeda2202f953a4adc0f43574a1ab90c3d51f7895a6d00b444f Sep 18 23:58:33.161517 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:33.161488 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e265fcc_098a_4a75_88b3_9917741344ef.slice/crio-374ce7653e4a7a268ce1810e8963a5c14a83e8f22e348d0dc77b50e63984835b WatchSource:0}: Error finding container 374ce7653e4a7a268ce1810e8963a5c14a83e8f22e348d0dc77b50e63984835b: Status 404 returned error can't find the container with id 374ce7653e4a7a268ce1810e8963a5c14a83e8f22e348d0dc77b50e63984835b Sep 18 23:58:33.163325 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:33.163289 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43d55fed_7cdc_4df4_b6c2_45eb0f9571bf.slice/crio-e3e16fbd4e9e3025d01034bd539648c8ebf4ee415e8f7bbacb974b2cc622325c WatchSource:0}: Error finding container e3e16fbd4e9e3025d01034bd539648c8ebf4ee415e8f7bbacb974b2cc622325c: Status 404 returned error can't find the container with id e3e16fbd4e9e3025d01034bd539648c8ebf4ee415e8f7bbacb974b2cc622325c Sep 18 23:58:33.188313 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:33.188285 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc366c450_b973_4a84_b562_b1970ebf743e.slice/crio-87bcd1be793aff222b812716031cc794a9adb1714b102529cb7727fbbfa36c59 WatchSource:0}: Error finding container 87bcd1be793aff222b812716031cc794a9adb1714b102529cb7727fbbfa36c59: Status 404 returned error can't find the container with id 87bcd1be793aff222b812716031cc794a9adb1714b102529cb7727fbbfa36c59 Sep 18 23:58:33.189073 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:33.189046 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70a2849d_3338_436b_9bdf_e136af4ae1b9.slice/crio-da931c4d923269b9dd30bcca05a0e64efa73fdfec485928a367550517a43849f WatchSource:0}: Error finding container da931c4d923269b9dd30bcca05a0e64efa73fdfec485928a367550517a43849f: Status 404 returned error can't find the container with id da931c4d923269b9dd30bcca05a0e64efa73fdfec485928a367550517a43849f Sep 18 23:58:33.189903 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:33.189882 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod558d514a_4560_4e46_96af_e19cb4d741f8.slice/crio-74d36052a2076bdb9c81fab4528a2649a47fb02177ab9560b067360a25519fa8 WatchSource:0}: Error finding container 74d36052a2076bdb9c81fab4528a2649a47fb02177ab9560b067360a25519fa8: Status 404 returned error can't find the container with id 74d36052a2076bdb9c81fab4528a2649a47fb02177ab9560b067360a25519fa8 Sep 18 23:58:33.191423 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:33.191343 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e7fd7f0_d5f2_4928_a6de_c7d241bd6b7c.slice/crio-00532bd048c9c7ff51e93cd3d68148c29a3eb9ef25886ab1d92e5a17e187928d WatchSource:0}: Error finding container 00532bd048c9c7ff51e93cd3d68148c29a3eb9ef25886ab1d92e5a17e187928d: Status 404 returned error can't find the container with id 00532bd048c9c7ff51e93cd3d68148c29a3eb9ef25886ab1d92e5a17e187928d Sep 18 23:58:33.192998 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:58:33.192912 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdff8643_b1e0_4122_8a03_906835642896.slice/crio-d74e118cc154e4791c3f85a05dd4952aca393c84849d31c531c7e3f13ac71b0c WatchSource:0}: Error finding container d74e118cc154e4791c3f85a05dd4952aca393c84849d31c531c7e3f13ac71b0c: Status 404 returned error can't find the container with id d74e118cc154e4791c3f85a05dd4952aca393c84849d31c531c7e3f13ac71b0c Sep 18 23:58:33.542242 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:33.542163 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hfnt\" (UniqueName: \"kubernetes.io/projected/3b5234a6-7648-434b-ab71-66239b3e1158-kube-api-access-9hfnt\") pod \"network-check-target-zcsgq\" (UID: \"3b5234a6-7648-434b-ab71-66239b3e1158\") " pod="openshift-network-diagnostics/network-check-target-zcsgq" Sep 18 23:58:33.542242 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:33.542211 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4319f89f-3b39-4c12-8ca8-3e3cf20d5b84-metrics-certs\") pod \"network-metrics-daemon-tvsd7\" (UID: \"4319f89f-3b39-4c12-8ca8-3e3cf20d5b84\") " pod="openshift-multus/network-metrics-daemon-tvsd7" Sep 18 23:58:33.542455 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:33.542374 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 23:58:33.542455 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:33.542403 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 23:58:33.542455 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:33.542432 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 23:58:33.542455 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:33.542440 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4319f89f-3b39-4c12-8ca8-3e3cf20d5b84-metrics-certs podName:4319f89f-3b39-4c12-8ca8-3e3cf20d5b84 nodeName:}" failed. No retries permitted until 2026-09-18 23:58:35.542425505 +0000 UTC m=+7.518633967 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4319f89f-3b39-4c12-8ca8-3e3cf20d5b84-metrics-certs") pod "network-metrics-daemon-tvsd7" (UID: "4319f89f-3b39-4c12-8ca8-3e3cf20d5b84") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 23:58:33.542455 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:33.542447 2579 projected.go:196] Error preparing data for projected volume kube-api-access-9hfnt for pod openshift-network-diagnostics/network-check-target-zcsgq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 23:58:33.542658 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:33.542505 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3b5234a6-7648-434b-ab71-66239b3e1158-kube-api-access-9hfnt podName:3b5234a6-7648-434b-ab71-66239b3e1158 nodeName:}" failed. No retries permitted until 2026-09-18 23:58:35.542488751 +0000 UTC m=+7.518697214 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-9hfnt" (UniqueName: "kubernetes.io/projected/3b5234a6-7648-434b-ab71-66239b3e1158-kube-api-access-9hfnt") pod "network-check-target-zcsgq" (UID: "3b5234a6-7648-434b-ab71-66239b3e1158") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 23:58:33.643797 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:33.643548 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2fa576fe-0727-4d71-9477-d92c65eedf38-original-pull-secret\") pod \"global-pull-secret-syncer-dhgxl\" (UID: \"2fa576fe-0727-4d71-9477-d92c65eedf38\") " pod="kube-system/global-pull-secret-syncer-dhgxl" Sep 18 23:58:33.643797 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:33.643701 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 23:58:33.643797 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:33.643768 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fa576fe-0727-4d71-9477-d92c65eedf38-original-pull-secret podName:2fa576fe-0727-4d71-9477-d92c65eedf38 nodeName:}" failed. No retries permitted until 2026-09-18 23:58:35.643749071 +0000 UTC m=+7.619957527 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2fa576fe-0727-4d71-9477-d92c65eedf38-original-pull-secret") pod "global-pull-secret-syncer-dhgxl" (UID: "2fa576fe-0727-4d71-9477-d92c65eedf38") : object "kube-system"/"original-pull-secret" not registered Sep 18 23:58:33.961441 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:33.961363 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 23:53:32 +0000 UTC" deadline="2028-02-24 18:53:43.679610666 +0000 UTC" Sep 18 23:58:33.961441 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:33.961402 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12570h55m9.718214081s" Sep 18 23:58:34.071724 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:34.070993 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tvsd7" Sep 18 23:58:34.071724 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:34.071366 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tvsd7" podUID="4319f89f-3b39-4c12-8ca8-3e3cf20d5b84" Sep 18 23:58:34.088698 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:34.088661 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-c2k4w" event={"ID":"a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614","Type":"ContainerStarted","Data":"ce30cfe0da51dceeda2202f953a4adc0f43574a1ab90c3d51f7895a6d00b444f"} Sep 18 23:58:34.094442 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:34.094362 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n42dv" event={"ID":"63261a0e-67b8-40f6-99a7-5254c014c189","Type":"ContainerStarted","Data":"67f3fe5d47bb9354d14f11353613193ec314f71b6e058e5efd29f82d71d4da08"} Sep 18 23:58:34.103988 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:34.103481 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-53.ec2.internal" event={"ID":"16b0fef0d964298ff4a2b765bfad6222","Type":"ContainerStarted","Data":"911c5cda6d3d547898ea51754c8e9644046a7cf1c5e00b550b2248edeaca29c3"} Sep 18 23:58:34.116844 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:34.116780 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qlfrm" event={"ID":"cdff8643-b1e0-4122-8a03-906835642896","Type":"ContainerStarted","Data":"d74e118cc154e4791c3f85a05dd4952aca393c84849d31c531c7e3f13ac71b0c"} Sep 18 23:58:34.141376 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:34.141277 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pz7c5" event={"ID":"8e7fd7f0-d5f2-4928-a6de-c7d241bd6b7c","Type":"ContainerStarted","Data":"00532bd048c9c7ff51e93cd3d68148c29a3eb9ef25886ab1d92e5a17e187928d"} Sep 18 23:58:34.147635 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:34.147501 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6j92q" event={"ID":"558d514a-4560-4e46-96af-e19cb4d741f8","Type":"ContainerStarted","Data":"74d36052a2076bdb9c81fab4528a2649a47fb02177ab9560b067360a25519fa8"} Sep 18 23:58:34.161039 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:34.161003 2579 generic.go:356] "Generic (PLEG): container finished" podID="6c8d92999cd8bd3edaf2f2f126532e2e" containerID="0881b45c9710f9d0c6973ff5b10ce6c31b025d2219171545a521a2cb9e662366" exitCode=0 Sep 18 23:58:34.161366 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:34.161324 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-53.ec2.internal" event={"ID":"6c8d92999cd8bd3edaf2f2f126532e2e","Type":"ContainerDied","Data":"0881b45c9710f9d0c6973ff5b10ce6c31b025d2219171545a521a2cb9e662366"} Sep 18 23:58:34.180431 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:34.180370 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hb5v7" event={"ID":"70a2849d-3338-436b-9bdf-e136af4ae1b9","Type":"ContainerStarted","Data":"da931c4d923269b9dd30bcca05a0e64efa73fdfec485928a367550517a43849f"} Sep 18 23:58:34.185736 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:34.185631 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-53.ec2.internal" podStartSLOduration=3.185611832 podStartE2EDuration="3.185611832s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 23:58:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 23:58:34.121455733 +0000 UTC m=+6.097664203" watchObservedRunningTime="2026-09-18 23:58:34.185611832 +0000 UTC m=+6.161820300" Sep 18 23:58:34.190829 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:34.190747 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rkngj" event={"ID":"43d55fed-7cdc-4df4-b6c2-45eb0f9571bf","Type":"ContainerStarted","Data":"e3e16fbd4e9e3025d01034bd539648c8ebf4ee415e8f7bbacb974b2cc622325c"} Sep 18 23:58:34.210558 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:34.210521 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-99rrr" event={"ID":"c366c450-b973-4a84-b562-b1970ebf743e","Type":"ContainerStarted","Data":"87bcd1be793aff222b812716031cc794a9adb1714b102529cb7727fbbfa36c59"} Sep 18 23:58:34.229838 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:34.229799 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ndc7h" event={"ID":"2e265fcc-098a-4a75-88b3-9917741344ef","Type":"ContainerStarted","Data":"374ce7653e4a7a268ce1810e8963a5c14a83e8f22e348d0dc77b50e63984835b"} Sep 18 23:58:35.072343 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:35.071771 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhgxl" Sep 18 23:58:35.072343 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:35.071955 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhgxl" podUID="2fa576fe-0727-4d71-9477-d92c65eedf38" Sep 18 23:58:35.072343 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:35.072287 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zcsgq" Sep 18 23:58:35.073024 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:35.072413 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zcsgq" podUID="3b5234a6-7648-434b-ab71-66239b3e1158" Sep 18 23:58:35.241079 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:35.241046 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-53.ec2.internal" event={"ID":"6c8d92999cd8bd3edaf2f2f126532e2e","Type":"ContainerStarted","Data":"9c2393c6c884e5aa93bbe8fe844f4dae7341dd3f51d5f9de551299fc7a31ff74"} Sep 18 23:58:35.560463 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:35.560415 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hfnt\" (UniqueName: \"kubernetes.io/projected/3b5234a6-7648-434b-ab71-66239b3e1158-kube-api-access-9hfnt\") pod \"network-check-target-zcsgq\" (UID: \"3b5234a6-7648-434b-ab71-66239b3e1158\") " pod="openshift-network-diagnostics/network-check-target-zcsgq" Sep 18 23:58:35.560664 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:35.560477 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4319f89f-3b39-4c12-8ca8-3e3cf20d5b84-metrics-certs\") pod \"network-metrics-daemon-tvsd7\" (UID: \"4319f89f-3b39-4c12-8ca8-3e3cf20d5b84\") " pod="openshift-multus/network-metrics-daemon-tvsd7" Sep 18 23:58:35.560664 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:35.560631 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 23:58:35.560864 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:35.560693 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4319f89f-3b39-4c12-8ca8-3e3cf20d5b84-metrics-certs podName:4319f89f-3b39-4c12-8ca8-3e3cf20d5b84 nodeName:}" failed. No retries permitted until 2026-09-18 23:58:39.560675164 +0000 UTC m=+11.536883616 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4319f89f-3b39-4c12-8ca8-3e3cf20d5b84-metrics-certs") pod "network-metrics-daemon-tvsd7" (UID: "4319f89f-3b39-4c12-8ca8-3e3cf20d5b84") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 23:58:35.560864 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:35.560798 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 23:58:35.560864 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:35.560813 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 23:58:35.560864 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:35.560825 2579 projected.go:196] Error preparing data for projected volume kube-api-access-9hfnt for pod openshift-network-diagnostics/network-check-target-zcsgq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 23:58:35.560864 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:35.560861 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3b5234a6-7648-434b-ab71-66239b3e1158-kube-api-access-9hfnt podName:3b5234a6-7648-434b-ab71-66239b3e1158 nodeName:}" failed. No retries permitted until 2026-09-18 23:58:39.560849286 +0000 UTC m=+11.537057737 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-9hfnt" (UniqueName: "kubernetes.io/projected/3b5234a6-7648-434b-ab71-66239b3e1158-kube-api-access-9hfnt") pod "network-check-target-zcsgq" (UID: "3b5234a6-7648-434b-ab71-66239b3e1158") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 23:58:35.661023 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:35.660969 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2fa576fe-0727-4d71-9477-d92c65eedf38-original-pull-secret\") pod \"global-pull-secret-syncer-dhgxl\" (UID: \"2fa576fe-0727-4d71-9477-d92c65eedf38\") " pod="kube-system/global-pull-secret-syncer-dhgxl" Sep 18 23:58:35.661182 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:35.661128 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 23:58:35.661229 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:35.661192 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fa576fe-0727-4d71-9477-d92c65eedf38-original-pull-secret podName:2fa576fe-0727-4d71-9477-d92c65eedf38 nodeName:}" failed. No retries permitted until 2026-09-18 23:58:39.661173921 +0000 UTC m=+11.637382381 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2fa576fe-0727-4d71-9477-d92c65eedf38-original-pull-secret") pod "global-pull-secret-syncer-dhgxl" (UID: "2fa576fe-0727-4d71-9477-d92c65eedf38") : object "kube-system"/"original-pull-secret" not registered Sep 18 23:58:36.072322 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:36.072289 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tvsd7" Sep 18 23:58:36.072511 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:36.072438 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tvsd7" podUID="4319f89f-3b39-4c12-8ca8-3e3cf20d5b84" Sep 18 23:58:37.071795 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:37.071746 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zcsgq" Sep 18 23:58:37.071963 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:37.071916 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zcsgq" podUID="3b5234a6-7648-434b-ab71-66239b3e1158" Sep 18 23:58:37.072318 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:37.072298 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhgxl" Sep 18 23:58:37.072425 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:37.072405 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhgxl" podUID="2fa576fe-0727-4d71-9477-d92c65eedf38" Sep 18 23:58:38.073387 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:38.073227 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tvsd7" Sep 18 23:58:38.073387 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:38.073374 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tvsd7" podUID="4319f89f-3b39-4c12-8ca8-3e3cf20d5b84" Sep 18 23:58:39.071129 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:39.071088 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zcsgq" Sep 18 23:58:39.071307 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:39.071228 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zcsgq" podUID="3b5234a6-7648-434b-ab71-66239b3e1158" Sep 18 23:58:39.071374 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:39.071358 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhgxl" Sep 18 23:58:39.071475 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:39.071447 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhgxl" podUID="2fa576fe-0727-4d71-9477-d92c65eedf38" Sep 18 23:58:39.594727 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:39.593945 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hfnt\" (UniqueName: \"kubernetes.io/projected/3b5234a6-7648-434b-ab71-66239b3e1158-kube-api-access-9hfnt\") pod \"network-check-target-zcsgq\" (UID: \"3b5234a6-7648-434b-ab71-66239b3e1158\") " pod="openshift-network-diagnostics/network-check-target-zcsgq" Sep 18 23:58:39.594727 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:39.594006 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4319f89f-3b39-4c12-8ca8-3e3cf20d5b84-metrics-certs\") pod \"network-metrics-daemon-tvsd7\" (UID: \"4319f89f-3b39-4c12-8ca8-3e3cf20d5b84\") " pod="openshift-multus/network-metrics-daemon-tvsd7" Sep 18 23:58:39.594727 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:39.594150 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 23:58:39.594727 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:39.594214 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4319f89f-3b39-4c12-8ca8-3e3cf20d5b84-metrics-certs podName:4319f89f-3b39-4c12-8ca8-3e3cf20d5b84 nodeName:}" failed. No retries permitted until 2026-09-18 23:58:47.594195297 +0000 UTC m=+19.570403749 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4319f89f-3b39-4c12-8ca8-3e3cf20d5b84-metrics-certs") pod "network-metrics-daemon-tvsd7" (UID: "4319f89f-3b39-4c12-8ca8-3e3cf20d5b84") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 23:58:39.594727 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:39.594618 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 23:58:39.594727 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:39.594637 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 23:58:39.594727 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:39.594649 2579 projected.go:196] Error preparing data for projected volume kube-api-access-9hfnt for pod openshift-network-diagnostics/network-check-target-zcsgq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 23:58:39.594727 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:39.594691 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3b5234a6-7648-434b-ab71-66239b3e1158-kube-api-access-9hfnt podName:3b5234a6-7648-434b-ab71-66239b3e1158 nodeName:}" failed. No retries permitted until 2026-09-18 23:58:47.594677848 +0000 UTC m=+19.570886296 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-9hfnt" (UniqueName: "kubernetes.io/projected/3b5234a6-7648-434b-ab71-66239b3e1158-kube-api-access-9hfnt") pod "network-check-target-zcsgq" (UID: "3b5234a6-7648-434b-ab71-66239b3e1158") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 23:58:39.694535 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:39.694487 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2fa576fe-0727-4d71-9477-d92c65eedf38-original-pull-secret\") pod \"global-pull-secret-syncer-dhgxl\" (UID: \"2fa576fe-0727-4d71-9477-d92c65eedf38\") " pod="kube-system/global-pull-secret-syncer-dhgxl" Sep 18 23:58:39.694711 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:39.694696 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 23:58:39.694810 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:39.694774 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fa576fe-0727-4d71-9477-d92c65eedf38-original-pull-secret podName:2fa576fe-0727-4d71-9477-d92c65eedf38 nodeName:}" failed. No retries permitted until 2026-09-18 23:58:47.694737949 +0000 UTC m=+19.670946401 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2fa576fe-0727-4d71-9477-d92c65eedf38-original-pull-secret") pod "global-pull-secret-syncer-dhgxl" (UID: "2fa576fe-0727-4d71-9477-d92c65eedf38") : object "kube-system"/"original-pull-secret" not registered Sep 18 23:58:40.072306 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:40.072268 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tvsd7" Sep 18 23:58:40.072463 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:40.072397 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tvsd7" podUID="4319f89f-3b39-4c12-8ca8-3e3cf20d5b84" Sep 18 23:58:41.071770 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:41.071714 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zcsgq" Sep 18 23:58:41.072253 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:41.071878 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zcsgq" podUID="3b5234a6-7648-434b-ab71-66239b3e1158" Sep 18 23:58:41.072335 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:41.072280 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhgxl" Sep 18 23:58:41.072403 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:41.072378 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhgxl" podUID="2fa576fe-0727-4d71-9477-d92c65eedf38" Sep 18 23:58:42.071067 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:42.071029 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tvsd7" Sep 18 23:58:42.071292 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:42.071187 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tvsd7" podUID="4319f89f-3b39-4c12-8ca8-3e3cf20d5b84" Sep 18 23:58:43.071816 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:43.071779 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zcsgq" Sep 18 23:58:43.072215 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:43.071780 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhgxl" Sep 18 23:58:43.072215 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:43.071881 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zcsgq" podUID="3b5234a6-7648-434b-ab71-66239b3e1158" Sep 18 23:58:43.072215 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:43.071993 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhgxl" podUID="2fa576fe-0727-4d71-9477-d92c65eedf38" Sep 18 23:58:44.071684 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:44.071644 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tvsd7" Sep 18 23:58:44.072003 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:44.071809 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tvsd7" podUID="4319f89f-3b39-4c12-8ca8-3e3cf20d5b84" Sep 18 23:58:45.071783 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:45.071734 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhgxl" Sep 18 23:58:45.071952 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:45.071734 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zcsgq" Sep 18 23:58:45.071952 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:45.071881 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhgxl" podUID="2fa576fe-0727-4d71-9477-d92c65eedf38" Sep 18 23:58:45.071952 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:45.071915 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zcsgq" podUID="3b5234a6-7648-434b-ab71-66239b3e1158" Sep 18 23:58:46.071640 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:46.071607 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tvsd7" Sep 18 23:58:46.071856 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:46.071762 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tvsd7" podUID="4319f89f-3b39-4c12-8ca8-3e3cf20d5b84" Sep 18 23:58:47.071194 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:47.071109 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zcsgq" Sep 18 23:58:47.071658 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:47.071245 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zcsgq" podUID="3b5234a6-7648-434b-ab71-66239b3e1158" Sep 18 23:58:47.071658 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:47.071308 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhgxl" Sep 18 23:58:47.071658 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:47.071415 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhgxl" podUID="2fa576fe-0727-4d71-9477-d92c65eedf38" Sep 18 23:58:47.658282 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:47.658244 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hfnt\" (UniqueName: \"kubernetes.io/projected/3b5234a6-7648-434b-ab71-66239b3e1158-kube-api-access-9hfnt\") pod \"network-check-target-zcsgq\" (UID: \"3b5234a6-7648-434b-ab71-66239b3e1158\") " pod="openshift-network-diagnostics/network-check-target-zcsgq" Sep 18 23:58:47.658282 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:47.658287 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4319f89f-3b39-4c12-8ca8-3e3cf20d5b84-metrics-certs\") pod \"network-metrics-daemon-tvsd7\" (UID: \"4319f89f-3b39-4c12-8ca8-3e3cf20d5b84\") " pod="openshift-multus/network-metrics-daemon-tvsd7" Sep 18 23:58:47.658547 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:47.658434 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 23:58:47.658547 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:47.658459 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 23:58:47.658547 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:47.658529 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4319f89f-3b39-4c12-8ca8-3e3cf20d5b84-metrics-certs podName:4319f89f-3b39-4c12-8ca8-3e3cf20d5b84 nodeName:}" failed. No retries permitted until 2026-09-18 23:59:03.658514927 +0000 UTC m=+35.634723373 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4319f89f-3b39-4c12-8ca8-3e3cf20d5b84-metrics-certs") pod "network-metrics-daemon-tvsd7" (UID: "4319f89f-3b39-4c12-8ca8-3e3cf20d5b84") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 23:58:47.658708 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:47.658462 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 23:58:47.658708 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:47.658577 2579 projected.go:196] Error preparing data for projected volume kube-api-access-9hfnt for pod openshift-network-diagnostics/network-check-target-zcsgq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 23:58:47.658708 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:47.658641 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3b5234a6-7648-434b-ab71-66239b3e1158-kube-api-access-9hfnt podName:3b5234a6-7648-434b-ab71-66239b3e1158 nodeName:}" failed. No retries permitted until 2026-09-18 23:59:03.658628479 +0000 UTC m=+35.634836939 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-9hfnt" (UniqueName: "kubernetes.io/projected/3b5234a6-7648-434b-ab71-66239b3e1158-kube-api-access-9hfnt") pod "network-check-target-zcsgq" (UID: "3b5234a6-7648-434b-ab71-66239b3e1158") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 23:58:47.759439 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:47.759397 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2fa576fe-0727-4d71-9477-d92c65eedf38-original-pull-secret\") pod \"global-pull-secret-syncer-dhgxl\" (UID: \"2fa576fe-0727-4d71-9477-d92c65eedf38\") " pod="kube-system/global-pull-secret-syncer-dhgxl" Sep 18 23:58:47.759634 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:47.759517 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 23:58:47.759634 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:47.759599 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fa576fe-0727-4d71-9477-d92c65eedf38-original-pull-secret podName:2fa576fe-0727-4d71-9477-d92c65eedf38 nodeName:}" failed. No retries permitted until 2026-09-18 23:59:03.759579022 +0000 UTC m=+35.735787484 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2fa576fe-0727-4d71-9477-d92c65eedf38-original-pull-secret") pod "global-pull-secret-syncer-dhgxl" (UID: "2fa576fe-0727-4d71-9477-d92c65eedf38") : object "kube-system"/"original-pull-secret" not registered Sep 18 23:58:48.071196 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:48.071123 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tvsd7" Sep 18 23:58:48.071364 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:48.071258 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tvsd7" podUID="4319f89f-3b39-4c12-8ca8-3e3cf20d5b84" Sep 18 23:58:49.071624 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:49.071587 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zcsgq" Sep 18 23:58:49.072071 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:49.071587 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhgxl" Sep 18 23:58:49.072071 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:49.071795 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhgxl" podUID="2fa576fe-0727-4d71-9477-d92c65eedf38" Sep 18 23:58:49.072071 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:49.071738 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zcsgq" podUID="3b5234a6-7648-434b-ab71-66239b3e1158" Sep 18 23:58:50.072503 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:50.072469 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tvsd7" Sep 18 23:58:50.072923 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:50.072602 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tvsd7" podUID="4319f89f-3b39-4c12-8ca8-3e3cf20d5b84" Sep 18 23:58:51.071668 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:51.071518 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zcsgq" Sep 18 23:58:51.071828 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:51.071575 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhgxl" Sep 18 23:58:51.071828 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:51.071773 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zcsgq" podUID="3b5234a6-7648-434b-ab71-66239b3e1158" Sep 18 23:58:51.071918 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:51.071882 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhgxl" podUID="2fa576fe-0727-4d71-9477-d92c65eedf38" Sep 18 23:58:51.272256 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:51.272225 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pz7c5" event={"ID":"8e7fd7f0-d5f2-4928-a6de-c7d241bd6b7c","Type":"ContainerStarted","Data":"eba53674e14c977b63dfe69a41ea9c408e4edde7b3cb514cc14017018686cbad"} Sep 18 23:58:51.274798 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:51.274779 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6j92q_558d514a-4560-4e46-96af-e19cb4d741f8/ovn-acl-logging/0.log" Sep 18 23:58:51.275131 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:51.275097 2579 generic.go:356] "Generic (PLEG): container finished" podID="558d514a-4560-4e46-96af-e19cb4d741f8" containerID="fac5ad5fb933e4ca78866cbc8a6a9bec5bf6403495438e8cef32824767d4422b" exitCode=1 Sep 18 23:58:51.275131 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:51.275128 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6j92q" event={"ID":"558d514a-4560-4e46-96af-e19cb4d741f8","Type":"ContainerStarted","Data":"e6f1ebca6d4b59ffa67338c6019aa95e7de12979ad04a02a4bdf1860e5982a48"} Sep 18 23:58:51.275319 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:51.275208 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6j92q" event={"ID":"558d514a-4560-4e46-96af-e19cb4d741f8","Type":"ContainerStarted","Data":"f54afa50f4382f3c437497af7e32d44b2534a18fe4cf3c878ad20176dc55d241"} Sep 18 23:58:51.275319 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:51.275258 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6j92q" event={"ID":"558d514a-4560-4e46-96af-e19cb4d741f8","Type":"ContainerStarted","Data":"080f8a97f15e0fd36cd82b0f0b1867256e8d5859312262576d2aa36ea06e9dc1"} Sep 18 23:58:51.275319 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:51.275308 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6j92q" event={"ID":"558d514a-4560-4e46-96af-e19cb4d741f8","Type":"ContainerDied","Data":"fac5ad5fb933e4ca78866cbc8a6a9bec5bf6403495438e8cef32824767d4422b"} Sep 18 23:58:51.275441 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:51.275353 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6j92q" event={"ID":"558d514a-4560-4e46-96af-e19cb4d741f8","Type":"ContainerStarted","Data":"bc0e9d65f0699f8f99210473c4fc673e9de345deb54ec13823ba6c4a1be80a5a"} Sep 18 23:58:51.276744 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:51.276719 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hb5v7" event={"ID":"70a2849d-3338-436b-9bdf-e136af4ae1b9","Type":"ContainerStarted","Data":"5628f188e9549159d0ab623f03b5a9a8289408db5213b214f9be5fa7b2653440"} Sep 18 23:58:51.278211 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:51.278192 2579 generic.go:356] "Generic (PLEG): container finished" podID="c366c450-b973-4a84-b562-b1970ebf743e" containerID="5a76b1db2fa7f152232e18c72db95fe460e03ea90afe833da0211cad222bcca8" exitCode=0 Sep 18 23:58:51.278304 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:51.278252 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-99rrr" event={"ID":"c366c450-b973-4a84-b562-b1970ebf743e","Type":"ContainerDied","Data":"5a76b1db2fa7f152232e18c72db95fe460e03ea90afe833da0211cad222bcca8"} Sep 18 23:58:51.279932 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:51.279905 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ndc7h" event={"ID":"2e265fcc-098a-4a75-88b3-9917741344ef","Type":"ContainerStarted","Data":"5d76ca4cc9a7e48e69627b752136f53155b3524f4213a2a83bbe68231db8c424"} Sep 18 23:58:51.281628 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:51.281578 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-c2k4w" event={"ID":"a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614","Type":"ContainerStarted","Data":"1c6068ce144e1522dfae9d861067f8daf9c8309c0a2f11440ee3f4330fc61711"} Sep 18 23:58:51.285090 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:51.285067 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n42dv" event={"ID":"63261a0e-67b8-40f6-99a7-5254c014c189","Type":"ContainerStarted","Data":"c7e8dc93157acdd569d66341c5f3f63ec38fe018e4e1562795e9ae94ad46c394"} Sep 18 23:58:51.286289 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:51.286265 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qlfrm" event={"ID":"cdff8643-b1e0-4122-8a03-906835642896","Type":"ContainerStarted","Data":"d624a7405f49d120beaa88c66f7b00dd759a39dca4ddedfda00400c97d43d865"} Sep 18 23:58:51.286863 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:51.286827 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-pz7c5" podStartSLOduration=3.999020534 podStartE2EDuration="21.28681358s" totalImagesPullingTime="17.287793046s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 23:58:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 23:58:51.286727169 +0000 UTC m=+23.262935667" watchObservedRunningTime="2026-09-18 23:58:51.28681358 +0000 UTC m=+23.263022050" Sep 18 23:58:51.286956 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:51.286893 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-53.ec2.internal" podStartSLOduration=20.286888882 podStartE2EDuration="20.286888882s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 23:58:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 23:58:35.254187968 +0000 UTC m=+7.230396438" watchObservedRunningTime="2026-09-18 23:58:51.286888882 +0000 UTC m=+23.263097387" Sep 18 23:58:51.314082 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:51.314039 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-ndc7h" podStartSLOduration=4.021297162 podStartE2EDuration="21.31402324s" totalImagesPullingTime="17.292726078s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 23:58:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 23:58:51.300858317 +0000 UTC m=+23.277066785" watchObservedRunningTime="2026-09-18 23:58:51.31402324 +0000 UTC m=+23.290231707" Sep 18 23:58:51.314219 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:51.314128 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-qlfrm" podStartSLOduration=4.032949992 podStartE2EDuration="21.314122737s" totalImagesPullingTime="17.281172745s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 23:58:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 23:58:51.313689353 +0000 UTC m=+23.289897831" watchObservedRunningTime="2026-09-18 23:58:51.314122737 +0000 UTC m=+23.290331205" Sep 18 23:58:51.330449 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:51.330408 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-c2k4w" podStartSLOduration=4.008390483 podStartE2EDuration="21.330394468s" totalImagesPullingTime="17.322003985s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 23:58:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 23:58:51.329816497 +0000 UTC m=+23.306024987" watchObservedRunningTime="2026-09-18 23:58:51.330394468 +0000 UTC m=+23.306602936" Sep 18 23:58:51.367783 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:51.367713 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-hb5v7" podStartSLOduration=4.176640213 podStartE2EDuration="21.367687996s" totalImagesPullingTime="17.191047783s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 23:58:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 23:58:51.366839679 +0000 UTC m=+23.343048358" watchObservedRunningTime="2026-09-18 23:58:51.367687996 +0000 UTC m=+23.343896466" Sep 18 23:58:52.071899 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:52.071621 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tvsd7" Sep 18 23:58:52.072080 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:52.072030 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tvsd7" podUID="4319f89f-3b39-4c12-8ca8-3e3cf20d5b84" Sep 18 23:58:52.291387 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:52.291353 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rkngj" event={"ID":"43d55fed-7cdc-4df4-b6c2-45eb0f9571bf","Type":"ContainerStarted","Data":"50930ffb18f4e3151fd064ce111fc92226392879ddf54309af535dd998ebd6c5"} Sep 18 23:58:52.293684 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:52.293660 2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 18 23:58:52.293684 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:52.293669 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n42dv" event={"ID":"63261a0e-67b8-40f6-99a7-5254c014c189","Type":"ContainerStarted","Data":"0aa9b40e1ba07949f85323687221fcc75e894e622eabb7dc0369a2329075be9a"} Sep 18 23:58:52.297149 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:52.297132 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6j92q_558d514a-4560-4e46-96af-e19cb4d741f8/ovn-acl-logging/0.log" Sep 18 23:58:52.297605 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:52.297585 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6j92q" event={"ID":"558d514a-4560-4e46-96af-e19cb4d741f8","Type":"ContainerStarted","Data":"e9e4d8dd78abf31bc538e22b2a19dd9630c6bc7849e7836a4c7398aae4748950"} Sep 18 23:58:52.305918 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:52.305881 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-rkngj" podStartSLOduration=5.109174839 podStartE2EDuration="22.305868119s" totalImagesPullingTime="17.19669328s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 23:58:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 23:58:52.305411107 +0000 UTC m=+24.281619593" watchObservedRunningTime="2026-09-18 23:58:52.305868119 +0000 UTC m=+24.282076586" Sep 18 23:58:53.007290 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:53.007176 2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-18T23:58:52.29368024Z","UUID":"a08490d7-e784-4f85-b776-d0f77265d15f","Handler":null,"Name":"","Endpoint":""} Sep 18 23:58:53.008882 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:53.008857 2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 18 23:58:53.009027 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:53.008897 2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 18 23:58:53.071419 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:53.071386 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zcsgq" Sep 18 23:58:53.071582 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:53.071504 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zcsgq" podUID="3b5234a6-7648-434b-ab71-66239b3e1158" Sep 18 23:58:53.071582 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:53.071560 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhgxl" Sep 18 23:58:53.071746 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:53.071723 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhgxl" podUID="2fa576fe-0727-4d71-9477-d92c65eedf38" Sep 18 23:58:54.070942 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:54.070911 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tvsd7" Sep 18 23:58:54.071336 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:54.071018 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tvsd7" podUID="4319f89f-3b39-4c12-8ca8-3e3cf20d5b84" Sep 18 23:58:54.304304 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:54.304273 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n42dv" event={"ID":"63261a0e-67b8-40f6-99a7-5254c014c189","Type":"ContainerStarted","Data":"0df5b64ca40c64f7973bbf1fdfd561b95dced852ec21e0762b568ddf65cad390"} Sep 18 23:58:54.308362 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:54.308334 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6j92q_558d514a-4560-4e46-96af-e19cb4d741f8/ovn-acl-logging/0.log" Sep 18 23:58:54.308790 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:54.308742 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6j92q" event={"ID":"558d514a-4560-4e46-96af-e19cb4d741f8","Type":"ContainerStarted","Data":"5d2ede018994572b034222dd5bd787f115af603ee74322e4284c70fdf89f481a"} Sep 18 23:58:54.320387 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:54.320343 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n42dv" podStartSLOduration=4.652492148 podStartE2EDuration="24.320326216s" totalImagesPullingTime="19.667834068s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 23:58:30 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 23:58:54.319958476 +0000 UTC m=+26.296166965" watchObservedRunningTime="2026-09-18 23:58:54.320326216 +0000 UTC m=+26.296534686" Sep 18 23:58:54.341156 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:54.341067 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-hb5v7" Sep 18 23:58:54.341769 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:54.341739 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-hb5v7" Sep 18 23:58:55.071622 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:55.071590 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zcsgq" Sep 18 23:58:55.072116 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:55.071728 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zcsgq" podUID="3b5234a6-7648-434b-ab71-66239b3e1158" Sep 18 23:58:55.072116 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:55.071827 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhgxl" Sep 18 23:58:55.072116 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:55.071941 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhgxl" podUID="2fa576fe-0727-4d71-9477-d92c65eedf38" Sep 18 23:58:55.311982 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:55.311932 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-hb5v7" Sep 18 23:58:55.312301 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:55.312285 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-hb5v7" Sep 18 23:58:56.071315 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:56.071137 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tvsd7" Sep 18 23:58:56.071462 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:56.071405 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tvsd7" podUID="4319f89f-3b39-4c12-8ca8-3e3cf20d5b84" Sep 18 23:58:56.314945 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:56.314865 2579 generic.go:356] "Generic (PLEG): container finished" podID="c366c450-b973-4a84-b562-b1970ebf743e" containerID="9182a2592910163ab3657f1d794005226e4ed16866ee1026c248fee4741ec810" exitCode=0 Sep 18 23:58:56.315639 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:56.314948 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-99rrr" event={"ID":"c366c450-b973-4a84-b562-b1970ebf743e","Type":"ContainerDied","Data":"9182a2592910163ab3657f1d794005226e4ed16866ee1026c248fee4741ec810"} Sep 18 23:58:56.320641 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:56.319033 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6j92q_558d514a-4560-4e46-96af-e19cb4d741f8/ovn-acl-logging/0.log" Sep 18 23:58:56.322083 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:56.322053 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6j92q" event={"ID":"558d514a-4560-4e46-96af-e19cb4d741f8","Type":"ContainerStarted","Data":"c2b5ebce35d630ab0456bb119666d0ed07b0a08791d97b95a04cc21865740827"} Sep 18 23:58:56.322532 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:56.322515 2579 scope.go:117] "RemoveContainer" containerID="fac5ad5fb933e4ca78866cbc8a6a9bec5bf6403495438e8cef32824767d4422b" Sep 18 23:58:57.071159 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:57.071121 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhgxl" Sep 18 23:58:57.071338 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:57.071120 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zcsgq" Sep 18 23:58:57.071338 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:57.071229 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhgxl" podUID="2fa576fe-0727-4d71-9477-d92c65eedf38" Sep 18 23:58:57.071338 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:57.071310 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zcsgq" podUID="3b5234a6-7648-434b-ab71-66239b3e1158" Sep 18 23:58:57.328920 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:57.328857 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6j92q_558d514a-4560-4e46-96af-e19cb4d741f8/ovn-acl-logging/0.log" Sep 18 23:58:57.329334 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:57.329278 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6j92q" event={"ID":"558d514a-4560-4e46-96af-e19cb4d741f8","Type":"ContainerStarted","Data":"55c497e9204b3c3271f2e7dc698a01745774b1057853ed3eb23ac9fcef33ef5b"} Sep 18 23:58:57.329783 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:57.329713 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6j92q" Sep 18 23:58:57.329861 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:57.329810 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6j92q" Sep 18 23:58:57.329914 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:57.329864 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6j92q" Sep 18 23:58:57.345911 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:57.345713 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6j92q" Sep 18 23:58:57.346323 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:57.346303 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6j92q" Sep 18 23:58:57.356156 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:57.356113 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-6j92q" podStartSLOduration=9.757116278 podStartE2EDuration="27.356098614s" totalImagesPullingTime="17.598982336s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 23:58:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 23:58:57.355333753 +0000 UTC m=+29.331542290" watchObservedRunningTime="2026-09-18 23:58:57.356098614 +0000 UTC m=+29.332307081" Sep 18 23:58:57.633673 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:57.633636 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tvsd7"] Sep 18 23:58:57.634299 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:57.633867 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tvsd7" Sep 18 23:58:57.634299 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:57.634028 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tvsd7" podUID="4319f89f-3b39-4c12-8ca8-3e3cf20d5b84" Sep 18 23:58:57.635846 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:57.635812 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zcsgq"] Sep 18 23:58:57.635958 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:57.635926 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zcsgq" Sep 18 23:58:57.636056 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:57.636033 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zcsgq" podUID="3b5234a6-7648-434b-ab71-66239b3e1158" Sep 18 23:58:57.636369 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:57.636351 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dhgxl"] Sep 18 23:58:57.636434 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:57.636425 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhgxl" Sep 18 23:58:57.636509 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:57.636492 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhgxl" podUID="2fa576fe-0727-4d71-9477-d92c65eedf38" Sep 18 23:58:58.333312 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:58.333279 2579 generic.go:356] "Generic (PLEG): container finished" podID="c366c450-b973-4a84-b562-b1970ebf743e" containerID="8494b8d49bd08d08c34bb3d7ebd3278f680f68f97d864210b147c3df320d9a87" exitCode=0 Sep 18 23:58:58.333747 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:58.333360 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-99rrr" event={"ID":"c366c450-b973-4a84-b562-b1970ebf743e","Type":"ContainerDied","Data":"8494b8d49bd08d08c34bb3d7ebd3278f680f68f97d864210b147c3df320d9a87"} Sep 18 23:58:59.071132 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:59.071097 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zcsgq" Sep 18 23:58:59.071323 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:59.071220 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zcsgq" podUID="3b5234a6-7648-434b-ab71-66239b3e1158" Sep 18 23:58:59.071323 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:58:59.071271 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tvsd7" Sep 18 23:58:59.071442 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:58:59.071362 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tvsd7" podUID="4319f89f-3b39-4c12-8ca8-3e3cf20d5b84" Sep 18 23:59:00.074039 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:00.072961 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhgxl" Sep 18 23:59:00.074039 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:59:00.073772 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhgxl" podUID="2fa576fe-0727-4d71-9477-d92c65eedf38" Sep 18 23:59:00.341216 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:00.341132 2579 generic.go:356] "Generic (PLEG): container finished" podID="c366c450-b973-4a84-b562-b1970ebf743e" containerID="791268e8442240f5dc1f7278e47ce7313f861d52647517e41886cb229d8ecd96" exitCode=0 Sep 18 23:59:00.341216 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:00.341180 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-99rrr" event={"ID":"c366c450-b973-4a84-b562-b1970ebf743e","Type":"ContainerDied","Data":"791268e8442240f5dc1f7278e47ce7313f861d52647517e41886cb229d8ecd96"} Sep 18 23:59:01.071191 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:01.071158 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zcsgq" Sep 18 23:59:01.071385 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:01.071158 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tvsd7" Sep 18 23:59:01.071385 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:59:01.071290 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zcsgq" podUID="3b5234a6-7648-434b-ab71-66239b3e1158" Sep 18 23:59:01.071385 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:59:01.071376 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tvsd7" podUID="4319f89f-3b39-4c12-8ca8-3e3cf20d5b84" Sep 18 23:59:02.071331 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:02.071302 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhgxl" Sep 18 23:59:02.071824 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:59:02.071424 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhgxl" podUID="2fa576fe-0727-4d71-9477-d92c65eedf38" Sep 18 23:59:03.071649 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:03.071609 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zcsgq" Sep 18 23:59:03.072151 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:03.071616 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tvsd7" Sep 18 23:59:03.072151 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:59:03.071769 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zcsgq" podUID="3b5234a6-7648-434b-ab71-66239b3e1158" Sep 18 23:59:03.072151 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:59:03.071857 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tvsd7" podUID="4319f89f-3b39-4c12-8ca8-3e3cf20d5b84" Sep 18 23:59:03.678413 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:03.678380 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hfnt\" (UniqueName: \"kubernetes.io/projected/3b5234a6-7648-434b-ab71-66239b3e1158-kube-api-access-9hfnt\") pod \"network-check-target-zcsgq\" (UID: \"3b5234a6-7648-434b-ab71-66239b3e1158\") " pod="openshift-network-diagnostics/network-check-target-zcsgq" Sep 18 23:59:03.678617 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:03.678435 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4319f89f-3b39-4c12-8ca8-3e3cf20d5b84-metrics-certs\") pod \"network-metrics-daemon-tvsd7\" (UID: \"4319f89f-3b39-4c12-8ca8-3e3cf20d5b84\") " pod="openshift-multus/network-metrics-daemon-tvsd7" Sep 18 23:59:03.678617 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:59:03.678543 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 23:59:03.678617 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:59:03.678572 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 23:59:03.678617 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:59:03.678578 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 23:59:03.678805 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:59:03.678652 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4319f89f-3b39-4c12-8ca8-3e3cf20d5b84-metrics-certs podName:4319f89f-3b39-4c12-8ca8-3e3cf20d5b84 nodeName:}" failed. No retries permitted until 2026-09-18 23:59:35.678636706 +0000 UTC m=+67.654845152 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4319f89f-3b39-4c12-8ca8-3e3cf20d5b84-metrics-certs") pod "network-metrics-daemon-tvsd7" (UID: "4319f89f-3b39-4c12-8ca8-3e3cf20d5b84") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 23:59:03.678805 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:59:03.678585 2579 projected.go:196] Error preparing data for projected volume kube-api-access-9hfnt for pod openshift-network-diagnostics/network-check-target-zcsgq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 23:59:03.678805 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:59:03.678742 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3b5234a6-7648-434b-ab71-66239b3e1158-kube-api-access-9hfnt podName:3b5234a6-7648-434b-ab71-66239b3e1158 nodeName:}" failed. No retries permitted until 2026-09-18 23:59:35.678729676 +0000 UTC m=+67.654938137 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-9hfnt" (UniqueName: "kubernetes.io/projected/3b5234a6-7648-434b-ab71-66239b3e1158-kube-api-access-9hfnt") pod "network-check-target-zcsgq" (UID: "3b5234a6-7648-434b-ab71-66239b3e1158") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 23:59:03.779652 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:03.779619 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2fa576fe-0727-4d71-9477-d92c65eedf38-original-pull-secret\") pod \"global-pull-secret-syncer-dhgxl\" (UID: \"2fa576fe-0727-4d71-9477-d92c65eedf38\") " pod="kube-system/global-pull-secret-syncer-dhgxl" Sep 18 23:59:03.779838 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:59:03.779767 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 23:59:03.779838 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:59:03.779827 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fa576fe-0727-4d71-9477-d92c65eedf38-original-pull-secret podName:2fa576fe-0727-4d71-9477-d92c65eedf38 nodeName:}" failed. No retries permitted until 2026-09-18 23:59:35.779811047 +0000 UTC m=+67.756019493 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2fa576fe-0727-4d71-9477-d92c65eedf38-original-pull-secret") pod "global-pull-secret-syncer-dhgxl" (UID: "2fa576fe-0727-4d71-9477-d92c65eedf38") : object "kube-system"/"original-pull-secret" not registered Sep 18 23:59:03.966420 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:03.966344 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pz7c5_8e7fd7f0-d5f2-4928-a6de-c7d241bd6b7c/dns-node-resolver/0.log" Sep 18 23:59:04.071389 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:04.071356 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhgxl" Sep 18 23:59:04.071567 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:59:04.071486 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhgxl" podUID="2fa576fe-0727-4d71-9477-d92c65eedf38" Sep 18 23:59:04.328772 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:04.328728 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-53.ec2.internal" event="NodeReady" Sep 18 23:59:04.329146 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:04.328863 2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 18 23:59:04.369523 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:04.369490 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-rvv44"] Sep 18 23:59:04.379281 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:04.379252 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-vpjpz"] Sep 18 23:59:04.379439 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:04.379374 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rvv44" Sep 18 23:59:04.381410 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:04.381379 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 18 23:59:04.381652 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:04.381634 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 18 23:59:04.381747 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:04.381634 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ljxt7\"" Sep 18 23:59:04.391982 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:04.391957 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rvv44"] Sep 18 23:59:04.391982 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:04.391989 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vpjpz"] Sep 18 23:59:04.392168 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:04.392063 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vpjpz" Sep 18 23:59:04.392168 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:04.392087 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-gw8q6"] Sep 18 23:59:04.394058 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:04.394038 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 18 23:59:04.394259 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:04.394238 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 18 23:59:04.394351 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:04.394260 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 18 23:59:04.394351 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:04.394268 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2jsqb\"" Sep 18 23:59:04.394430 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:04.394363 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 18 23:59:04.404171 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:04.404150 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gw8q6"] Sep 18 23:59:04.404279 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:04.404256 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gw8q6" Sep 18 23:59:04.406397 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:04.406379 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 18 23:59:04.406494 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:04.406439 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-kfzh4\"" Sep 18 23:59:04.406683 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:04.406668 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 18 23:59:04.406833 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:04.406818 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 18 23:59:04.484482 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:04.484451 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e0a7fd40-c030-4559-981d-cb21383efcd4-tmp-dir\") pod \"dns-default-rvv44\" (UID: \"e0a7fd40-c030-4559-981d-cb21383efcd4\") " pod="openshift-dns/dns-default-rvv44" Sep 18 23:59:04.484482 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:04.484493 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkktl\" (UniqueName: \"kubernetes.io/projected/e0a7fd40-c030-4559-981d-cb21383efcd4-kube-api-access-xkktl\") pod \"dns-default-rvv44\" (UID: \"e0a7fd40-c030-4559-981d-cb21383efcd4\") " pod="openshift-dns/dns-default-rvv44" Sep 18 23:59:04.484694 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:04.484512 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4bx6\" (UniqueName: \"kubernetes.io/projected/7d3f64f3-edc0-472e-9e12-4980ef2d9a26-kube-api-access-b4bx6\") pod \"ingress-canary-gw8q6\" (UID: \"7d3f64f3-edc0-472e-9e12-4980ef2d9a26\") " pod="openshift-ingress-canary/ingress-canary-gw8q6" Sep 18 23:59:04.484694 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:04.484529 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fafc2259-0ac4-460d-a796-9e1d5c4f0f15-crio-socket\") pod \"insights-runtime-extractor-vpjpz\" (UID: \"fafc2259-0ac4-460d-a796-9e1d5c4f0f15\") " pod="openshift-insights/insights-runtime-extractor-vpjpz" Sep 18 23:59:04.484694 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:04.484548 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fafc2259-0ac4-460d-a796-9e1d5c4f0f15-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vpjpz\" (UID: \"fafc2259-0ac4-460d-a796-9e1d5c4f0f15\") " pod="openshift-insights/insights-runtime-extractor-vpjpz" Sep 18 23:59:04.484694 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:04.484607 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fafc2259-0ac4-460d-a796-9e1d5c4f0f15-data-volume\") pod \"insights-runtime-extractor-vpjpz\" (UID: \"fafc2259-0ac4-460d-a796-9e1d5c4f0f15\") " pod="openshift-insights/insights-runtime-extractor-vpjpz" Sep 18 23:59:04.484694 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:04.484668 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e0a7fd40-c030-4559-981d-cb21383efcd4-metrics-tls\") pod \"dns-default-rvv44\" (UID: \"e0a7fd40-c030-4559-981d-cb21383efcd4\") " pod="openshift-dns/dns-default-rvv44" Sep 18 23:59:04.484694 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:04.484685 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdm62\" (UniqueName: \"kubernetes.io/projected/fafc2259-0ac4-460d-a796-9e1d5c4f0f15-kube-api-access-sdm62\") pod \"insights-runtime-extractor-vpjpz\" (UID: \"fafc2259-0ac4-460d-a796-9e1d5c4f0f15\") " pod="openshift-insights/insights-runtime-extractor-vpjpz" Sep 18 23:59:04.484990 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:04.484701 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e0a7fd40-c030-4559-981d-cb21383efcd4-config-volume\") pod \"dns-default-rvv44\" (UID: \"e0a7fd40-c030-4559-981d-cb21383efcd4\") " pod="openshift-dns/dns-default-rvv44" Sep 18 23:59:04.484990 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:04.484716 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fafc2259-0ac4-460d-a796-9e1d5c4f0f15-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vpjpz\" (UID: \"fafc2259-0ac4-460d-a796-9e1d5c4f0f15\") " pod="openshift-insights/insights-runtime-extractor-vpjpz" Sep 18 23:59:04.484990 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:04.484728 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d3f64f3-edc0-472e-9e12-4980ef2d9a26-cert\") pod \"ingress-canary-gw8q6\" (UID: \"7d3f64f3-edc0-472e-9e12-4980ef2d9a26\") " pod="openshift-ingress-canary/ingress-canary-gw8q6" Sep 18 23:59:04.585887 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:04.585809 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkktl\" (UniqueName: \"kubernetes.io/projected/e0a7fd40-c030-4559-981d-cb21383efcd4-kube-api-access-xkktl\") pod \"dns-default-rvv44\" (UID: \"e0a7fd40-c030-4559-981d-cb21383efcd4\") " pod="openshift-dns/dns-default-rvv44" Sep 18 23:59:04.585887 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:04.585845 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4bx6\" (UniqueName: \"kubernetes.io/projected/7d3f64f3-edc0-472e-9e12-4980ef2d9a26-kube-api-access-b4bx6\") pod \"ingress-canary-gw8q6\" (UID: \"7d3f64f3-edc0-472e-9e12-4980ef2d9a26\") " pod="openshift-ingress-canary/ingress-canary-gw8q6" Sep 18 23:59:04.585887 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:04.585864 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fafc2259-0ac4-460d-a796-9e1d5c4f0f15-crio-socket\") pod \"insights-runtime-extractor-vpjpz\" (UID: \"fafc2259-0ac4-460d-a796-9e1d5c4f0f15\") " pod="openshift-insights/insights-runtime-extractor-vpjpz" Sep 18 23:59:04.585887 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:04.585885 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fafc2259-0ac4-460d-a796-9e1d5c4f0f15-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vpjpz\" (UID: \"fafc2259-0ac4-460d-a796-9e1d5c4f0f15\") " pod="openshift-insights/insights-runtime-extractor-vpjpz" Sep 18 23:59:04.586199 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:04.585905 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fafc2259-0ac4-460d-a796-9e1d5c4f0f15-data-volume\") pod \"insights-runtime-extractor-vpjpz\" (UID: \"fafc2259-0ac4-460d-a796-9e1d5c4f0f15\") " pod="openshift-insights/insights-runtime-extractor-vpjpz" Sep 18 23:59:04.586199 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:59:04.585997 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 23:59:04.586199 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:04.586015 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e0a7fd40-c030-4559-981d-cb21383efcd4-metrics-tls\") pod \"dns-default-rvv44\" (UID: \"e0a7fd40-c030-4559-981d-cb21383efcd4\") " pod="openshift-dns/dns-default-rvv44" Sep 18 23:59:04.586199 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:59:04.586081 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fafc2259-0ac4-460d-a796-9e1d5c4f0f15-insights-runtime-extractor-tls podName:fafc2259-0ac4-460d-a796-9e1d5c4f0f15 nodeName:}" failed. No retries permitted until 2026-09-18 23:59:05.086059686 +0000 UTC m=+37.062268132 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fafc2259-0ac4-460d-a796-9e1d5c4f0f15-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vpjpz" (UID: "fafc2259-0ac4-460d-a796-9e1d5c4f0f15") : secret "insights-runtime-extractor-tls" not found Sep 18 23:59:04.586199 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:04.586092 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fafc2259-0ac4-460d-a796-9e1d5c4f0f15-crio-socket\") pod \"insights-runtime-extractor-vpjpz\" (UID: \"fafc2259-0ac4-460d-a796-9e1d5c4f0f15\") " pod="openshift-insights/insights-runtime-extractor-vpjpz" Sep 18 23:59:04.586199 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:59:04.586107 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 23:59:04.586199 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:59:04.586153 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0a7fd40-c030-4559-981d-cb21383efcd4-metrics-tls podName:e0a7fd40-c030-4559-981d-cb21383efcd4 nodeName:}" failed. No retries permitted until 2026-09-18 23:59:05.086137273 +0000 UTC m=+37.062345753 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e0a7fd40-c030-4559-981d-cb21383efcd4-metrics-tls") pod "dns-default-rvv44" (UID: "e0a7fd40-c030-4559-981d-cb21383efcd4") : secret "dns-default-metrics-tls" not found Sep 18 23:59:04.586564 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:04.586213 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fafc2259-0ac4-460d-a796-9e1d5c4f0f15-data-volume\") pod \"insights-runtime-extractor-vpjpz\" (UID: \"fafc2259-0ac4-460d-a796-9e1d5c4f0f15\") " pod="openshift-insights/insights-runtime-extractor-vpjpz" Sep 18 23:59:04.586564 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:04.586234 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdm62\" (UniqueName: \"kubernetes.io/projected/fafc2259-0ac4-460d-a796-9e1d5c4f0f15-kube-api-access-sdm62\") pod \"insights-runtime-extractor-vpjpz\" (UID: \"fafc2259-0ac4-460d-a796-9e1d5c4f0f15\") " pod="openshift-insights/insights-runtime-extractor-vpjpz" Sep 18 23:59:04.586564 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:04.586271 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e0a7fd40-c030-4559-981d-cb21383efcd4-config-volume\") pod \"dns-default-rvv44\" (UID: \"e0a7fd40-c030-4559-981d-cb21383efcd4\") " pod="openshift-dns/dns-default-rvv44" Sep 18 23:59:04.586564 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:04.586297 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fafc2259-0ac4-460d-a796-9e1d5c4f0f15-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vpjpz\" (UID: \"fafc2259-0ac4-460d-a796-9e1d5c4f0f15\") " pod="openshift-insights/insights-runtime-extractor-vpjpz" Sep 18 23:59:04.586564 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:04.586321 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d3f64f3-edc0-472e-9e12-4980ef2d9a26-cert\") pod \"ingress-canary-gw8q6\" (UID: \"7d3f64f3-edc0-472e-9e12-4980ef2d9a26\") " pod="openshift-ingress-canary/ingress-canary-gw8q6" Sep 18 23:59:04.586564 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:04.586372 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e0a7fd40-c030-4559-981d-cb21383efcd4-tmp-dir\") pod \"dns-default-rvv44\" (UID: \"e0a7fd40-c030-4559-981d-cb21383efcd4\") " pod="openshift-dns/dns-default-rvv44" Sep 18 23:59:04.586564 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:59:04.586435 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 23:59:04.586564 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:59:04.586479 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fafc2259-0ac4-460d-a796-9e1d5c4f0f15-kube-rbac-proxy-cm podName:fafc2259-0ac4-460d-a796-9e1d5c4f0f15 nodeName:}" failed. No retries permitted until 2026-09-18 23:59:05.086465549 +0000 UTC m=+37.062673995 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fafc2259-0ac4-460d-a796-9e1d5c4f0f15-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vpjpz" (UID: "fafc2259-0ac4-460d-a796-9e1d5c4f0f15") : configmap "kube-rbac-proxy" not found Sep 18 23:59:04.586964 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:04.586684 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e0a7fd40-c030-4559-981d-cb21383efcd4-tmp-dir\") pod \"dns-default-rvv44\" (UID: \"e0a7fd40-c030-4559-981d-cb21383efcd4\") " pod="openshift-dns/dns-default-rvv44" Sep 18 23:59:04.586964 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:04.586905 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e0a7fd40-c030-4559-981d-cb21383efcd4-config-volume\") pod \"dns-default-rvv44\" (UID: \"e0a7fd40-c030-4559-981d-cb21383efcd4\") " pod="openshift-dns/dns-default-rvv44" Sep 18 23:59:04.590631 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:04.590496 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d3f64f3-edc0-472e-9e12-4980ef2d9a26-cert\") pod \"ingress-canary-gw8q6\" (UID: \"7d3f64f3-edc0-472e-9e12-4980ef2d9a26\") " pod="openshift-ingress-canary/ingress-canary-gw8q6" Sep 18 23:59:04.594556 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:04.594510 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkktl\" (UniqueName: \"kubernetes.io/projected/e0a7fd40-c030-4559-981d-cb21383efcd4-kube-api-access-xkktl\") pod \"dns-default-rvv44\" (UID: \"e0a7fd40-c030-4559-981d-cb21383efcd4\") " pod="openshift-dns/dns-default-rvv44" Sep 18 23:59:04.594657 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:04.594563 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdm62\" (UniqueName: \"kubernetes.io/projected/fafc2259-0ac4-460d-a796-9e1d5c4f0f15-kube-api-access-sdm62\") pod \"insights-runtime-extractor-vpjpz\" (UID: \"fafc2259-0ac4-460d-a796-9e1d5c4f0f15\") " pod="openshift-insights/insights-runtime-extractor-vpjpz" Sep 18 23:59:04.594657 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:04.594587 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4bx6\" (UniqueName: \"kubernetes.io/projected/7d3f64f3-edc0-472e-9e12-4980ef2d9a26-kube-api-access-b4bx6\") pod \"ingress-canary-gw8q6\" (UID: \"7d3f64f3-edc0-472e-9e12-4980ef2d9a26\") " pod="openshift-ingress-canary/ingress-canary-gw8q6" Sep 18 23:59:04.712709 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:04.712683 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gw8q6" Sep 18 23:59:05.057612 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:05.057580 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gw8q6"] Sep 18 23:59:05.060739 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:59:05.060709 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d3f64f3_edc0_472e_9e12_4980ef2d9a26.slice/crio-f0e251e8ae340cd655a0bb0186b10da032454964ca1b925c9ecaca7effcd1ddb WatchSource:0}: Error finding container f0e251e8ae340cd655a0bb0186b10da032454964ca1b925c9ecaca7effcd1ddb: Status 404 returned error can't find the container with id f0e251e8ae340cd655a0bb0186b10da032454964ca1b925c9ecaca7effcd1ddb Sep 18 23:59:05.071179 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:05.071156 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tvsd7" Sep 18 23:59:05.071338 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:05.071315 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zcsgq" Sep 18 23:59:05.073528 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:05.073505 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 18 23:59:05.073620 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:05.073542 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ggrtp\"" Sep 18 23:59:05.073620 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:05.073506 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 18 23:59:05.073866 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:05.073849 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 18 23:59:05.073959 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:05.073877 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jgg6h\"" Sep 18 23:59:05.089703 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:05.089633 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fafc2259-0ac4-460d-a796-9e1d5c4f0f15-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vpjpz\" (UID: \"fafc2259-0ac4-460d-a796-9e1d5c4f0f15\") " pod="openshift-insights/insights-runtime-extractor-vpjpz" Sep 18 23:59:05.089828 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:05.089715 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e0a7fd40-c030-4559-981d-cb21383efcd4-metrics-tls\") pod \"dns-default-rvv44\" (UID: \"e0a7fd40-c030-4559-981d-cb21383efcd4\") " pod="openshift-dns/dns-default-rvv44" Sep 18 23:59:05.089828 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:05.089747 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fafc2259-0ac4-460d-a796-9e1d5c4f0f15-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vpjpz\" (UID: \"fafc2259-0ac4-460d-a796-9e1d5c4f0f15\") " pod="openshift-insights/insights-runtime-extractor-vpjpz" Sep 18 23:59:05.089910 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:59:05.089830 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 23:59:05.089910 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:59:05.089882 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 23:59:05.089910 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:59:05.089890 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fafc2259-0ac4-460d-a796-9e1d5c4f0f15-insights-runtime-extractor-tls podName:fafc2259-0ac4-460d-a796-9e1d5c4f0f15 nodeName:}" failed. No retries permitted until 2026-09-18 23:59:06.089874991 +0000 UTC m=+38.066083442 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fafc2259-0ac4-460d-a796-9e1d5c4f0f15-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vpjpz" (UID: "fafc2259-0ac4-460d-a796-9e1d5c4f0f15") : secret "insights-runtime-extractor-tls" not found Sep 18 23:59:05.089910 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:59:05.089830 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 23:59:05.090045 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:59:05.089926 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fafc2259-0ac4-460d-a796-9e1d5c4f0f15-kube-rbac-proxy-cm podName:fafc2259-0ac4-460d-a796-9e1d5c4f0f15 nodeName:}" failed. No retries permitted until 2026-09-18 23:59:06.089914781 +0000 UTC m=+38.066123227 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fafc2259-0ac4-460d-a796-9e1d5c4f0f15-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vpjpz" (UID: "fafc2259-0ac4-460d-a796-9e1d5c4f0f15") : configmap "kube-rbac-proxy" not found Sep 18 23:59:05.090045 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:59:05.089940 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0a7fd40-c030-4559-981d-cb21383efcd4-metrics-tls podName:e0a7fd40-c030-4559-981d-cb21383efcd4 nodeName:}" failed. No retries permitted until 2026-09-18 23:59:06.089934186 +0000 UTC m=+38.066142632 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e0a7fd40-c030-4559-981d-cb21383efcd4-metrics-tls") pod "dns-default-rvv44" (UID: "e0a7fd40-c030-4559-981d-cb21383efcd4") : secret "dns-default-metrics-tls" not found Sep 18 23:59:05.129857 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:05.129834 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qlfrm_cdff8643-b1e0-4122-8a03-906835642896/node-ca/0.log" Sep 18 23:59:05.355740 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:05.355648 2579 generic.go:356] "Generic (PLEG): container finished" podID="c366c450-b973-4a84-b562-b1970ebf743e" containerID="cf2dd19aaeaf1b11a00c87ad8d0553df88cb8dd863dd16aa1c701cd15dbe083e" exitCode=0 Sep 18 23:59:05.356567 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:05.355741 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-99rrr" event={"ID":"c366c450-b973-4a84-b562-b1970ebf743e","Type":"ContainerDied","Data":"cf2dd19aaeaf1b11a00c87ad8d0553df88cb8dd863dd16aa1c701cd15dbe083e"} Sep 18 23:59:05.356983 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:05.356964 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gw8q6" event={"ID":"7d3f64f3-edc0-472e-9e12-4980ef2d9a26","Type":"ContainerStarted","Data":"f0e251e8ae340cd655a0bb0186b10da032454964ca1b925c9ecaca7effcd1ddb"} Sep 18 23:59:06.071954 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:06.071920 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhgxl" Sep 18 23:59:06.074545 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:06.074514 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 18 23:59:06.099274 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:06.099244 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fafc2259-0ac4-460d-a796-9e1d5c4f0f15-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vpjpz\" (UID: \"fafc2259-0ac4-460d-a796-9e1d5c4f0f15\") " pod="openshift-insights/insights-runtime-extractor-vpjpz" Sep 18 23:59:06.099437 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:06.099309 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e0a7fd40-c030-4559-981d-cb21383efcd4-metrics-tls\") pod \"dns-default-rvv44\" (UID: \"e0a7fd40-c030-4559-981d-cb21383efcd4\") " pod="openshift-dns/dns-default-rvv44" Sep 18 23:59:06.099437 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:06.099340 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fafc2259-0ac4-460d-a796-9e1d5c4f0f15-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vpjpz\" (UID: \"fafc2259-0ac4-460d-a796-9e1d5c4f0f15\") " pod="openshift-insights/insights-runtime-extractor-vpjpz" Sep 18 23:59:06.099437 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:59:06.099397 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 23:59:06.099437 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:59:06.099419 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 23:59:06.099609 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:59:06.099449 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 23:59:06.099609 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:59:06.099470 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fafc2259-0ac4-460d-a796-9e1d5c4f0f15-insights-runtime-extractor-tls podName:fafc2259-0ac4-460d-a796-9e1d5c4f0f15 nodeName:}" failed. No retries permitted until 2026-09-18 23:59:08.099450138 +0000 UTC m=+40.075658608 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fafc2259-0ac4-460d-a796-9e1d5c4f0f15-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vpjpz" (UID: "fafc2259-0ac4-460d-a796-9e1d5c4f0f15") : secret "insights-runtime-extractor-tls" not found Sep 18 23:59:06.099609 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:59:06.099491 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fafc2259-0ac4-460d-a796-9e1d5c4f0f15-kube-rbac-proxy-cm podName:fafc2259-0ac4-460d-a796-9e1d5c4f0f15 nodeName:}" failed. No retries permitted until 2026-09-18 23:59:08.099480879 +0000 UTC m=+40.075689330 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fafc2259-0ac4-460d-a796-9e1d5c4f0f15-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vpjpz" (UID: "fafc2259-0ac4-460d-a796-9e1d5c4f0f15") : configmap "kube-rbac-proxy" not found Sep 18 23:59:06.099609 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:59:06.099506 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0a7fd40-c030-4559-981d-cb21383efcd4-metrics-tls podName:e0a7fd40-c030-4559-981d-cb21383efcd4 nodeName:}" failed. No retries permitted until 2026-09-18 23:59:08.0994978 +0000 UTC m=+40.075706248 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e0a7fd40-c030-4559-981d-cb21383efcd4-metrics-tls") pod "dns-default-rvv44" (UID: "e0a7fd40-c030-4559-981d-cb21383efcd4") : secret "dns-default-metrics-tls" not found Sep 18 23:59:06.363280 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:06.363192 2579 generic.go:356] "Generic (PLEG): container finished" podID="c366c450-b973-4a84-b562-b1970ebf743e" containerID="76e31e7e955f621f1c2b0b98a379991e3ce7710f57790068d394200c757dbacb" exitCode=0 Sep 18 23:59:06.363280 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:06.363247 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-99rrr" event={"ID":"c366c450-b973-4a84-b562-b1970ebf743e","Type":"ContainerDied","Data":"76e31e7e955f621f1c2b0b98a379991e3ce7710f57790068d394200c757dbacb"} Sep 18 23:59:06.641272 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:06.641238 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-ptdm2"] Sep 18 23:59:06.645107 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:06.645083 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-55f6fc7b86-ptdm2" Sep 18 23:59:06.648045 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:06.648021 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Sep 18 23:59:06.648484 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:06.648451 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Sep 18 23:59:06.648802 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:06.648779 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-k74jr\"" Sep 18 23:59:06.649108 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:06.649090 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Sep 18 23:59:06.649108 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:06.649106 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Sep 18 23:59:06.663767 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:06.663715 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-ptdm2"] Sep 18 23:59:06.805806 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:06.805525 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9a202402-e74b-489b-809e-01d6ed8d4782-signing-key\") pod \"service-ca-55f6fc7b86-ptdm2\" (UID: \"9a202402-e74b-489b-809e-01d6ed8d4782\") " pod="openshift-service-ca/service-ca-55f6fc7b86-ptdm2" Sep 18 23:59:06.805970 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:06.805856 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9a202402-e74b-489b-809e-01d6ed8d4782-signing-cabundle\") pod \"service-ca-55f6fc7b86-ptdm2\" (UID: \"9a202402-e74b-489b-809e-01d6ed8d4782\") " pod="openshift-service-ca/service-ca-55f6fc7b86-ptdm2" Sep 18 23:59:06.805970 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:06.805890 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mt6gg\" (UniqueName: \"kubernetes.io/projected/9a202402-e74b-489b-809e-01d6ed8d4782-kube-api-access-mt6gg\") pod \"service-ca-55f6fc7b86-ptdm2\" (UID: \"9a202402-e74b-489b-809e-01d6ed8d4782\") " pod="openshift-service-ca/service-ca-55f6fc7b86-ptdm2" Sep 18 23:59:06.907516 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:06.907429 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9a202402-e74b-489b-809e-01d6ed8d4782-signing-key\") pod \"service-ca-55f6fc7b86-ptdm2\" (UID: \"9a202402-e74b-489b-809e-01d6ed8d4782\") " pod="openshift-service-ca/service-ca-55f6fc7b86-ptdm2" Sep 18 23:59:06.907516 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:06.907476 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9a202402-e74b-489b-809e-01d6ed8d4782-signing-cabundle\") pod \"service-ca-55f6fc7b86-ptdm2\" (UID: \"9a202402-e74b-489b-809e-01d6ed8d4782\") " pod="openshift-service-ca/service-ca-55f6fc7b86-ptdm2" Sep 18 23:59:06.907516 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:06.907509 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mt6gg\" (UniqueName: \"kubernetes.io/projected/9a202402-e74b-489b-809e-01d6ed8d4782-kube-api-access-mt6gg\") pod \"service-ca-55f6fc7b86-ptdm2\" (UID: \"9a202402-e74b-489b-809e-01d6ed8d4782\") " pod="openshift-service-ca/service-ca-55f6fc7b86-ptdm2" Sep 18 23:59:06.908302 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:06.908270 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9a202402-e74b-489b-809e-01d6ed8d4782-signing-cabundle\") pod \"service-ca-55f6fc7b86-ptdm2\" (UID: \"9a202402-e74b-489b-809e-01d6ed8d4782\") " pod="openshift-service-ca/service-ca-55f6fc7b86-ptdm2" Sep 18 23:59:06.910931 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:06.910905 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9a202402-e74b-489b-809e-01d6ed8d4782-signing-key\") pod \"service-ca-55f6fc7b86-ptdm2\" (UID: \"9a202402-e74b-489b-809e-01d6ed8d4782\") " pod="openshift-service-ca/service-ca-55f6fc7b86-ptdm2" Sep 18 23:59:06.916058 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:06.916022 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mt6gg\" (UniqueName: \"kubernetes.io/projected/9a202402-e74b-489b-809e-01d6ed8d4782-kube-api-access-mt6gg\") pod \"service-ca-55f6fc7b86-ptdm2\" (UID: \"9a202402-e74b-489b-809e-01d6ed8d4782\") " pod="openshift-service-ca/service-ca-55f6fc7b86-ptdm2" Sep 18 23:59:06.955098 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:06.955064 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-55f6fc7b86-ptdm2" Sep 18 23:59:07.292971 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:07.292939 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-ptdm2"] Sep 18 23:59:07.369661 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:07.369620 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-99rrr" event={"ID":"c366c450-b973-4a84-b562-b1970ebf743e","Type":"ContainerStarted","Data":"6cf1a04118f88ec1f75e53ff0ee6b963ce180f8ea82ad224c8876656e1ef2f49"} Sep 18 23:59:07.371166 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:07.371139 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gw8q6" event={"ID":"7d3f64f3-edc0-472e-9e12-4980ef2d9a26","Type":"ContainerStarted","Data":"d934a4c52a5f5e1c7ba3774ba72adf7b1800f40e9f8b6171c0e0768fde02c9b1"} Sep 18 23:59:07.372201 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:07.372183 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-55f6fc7b86-ptdm2" event={"ID":"9a202402-e74b-489b-809e-01d6ed8d4782","Type":"ContainerStarted","Data":"147873852acb0f5f8c7dde19afc96a92dbe8d2e2756a83908d28555b4eb92bbf"} Sep 18 23:59:07.391228 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:07.391182 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-99rrr" podStartSLOduration=9.118360907 podStartE2EDuration="37.391168929s" totalImagesPullingTime="28.272808022s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 23:58:30 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 23:59:07.390691313 +0000 UTC m=+39.366899793" watchObservedRunningTime="2026-09-18 23:59:07.391168929 +0000 UTC m=+39.367377397" Sep 18 23:59:07.406626 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:07.406575 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-gw8q6" podStartSLOduration=1.385280405 podStartE2EDuration="3.40656022s" totalImagesPullingTime="2.021279815s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 23:59:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 23:59:07.405873844 +0000 UTC m=+39.382082325" watchObservedRunningTime="2026-09-18 23:59:07.40656022 +0000 UTC m=+39.382768732" Sep 18 23:59:08.120537 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:08.120285 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e0a7fd40-c030-4559-981d-cb21383efcd4-metrics-tls\") pod \"dns-default-rvv44\" (UID: \"e0a7fd40-c030-4559-981d-cb21383efcd4\") " pod="openshift-dns/dns-default-rvv44" Sep 18 23:59:08.120537 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:08.120517 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fafc2259-0ac4-460d-a796-9e1d5c4f0f15-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vpjpz\" (UID: \"fafc2259-0ac4-460d-a796-9e1d5c4f0f15\") " pod="openshift-insights/insights-runtime-extractor-vpjpz" Sep 18 23:59:08.120727 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:59:08.120448 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 23:59:08.120727 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:08.120611 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fafc2259-0ac4-460d-a796-9e1d5c4f0f15-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vpjpz\" (UID: \"fafc2259-0ac4-460d-a796-9e1d5c4f0f15\") " pod="openshift-insights/insights-runtime-extractor-vpjpz" Sep 18 23:59:08.120727 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:59:08.120669 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0a7fd40-c030-4559-981d-cb21383efcd4-metrics-tls podName:e0a7fd40-c030-4559-981d-cb21383efcd4 nodeName:}" failed. No retries permitted until 2026-09-18 23:59:12.120635503 +0000 UTC m=+44.096843974 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e0a7fd40-c030-4559-981d-cb21383efcd4-metrics-tls") pod "dns-default-rvv44" (UID: "e0a7fd40-c030-4559-981d-cb21383efcd4") : secret "dns-default-metrics-tls" not found Sep 18 23:59:08.120727 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:59:08.120714 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 23:59:08.120937 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:59:08.120763 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 23:59:08.120937 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:59:08.120790 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fafc2259-0ac4-460d-a796-9e1d5c4f0f15-kube-rbac-proxy-cm podName:fafc2259-0ac4-460d-a796-9e1d5c4f0f15 nodeName:}" failed. No retries permitted until 2026-09-18 23:59:12.120771277 +0000 UTC m=+44.096979744 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fafc2259-0ac4-460d-a796-9e1d5c4f0f15-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vpjpz" (UID: "fafc2259-0ac4-460d-a796-9e1d5c4f0f15") : configmap "kube-rbac-proxy" not found Sep 18 23:59:08.120937 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:59:08.120810 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fafc2259-0ac4-460d-a796-9e1d5c4f0f15-insights-runtime-extractor-tls podName:fafc2259-0ac4-460d-a796-9e1d5c4f0f15 nodeName:}" failed. No retries permitted until 2026-09-18 23:59:12.120800408 +0000 UTC m=+44.097008858 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fafc2259-0ac4-460d-a796-9e1d5c4f0f15-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vpjpz" (UID: "fafc2259-0ac4-460d-a796-9e1d5c4f0f15") : secret "insights-runtime-extractor-tls" not found Sep 18 23:59:10.382523 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:10.382490 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-55f6fc7b86-ptdm2" event={"ID":"9a202402-e74b-489b-809e-01d6ed8d4782","Type":"ContainerStarted","Data":"8dcbcf2d99fdf6e541e6cd3a6e38be9c78e605ed0cb59b384f8226336fbb7a42"} Sep 18 23:59:10.401770 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:10.399267 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-55f6fc7b86-ptdm2" podStartSLOduration=2.150914764 podStartE2EDuration="4.399235227s" totalImagesPullingTime="2.248320463s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 23:59:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 23:59:10.398055163 +0000 UTC m=+42.374263652" watchObservedRunningTime="2026-09-18 23:59:10.399235227 +0000 UTC m=+42.375443700" Sep 18 23:59:12.151133 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:12.151091 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fafc2259-0ac4-460d-a796-9e1d5c4f0f15-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vpjpz\" (UID: \"fafc2259-0ac4-460d-a796-9e1d5c4f0f15\") " pod="openshift-insights/insights-runtime-extractor-vpjpz" Sep 18 23:59:12.151521 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:12.151152 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e0a7fd40-c030-4559-981d-cb21383efcd4-metrics-tls\") pod \"dns-default-rvv44\" (UID: \"e0a7fd40-c030-4559-981d-cb21383efcd4\") " pod="openshift-dns/dns-default-rvv44" Sep 18 23:59:12.151521 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:59:12.151234 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 23:59:12.151521 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:59:12.151245 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 23:59:12.151521 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:12.151262 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fafc2259-0ac4-460d-a796-9e1d5c4f0f15-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vpjpz\" (UID: \"fafc2259-0ac4-460d-a796-9e1d5c4f0f15\") " pod="openshift-insights/insights-runtime-extractor-vpjpz" Sep 18 23:59:12.151521 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:59:12.151285 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0a7fd40-c030-4559-981d-cb21383efcd4-metrics-tls podName:e0a7fd40-c030-4559-981d-cb21383efcd4 nodeName:}" failed. No retries permitted until 2026-09-18 23:59:20.151272974 +0000 UTC m=+52.127481420 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e0a7fd40-c030-4559-981d-cb21383efcd4-metrics-tls") pod "dns-default-rvv44" (UID: "e0a7fd40-c030-4559-981d-cb21383efcd4") : secret "dns-default-metrics-tls" not found Sep 18 23:59:12.151521 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:59:12.151305 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fafc2259-0ac4-460d-a796-9e1d5c4f0f15-insights-runtime-extractor-tls podName:fafc2259-0ac4-460d-a796-9e1d5c4f0f15 nodeName:}" failed. No retries permitted until 2026-09-18 23:59:20.15129686 +0000 UTC m=+52.127505305 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fafc2259-0ac4-460d-a796-9e1d5c4f0f15-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vpjpz" (UID: "fafc2259-0ac4-460d-a796-9e1d5c4f0f15") : secret "insights-runtime-extractor-tls" not found Sep 18 23:59:12.151744 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:12.151681 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fafc2259-0ac4-460d-a796-9e1d5c4f0f15-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vpjpz\" (UID: \"fafc2259-0ac4-460d-a796-9e1d5c4f0f15\") " pod="openshift-insights/insights-runtime-extractor-vpjpz" Sep 18 23:59:20.209722 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:20.209676 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e0a7fd40-c030-4559-981d-cb21383efcd4-metrics-tls\") pod \"dns-default-rvv44\" (UID: \"e0a7fd40-c030-4559-981d-cb21383efcd4\") " pod="openshift-dns/dns-default-rvv44" Sep 18 23:59:20.210206 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:20.209784 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fafc2259-0ac4-460d-a796-9e1d5c4f0f15-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vpjpz\" (UID: \"fafc2259-0ac4-460d-a796-9e1d5c4f0f15\") " pod="openshift-insights/insights-runtime-extractor-vpjpz" Sep 18 23:59:20.213260 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:20.213225 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e0a7fd40-c030-4559-981d-cb21383efcd4-metrics-tls\") pod \"dns-default-rvv44\" (UID: \"e0a7fd40-c030-4559-981d-cb21383efcd4\") " pod="openshift-dns/dns-default-rvv44" Sep 18 23:59:20.213377 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:20.213278 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fafc2259-0ac4-460d-a796-9e1d5c4f0f15-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vpjpz\" (UID: \"fafc2259-0ac4-460d-a796-9e1d5c4f0f15\") " pod="openshift-insights/insights-runtime-extractor-vpjpz" Sep 18 23:59:20.289924 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:20.289888 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rvv44" Sep 18 23:59:20.300046 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:20.300020 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vpjpz" Sep 18 23:59:20.588161 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:20.588091 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rvv44"] Sep 18 23:59:20.590942 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:59:20.590912 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0a7fd40_c030_4559_981d_cb21383efcd4.slice/crio-d73d79e9273b39f8f0ee9c7c9b419b92d1bab6a0aecdec540bd3bd8614a2f526 WatchSource:0}: Error finding container d73d79e9273b39f8f0ee9c7c9b419b92d1bab6a0aecdec540bd3bd8614a2f526: Status 404 returned error can't find the container with id d73d79e9273b39f8f0ee9c7c9b419b92d1bab6a0aecdec540bd3bd8614a2f526 Sep 18 23:59:20.620960 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:20.620921 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vpjpz"] Sep 18 23:59:20.623770 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:59:20.623735 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfafc2259_0ac4_460d_a796_9e1d5c4f0f15.slice/crio-9c05f0d16fd7a55ddc6a65c9031d66fd6140aaf777e30658041a22aacb66be37 WatchSource:0}: Error finding container 9c05f0d16fd7a55ddc6a65c9031d66fd6140aaf777e30658041a22aacb66be37: Status 404 returned error can't find the container with id 9c05f0d16fd7a55ddc6a65c9031d66fd6140aaf777e30658041a22aacb66be37 Sep 18 23:59:21.414180 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:21.414140 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vpjpz" event={"ID":"fafc2259-0ac4-460d-a796-9e1d5c4f0f15","Type":"ContainerStarted","Data":"82d43290625c1205588c7d4d7f0550b82feca383c30ca24af77ecdd667088069"} Sep 18 23:59:21.414698 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:21.414206 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vpjpz" event={"ID":"fafc2259-0ac4-460d-a796-9e1d5c4f0f15","Type":"ContainerStarted","Data":"9c05f0d16fd7a55ddc6a65c9031d66fd6140aaf777e30658041a22aacb66be37"} Sep 18 23:59:21.415416 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:21.415393 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rvv44" event={"ID":"e0a7fd40-c030-4559-981d-cb21383efcd4","Type":"ContainerStarted","Data":"d73d79e9273b39f8f0ee9c7c9b419b92d1bab6a0aecdec540bd3bd8614a2f526"} Sep 18 23:59:22.420224 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:22.420191 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vpjpz" event={"ID":"fafc2259-0ac4-460d-a796-9e1d5c4f0f15","Type":"ContainerStarted","Data":"a6bddafbf3f90fc603bd4f727963c17a45d53dbfffa4c31aab9fd971eb14e5be"} Sep 18 23:59:23.425909 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:23.425875 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rvv44" event={"ID":"e0a7fd40-c030-4559-981d-cb21383efcd4","Type":"ContainerStarted","Data":"fcdedec60e17df7905460ebd4b05676d3ec7fc61f9795e6cb6e722a1bf23c9d4"} Sep 18 23:59:23.426296 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:23.425950 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rvv44" event={"ID":"e0a7fd40-c030-4559-981d-cb21383efcd4","Type":"ContainerStarted","Data":"c61d5e1be32ff473d1171b59d9719639984cae410f0c2b2bb65c37ee9ebbe8a5"} Sep 18 23:59:23.426296 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:23.425999 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-rvv44" Sep 18 23:59:23.442347 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:23.442295 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-rvv44" podStartSLOduration=17.356912468 podStartE2EDuration="19.442282176s" totalImagesPullingTime="2.085369708s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 23:59:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 23:59:23.442067098 +0000 UTC m=+55.418275586" watchObservedRunningTime="2026-09-18 23:59:23.442282176 +0000 UTC m=+55.418490644" Sep 18 23:59:24.431067 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:24.431029 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vpjpz" event={"ID":"fafc2259-0ac4-460d-a796-9e1d5c4f0f15","Type":"ContainerStarted","Data":"40f4eb2164b36f9999985ea59d37d2f77b435fa1abb97c12e4554d0a8531d500"} Sep 18 23:59:24.446969 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:24.446906 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-vpjpz" podStartSLOduration=17.187414691 podStartE2EDuration="20.446886632s" totalImagesPullingTime="3.259471941s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 23:59:04 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 23:59:24.445734125 +0000 UTC m=+56.421942638" watchObservedRunningTime="2026-09-18 23:59:24.446886632 +0000 UTC m=+56.423095101" Sep 18 23:59:25.587770 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:25.587706 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d874f599d-krh9d"] Sep 18 23:59:25.610582 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:25.610543 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-766ff8bb5-2bwnb"] Sep 18 23:59:25.610767 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:25.610688 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d874f599d-krh9d" Sep 18 23:59:25.613147 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:25.613126 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 18 23:59:25.613886 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:25.613871 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Sep 18 23:59:25.613949 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:25.613910 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 18 23:59:25.614014 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:25.613977 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-cqqwc\"" Sep 18 23:59:25.614014 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:25.613998 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 18 23:59:25.622883 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:25.622864 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d874f599d-krh9d"] Sep 18 23:59:25.622956 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:25.622892 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-766ff8bb5-2bwnb"] Sep 18 23:59:25.623004 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:25.622974 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-766ff8bb5-2bwnb" Sep 18 23:59:25.625092 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:25.625073 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Sep 18 23:59:25.651408 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:25.651385 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6d17b34b-1ccc-4fe1-95af-2cdae4434b3e-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-d874f599d-krh9d\" (UID: \"6d17b34b-1ccc-4fe1-95af-2cdae4434b3e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d874f599d-krh9d" Sep 18 23:59:25.651509 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:25.651429 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/b593de3f-78b1-4879-a538-baf595008e7e-klusterlet-config\") pod \"klusterlet-addon-workmgr-766ff8bb5-2bwnb\" (UID: \"b593de3f-78b1-4879-a538-baf595008e7e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-766ff8bb5-2bwnb" Sep 18 23:59:25.651509 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:25.651479 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnlc5\" (UniqueName: \"kubernetes.io/projected/b593de3f-78b1-4879-a538-baf595008e7e-kube-api-access-vnlc5\") pod \"klusterlet-addon-workmgr-766ff8bb5-2bwnb\" (UID: \"b593de3f-78b1-4879-a538-baf595008e7e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-766ff8bb5-2bwnb" Sep 18 23:59:25.651589 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:25.651511 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5hz7\" (UniqueName: \"kubernetes.io/projected/6d17b34b-1ccc-4fe1-95af-2cdae4434b3e-kube-api-access-x5hz7\") pod \"managed-serviceaccount-addon-agent-d874f599d-krh9d\" (UID: \"6d17b34b-1ccc-4fe1-95af-2cdae4434b3e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d874f599d-krh9d" Sep 18 23:59:25.651589 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:25.651531 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b593de3f-78b1-4879-a538-baf595008e7e-tmp\") pod \"klusterlet-addon-workmgr-766ff8bb5-2bwnb\" (UID: \"b593de3f-78b1-4879-a538-baf595008e7e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-766ff8bb5-2bwnb" Sep 18 23:59:25.748084 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:25.748051 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-8598f7b4-qccdt"] Sep 18 23:59:25.752258 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:25.752240 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6d17b34b-1ccc-4fe1-95af-2cdae4434b3e-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-d874f599d-krh9d\" (UID: \"6d17b34b-1ccc-4fe1-95af-2cdae4434b3e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d874f599d-krh9d" Sep 18 23:59:25.752326 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:25.752278 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/b593de3f-78b1-4879-a538-baf595008e7e-klusterlet-config\") pod \"klusterlet-addon-workmgr-766ff8bb5-2bwnb\" (UID: \"b593de3f-78b1-4879-a538-baf595008e7e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-766ff8bb5-2bwnb" Sep 18 23:59:25.752326 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:25.752308 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnlc5\" (UniqueName: \"kubernetes.io/projected/b593de3f-78b1-4879-a538-baf595008e7e-kube-api-access-vnlc5\") pod \"klusterlet-addon-workmgr-766ff8bb5-2bwnb\" (UID: \"b593de3f-78b1-4879-a538-baf595008e7e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-766ff8bb5-2bwnb" Sep 18 23:59:25.752403 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:25.752329 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5hz7\" (UniqueName: \"kubernetes.io/projected/6d17b34b-1ccc-4fe1-95af-2cdae4434b3e-kube-api-access-x5hz7\") pod \"managed-serviceaccount-addon-agent-d874f599d-krh9d\" (UID: \"6d17b34b-1ccc-4fe1-95af-2cdae4434b3e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d874f599d-krh9d" Sep 18 23:59:25.752403 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:25.752344 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b593de3f-78b1-4879-a538-baf595008e7e-tmp\") pod \"klusterlet-addon-workmgr-766ff8bb5-2bwnb\" (UID: \"b593de3f-78b1-4879-a538-baf595008e7e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-766ff8bb5-2bwnb" Sep 18 23:59:25.752638 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:25.752622 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b593de3f-78b1-4879-a538-baf595008e7e-tmp\") pod \"klusterlet-addon-workmgr-766ff8bb5-2bwnb\" (UID: \"b593de3f-78b1-4879-a538-baf595008e7e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-766ff8bb5-2bwnb" Sep 18 23:59:25.755032 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:25.755002 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/b593de3f-78b1-4879-a538-baf595008e7e-klusterlet-config\") pod \"klusterlet-addon-workmgr-766ff8bb5-2bwnb\" (UID: \"b593de3f-78b1-4879-a538-baf595008e7e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-766ff8bb5-2bwnb" Sep 18 23:59:25.755127 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:25.755002 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6d17b34b-1ccc-4fe1-95af-2cdae4434b3e-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-d874f599d-krh9d\" (UID: \"6d17b34b-1ccc-4fe1-95af-2cdae4434b3e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d874f599d-krh9d" Sep 18 23:59:25.767401 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:25.767370 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5hz7\" (UniqueName: \"kubernetes.io/projected/6d17b34b-1ccc-4fe1-95af-2cdae4434b3e-kube-api-access-x5hz7\") pod \"managed-serviceaccount-addon-agent-d874f599d-krh9d\" (UID: \"6d17b34b-1ccc-4fe1-95af-2cdae4434b3e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d874f599d-krh9d" Sep 18 23:59:25.767581 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:25.767563 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnlc5\" (UniqueName: \"kubernetes.io/projected/b593de3f-78b1-4879-a538-baf595008e7e-kube-api-access-vnlc5\") pod \"klusterlet-addon-workmgr-766ff8bb5-2bwnb\" (UID: \"b593de3f-78b1-4879-a538-baf595008e7e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-766ff8bb5-2bwnb" Sep 18 23:59:25.772298 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:25.772248 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8598f7b4-qccdt"] Sep 18 23:59:25.772422 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:25.772332 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8598f7b4-qccdt" Sep 18 23:59:25.774402 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:25.774380 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 18 23:59:25.774509 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:25.774410 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-q8qxt\"" Sep 18 23:59:25.774509 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:25.774491 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 18 23:59:25.774595 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:25.774494 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 18 23:59:25.780276 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:25.780123 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 18 23:59:25.853482 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:25.853396 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/806e0903-3678-40b1-b452-188dd9b91dda-image-registry-private-configuration\") pod \"image-registry-8598f7b4-qccdt\" (UID: \"806e0903-3678-40b1-b452-188dd9b91dda\") " pod="openshift-image-registry/image-registry-8598f7b4-qccdt" Sep 18 23:59:25.853482 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:25.853428 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tpcp\" (UniqueName: \"kubernetes.io/projected/806e0903-3678-40b1-b452-188dd9b91dda-kube-api-access-6tpcp\") pod \"image-registry-8598f7b4-qccdt\" (UID: \"806e0903-3678-40b1-b452-188dd9b91dda\") " pod="openshift-image-registry/image-registry-8598f7b4-qccdt" Sep 18 23:59:25.853482 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:25.853453 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/806e0903-3678-40b1-b452-188dd9b91dda-trusted-ca\") pod \"image-registry-8598f7b4-qccdt\" (UID: \"806e0903-3678-40b1-b452-188dd9b91dda\") " pod="openshift-image-registry/image-registry-8598f7b4-qccdt" Sep 18 23:59:25.853699 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:25.853515 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/806e0903-3678-40b1-b452-188dd9b91dda-registry-tls\") pod \"image-registry-8598f7b4-qccdt\" (UID: \"806e0903-3678-40b1-b452-188dd9b91dda\") " pod="openshift-image-registry/image-registry-8598f7b4-qccdt" Sep 18 23:59:25.853699 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:25.853546 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/806e0903-3678-40b1-b452-188dd9b91dda-installation-pull-secrets\") pod \"image-registry-8598f7b4-qccdt\" (UID: \"806e0903-3678-40b1-b452-188dd9b91dda\") " pod="openshift-image-registry/image-registry-8598f7b4-qccdt" Sep 18 23:59:25.853699 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:25.853610 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/806e0903-3678-40b1-b452-188dd9b91dda-ca-trust-extracted\") pod \"image-registry-8598f7b4-qccdt\" (UID: \"806e0903-3678-40b1-b452-188dd9b91dda\") " pod="openshift-image-registry/image-registry-8598f7b4-qccdt" Sep 18 23:59:25.853699 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:25.853629 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/806e0903-3678-40b1-b452-188dd9b91dda-bound-sa-token\") pod \"image-registry-8598f7b4-qccdt\" (UID: \"806e0903-3678-40b1-b452-188dd9b91dda\") " pod="openshift-image-registry/image-registry-8598f7b4-qccdt" Sep 18 23:59:25.853699 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:25.853681 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/806e0903-3678-40b1-b452-188dd9b91dda-registry-certificates\") pod \"image-registry-8598f7b4-qccdt\" (UID: \"806e0903-3678-40b1-b452-188dd9b91dda\") " pod="openshift-image-registry/image-registry-8598f7b4-qccdt" Sep 18 23:59:25.932592 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:25.932562 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d874f599d-krh9d" Sep 18 23:59:25.939333 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:25.939304 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-766ff8bb5-2bwnb" Sep 18 23:59:25.954503 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:25.954481 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/806e0903-3678-40b1-b452-188dd9b91dda-image-registry-private-configuration\") pod \"image-registry-8598f7b4-qccdt\" (UID: \"806e0903-3678-40b1-b452-188dd9b91dda\") " pod="openshift-image-registry/image-registry-8598f7b4-qccdt" Sep 18 23:59:25.954582 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:25.954510 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tpcp\" (UniqueName: \"kubernetes.io/projected/806e0903-3678-40b1-b452-188dd9b91dda-kube-api-access-6tpcp\") pod \"image-registry-8598f7b4-qccdt\" (UID: \"806e0903-3678-40b1-b452-188dd9b91dda\") " pod="openshift-image-registry/image-registry-8598f7b4-qccdt" Sep 18 23:59:25.954582 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:25.954536 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/806e0903-3678-40b1-b452-188dd9b91dda-trusted-ca\") pod \"image-registry-8598f7b4-qccdt\" (UID: \"806e0903-3678-40b1-b452-188dd9b91dda\") " pod="openshift-image-registry/image-registry-8598f7b4-qccdt" Sep 18 23:59:25.954582 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:25.954561 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/806e0903-3678-40b1-b452-188dd9b91dda-registry-tls\") pod \"image-registry-8598f7b4-qccdt\" (UID: \"806e0903-3678-40b1-b452-188dd9b91dda\") " pod="openshift-image-registry/image-registry-8598f7b4-qccdt" Sep 18 23:59:25.954582 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:25.954576 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/806e0903-3678-40b1-b452-188dd9b91dda-installation-pull-secrets\") pod \"image-registry-8598f7b4-qccdt\" (UID: \"806e0903-3678-40b1-b452-188dd9b91dda\") " pod="openshift-image-registry/image-registry-8598f7b4-qccdt" Sep 18 23:59:25.954779 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:25.954632 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/806e0903-3678-40b1-b452-188dd9b91dda-ca-trust-extracted\") pod \"image-registry-8598f7b4-qccdt\" (UID: \"806e0903-3678-40b1-b452-188dd9b91dda\") " pod="openshift-image-registry/image-registry-8598f7b4-qccdt" Sep 18 23:59:25.954939 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:25.954899 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/806e0903-3678-40b1-b452-188dd9b91dda-bound-sa-token\") pod \"image-registry-8598f7b4-qccdt\" (UID: \"806e0903-3678-40b1-b452-188dd9b91dda\") " pod="openshift-image-registry/image-registry-8598f7b4-qccdt" Sep 18 23:59:25.955060 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:25.954969 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/806e0903-3678-40b1-b452-188dd9b91dda-registry-certificates\") pod \"image-registry-8598f7b4-qccdt\" (UID: \"806e0903-3678-40b1-b452-188dd9b91dda\") " pod="openshift-image-registry/image-registry-8598f7b4-qccdt" Sep 18 23:59:25.955855 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:25.955824 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/806e0903-3678-40b1-b452-188dd9b91dda-registry-certificates\") pod \"image-registry-8598f7b4-qccdt\" (UID: \"806e0903-3678-40b1-b452-188dd9b91dda\") " pod="openshift-image-registry/image-registry-8598f7b4-qccdt" Sep 18 23:59:25.956014 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:25.955992 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/806e0903-3678-40b1-b452-188dd9b91dda-ca-trust-extracted\") pod \"image-registry-8598f7b4-qccdt\" (UID: \"806e0903-3678-40b1-b452-188dd9b91dda\") " pod="openshift-image-registry/image-registry-8598f7b4-qccdt" Sep 18 23:59:25.956139 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:25.956122 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/806e0903-3678-40b1-b452-188dd9b91dda-trusted-ca\") pod \"image-registry-8598f7b4-qccdt\" (UID: \"806e0903-3678-40b1-b452-188dd9b91dda\") " pod="openshift-image-registry/image-registry-8598f7b4-qccdt" Sep 18 23:59:25.957237 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:25.957218 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/806e0903-3678-40b1-b452-188dd9b91dda-registry-tls\") pod \"image-registry-8598f7b4-qccdt\" (UID: \"806e0903-3678-40b1-b452-188dd9b91dda\") " pod="openshift-image-registry/image-registry-8598f7b4-qccdt" Sep 18 23:59:25.957363 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:25.957345 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/806e0903-3678-40b1-b452-188dd9b91dda-installation-pull-secrets\") pod \"image-registry-8598f7b4-qccdt\" (UID: \"806e0903-3678-40b1-b452-188dd9b91dda\") " pod="openshift-image-registry/image-registry-8598f7b4-qccdt" Sep 18 23:59:25.957711 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:25.957687 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/806e0903-3678-40b1-b452-188dd9b91dda-image-registry-private-configuration\") pod \"image-registry-8598f7b4-qccdt\" (UID: \"806e0903-3678-40b1-b452-188dd9b91dda\") " pod="openshift-image-registry/image-registry-8598f7b4-qccdt" Sep 18 23:59:25.964984 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:25.964965 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/806e0903-3678-40b1-b452-188dd9b91dda-bound-sa-token\") pod \"image-registry-8598f7b4-qccdt\" (UID: \"806e0903-3678-40b1-b452-188dd9b91dda\") " pod="openshift-image-registry/image-registry-8598f7b4-qccdt" Sep 18 23:59:25.965446 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:25.965431 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tpcp\" (UniqueName: \"kubernetes.io/projected/806e0903-3678-40b1-b452-188dd9b91dda-kube-api-access-6tpcp\") pod \"image-registry-8598f7b4-qccdt\" (UID: \"806e0903-3678-40b1-b452-188dd9b91dda\") " pod="openshift-image-registry/image-registry-8598f7b4-qccdt" Sep 18 23:59:26.082712 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:26.082680 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8598f7b4-qccdt" Sep 18 23:59:26.214624 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:26.214593 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d874f599d-krh9d"] Sep 18 23:59:26.217454 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:59:26.217424 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6d17b34b_1ccc_4fe1_95af_2cdae4434b3e.slice/crio-5d72297d843636bff3faf8c1ae294c5cadfcda36af41801120271cb3f954dc80 WatchSource:0}: Error finding container 5d72297d843636bff3faf8c1ae294c5cadfcda36af41801120271cb3f954dc80: Status 404 returned error can't find the container with id 5d72297d843636bff3faf8c1ae294c5cadfcda36af41801120271cb3f954dc80 Sep 18 23:59:26.251053 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:26.251025 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-766ff8bb5-2bwnb"] Sep 18 23:59:26.253522 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:59:26.253499 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb593de3f_78b1_4879_a538_baf595008e7e.slice/crio-bc31d4a035f822f1473244ce1b425709a0eda188903a1a3a3e4e9cc58d6f4cca WatchSource:0}: Error finding container bc31d4a035f822f1473244ce1b425709a0eda188903a1a3a3e4e9cc58d6f4cca: Status 404 returned error can't find the container with id bc31d4a035f822f1473244ce1b425709a0eda188903a1a3a3e4e9cc58d6f4cca Sep 18 23:59:26.375182 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:26.375114 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8598f7b4-qccdt"] Sep 18 23:59:26.378148 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:59:26.378122 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod806e0903_3678_40b1_b452_188dd9b91dda.slice/crio-7cbfc92ab2b71fb5585dbbb794f359e354b04e779c3c60a32ff0044086fa40ee WatchSource:0}: Error finding container 7cbfc92ab2b71fb5585dbbb794f359e354b04e779c3c60a32ff0044086fa40ee: Status 404 returned error can't find the container with id 7cbfc92ab2b71fb5585dbbb794f359e354b04e779c3c60a32ff0044086fa40ee Sep 18 23:59:26.441115 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:26.441085 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8598f7b4-qccdt" event={"ID":"806e0903-3678-40b1-b452-188dd9b91dda","Type":"ContainerStarted","Data":"7cbfc92ab2b71fb5585dbbb794f359e354b04e779c3c60a32ff0044086fa40ee"} Sep 18 23:59:26.442452 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:26.442421 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d874f599d-krh9d" event={"ID":"6d17b34b-1ccc-4fe1-95af-2cdae4434b3e","Type":"ContainerStarted","Data":"5d72297d843636bff3faf8c1ae294c5cadfcda36af41801120271cb3f954dc80"} Sep 18 23:59:26.443710 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:26.443688 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-766ff8bb5-2bwnb" event={"ID":"b593de3f-78b1-4879-a538-baf595008e7e","Type":"ContainerStarted","Data":"bc31d4a035f822f1473244ce1b425709a0eda188903a1a3a3e4e9cc58d6f4cca"} Sep 18 23:59:27.452251 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:27.451716 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8598f7b4-qccdt" event={"ID":"806e0903-3678-40b1-b452-188dd9b91dda","Type":"ContainerStarted","Data":"14af98d442134e445e44b284bd66775040eadee4ae3fc4ef9194d945238ef19a"} Sep 18 23:59:27.452251 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:27.452150 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-8598f7b4-qccdt" Sep 18 23:59:29.348693 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:29.348657 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6j92q" Sep 18 23:59:29.373582 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:29.373525 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-8598f7b4-qccdt" podStartSLOduration=4.373509994 podStartE2EDuration="4.373509994s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 23:59:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 23:59:27.475442434 +0000 UTC m=+59.451650895" watchObservedRunningTime="2026-09-18 23:59:29.373509994 +0000 UTC m=+61.349718459" Sep 18 23:59:31.467791 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:31.467728 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d874f599d-krh9d" event={"ID":"6d17b34b-1ccc-4fe1-95af-2cdae4434b3e","Type":"ContainerStarted","Data":"162f6909bbc788ef88eea3690ff3aab6bf50ba8fe100edea9cc12126acacf5a1"} Sep 18 23:59:31.469367 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:31.469344 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-766ff8bb5-2bwnb" event={"ID":"b593de3f-78b1-4879-a538-baf595008e7e","Type":"ContainerStarted","Data":"a5bce9362e93ec62505c0d34cde9bde571014ff49537c9b2724b1ce77a1883c6"} Sep 18 23:59:31.469559 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:31.469548 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-766ff8bb5-2bwnb" Sep 18 23:59:31.471047 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:31.471026 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-766ff8bb5-2bwnb" Sep 18 23:59:31.481131 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:31.481093 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d874f599d-krh9d" podStartSLOduration=1.7479374330000002 podStartE2EDuration="6.481080267s" totalImagesPullingTime="4.733142834s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 23:59:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 23:59:31.480119061 +0000 UTC m=+63.456327530" watchObservedRunningTime="2026-09-18 23:59:31.481080267 +0000 UTC m=+63.457288731" Sep 18 23:59:31.493949 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:31.493906 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-766ff8bb5-2bwnb" podStartSLOduration=1.787708269 podStartE2EDuration="6.493894417s" totalImagesPullingTime="4.706186148s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 23:59:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 23:59:31.492889257 +0000 UTC m=+63.469097721" watchObservedRunningTime="2026-09-18 23:59:31.493894417 +0000 UTC m=+63.470102885" Sep 18 23:59:33.433446 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:33.433411 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-rvv44" Sep 18 23:59:34.554740 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:34.554700 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-xjkjs"] Sep 18 23:59:34.559586 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:34.559567 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-xjkjs" Sep 18 23:59:34.561745 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:34.561726 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Sep 18 23:59:34.562502 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:34.562484 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 18 23:59:34.562630 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:34.562526 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 18 23:59:34.562630 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:34.562537 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 18 23:59:34.562630 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:34.562619 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-4g6qm\"" Sep 18 23:59:34.562816 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:34.562630 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Sep 18 23:59:34.570093 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:34.570072 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-xjkjs"] Sep 18 23:59:34.623210 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:34.623169 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/952f3a1f-98f2-4f76-b7ba-f129bbfc1726-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-xjkjs\" (UID: \"952f3a1f-98f2-4f76-b7ba-f129bbfc1726\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-xjkjs" Sep 18 23:59:34.623210 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:34.623207 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/952f3a1f-98f2-4f76-b7ba-f129bbfc1726-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-xjkjs\" (UID: \"952f3a1f-98f2-4f76-b7ba-f129bbfc1726\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-xjkjs" Sep 18 23:59:34.623419 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:34.623228 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/952f3a1f-98f2-4f76-b7ba-f129bbfc1726-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-xjkjs\" (UID: \"952f3a1f-98f2-4f76-b7ba-f129bbfc1726\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-xjkjs" Sep 18 23:59:34.623419 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:34.623358 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5nlh\" (UniqueName: \"kubernetes.io/projected/952f3a1f-98f2-4f76-b7ba-f129bbfc1726-kube-api-access-n5nlh\") pod \"prometheus-operator-7bd5d56d6-xjkjs\" (UID: \"952f3a1f-98f2-4f76-b7ba-f129bbfc1726\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-xjkjs" Sep 18 23:59:34.724469 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:34.724436 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/952f3a1f-98f2-4f76-b7ba-f129bbfc1726-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-xjkjs\" (UID: \"952f3a1f-98f2-4f76-b7ba-f129bbfc1726\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-xjkjs" Sep 18 23:59:34.724548 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:34.724475 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/952f3a1f-98f2-4f76-b7ba-f129bbfc1726-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-xjkjs\" (UID: \"952f3a1f-98f2-4f76-b7ba-f129bbfc1726\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-xjkjs" Sep 18 23:59:34.724548 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:34.724492 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/952f3a1f-98f2-4f76-b7ba-f129bbfc1726-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-xjkjs\" (UID: \"952f3a1f-98f2-4f76-b7ba-f129bbfc1726\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-xjkjs" Sep 18 23:59:34.724548 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:34.724528 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5nlh\" (UniqueName: \"kubernetes.io/projected/952f3a1f-98f2-4f76-b7ba-f129bbfc1726-kube-api-access-n5nlh\") pod \"prometheus-operator-7bd5d56d6-xjkjs\" (UID: \"952f3a1f-98f2-4f76-b7ba-f129bbfc1726\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-xjkjs" Sep 18 23:59:34.724653 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:59:34.724620 2579 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Sep 18 23:59:34.724721 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:59:34.724708 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/952f3a1f-98f2-4f76-b7ba-f129bbfc1726-prometheus-operator-tls podName:952f3a1f-98f2-4f76-b7ba-f129bbfc1726 nodeName:}" failed. No retries permitted until 2026-09-18 23:59:35.224689699 +0000 UTC m=+67.200898149 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/952f3a1f-98f2-4f76-b7ba-f129bbfc1726-prometheus-operator-tls") pod "prometheus-operator-7bd5d56d6-xjkjs" (UID: "952f3a1f-98f2-4f76-b7ba-f129bbfc1726") : secret "prometheus-operator-tls" not found Sep 18 23:59:34.725212 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:34.725188 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/952f3a1f-98f2-4f76-b7ba-f129bbfc1726-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-xjkjs\" (UID: \"952f3a1f-98f2-4f76-b7ba-f129bbfc1726\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-xjkjs" Sep 18 23:59:34.726925 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:34.726905 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/952f3a1f-98f2-4f76-b7ba-f129bbfc1726-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-xjkjs\" (UID: \"952f3a1f-98f2-4f76-b7ba-f129bbfc1726\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-xjkjs" Sep 18 23:59:34.732450 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:34.732424 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5nlh\" (UniqueName: \"kubernetes.io/projected/952f3a1f-98f2-4f76-b7ba-f129bbfc1726-kube-api-access-n5nlh\") pod \"prometheus-operator-7bd5d56d6-xjkjs\" (UID: \"952f3a1f-98f2-4f76-b7ba-f129bbfc1726\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-xjkjs" Sep 18 23:59:35.229291 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:35.229247 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/952f3a1f-98f2-4f76-b7ba-f129bbfc1726-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-xjkjs\" (UID: \"952f3a1f-98f2-4f76-b7ba-f129bbfc1726\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-xjkjs" Sep 18 23:59:35.231584 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:35.231565 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/952f3a1f-98f2-4f76-b7ba-f129bbfc1726-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-xjkjs\" (UID: \"952f3a1f-98f2-4f76-b7ba-f129bbfc1726\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-xjkjs" Sep 18 23:59:35.468281 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:35.468247 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-xjkjs" Sep 18 23:59:35.733706 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:35.733669 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4319f89f-3b39-4c12-8ca8-3e3cf20d5b84-metrics-certs\") pod \"network-metrics-daemon-tvsd7\" (UID: \"4319f89f-3b39-4c12-8ca8-3e3cf20d5b84\") " pod="openshift-multus/network-metrics-daemon-tvsd7" Sep 18 23:59:35.734168 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:35.733734 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hfnt\" (UniqueName: \"kubernetes.io/projected/3b5234a6-7648-434b-ab71-66239b3e1158-kube-api-access-9hfnt\") pod \"network-check-target-zcsgq\" (UID: \"3b5234a6-7648-434b-ab71-66239b3e1158\") " pod="openshift-network-diagnostics/network-check-target-zcsgq" Sep 18 23:59:35.735657 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:35.735632 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-xjkjs"] Sep 18 23:59:35.736074 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:35.736056 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 18 23:59:35.736157 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:35.736056 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 18 23:59:35.738402 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:59:35.738380 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod952f3a1f_98f2_4f76_b7ba_f129bbfc1726.slice/crio-8099fdfe04871ac0c067a735d4372972f358cdcc026393c3d2ecbf9e5d787c1c WatchSource:0}: Error finding container 8099fdfe04871ac0c067a735d4372972f358cdcc026393c3d2ecbf9e5d787c1c: Status 404 returned error can't find the container with id 8099fdfe04871ac0c067a735d4372972f358cdcc026393c3d2ecbf9e5d787c1c Sep 18 23:59:35.745950 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:35.745930 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 18 23:59:35.746524 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:35.746504 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4319f89f-3b39-4c12-8ca8-3e3cf20d5b84-metrics-certs\") pod \"network-metrics-daemon-tvsd7\" (UID: \"4319f89f-3b39-4c12-8ca8-3e3cf20d5b84\") " pod="openshift-multus/network-metrics-daemon-tvsd7" Sep 18 23:59:35.756839 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:35.756814 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hfnt\" (UniqueName: \"kubernetes.io/projected/3b5234a6-7648-434b-ab71-66239b3e1158-kube-api-access-9hfnt\") pod \"network-check-target-zcsgq\" (UID: \"3b5234a6-7648-434b-ab71-66239b3e1158\") " pod="openshift-network-diagnostics/network-check-target-zcsgq" Sep 18 23:59:35.834904 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:35.834805 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2fa576fe-0727-4d71-9477-d92c65eedf38-original-pull-secret\") pod \"global-pull-secret-syncer-dhgxl\" (UID: \"2fa576fe-0727-4d71-9477-d92c65eedf38\") " pod="kube-system/global-pull-secret-syncer-dhgxl" Sep 18 23:59:35.837240 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:35.837224 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 18 23:59:35.847198 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:35.847177 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2fa576fe-0727-4d71-9477-d92c65eedf38-original-pull-secret\") pod \"global-pull-secret-syncer-dhgxl\" (UID: \"2fa576fe-0727-4d71-9477-d92c65eedf38\") " pod="kube-system/global-pull-secret-syncer-dhgxl" Sep 18 23:59:35.984493 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:35.984465 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ggrtp\"" Sep 18 23:59:35.992439 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:35.992414 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tvsd7" Sep 18 23:59:35.992577 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:35.992555 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jgg6h\"" Sep 18 23:59:36.000882 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:36.000867 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zcsgq" Sep 18 23:59:36.082714 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:36.082685 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhgxl" Sep 18 23:59:36.266567 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:36.266531 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tvsd7"] Sep 18 23:59:36.269805 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:36.269733 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zcsgq"] Sep 18 23:59:36.270951 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:59:36.270919 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4319f89f_3b39_4c12_8ca8_3e3cf20d5b84.slice/crio-75d6f67525f2bdea38ea355bad9f3231be2f6aaa34907e48fc13f202eee677e2 WatchSource:0}: Error finding container 75d6f67525f2bdea38ea355bad9f3231be2f6aaa34907e48fc13f202eee677e2: Status 404 returned error can't find the container with id 75d6f67525f2bdea38ea355bad9f3231be2f6aaa34907e48fc13f202eee677e2 Sep 18 23:59:36.272662 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:59:36.272638 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b5234a6_7648_434b_ab71_66239b3e1158.slice/crio-f1bba600c4549f00ddacf0568f668419f2194d7ffbe729570ff3d2cd08db5054 WatchSource:0}: Error finding container f1bba600c4549f00ddacf0568f668419f2194d7ffbe729570ff3d2cd08db5054: Status 404 returned error can't find the container with id f1bba600c4549f00ddacf0568f668419f2194d7ffbe729570ff3d2cd08db5054 Sep 18 23:59:36.359042 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:36.358958 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dhgxl"] Sep 18 23:59:36.362906 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:59:36.362874 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fa576fe_0727_4d71_9477_d92c65eedf38.slice/crio-c27b928a319ecc91a4dc399fca20fd71235c49fec983437ced277c903674ba02 WatchSource:0}: Error finding container c27b928a319ecc91a4dc399fca20fd71235c49fec983437ced277c903674ba02: Status 404 returned error can't find the container with id c27b928a319ecc91a4dc399fca20fd71235c49fec983437ced277c903674ba02 Sep 18 23:59:36.485706 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:36.485666 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dhgxl" event={"ID":"2fa576fe-0727-4d71-9477-d92c65eedf38","Type":"ContainerStarted","Data":"c27b928a319ecc91a4dc399fca20fd71235c49fec983437ced277c903674ba02"} Sep 18 23:59:36.486888 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:36.486862 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zcsgq" event={"ID":"3b5234a6-7648-434b-ab71-66239b3e1158","Type":"ContainerStarted","Data":"f1bba600c4549f00ddacf0568f668419f2194d7ffbe729570ff3d2cd08db5054"} Sep 18 23:59:36.488086 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:36.488060 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tvsd7" event={"ID":"4319f89f-3b39-4c12-8ca8-3e3cf20d5b84","Type":"ContainerStarted","Data":"75d6f67525f2bdea38ea355bad9f3231be2f6aaa34907e48fc13f202eee677e2"} Sep 18 23:59:36.489182 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:36.489156 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-xjkjs" event={"ID":"952f3a1f-98f2-4f76-b7ba-f129bbfc1726","Type":"ContainerStarted","Data":"8099fdfe04871ac0c067a735d4372972f358cdcc026393c3d2ecbf9e5d787c1c"} Sep 18 23:59:37.496486 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:37.496385 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tvsd7" event={"ID":"4319f89f-3b39-4c12-8ca8-3e3cf20d5b84","Type":"ContainerStarted","Data":"18269b177caff4bd3010fe58b286329c3df5d6ff77cbb5f3d5e6c46480021076"} Sep 18 23:59:37.496486 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:37.496450 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tvsd7" event={"ID":"4319f89f-3b39-4c12-8ca8-3e3cf20d5b84","Type":"ContainerStarted","Data":"7c58c9be03e241f50ea3ca60550523cb9f9fd70598b8c2c68cb93f25253c2327"} Sep 18 23:59:37.501224 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:37.501174 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-xjkjs" event={"ID":"952f3a1f-98f2-4f76-b7ba-f129bbfc1726","Type":"ContainerStarted","Data":"b67eb68bca56d7953bd796b0e21dfbbefb6be5635204ef06846780c347f834ef"} Sep 18 23:59:37.501224 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:37.501218 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-xjkjs" event={"ID":"952f3a1f-98f2-4f76-b7ba-f129bbfc1726","Type":"ContainerStarted","Data":"3f8d7ba75d70729c4b92255628dd6967b8080024e014ba648c267f38bf42a968"} Sep 18 23:59:37.513054 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:37.512840 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-tvsd7" podStartSLOduration=66.570491013 podStartE2EDuration="1m7.51282048s" totalImagesPullingTime="942.329467ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 23:58:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 23:59:37.511736982 +0000 UTC m=+69.487945485" watchObservedRunningTime="2026-09-18 23:59:37.51282048 +0000 UTC m=+69.489028949" Sep 18 23:59:37.526995 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:37.526934 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-xjkjs" podStartSLOduration=2.099922486 podStartE2EDuration="3.526911891s" totalImagesPullingTime="1.426989405s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 23:59:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 23:59:37.526127706 +0000 UTC m=+69.502336200" watchObservedRunningTime="2026-09-18 23:59:37.526911891 +0000 UTC m=+69.503120361" Sep 18 23:59:39.902872 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:39.902566 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-w92l8"] Sep 18 23:59:39.907452 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:39.907425 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-84c885658c-w92l8" Sep 18 23:59:39.910371 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:39.910348 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Sep 18 23:59:39.910371 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:39.910358 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Sep 18 23:59:39.910649 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:39.910635 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-whbl7\"" Sep 18 23:59:39.911166 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:39.911147 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Sep 18 23:59:39.918696 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:39.918670 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-w92l8"] Sep 18 23:59:39.926884 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:39.926500 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-cdhx6"] Sep 18 23:59:39.933026 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:39.933005 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cdhx6" Sep 18 23:59:39.936817 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:39.936225 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-v4xfs\"" Sep 18 23:59:39.936817 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:39.936419 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 18 23:59:39.936817 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:39.936628 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 18 23:59:39.937604 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:39.937576 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 18 23:59:39.989058 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:39.989020 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/891a13b3-ecd6-4ffd-b771-860e063976f1-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-w92l8\" (UID: \"891a13b3-ecd6-4ffd-b771-860e063976f1\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-w92l8" Sep 18 23:59:39.989245 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:39.989147 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/891a13b3-ecd6-4ffd-b771-860e063976f1-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-w92l8\" (UID: \"891a13b3-ecd6-4ffd-b771-860e063976f1\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-w92l8" Sep 18 23:59:39.989245 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:39.989194 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/891a13b3-ecd6-4ffd-b771-860e063976f1-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-w92l8\" (UID: \"891a13b3-ecd6-4ffd-b771-860e063976f1\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-w92l8" Sep 18 23:59:39.989245 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:39.989219 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mpzx\" (UniqueName: \"kubernetes.io/projected/891a13b3-ecd6-4ffd-b771-860e063976f1-kube-api-access-6mpzx\") pod \"kube-state-metrics-84c885658c-w92l8\" (UID: \"891a13b3-ecd6-4ffd-b771-860e063976f1\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-w92l8" Sep 18 23:59:39.989245 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:39.989242 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/891a13b3-ecd6-4ffd-b771-860e063976f1-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-w92l8\" (UID: \"891a13b3-ecd6-4ffd-b771-860e063976f1\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-w92l8" Sep 18 23:59:39.989435 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:39.989288 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/891a13b3-ecd6-4ffd-b771-860e063976f1-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-w92l8\" (UID: \"891a13b3-ecd6-4ffd-b771-860e063976f1\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-w92l8" Sep 18 23:59:40.089872 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:40.089839 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/891a13b3-ecd6-4ffd-b771-860e063976f1-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-w92l8\" (UID: \"891a13b3-ecd6-4ffd-b771-860e063976f1\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-w92l8" Sep 18 23:59:40.090066 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:40.089884 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8bb579ec-3570-4b4a-8d17-fc5eb0e58a4a-metrics-client-ca\") pod \"node-exporter-cdhx6\" (UID: \"8bb579ec-3570-4b4a-8d17-fc5eb0e58a4a\") " pod="openshift-monitoring/node-exporter-cdhx6" Sep 18 23:59:40.090066 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:40.089922 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvk4g\" (UniqueName: \"kubernetes.io/projected/8bb579ec-3570-4b4a-8d17-fc5eb0e58a4a-kube-api-access-mvk4g\") pod \"node-exporter-cdhx6\" (UID: \"8bb579ec-3570-4b4a-8d17-fc5eb0e58a4a\") " pod="openshift-monitoring/node-exporter-cdhx6" Sep 18 23:59:40.090066 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:40.089956 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/891a13b3-ecd6-4ffd-b771-860e063976f1-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-w92l8\" (UID: \"891a13b3-ecd6-4ffd-b771-860e063976f1\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-w92l8" Sep 18 23:59:40.090066 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:40.089979 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8bb579ec-3570-4b4a-8d17-fc5eb0e58a4a-sys\") pod \"node-exporter-cdhx6\" (UID: \"8bb579ec-3570-4b4a-8d17-fc5eb0e58a4a\") " pod="openshift-monitoring/node-exporter-cdhx6" Sep 18 23:59:40.090066 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:40.090010 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/891a13b3-ecd6-4ffd-b771-860e063976f1-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-w92l8\" (UID: \"891a13b3-ecd6-4ffd-b771-860e063976f1\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-w92l8" Sep 18 23:59:40.090066 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:40.090032 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8bb579ec-3570-4b4a-8d17-fc5eb0e58a4a-node-exporter-accelerators-collector-config\") pod \"node-exporter-cdhx6\" (UID: \"8bb579ec-3570-4b4a-8d17-fc5eb0e58a4a\") " pod="openshift-monitoring/node-exporter-cdhx6" Sep 18 23:59:40.090374 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:40.090074 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8bb579ec-3570-4b4a-8d17-fc5eb0e58a4a-node-exporter-wtmp\") pod \"node-exporter-cdhx6\" (UID: \"8bb579ec-3570-4b4a-8d17-fc5eb0e58a4a\") " pod="openshift-monitoring/node-exporter-cdhx6" Sep 18 23:59:40.090374 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:40.090134 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/891a13b3-ecd6-4ffd-b771-860e063976f1-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-w92l8\" (UID: \"891a13b3-ecd6-4ffd-b771-860e063976f1\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-w92l8" Sep 18 23:59:40.090374 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:40.090170 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8bb579ec-3570-4b4a-8d17-fc5eb0e58a4a-node-exporter-textfile\") pod \"node-exporter-cdhx6\" (UID: \"8bb579ec-3570-4b4a-8d17-fc5eb0e58a4a\") " pod="openshift-monitoring/node-exporter-cdhx6" Sep 18 23:59:40.090374 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:40.090193 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8bb579ec-3570-4b4a-8d17-fc5eb0e58a4a-node-exporter-tls\") pod \"node-exporter-cdhx6\" (UID: \"8bb579ec-3570-4b4a-8d17-fc5eb0e58a4a\") " pod="openshift-monitoring/node-exporter-cdhx6" Sep 18 23:59:40.090374 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:40.090220 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8bb579ec-3570-4b4a-8d17-fc5eb0e58a4a-root\") pod \"node-exporter-cdhx6\" (UID: \"8bb579ec-3570-4b4a-8d17-fc5eb0e58a4a\") " pod="openshift-monitoring/node-exporter-cdhx6" Sep 18 23:59:40.090374 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:40.090247 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/891a13b3-ecd6-4ffd-b771-860e063976f1-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-w92l8\" (UID: \"891a13b3-ecd6-4ffd-b771-860e063976f1\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-w92l8" Sep 18 23:59:40.090374 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:40.090271 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mpzx\" (UniqueName: \"kubernetes.io/projected/891a13b3-ecd6-4ffd-b771-860e063976f1-kube-api-access-6mpzx\") pod \"kube-state-metrics-84c885658c-w92l8\" (UID: \"891a13b3-ecd6-4ffd-b771-860e063976f1\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-w92l8" Sep 18 23:59:40.090374 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:40.090297 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8bb579ec-3570-4b4a-8d17-fc5eb0e58a4a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cdhx6\" (UID: \"8bb579ec-3570-4b4a-8d17-fc5eb0e58a4a\") " pod="openshift-monitoring/node-exporter-cdhx6" Sep 18 23:59:40.090772 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:40.090436 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/891a13b3-ecd6-4ffd-b771-860e063976f1-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-w92l8\" (UID: \"891a13b3-ecd6-4ffd-b771-860e063976f1\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-w92l8" Sep 18 23:59:40.091002 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:40.090975 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/891a13b3-ecd6-4ffd-b771-860e063976f1-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-w92l8\" (UID: \"891a13b3-ecd6-4ffd-b771-860e063976f1\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-w92l8" Sep 18 23:59:40.091091 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:40.091047 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/891a13b3-ecd6-4ffd-b771-860e063976f1-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-w92l8\" (UID: \"891a13b3-ecd6-4ffd-b771-860e063976f1\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-w92l8" Sep 18 23:59:40.091091 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:59:40.091079 2579 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Sep 18 23:59:40.091199 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:59:40.091136 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/891a13b3-ecd6-4ffd-b771-860e063976f1-kube-state-metrics-tls podName:891a13b3-ecd6-4ffd-b771-860e063976f1 nodeName:}" failed. No retries permitted until 2026-09-18 23:59:40.591118282 +0000 UTC m=+72.567326741 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/891a13b3-ecd6-4ffd-b771-860e063976f1-kube-state-metrics-tls") pod "kube-state-metrics-84c885658c-w92l8" (UID: "891a13b3-ecd6-4ffd-b771-860e063976f1") : secret "kube-state-metrics-tls" not found Sep 18 23:59:40.093383 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:40.093341 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/891a13b3-ecd6-4ffd-b771-860e063976f1-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-w92l8\" (UID: \"891a13b3-ecd6-4ffd-b771-860e063976f1\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-w92l8" Sep 18 23:59:40.100059 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:40.099798 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mpzx\" (UniqueName: \"kubernetes.io/projected/891a13b3-ecd6-4ffd-b771-860e063976f1-kube-api-access-6mpzx\") pod \"kube-state-metrics-84c885658c-w92l8\" (UID: \"891a13b3-ecd6-4ffd-b771-860e063976f1\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-w92l8" Sep 18 23:59:40.191838 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:40.190797 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8bb579ec-3570-4b4a-8d17-fc5eb0e58a4a-node-exporter-textfile\") pod \"node-exporter-cdhx6\" (UID: \"8bb579ec-3570-4b4a-8d17-fc5eb0e58a4a\") " pod="openshift-monitoring/node-exporter-cdhx6" Sep 18 23:59:40.191838 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:40.190848 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8bb579ec-3570-4b4a-8d17-fc5eb0e58a4a-node-exporter-tls\") pod \"node-exporter-cdhx6\" (UID: \"8bb579ec-3570-4b4a-8d17-fc5eb0e58a4a\") " pod="openshift-monitoring/node-exporter-cdhx6" Sep 18 23:59:40.191838 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:40.190882 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8bb579ec-3570-4b4a-8d17-fc5eb0e58a4a-root\") pod \"node-exporter-cdhx6\" (UID: \"8bb579ec-3570-4b4a-8d17-fc5eb0e58a4a\") " pod="openshift-monitoring/node-exporter-cdhx6" Sep 18 23:59:40.191838 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:40.190915 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8bb579ec-3570-4b4a-8d17-fc5eb0e58a4a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cdhx6\" (UID: \"8bb579ec-3570-4b4a-8d17-fc5eb0e58a4a\") " pod="openshift-monitoring/node-exporter-cdhx6" Sep 18 23:59:40.191838 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:40.190945 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8bb579ec-3570-4b4a-8d17-fc5eb0e58a4a-metrics-client-ca\") pod \"node-exporter-cdhx6\" (UID: \"8bb579ec-3570-4b4a-8d17-fc5eb0e58a4a\") " pod="openshift-monitoring/node-exporter-cdhx6" Sep 18 23:59:40.191838 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:40.190984 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvk4g\" (UniqueName: \"kubernetes.io/projected/8bb579ec-3570-4b4a-8d17-fc5eb0e58a4a-kube-api-access-mvk4g\") pod \"node-exporter-cdhx6\" (UID: \"8bb579ec-3570-4b4a-8d17-fc5eb0e58a4a\") " pod="openshift-monitoring/node-exporter-cdhx6" Sep 18 23:59:40.191838 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:40.191018 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8bb579ec-3570-4b4a-8d17-fc5eb0e58a4a-sys\") pod \"node-exporter-cdhx6\" (UID: \"8bb579ec-3570-4b4a-8d17-fc5eb0e58a4a\") " pod="openshift-monitoring/node-exporter-cdhx6" Sep 18 23:59:40.191838 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:40.191068 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8bb579ec-3570-4b4a-8d17-fc5eb0e58a4a-node-exporter-accelerators-collector-config\") pod \"node-exporter-cdhx6\" (UID: \"8bb579ec-3570-4b4a-8d17-fc5eb0e58a4a\") " pod="openshift-monitoring/node-exporter-cdhx6" Sep 18 23:59:40.191838 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:40.191122 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8bb579ec-3570-4b4a-8d17-fc5eb0e58a4a-root\") pod \"node-exporter-cdhx6\" (UID: \"8bb579ec-3570-4b4a-8d17-fc5eb0e58a4a\") " pod="openshift-monitoring/node-exporter-cdhx6" Sep 18 23:59:40.191838 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:59:40.191230 2579 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 18 23:59:40.191838 ip-10-0-130-53 kubenswrapper[2579]: E0918 23:59:40.191288 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bb579ec-3570-4b4a-8d17-fc5eb0e58a4a-node-exporter-tls podName:8bb579ec-3570-4b4a-8d17-fc5eb0e58a4a nodeName:}" failed. No retries permitted until 2026-09-18 23:59:40.69126835 +0000 UTC m=+72.667476806 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/8bb579ec-3570-4b4a-8d17-fc5eb0e58a4a-node-exporter-tls") pod "node-exporter-cdhx6" (UID: "8bb579ec-3570-4b4a-8d17-fc5eb0e58a4a") : secret "node-exporter-tls" not found Sep 18 23:59:40.191838 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:40.191569 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8bb579ec-3570-4b4a-8d17-fc5eb0e58a4a-sys\") pod \"node-exporter-cdhx6\" (UID: \"8bb579ec-3570-4b4a-8d17-fc5eb0e58a4a\") " pod="openshift-monitoring/node-exporter-cdhx6" Sep 18 23:59:40.191838 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:40.191614 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8bb579ec-3570-4b4a-8d17-fc5eb0e58a4a-node-exporter-wtmp\") pod \"node-exporter-cdhx6\" (UID: \"8bb579ec-3570-4b4a-8d17-fc5eb0e58a4a\") " pod="openshift-monitoring/node-exporter-cdhx6" Sep 18 23:59:40.191838 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:40.191729 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8bb579ec-3570-4b4a-8d17-fc5eb0e58a4a-node-exporter-accelerators-collector-config\") pod \"node-exporter-cdhx6\" (UID: \"8bb579ec-3570-4b4a-8d17-fc5eb0e58a4a\") " pod="openshift-monitoring/node-exporter-cdhx6" Sep 18 23:59:40.191838 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:40.191819 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8bb579ec-3570-4b4a-8d17-fc5eb0e58a4a-node-exporter-wtmp\") pod \"node-exporter-cdhx6\" (UID: \"8bb579ec-3570-4b4a-8d17-fc5eb0e58a4a\") " pod="openshift-monitoring/node-exporter-cdhx6" Sep 18 23:59:40.192667 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:40.192157 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8bb579ec-3570-4b4a-8d17-fc5eb0e58a4a-node-exporter-textfile\") pod \"node-exporter-cdhx6\" (UID: \"8bb579ec-3570-4b4a-8d17-fc5eb0e58a4a\") " pod="openshift-monitoring/node-exporter-cdhx6" Sep 18 23:59:40.192667 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:40.192432 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8bb579ec-3570-4b4a-8d17-fc5eb0e58a4a-metrics-client-ca\") pod \"node-exporter-cdhx6\" (UID: \"8bb579ec-3570-4b4a-8d17-fc5eb0e58a4a\") " pod="openshift-monitoring/node-exporter-cdhx6" Sep 18 23:59:40.205938 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:40.203233 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8bb579ec-3570-4b4a-8d17-fc5eb0e58a4a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cdhx6\" (UID: \"8bb579ec-3570-4b4a-8d17-fc5eb0e58a4a\") " pod="openshift-monitoring/node-exporter-cdhx6" Sep 18 23:59:40.205938 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:40.205840 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvk4g\" (UniqueName: \"kubernetes.io/projected/8bb579ec-3570-4b4a-8d17-fc5eb0e58a4a-kube-api-access-mvk4g\") pod \"node-exporter-cdhx6\" (UID: \"8bb579ec-3570-4b4a-8d17-fc5eb0e58a4a\") " pod="openshift-monitoring/node-exporter-cdhx6" Sep 18 23:59:40.595995 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:40.595904 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/891a13b3-ecd6-4ffd-b771-860e063976f1-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-w92l8\" (UID: \"891a13b3-ecd6-4ffd-b771-860e063976f1\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-w92l8" Sep 18 23:59:40.598708 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:40.598678 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/891a13b3-ecd6-4ffd-b771-860e063976f1-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-w92l8\" (UID: \"891a13b3-ecd6-4ffd-b771-860e063976f1\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-w92l8" Sep 18 23:59:40.697053 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:40.697008 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8bb579ec-3570-4b4a-8d17-fc5eb0e58a4a-node-exporter-tls\") pod \"node-exporter-cdhx6\" (UID: \"8bb579ec-3570-4b4a-8d17-fc5eb0e58a4a\") " pod="openshift-monitoring/node-exporter-cdhx6" Sep 18 23:59:40.702150 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:40.702119 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8bb579ec-3570-4b4a-8d17-fc5eb0e58a4a-node-exporter-tls\") pod \"node-exporter-cdhx6\" (UID: \"8bb579ec-3570-4b4a-8d17-fc5eb0e58a4a\") " pod="openshift-monitoring/node-exporter-cdhx6" Sep 18 23:59:40.822828 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:40.822793 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-84c885658c-w92l8" Sep 18 23:59:40.845196 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:40.845155 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cdhx6" Sep 18 23:59:41.249283 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:59:41.249246 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bb579ec_3570_4b4a_8d17_fc5eb0e58a4a.slice/crio-9f6eca9cf8776b09825180918cd452fa6c640ccdffcaa91cba46eb7bc242f0ab WatchSource:0}: Error finding container 9f6eca9cf8776b09825180918cd452fa6c640ccdffcaa91cba46eb7bc242f0ab: Status 404 returned error can't find the container with id 9f6eca9cf8776b09825180918cd452fa6c640ccdffcaa91cba46eb7bc242f0ab Sep 18 23:59:41.513633 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:41.513542 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-w92l8"] Sep 18 23:59:41.516592 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:59:41.516560 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod891a13b3_ecd6_4ffd_b771_860e063976f1.slice/crio-632ec87a405746c98b6cbb000f7a49a598e07d20e62f5255617934804d2c7d45 WatchSource:0}: Error finding container 632ec87a405746c98b6cbb000f7a49a598e07d20e62f5255617934804d2c7d45: Status 404 returned error can't find the container with id 632ec87a405746c98b6cbb000f7a49a598e07d20e62f5255617934804d2c7d45 Sep 18 23:59:41.520988 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:41.520959 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dhgxl" event={"ID":"2fa576fe-0727-4d71-9477-d92c65eedf38","Type":"ContainerStarted","Data":"c5ea5aad815b68f1495ca1c9472b1b37d8fcddba5adc844adbb729fde5ac92ce"} Sep 18 23:59:41.522654 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:41.522629 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zcsgq" event={"ID":"3b5234a6-7648-434b-ab71-66239b3e1158","Type":"ContainerStarted","Data":"8784f8d6df162655adb4ec796965a54300c2eb2fe1e7cd9c7ff3a18ea989de1c"} Sep 18 23:59:41.522804 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:41.522683 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-zcsgq" Sep 18 23:59:41.523936 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:41.523895 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cdhx6" event={"ID":"8bb579ec-3570-4b4a-8d17-fc5eb0e58a4a","Type":"ContainerStarted","Data":"9f6eca9cf8776b09825180918cd452fa6c640ccdffcaa91cba46eb7bc242f0ab"} Sep 18 23:59:41.536449 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:41.536406 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-dhgxl" podStartSLOduration=66.640671658 podStartE2EDuration="1m11.536392261s" totalImagesPullingTime="4.895720603s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 23:58:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 23:59:41.535487464 +0000 UTC m=+73.511695954" watchObservedRunningTime="2026-09-18 23:59:41.536392261 +0000 UTC m=+73.512600731" Sep 18 23:59:41.548648 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:41.548607 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-zcsgq" podStartSLOduration=66.573823545 podStartE2EDuration="1m11.548593179s" totalImagesPullingTime="4.974769634s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 23:58:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 23:59:41.547911687 +0000 UTC m=+73.524120166" watchObservedRunningTime="2026-09-18 23:59:41.548593179 +0000 UTC m=+73.524801647" Sep 18 23:59:42.529244 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:42.529197 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-w92l8" event={"ID":"891a13b3-ecd6-4ffd-b771-860e063976f1","Type":"ContainerStarted","Data":"632ec87a405746c98b6cbb000f7a49a598e07d20e62f5255617934804d2c7d45"} Sep 18 23:59:42.531022 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:42.530998 2579 generic.go:356] "Generic (PLEG): container finished" podID="8bb579ec-3570-4b4a-8d17-fc5eb0e58a4a" containerID="59ffd246b354ba200b5d2b06485eb3e7c896918b1a5c01bd4b70044b986f37b5" exitCode=0 Sep 18 23:59:42.531157 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:42.531090 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cdhx6" event={"ID":"8bb579ec-3570-4b4a-8d17-fc5eb0e58a4a","Type":"ContainerDied","Data":"59ffd246b354ba200b5d2b06485eb3e7c896918b1a5c01bd4b70044b986f37b5"} Sep 18 23:59:43.542656 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:43.542618 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-w92l8" event={"ID":"891a13b3-ecd6-4ffd-b771-860e063976f1","Type":"ContainerStarted","Data":"3cceba1c3f05f5cdef04f35619c01e131f63558ca6070f32528a8672790e1cf0"} Sep 18 23:59:43.543047 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:43.542714 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-w92l8" event={"ID":"891a13b3-ecd6-4ffd-b771-860e063976f1","Type":"ContainerStarted","Data":"de88ac3f617fa3d89b0bd2e038bb82810851e95d51c40f4a66f6224735e46f31"} Sep 18 23:59:43.543047 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:43.542747 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-w92l8" event={"ID":"891a13b3-ecd6-4ffd-b771-860e063976f1","Type":"ContainerStarted","Data":"c7de96ec4a5b80f4f0f12ccaafeb1319f762c985469e43cf76010e07943c98b6"} Sep 18 23:59:43.544646 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:43.544619 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cdhx6" event={"ID":"8bb579ec-3570-4b4a-8d17-fc5eb0e58a4a","Type":"ContainerStarted","Data":"9aded31b40b28f1187e5edae2f695b108523c534ffdb9900546c8930773899b5"} Sep 18 23:59:43.544767 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:43.544670 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cdhx6" event={"ID":"8bb579ec-3570-4b4a-8d17-fc5eb0e58a4a","Type":"ContainerStarted","Data":"018cf19a9b9567cb5e14c5cca7b0b4a5fc41c33128dea7f62262aafcf525a9af"} Sep 18 23:59:43.559456 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:43.559417 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-84c885658c-w92l8" podStartSLOduration=3.311837744 podStartE2EDuration="4.55940271s" totalImagesPullingTime="1.247564966s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 23:59:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 23:59:43.558184703 +0000 UTC m=+75.534393222" watchObservedRunningTime="2026-09-18 23:59:43.55940271 +0000 UTC m=+75.535611178" Sep 18 23:59:43.574268 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:43.574220 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-cdhx6" podStartSLOduration=3.719421722 podStartE2EDuration="4.574206649s" totalImagesPullingTime="783.370514ms" totalInitContainerRuntime="71.414413ms" isStatefulPod=true podCreationTimestamp="2026-09-18 23:59:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 23:59:43.573391866 +0000 UTC m=+75.549600354" watchObservedRunningTime="2026-09-18 23:59:43.574206649 +0000 UTC m=+75.550415117" Sep 18 23:59:46.091272 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:46.091239 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 23:59:46.096361 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:46.096334 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 23:59:46.098490 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:46.098463 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 18 23:59:46.099333 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:46.098543 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 18 23:59:46.099460 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:46.098706 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 18 23:59:46.099517 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:46.098998 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 18 23:59:46.099592 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:46.099115 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 18 23:59:46.099645 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:46.099122 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-xvfpc\"" Sep 18 23:59:46.099699 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:46.099158 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 18 23:59:46.100382 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:46.100114 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 18 23:59:46.100382 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:46.100153 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 18 23:59:46.100382 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:46.100204 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 18 23:59:46.100614 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:46.100408 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 18 23:59:46.100614 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:46.100455 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 18 23:59:46.100724 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:46.100624 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-69g8nskjgtg97\"" Sep 18 23:59:46.100724 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:46.100684 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 18 23:59:46.100856 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:46.100831 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 18 23:59:46.100923 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:46.100831 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 18 23:59:46.102676 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:46.102657 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 18 23:59:46.110525 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:46.110495 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 23:59:46.240905 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:46.240868 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/13a17989-270b-490a-a785-69b15683aa61-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"13a17989-270b-490a-a785-69b15683aa61\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 23:59:46.241103 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:46.240916 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7qn8\" (UniqueName: \"kubernetes.io/projected/13a17989-270b-490a-a785-69b15683aa61-kube-api-access-q7qn8\") pod \"prometheus-k8s-0\" (UID: \"13a17989-270b-490a-a785-69b15683aa61\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 23:59:46.241103 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:46.240946 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/13a17989-270b-490a-a785-69b15683aa61-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"13a17989-270b-490a-a785-69b15683aa61\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 23:59:46.241103 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:46.240970 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13a17989-270b-490a-a785-69b15683aa61-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"13a17989-270b-490a-a785-69b15683aa61\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 23:59:46.241103 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:46.241006 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/13a17989-270b-490a-a785-69b15683aa61-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"13a17989-270b-490a-a785-69b15683aa61\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 23:59:46.241103 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:46.241032 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/13a17989-270b-490a-a785-69b15683aa61-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"13a17989-270b-490a-a785-69b15683aa61\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 23:59:46.241103 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:46.241054 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/13a17989-270b-490a-a785-69b15683aa61-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"13a17989-270b-490a-a785-69b15683aa61\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 23:59:46.241103 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:46.241093 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13a17989-270b-490a-a785-69b15683aa61-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"13a17989-270b-490a-a785-69b15683aa61\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 23:59:46.241448 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:46.241120 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/13a17989-270b-490a-a785-69b15683aa61-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"13a17989-270b-490a-a785-69b15683aa61\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 23:59:46.241448 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:46.241154 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13a17989-270b-490a-a785-69b15683aa61-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"13a17989-270b-490a-a785-69b15683aa61\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 23:59:46.241448 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:46.241177 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/13a17989-270b-490a-a785-69b15683aa61-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"13a17989-270b-490a-a785-69b15683aa61\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 23:59:46.241448 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:46.241225 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/13a17989-270b-490a-a785-69b15683aa61-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"13a17989-270b-490a-a785-69b15683aa61\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 23:59:46.241448 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:46.241275 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/13a17989-270b-490a-a785-69b15683aa61-config-out\") pod \"prometheus-k8s-0\" (UID: \"13a17989-270b-490a-a785-69b15683aa61\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 23:59:46.241448 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:46.241301 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/13a17989-270b-490a-a785-69b15683aa61-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"13a17989-270b-490a-a785-69b15683aa61\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 23:59:46.241448 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:46.241325 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/13a17989-270b-490a-a785-69b15683aa61-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"13a17989-270b-490a-a785-69b15683aa61\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 23:59:46.241448 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:46.241352 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/13a17989-270b-490a-a785-69b15683aa61-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"13a17989-270b-490a-a785-69b15683aa61\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 23:59:46.241448 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:46.241393 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/13a17989-270b-490a-a785-69b15683aa61-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"13a17989-270b-490a-a785-69b15683aa61\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 23:59:46.241448 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:46.241429 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/13a17989-270b-490a-a785-69b15683aa61-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"13a17989-270b-490a-a785-69b15683aa61\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 23:59:46.241448 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:46.241451 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/13a17989-270b-490a-a785-69b15683aa61-web-config\") pod \"prometheus-k8s-0\" (UID: \"13a17989-270b-490a-a785-69b15683aa61\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 23:59:46.241940 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:46.241476 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/13a17989-270b-490a-a785-69b15683aa61-config\") pod \"prometheus-k8s-0\" (UID: \"13a17989-270b-490a-a785-69b15683aa61\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 23:59:46.342398 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:46.342301 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13a17989-270b-490a-a785-69b15683aa61-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"13a17989-270b-490a-a785-69b15683aa61\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 23:59:46.342398 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:46.342335 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/13a17989-270b-490a-a785-69b15683aa61-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"13a17989-270b-490a-a785-69b15683aa61\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 23:59:46.342398 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:46.342371 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13a17989-270b-490a-a785-69b15683aa61-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"13a17989-270b-490a-a785-69b15683aa61\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 23:59:46.342398 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:46.342397 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/13a17989-270b-490a-a785-69b15683aa61-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"13a17989-270b-490a-a785-69b15683aa61\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 23:59:46.342725 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:46.342431 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/13a17989-270b-490a-a785-69b15683aa61-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"13a17989-270b-490a-a785-69b15683aa61\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 23:59:46.342725 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:46.342458 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/13a17989-270b-490a-a785-69b15683aa61-config-out\") pod \"prometheus-k8s-0\" (UID: \"13a17989-270b-490a-a785-69b15683aa61\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 23:59:46.342725 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:46.342483 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/13a17989-270b-490a-a785-69b15683aa61-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"13a17989-270b-490a-a785-69b15683aa61\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 23:59:46.342725 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:46.342505 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/13a17989-270b-490a-a785-69b15683aa61-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"13a17989-270b-490a-a785-69b15683aa61\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 23:59:46.342725 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:46.342529 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/13a17989-270b-490a-a785-69b15683aa61-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"13a17989-270b-490a-a785-69b15683aa61\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 23:59:46.342725 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:46.342552 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/13a17989-270b-490a-a785-69b15683aa61-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"13a17989-270b-490a-a785-69b15683aa61\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 23:59:46.342725 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:46.342584 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/13a17989-270b-490a-a785-69b15683aa61-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"13a17989-270b-490a-a785-69b15683aa61\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 23:59:46.342725 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:46.342607 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/13a17989-270b-490a-a785-69b15683aa61-web-config\") pod \"prometheus-k8s-0\" (UID: \"13a17989-270b-490a-a785-69b15683aa61\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 23:59:46.342725 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:46.342631 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/13a17989-270b-490a-a785-69b15683aa61-config\") pod \"prometheus-k8s-0\" (UID: \"13a17989-270b-490a-a785-69b15683aa61\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 23:59:46.342725 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:46.342662 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/13a17989-270b-490a-a785-69b15683aa61-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"13a17989-270b-490a-a785-69b15683aa61\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 23:59:46.342725 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:46.342684 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7qn8\" (UniqueName: \"kubernetes.io/projected/13a17989-270b-490a-a785-69b15683aa61-kube-api-access-q7qn8\") pod \"prometheus-k8s-0\" (UID: \"13a17989-270b-490a-a785-69b15683aa61\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 23:59:46.342725 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:46.342712 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/13a17989-270b-490a-a785-69b15683aa61-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"13a17989-270b-490a-a785-69b15683aa61\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 23:59:46.343320 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:46.342742 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13a17989-270b-490a-a785-69b15683aa61-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"13a17989-270b-490a-a785-69b15683aa61\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 23:59:46.343320 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:46.342814 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/13a17989-270b-490a-a785-69b15683aa61-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"13a17989-270b-490a-a785-69b15683aa61\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 23:59:46.343320 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:46.342840 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/13a17989-270b-490a-a785-69b15683aa61-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"13a17989-270b-490a-a785-69b15683aa61\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 23:59:46.343320 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:46.342864 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/13a17989-270b-490a-a785-69b15683aa61-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"13a17989-270b-490a-a785-69b15683aa61\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 23:59:46.343320 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:46.343168 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13a17989-270b-490a-a785-69b15683aa61-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"13a17989-270b-490a-a785-69b15683aa61\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 23:59:46.343676 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:46.343651 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/13a17989-270b-490a-a785-69b15683aa61-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"13a17989-270b-490a-a785-69b15683aa61\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 23:59:46.345468 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:46.345441 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/13a17989-270b-490a-a785-69b15683aa61-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"13a17989-270b-490a-a785-69b15683aa61\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 23:59:46.346550 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:46.346521 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13a17989-270b-490a-a785-69b15683aa61-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"13a17989-270b-490a-a785-69b15683aa61\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 23:59:46.346901 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:46.346857 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/13a17989-270b-490a-a785-69b15683aa61-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"13a17989-270b-490a-a785-69b15683aa61\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 23:59:46.347027 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:46.347005 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/13a17989-270b-490a-a785-69b15683aa61-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"13a17989-270b-490a-a785-69b15683aa61\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 23:59:46.347702 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:46.347418 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13a17989-270b-490a-a785-69b15683aa61-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"13a17989-270b-490a-a785-69b15683aa61\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 23:59:46.347702 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:46.347449 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/13a17989-270b-490a-a785-69b15683aa61-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"13a17989-270b-490a-a785-69b15683aa61\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 23:59:46.347702 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:46.347674 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/13a17989-270b-490a-a785-69b15683aa61-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"13a17989-270b-490a-a785-69b15683aa61\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 23:59:46.348559 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:46.348538 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/13a17989-270b-490a-a785-69b15683aa61-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"13a17989-270b-490a-a785-69b15683aa61\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 23:59:46.348955 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:46.348933 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/13a17989-270b-490a-a785-69b15683aa61-config-out\") pod \"prometheus-k8s-0\" (UID: \"13a17989-270b-490a-a785-69b15683aa61\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 23:59:46.349326 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:46.349302 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/13a17989-270b-490a-a785-69b15683aa61-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"13a17989-270b-490a-a785-69b15683aa61\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 23:59:46.349776 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:46.349718 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/13a17989-270b-490a-a785-69b15683aa61-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"13a17989-270b-490a-a785-69b15683aa61\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 23:59:46.350625 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:46.350592 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/13a17989-270b-490a-a785-69b15683aa61-web-config\") pod \"prometheus-k8s-0\" (UID: \"13a17989-270b-490a-a785-69b15683aa61\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 23:59:46.350907 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:46.350884 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/13a17989-270b-490a-a785-69b15683aa61-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"13a17989-270b-490a-a785-69b15683aa61\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 23:59:46.351335 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:46.351299 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/13a17989-270b-490a-a785-69b15683aa61-config\") pod \"prometheus-k8s-0\" (UID: \"13a17989-270b-490a-a785-69b15683aa61\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 23:59:46.351414 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:46.351353 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/13a17989-270b-490a-a785-69b15683aa61-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"13a17989-270b-490a-a785-69b15683aa61\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 23:59:46.351475 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:46.351453 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/13a17989-270b-490a-a785-69b15683aa61-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"13a17989-270b-490a-a785-69b15683aa61\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 23:59:46.352202 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:46.351772 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/13a17989-270b-490a-a785-69b15683aa61-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"13a17989-270b-490a-a785-69b15683aa61\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 23:59:46.354346 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:46.354318 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7qn8\" (UniqueName: \"kubernetes.io/projected/13a17989-270b-490a-a785-69b15683aa61-kube-api-access-q7qn8\") pod \"prometheus-k8s-0\" (UID: \"13a17989-270b-490a-a785-69b15683aa61\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 23:59:46.409121 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:46.409079 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 23:59:46.690563 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:46.690531 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 23:59:46.693616 ip-10-0-130-53 kubenswrapper[2579]: W0918 23:59:46.693575 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13a17989_270b_490a_a785_69b15683aa61.slice/crio-828f9d8e2e503079010ebacf245bbf21d6e6fbdccfc89ccdd7b9718a80ed3211 WatchSource:0}: Error finding container 828f9d8e2e503079010ebacf245bbf21d6e6fbdccfc89ccdd7b9718a80ed3211: Status 404 returned error can't find the container with id 828f9d8e2e503079010ebacf245bbf21d6e6fbdccfc89ccdd7b9718a80ed3211 Sep 18 23:59:47.560554 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:47.560516 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"13a17989-270b-490a-a785-69b15683aa61","Type":"ContainerStarted","Data":"828f9d8e2e503079010ebacf245bbf21d6e6fbdccfc89ccdd7b9718a80ed3211"} Sep 18 23:59:48.461377 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:48.461348 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-8598f7b4-qccdt" Sep 18 23:59:48.565676 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:48.565641 2579 generic.go:356] "Generic (PLEG): container finished" podID="13a17989-270b-490a-a785-69b15683aa61" containerID="80f358770d7989facae049a9426507417a9097b5a4d3e0919253ab538390b9bd" exitCode=0 Sep 18 23:59:48.566165 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:48.565695 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"13a17989-270b-490a-a785-69b15683aa61","Type":"ContainerDied","Data":"80f358770d7989facae049a9426507417a9097b5a4d3e0919253ab538390b9bd"} Sep 18 23:59:52.586035 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:52.585993 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"13a17989-270b-490a-a785-69b15683aa61","Type":"ContainerStarted","Data":"c49d0f849ce5633992ffca5290815fd5c4a6bed824a2f4629915dad086b57d3e"} Sep 18 23:59:52.586518 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:52.586094 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"13a17989-270b-490a-a785-69b15683aa61","Type":"ContainerStarted","Data":"43ce12170b1aa9ae03dcecf70b17d454857699be3cc1c0309946a88db3af4943"} Sep 18 23:59:54.601331 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:54.601294 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"13a17989-270b-490a-a785-69b15683aa61","Type":"ContainerStarted","Data":"386ab59b469e5e01cf4a8d89fb257086afaf0119fb2bac0aebd0ab7708781592"} Sep 18 23:59:54.601849 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:54.601462 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"13a17989-270b-490a-a785-69b15683aa61","Type":"ContainerStarted","Data":"df5dd3683cfb5b8aa55192c7457adb8fcc2792a98f92713d15be00cf372ae86c"} Sep 18 23:59:54.601849 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:54.601525 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"13a17989-270b-490a-a785-69b15683aa61","Type":"ContainerStarted","Data":"6266d47316c196714a1a23e1544f7b5b31ee8a26a2e0d26fe7350d5d969a92b0"} Sep 18 23:59:54.601849 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:54.601567 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"13a17989-270b-490a-a785-69b15683aa61","Type":"ContainerStarted","Data":"d502423fad600cde246028741ddc497890313fea4a462729384b1fe123a39376"} Sep 18 23:59:54.628880 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:54.628778 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.672353466 podStartE2EDuration="8.628740157s" totalImagesPullingTime="5.937159723s" totalInitContainerRuntime="19.226968ms" isStatefulPod=false podCreationTimestamp="2026-09-18 23:59:46 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 23:59:54.626917506 +0000 UTC m=+86.603125995" watchObservedRunningTime="2026-09-18 23:59:54.628740157 +0000 UTC m=+86.604948626" Sep 18 23:59:56.410209 ip-10-0-130-53 kubenswrapper[2579]: I0918 23:59:56.410171 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 19 00:00:10.549762 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:00:10.549718 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gw8q6_7d3f64f3-edc0-472e-9e12-4980ef2d9a26/serve-healthcheck-canary/0.log" Sep 19 00:00:12.534575 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:00:12.534546 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-zcsgq" Sep 19 00:00:46.409909 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:00:46.409874 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 19 00:00:46.428632 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:00:46.428607 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 19 00:00:46.806621 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:00:46.806545 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 19 00:01:04.438636 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.438598 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 19 00:01:04.439282 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.439033 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="13a17989-270b-490a-a785-69b15683aa61" containerName="thanos-sidecar" containerID="cri-o://d502423fad600cde246028741ddc497890313fea4a462729384b1fe123a39376" gracePeriod=600 Sep 19 00:01:04.439282 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.439062 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="13a17989-270b-490a-a785-69b15683aa61" containerName="kube-rbac-proxy-thanos" containerID="cri-o://386ab59b469e5e01cf4a8d89fb257086afaf0119fb2bac0aebd0ab7708781592" gracePeriod=600 Sep 19 00:01:04.439282 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.439083 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="13a17989-270b-490a-a785-69b15683aa61" containerName="kube-rbac-proxy" containerID="cri-o://df5dd3683cfb5b8aa55192c7457adb8fcc2792a98f92713d15be00cf372ae86c" gracePeriod=600 Sep 19 00:01:04.439282 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.439017 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="13a17989-270b-490a-a785-69b15683aa61" containerName="prometheus" containerID="cri-o://43ce12170b1aa9ae03dcecf70b17d454857699be3cc1c0309946a88db3af4943" gracePeriod=600 Sep 19 00:01:04.439282 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.439038 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="13a17989-270b-490a-a785-69b15683aa61" containerName="config-reloader" containerID="cri-o://c49d0f849ce5633992ffca5290815fd5c4a6bed824a2f4629915dad086b57d3e" gracePeriod=600 Sep 19 00:01:04.439282 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.439041 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="13a17989-270b-490a-a785-69b15683aa61" containerName="kube-rbac-proxy-web" containerID="cri-o://6266d47316c196714a1a23e1544f7b5b31ee8a26a2e0d26fe7350d5d969a92b0" gracePeriod=600 Sep 19 00:01:04.689365 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.689302 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 19 00:01:04.776685 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.776648 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/13a17989-270b-490a-a785-69b15683aa61-configmap-metrics-client-ca\") pod \"13a17989-270b-490a-a785-69b15683aa61\" (UID: \"13a17989-270b-490a-a785-69b15683aa61\") " Sep 19 00:01:04.776896 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.776696 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/13a17989-270b-490a-a785-69b15683aa61-config\") pod \"13a17989-270b-490a-a785-69b15683aa61\" (UID: \"13a17989-270b-490a-a785-69b15683aa61\") " Sep 19 00:01:04.776896 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.776726 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/13a17989-270b-490a-a785-69b15683aa61-prometheus-k8s-rulefiles-1\") pod \"13a17989-270b-490a-a785-69b15683aa61\" (UID: \"13a17989-270b-490a-a785-69b15683aa61\") " Sep 19 00:01:04.776896 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.776748 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/13a17989-270b-490a-a785-69b15683aa61-web-config\") pod \"13a17989-270b-490a-a785-69b15683aa61\" (UID: \"13a17989-270b-490a-a785-69b15683aa61\") " Sep 19 00:01:04.776896 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.776789 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/13a17989-270b-490a-a785-69b15683aa61-secret-metrics-client-certs\") pod \"13a17989-270b-490a-a785-69b15683aa61\" (UID: \"13a17989-270b-490a-a785-69b15683aa61\") " Sep 19 00:01:04.776896 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.776812 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/13a17989-270b-490a-a785-69b15683aa61-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"13a17989-270b-490a-a785-69b15683aa61\" (UID: \"13a17989-270b-490a-a785-69b15683aa61\") " Sep 19 00:01:04.776896 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.776840 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/13a17989-270b-490a-a785-69b15683aa61-tls-assets\") pod \"13a17989-270b-490a-a785-69b15683aa61\" (UID: \"13a17989-270b-490a-a785-69b15683aa61\") " Sep 19 00:01:04.776896 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.776860 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/13a17989-270b-490a-a785-69b15683aa61-prometheus-k8s-rulefiles-2\") pod \"13a17989-270b-490a-a785-69b15683aa61\" (UID: \"13a17989-270b-490a-a785-69b15683aa61\") " Sep 19 00:01:04.776896 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.776878 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q7qn8\" (UniqueName: \"kubernetes.io/projected/13a17989-270b-490a-a785-69b15683aa61-kube-api-access-q7qn8\") pod \"13a17989-270b-490a-a785-69b15683aa61\" (UID: \"13a17989-270b-490a-a785-69b15683aa61\") " Sep 19 00:01:04.776896 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.776892 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/13a17989-270b-490a-a785-69b15683aa61-secret-grpc-tls\") pod \"13a17989-270b-490a-a785-69b15683aa61\" (UID: \"13a17989-270b-490a-a785-69b15683aa61\") " Sep 19 00:01:04.777419 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.776919 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/13a17989-270b-490a-a785-69b15683aa61-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"13a17989-270b-490a-a785-69b15683aa61\" (UID: \"13a17989-270b-490a-a785-69b15683aa61\") " Sep 19 00:01:04.777419 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.776959 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13a17989-270b-490a-a785-69b15683aa61-prometheus-trusted-ca-bundle\") pod \"13a17989-270b-490a-a785-69b15683aa61\" (UID: \"13a17989-270b-490a-a785-69b15683aa61\") " Sep 19 00:01:04.777419 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.776977 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/13a17989-270b-490a-a785-69b15683aa61-thanos-prometheus-http-client-file\") pod \"13a17989-270b-490a-a785-69b15683aa61\" (UID: \"13a17989-270b-490a-a785-69b15683aa61\") " Sep 19 00:01:04.777419 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.777014 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/13a17989-270b-490a-a785-69b15683aa61-secret-prometheus-k8s-tls\") pod \"13a17989-270b-490a-a785-69b15683aa61\" (UID: \"13a17989-270b-490a-a785-69b15683aa61\") " Sep 19 00:01:04.777419 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.777052 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/13a17989-270b-490a-a785-69b15683aa61-prometheus-k8s-db\") pod \"13a17989-270b-490a-a785-69b15683aa61\" (UID: \"13a17989-270b-490a-a785-69b15683aa61\") " Sep 19 00:01:04.777419 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.777053 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13a17989-270b-490a-a785-69b15683aa61-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "13a17989-270b-490a-a785-69b15683aa61" (UID: "13a17989-270b-490a-a785-69b15683aa61"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 00:01:04.777419 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.777079 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13a17989-270b-490a-a785-69b15683aa61-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "13a17989-270b-490a-a785-69b15683aa61" (UID: "13a17989-270b-490a-a785-69b15683aa61"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 00:01:04.777419 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.777097 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13a17989-270b-490a-a785-69b15683aa61-configmap-serving-certs-ca-bundle\") pod \"13a17989-270b-490a-a785-69b15683aa61\" (UID: \"13a17989-270b-490a-a785-69b15683aa61\") " Sep 19 00:01:04.777419 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.777122 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/13a17989-270b-490a-a785-69b15683aa61-config-out\") pod \"13a17989-270b-490a-a785-69b15683aa61\" (UID: \"13a17989-270b-490a-a785-69b15683aa61\") " Sep 19 00:01:04.777419 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.777141 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/13a17989-270b-490a-a785-69b15683aa61-prometheus-k8s-rulefiles-0\") pod \"13a17989-270b-490a-a785-69b15683aa61\" (UID: \"13a17989-270b-490a-a785-69b15683aa61\") " Sep 19 00:01:04.777419 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.777163 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13a17989-270b-490a-a785-69b15683aa61-configmap-kubelet-serving-ca-bundle\") pod \"13a17989-270b-490a-a785-69b15683aa61\" (UID: \"13a17989-270b-490a-a785-69b15683aa61\") " Sep 19 00:01:04.777419 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.777186 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/13a17989-270b-490a-a785-69b15683aa61-secret-kube-rbac-proxy\") pod \"13a17989-270b-490a-a785-69b15683aa61\" (UID: \"13a17989-270b-490a-a785-69b15683aa61\") " Sep 19 00:01:04.778024 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.777734 2579 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/13a17989-270b-490a-a785-69b15683aa61-configmap-metrics-client-ca\") on node \"ip-10-0-130-53.ec2.internal\" DevicePath \"\"" Sep 19 00:01:04.778024 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.777770 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/13a17989-270b-490a-a785-69b15683aa61-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-130-53.ec2.internal\" DevicePath \"\"" Sep 19 00:01:04.778024 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.777881 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13a17989-270b-490a-a785-69b15683aa61-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "13a17989-270b-490a-a785-69b15683aa61" (UID: "13a17989-270b-490a-a785-69b15683aa61"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 00:01:04.780111 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.778491 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13a17989-270b-490a-a785-69b15683aa61-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "13a17989-270b-490a-a785-69b15683aa61" (UID: "13a17989-270b-490a-a785-69b15683aa61"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 00:01:04.780111 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.778621 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13a17989-270b-490a-a785-69b15683aa61-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "13a17989-270b-490a-a785-69b15683aa61" (UID: "13a17989-270b-490a-a785-69b15683aa61"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 19 00:01:04.780111 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.779374 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13a17989-270b-490a-a785-69b15683aa61-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "13a17989-270b-490a-a785-69b15683aa61" (UID: "13a17989-270b-490a-a785-69b15683aa61"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 00:01:04.780111 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.779585 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13a17989-270b-490a-a785-69b15683aa61-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "13a17989-270b-490a-a785-69b15683aa61" (UID: "13a17989-270b-490a-a785-69b15683aa61"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 00:01:04.780111 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.780077 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13a17989-270b-490a-a785-69b15683aa61-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "13a17989-270b-490a-a785-69b15683aa61" (UID: "13a17989-270b-490a-a785-69b15683aa61"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 00:01:04.781107 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.781007 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13a17989-270b-490a-a785-69b15683aa61-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "13a17989-270b-490a-a785-69b15683aa61" (UID: "13a17989-270b-490a-a785-69b15683aa61"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 00:01:04.781382 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.781347 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13a17989-270b-490a-a785-69b15683aa61-kube-api-access-q7qn8" (OuterVolumeSpecName: "kube-api-access-q7qn8") pod "13a17989-270b-490a-a785-69b15683aa61" (UID: "13a17989-270b-490a-a785-69b15683aa61"). InnerVolumeSpecName "kube-api-access-q7qn8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 00:01:04.781547 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.781502 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13a17989-270b-490a-a785-69b15683aa61-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "13a17989-270b-490a-a785-69b15683aa61" (UID: "13a17989-270b-490a-a785-69b15683aa61"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 00:01:04.781917 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.781894 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13a17989-270b-490a-a785-69b15683aa61-config" (OuterVolumeSpecName: "config") pod "13a17989-270b-490a-a785-69b15683aa61" (UID: "13a17989-270b-490a-a785-69b15683aa61"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 00:01:04.782503 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.782471 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13a17989-270b-490a-a785-69b15683aa61-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "13a17989-270b-490a-a785-69b15683aa61" (UID: "13a17989-270b-490a-a785-69b15683aa61"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 00:01:04.782665 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.782639 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13a17989-270b-490a-a785-69b15683aa61-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "13a17989-270b-490a-a785-69b15683aa61" (UID: "13a17989-270b-490a-a785-69b15683aa61"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 00:01:04.782797 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.782772 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13a17989-270b-490a-a785-69b15683aa61-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "13a17989-270b-490a-a785-69b15683aa61" (UID: "13a17989-270b-490a-a785-69b15683aa61"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 00:01:04.782923 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.782898 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13a17989-270b-490a-a785-69b15683aa61-config-out" (OuterVolumeSpecName: "config-out") pod "13a17989-270b-490a-a785-69b15683aa61" (UID: "13a17989-270b-490a-a785-69b15683aa61"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 19 00:01:04.783052 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.783031 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13a17989-270b-490a-a785-69b15683aa61-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "13a17989-270b-490a-a785-69b15683aa61" (UID: "13a17989-270b-490a-a785-69b15683aa61"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 00:01:04.783126 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.783052 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13a17989-270b-490a-a785-69b15683aa61-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "13a17989-270b-490a-a785-69b15683aa61" (UID: "13a17989-270b-490a-a785-69b15683aa61"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 00:01:04.783606 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.783587 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13a17989-270b-490a-a785-69b15683aa61-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "13a17989-270b-490a-a785-69b15683aa61" (UID: "13a17989-270b-490a-a785-69b15683aa61"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 00:01:04.791553 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.791529 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13a17989-270b-490a-a785-69b15683aa61-web-config" (OuterVolumeSpecName: "web-config") pod "13a17989-270b-490a-a785-69b15683aa61" (UID: "13a17989-270b-490a-a785-69b15683aa61"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 00:01:04.858441 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.858407 2579 generic.go:356] "Generic (PLEG): container finished" podID="13a17989-270b-490a-a785-69b15683aa61" containerID="386ab59b469e5e01cf4a8d89fb257086afaf0119fb2bac0aebd0ab7708781592" exitCode=0 Sep 19 00:01:04.858441 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.858431 2579 generic.go:356] "Generic (PLEG): container finished" podID="13a17989-270b-490a-a785-69b15683aa61" containerID="df5dd3683cfb5b8aa55192c7457adb8fcc2792a98f92713d15be00cf372ae86c" exitCode=0 Sep 19 00:01:04.858441 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.858438 2579 generic.go:356] "Generic (PLEG): container finished" podID="13a17989-270b-490a-a785-69b15683aa61" containerID="6266d47316c196714a1a23e1544f7b5b31ee8a26a2e0d26fe7350d5d969a92b0" exitCode=0 Sep 19 00:01:04.858441 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.858444 2579 generic.go:356] "Generic (PLEG): container finished" podID="13a17989-270b-490a-a785-69b15683aa61" containerID="d502423fad600cde246028741ddc497890313fea4a462729384b1fe123a39376" exitCode=0 Sep 19 00:01:04.858441 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.858449 2579 generic.go:356] "Generic (PLEG): container finished" podID="13a17989-270b-490a-a785-69b15683aa61" containerID="c49d0f849ce5633992ffca5290815fd5c4a6bed824a2f4629915dad086b57d3e" exitCode=0 Sep 19 00:01:04.858441 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.858454 2579 generic.go:356] "Generic (PLEG): container finished" podID="13a17989-270b-490a-a785-69b15683aa61" containerID="43ce12170b1aa9ae03dcecf70b17d454857699be3cc1c0309946a88db3af4943" exitCode=0 Sep 19 00:01:04.858794 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.858487 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 19 00:01:04.858794 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.858486 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"13a17989-270b-490a-a785-69b15683aa61","Type":"ContainerDied","Data":"386ab59b469e5e01cf4a8d89fb257086afaf0119fb2bac0aebd0ab7708781592"} Sep 19 00:01:04.858794 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.858554 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"13a17989-270b-490a-a785-69b15683aa61","Type":"ContainerDied","Data":"df5dd3683cfb5b8aa55192c7457adb8fcc2792a98f92713d15be00cf372ae86c"} Sep 19 00:01:04.858794 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.858583 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"13a17989-270b-490a-a785-69b15683aa61","Type":"ContainerDied","Data":"6266d47316c196714a1a23e1544f7b5b31ee8a26a2e0d26fe7350d5d969a92b0"} Sep 19 00:01:04.858794 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.858610 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"13a17989-270b-490a-a785-69b15683aa61","Type":"ContainerDied","Data":"d502423fad600cde246028741ddc497890313fea4a462729384b1fe123a39376"} Sep 19 00:01:04.858794 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.858620 2579 scope.go:117] "RemoveContainer" containerID="386ab59b469e5e01cf4a8d89fb257086afaf0119fb2bac0aebd0ab7708781592" Sep 19 00:01:04.858794 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.858635 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"13a17989-270b-490a-a785-69b15683aa61","Type":"ContainerDied","Data":"c49d0f849ce5633992ffca5290815fd5c4a6bed824a2f4629915dad086b57d3e"} Sep 19 00:01:04.858794 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.858660 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"13a17989-270b-490a-a785-69b15683aa61","Type":"ContainerDied","Data":"43ce12170b1aa9ae03dcecf70b17d454857699be3cc1c0309946a88db3af4943"} Sep 19 00:01:04.858794 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.858683 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"13a17989-270b-490a-a785-69b15683aa61","Type":"ContainerDied","Data":"828f9d8e2e503079010ebacf245bbf21d6e6fbdccfc89ccdd7b9718a80ed3211"} Sep 19 00:01:04.868558 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.868158 2579 scope.go:117] "RemoveContainer" containerID="df5dd3683cfb5b8aa55192c7457adb8fcc2792a98f92713d15be00cf372ae86c" Sep 19 00:01:04.878965 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.878940 2579 scope.go:117] "RemoveContainer" containerID="6266d47316c196714a1a23e1544f7b5b31ee8a26a2e0d26fe7350d5d969a92b0" Sep 19 00:01:04.879038 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.879023 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13a17989-270b-490a-a785-69b15683aa61-prometheus-trusted-ca-bundle\") on node \"ip-10-0-130-53.ec2.internal\" DevicePath \"\"" Sep 19 00:01:04.879085 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.879046 2579 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/13a17989-270b-490a-a785-69b15683aa61-thanos-prometheus-http-client-file\") on node \"ip-10-0-130-53.ec2.internal\" DevicePath \"\"" Sep 19 00:01:04.879085 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.879063 2579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/13a17989-270b-490a-a785-69b15683aa61-secret-prometheus-k8s-tls\") on node \"ip-10-0-130-53.ec2.internal\" DevicePath \"\"" Sep 19 00:01:04.879085 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.879076 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/13a17989-270b-490a-a785-69b15683aa61-prometheus-k8s-db\") on node \"ip-10-0-130-53.ec2.internal\" DevicePath \"\"" Sep 19 00:01:04.879199 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.879090 2579 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13a17989-270b-490a-a785-69b15683aa61-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-130-53.ec2.internal\" DevicePath \"\"" Sep 19 00:01:04.879199 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.879103 2579 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/13a17989-270b-490a-a785-69b15683aa61-config-out\") on node \"ip-10-0-130-53.ec2.internal\" DevicePath \"\"" Sep 19 00:01:04.879199 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.879117 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/13a17989-270b-490a-a785-69b15683aa61-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-130-53.ec2.internal\" DevicePath \"\"" Sep 19 00:01:04.879199 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.879130 2579 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13a17989-270b-490a-a785-69b15683aa61-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-130-53.ec2.internal\" DevicePath \"\"" Sep 19 00:01:04.879199 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.879142 2579 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/13a17989-270b-490a-a785-69b15683aa61-secret-kube-rbac-proxy\") on node \"ip-10-0-130-53.ec2.internal\" DevicePath \"\"" Sep 19 00:01:04.879199 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.879154 2579 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/13a17989-270b-490a-a785-69b15683aa61-config\") on node \"ip-10-0-130-53.ec2.internal\" DevicePath \"\"" Sep 19 00:01:04.879199 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.879191 2579 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/13a17989-270b-490a-a785-69b15683aa61-web-config\") on node \"ip-10-0-130-53.ec2.internal\" DevicePath \"\"" Sep 19 00:01:04.879430 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.879204 2579 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/13a17989-270b-490a-a785-69b15683aa61-secret-metrics-client-certs\") on node \"ip-10-0-130-53.ec2.internal\" DevicePath \"\"" Sep 19 00:01:04.879430 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.879217 2579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/13a17989-270b-490a-a785-69b15683aa61-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-130-53.ec2.internal\" DevicePath \"\"" Sep 19 00:01:04.879430 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.879232 2579 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/13a17989-270b-490a-a785-69b15683aa61-tls-assets\") on node \"ip-10-0-130-53.ec2.internal\" DevicePath \"\"" Sep 19 00:01:04.879430 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.879245 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/13a17989-270b-490a-a785-69b15683aa61-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-130-53.ec2.internal\" DevicePath \"\"" Sep 19 00:01:04.879430 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.879257 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q7qn8\" (UniqueName: \"kubernetes.io/projected/13a17989-270b-490a-a785-69b15683aa61-kube-api-access-q7qn8\") on node \"ip-10-0-130-53.ec2.internal\" DevicePath \"\"" Sep 19 00:01:04.879430 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.879265 2579 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/13a17989-270b-490a-a785-69b15683aa61-secret-grpc-tls\") on node \"ip-10-0-130-53.ec2.internal\" DevicePath \"\"" Sep 19 00:01:04.879430 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.879274 2579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/13a17989-270b-490a-a785-69b15683aa61-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-130-53.ec2.internal\" DevicePath \"\"" Sep 19 00:01:04.884510 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.884478 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 19 00:01:04.886838 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.886822 2579 scope.go:117] "RemoveContainer" containerID="d502423fad600cde246028741ddc497890313fea4a462729384b1fe123a39376" Sep 19 00:01:04.894767 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.894732 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 19 00:01:04.895015 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.894999 2579 scope.go:117] "RemoveContainer" containerID="c49d0f849ce5633992ffca5290815fd5c4a6bed824a2f4629915dad086b57d3e" Sep 19 00:01:04.902561 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.902544 2579 scope.go:117] "RemoveContainer" containerID="43ce12170b1aa9ae03dcecf70b17d454857699be3cc1c0309946a88db3af4943" Sep 19 00:01:04.910153 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.910134 2579 scope.go:117] "RemoveContainer" containerID="80f358770d7989facae049a9426507417a9097b5a4d3e0919253ab538390b9bd" Sep 19 00:01:04.917146 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.917127 2579 scope.go:117] "RemoveContainer" containerID="386ab59b469e5e01cf4a8d89fb257086afaf0119fb2bac0aebd0ab7708781592" Sep 19 00:01:04.917466 ip-10-0-130-53 kubenswrapper[2579]: E0919 00:01:04.917441 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"386ab59b469e5e01cf4a8d89fb257086afaf0119fb2bac0aebd0ab7708781592\": container with ID starting with 386ab59b469e5e01cf4a8d89fb257086afaf0119fb2bac0aebd0ab7708781592 not found: ID does not exist" containerID="386ab59b469e5e01cf4a8d89fb257086afaf0119fb2bac0aebd0ab7708781592" Sep 19 00:01:04.917539 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.917462 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 19 00:01:04.917539 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.917480 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"386ab59b469e5e01cf4a8d89fb257086afaf0119fb2bac0aebd0ab7708781592"} err="failed to get container status \"386ab59b469e5e01cf4a8d89fb257086afaf0119fb2bac0aebd0ab7708781592\": rpc error: code = NotFound desc = could not find container \"386ab59b469e5e01cf4a8d89fb257086afaf0119fb2bac0aebd0ab7708781592\": container with ID starting with 386ab59b469e5e01cf4a8d89fb257086afaf0119fb2bac0aebd0ab7708781592 not found: ID does not exist" Sep 19 00:01:04.917539 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.917526 2579 scope.go:117] "RemoveContainer" containerID="df5dd3683cfb5b8aa55192c7457adb8fcc2792a98f92713d15be00cf372ae86c" Sep 19 00:01:04.917726 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.917714 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13a17989-270b-490a-a785-69b15683aa61" containerName="prometheus" Sep 19 00:01:04.917804 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.917728 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="13a17989-270b-490a-a785-69b15683aa61" containerName="prometheus" Sep 19 00:01:04.917804 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.917737 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13a17989-270b-490a-a785-69b15683aa61" containerName="kube-rbac-proxy" Sep 19 00:01:04.917804 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.917742 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="13a17989-270b-490a-a785-69b15683aa61" containerName="kube-rbac-proxy" Sep 19 00:01:04.917804 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.917768 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13a17989-270b-490a-a785-69b15683aa61" containerName="init-config-reloader" Sep 19 00:01:04.917804 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.917776 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="13a17989-270b-490a-a785-69b15683aa61" containerName="init-config-reloader" Sep 19 00:01:04.917804 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.917787 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13a17989-270b-490a-a785-69b15683aa61" containerName="kube-rbac-proxy-thanos" Sep 19 00:01:04.917804 ip-10-0-130-53 kubenswrapper[2579]: E0919 00:01:04.917786 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df5dd3683cfb5b8aa55192c7457adb8fcc2792a98f92713d15be00cf372ae86c\": container with ID starting with df5dd3683cfb5b8aa55192c7457adb8fcc2792a98f92713d15be00cf372ae86c not found: ID does not exist" containerID="df5dd3683cfb5b8aa55192c7457adb8fcc2792a98f92713d15be00cf372ae86c" Sep 19 00:01:04.918073 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.917811 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df5dd3683cfb5b8aa55192c7457adb8fcc2792a98f92713d15be00cf372ae86c"} err="failed to get container status \"df5dd3683cfb5b8aa55192c7457adb8fcc2792a98f92713d15be00cf372ae86c\": rpc error: code = NotFound desc = could not find container \"df5dd3683cfb5b8aa55192c7457adb8fcc2792a98f92713d15be00cf372ae86c\": container with ID starting with df5dd3683cfb5b8aa55192c7457adb8fcc2792a98f92713d15be00cf372ae86c not found: ID does not exist" Sep 19 00:01:04.918073 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.917826 2579 scope.go:117] "RemoveContainer" containerID="6266d47316c196714a1a23e1544f7b5b31ee8a26a2e0d26fe7350d5d969a92b0" Sep 19 00:01:04.918073 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.917792 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="13a17989-270b-490a-a785-69b15683aa61" containerName="kube-rbac-proxy-thanos" Sep 19 00:01:04.918073 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.917872 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13a17989-270b-490a-a785-69b15683aa61" containerName="config-reloader" Sep 19 00:01:04.918073 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.917882 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="13a17989-270b-490a-a785-69b15683aa61" containerName="config-reloader" Sep 19 00:01:04.918073 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.917894 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13a17989-270b-490a-a785-69b15683aa61" containerName="thanos-sidecar" Sep 19 00:01:04.918073 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.917902 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="13a17989-270b-490a-a785-69b15683aa61" containerName="thanos-sidecar" Sep 19 00:01:04.918073 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.917921 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13a17989-270b-490a-a785-69b15683aa61" containerName="kube-rbac-proxy-web" Sep 19 00:01:04.918073 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.917929 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="13a17989-270b-490a-a785-69b15683aa61" containerName="kube-rbac-proxy-web" Sep 19 00:01:04.918073 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.918016 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="13a17989-270b-490a-a785-69b15683aa61" containerName="config-reloader" Sep 19 00:01:04.918073 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.918028 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="13a17989-270b-490a-a785-69b15683aa61" containerName="kube-rbac-proxy" Sep 19 00:01:04.918073 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.918037 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="13a17989-270b-490a-a785-69b15683aa61" containerName="kube-rbac-proxy-web" Sep 19 00:01:04.918073 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.918045 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="13a17989-270b-490a-a785-69b15683aa61" containerName="kube-rbac-proxy-thanos" Sep 19 00:01:04.918073 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.918053 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="13a17989-270b-490a-a785-69b15683aa61" containerName="prometheus" Sep 19 00:01:04.918073 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.918059 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="13a17989-270b-490a-a785-69b15683aa61" containerName="thanos-sidecar" Sep 19 00:01:04.918544 ip-10-0-130-53 kubenswrapper[2579]: E0919 00:01:04.918119 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6266d47316c196714a1a23e1544f7b5b31ee8a26a2e0d26fe7350d5d969a92b0\": container with ID starting with 6266d47316c196714a1a23e1544f7b5b31ee8a26a2e0d26fe7350d5d969a92b0 not found: ID does not exist" containerID="6266d47316c196714a1a23e1544f7b5b31ee8a26a2e0d26fe7350d5d969a92b0" Sep 19 00:01:04.918544 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.918136 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6266d47316c196714a1a23e1544f7b5b31ee8a26a2e0d26fe7350d5d969a92b0"} err="failed to get container status \"6266d47316c196714a1a23e1544f7b5b31ee8a26a2e0d26fe7350d5d969a92b0\": rpc error: code = NotFound desc = could not find container \"6266d47316c196714a1a23e1544f7b5b31ee8a26a2e0d26fe7350d5d969a92b0\": container with ID starting with 6266d47316c196714a1a23e1544f7b5b31ee8a26a2e0d26fe7350d5d969a92b0 not found: ID does not exist" Sep 19 00:01:04.918544 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.918151 2579 scope.go:117] "RemoveContainer" containerID="d502423fad600cde246028741ddc497890313fea4a462729384b1fe123a39376" Sep 19 00:01:04.918544 ip-10-0-130-53 kubenswrapper[2579]: E0919 00:01:04.918378 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d502423fad600cde246028741ddc497890313fea4a462729384b1fe123a39376\": container with ID starting with d502423fad600cde246028741ddc497890313fea4a462729384b1fe123a39376 not found: ID does not exist" containerID="d502423fad600cde246028741ddc497890313fea4a462729384b1fe123a39376" Sep 19 00:01:04.918544 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.918395 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d502423fad600cde246028741ddc497890313fea4a462729384b1fe123a39376"} err="failed to get container status \"d502423fad600cde246028741ddc497890313fea4a462729384b1fe123a39376\": rpc error: code = NotFound desc = could not find container \"d502423fad600cde246028741ddc497890313fea4a462729384b1fe123a39376\": container with ID starting with d502423fad600cde246028741ddc497890313fea4a462729384b1fe123a39376 not found: ID does not exist" Sep 19 00:01:04.918544 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.918407 2579 scope.go:117] "RemoveContainer" containerID="c49d0f849ce5633992ffca5290815fd5c4a6bed824a2f4629915dad086b57d3e" Sep 19 00:01:04.918833 ip-10-0-130-53 kubenswrapper[2579]: E0919 00:01:04.918626 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c49d0f849ce5633992ffca5290815fd5c4a6bed824a2f4629915dad086b57d3e\": container with ID starting with c49d0f849ce5633992ffca5290815fd5c4a6bed824a2f4629915dad086b57d3e not found: ID does not exist" containerID="c49d0f849ce5633992ffca5290815fd5c4a6bed824a2f4629915dad086b57d3e" Sep 19 00:01:04.918833 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.918658 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c49d0f849ce5633992ffca5290815fd5c4a6bed824a2f4629915dad086b57d3e"} err="failed to get container status \"c49d0f849ce5633992ffca5290815fd5c4a6bed824a2f4629915dad086b57d3e\": rpc error: code = NotFound desc = could not find container \"c49d0f849ce5633992ffca5290815fd5c4a6bed824a2f4629915dad086b57d3e\": container with ID starting with c49d0f849ce5633992ffca5290815fd5c4a6bed824a2f4629915dad086b57d3e not found: ID does not exist" Sep 19 00:01:04.918833 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.918679 2579 scope.go:117] "RemoveContainer" containerID="43ce12170b1aa9ae03dcecf70b17d454857699be3cc1c0309946a88db3af4943" Sep 19 00:01:04.918953 ip-10-0-130-53 kubenswrapper[2579]: E0919 00:01:04.918919 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43ce12170b1aa9ae03dcecf70b17d454857699be3cc1c0309946a88db3af4943\": container with ID starting with 43ce12170b1aa9ae03dcecf70b17d454857699be3cc1c0309946a88db3af4943 not found: ID does not exist" containerID="43ce12170b1aa9ae03dcecf70b17d454857699be3cc1c0309946a88db3af4943" Sep 19 00:01:04.918953 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.918937 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43ce12170b1aa9ae03dcecf70b17d454857699be3cc1c0309946a88db3af4943"} err="failed to get container status \"43ce12170b1aa9ae03dcecf70b17d454857699be3cc1c0309946a88db3af4943\": rpc error: code = NotFound desc = could not find container \"43ce12170b1aa9ae03dcecf70b17d454857699be3cc1c0309946a88db3af4943\": container with ID starting with 43ce12170b1aa9ae03dcecf70b17d454857699be3cc1c0309946a88db3af4943 not found: ID does not exist" Sep 19 00:01:04.918953 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.918951 2579 scope.go:117] "RemoveContainer" containerID="80f358770d7989facae049a9426507417a9097b5a4d3e0919253ab538390b9bd" Sep 19 00:01:04.919201 ip-10-0-130-53 kubenswrapper[2579]: E0919 00:01:04.919187 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80f358770d7989facae049a9426507417a9097b5a4d3e0919253ab538390b9bd\": container with ID starting with 80f358770d7989facae049a9426507417a9097b5a4d3e0919253ab538390b9bd not found: ID does not exist" containerID="80f358770d7989facae049a9426507417a9097b5a4d3e0919253ab538390b9bd" Sep 19 00:01:04.919247 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.919203 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80f358770d7989facae049a9426507417a9097b5a4d3e0919253ab538390b9bd"} err="failed to get container status \"80f358770d7989facae049a9426507417a9097b5a4d3e0919253ab538390b9bd\": rpc error: code = NotFound desc = could not find container \"80f358770d7989facae049a9426507417a9097b5a4d3e0919253ab538390b9bd\": container with ID starting with 80f358770d7989facae049a9426507417a9097b5a4d3e0919253ab538390b9bd not found: ID does not exist" Sep 19 00:01:04.919247 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.919214 2579 scope.go:117] "RemoveContainer" containerID="386ab59b469e5e01cf4a8d89fb257086afaf0119fb2bac0aebd0ab7708781592" Sep 19 00:01:04.919474 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.919456 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"386ab59b469e5e01cf4a8d89fb257086afaf0119fb2bac0aebd0ab7708781592"} err="failed to get container status \"386ab59b469e5e01cf4a8d89fb257086afaf0119fb2bac0aebd0ab7708781592\": rpc error: code = NotFound desc = could not find container \"386ab59b469e5e01cf4a8d89fb257086afaf0119fb2bac0aebd0ab7708781592\": container with ID starting with 386ab59b469e5e01cf4a8d89fb257086afaf0119fb2bac0aebd0ab7708781592 not found: ID does not exist" Sep 19 00:01:04.919547 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.919476 2579 scope.go:117] "RemoveContainer" containerID="df5dd3683cfb5b8aa55192c7457adb8fcc2792a98f92713d15be00cf372ae86c" Sep 19 00:01:04.919833 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.919797 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df5dd3683cfb5b8aa55192c7457adb8fcc2792a98f92713d15be00cf372ae86c"} err="failed to get container status \"df5dd3683cfb5b8aa55192c7457adb8fcc2792a98f92713d15be00cf372ae86c\": rpc error: code = NotFound desc = could not find container \"df5dd3683cfb5b8aa55192c7457adb8fcc2792a98f92713d15be00cf372ae86c\": container with ID starting with df5dd3683cfb5b8aa55192c7457adb8fcc2792a98f92713d15be00cf372ae86c not found: ID does not exist" Sep 19 00:01:04.919926 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.919834 2579 scope.go:117] "RemoveContainer" containerID="6266d47316c196714a1a23e1544f7b5b31ee8a26a2e0d26fe7350d5d969a92b0" Sep 19 00:01:04.920152 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.920125 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6266d47316c196714a1a23e1544f7b5b31ee8a26a2e0d26fe7350d5d969a92b0"} err="failed to get container status \"6266d47316c196714a1a23e1544f7b5b31ee8a26a2e0d26fe7350d5d969a92b0\": rpc error: code = NotFound desc = could not find container \"6266d47316c196714a1a23e1544f7b5b31ee8a26a2e0d26fe7350d5d969a92b0\": container with ID starting with 6266d47316c196714a1a23e1544f7b5b31ee8a26a2e0d26fe7350d5d969a92b0 not found: ID does not exist" Sep 19 00:01:04.920152 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.920156 2579 scope.go:117] "RemoveContainer" containerID="d502423fad600cde246028741ddc497890313fea4a462729384b1fe123a39376" Sep 19 00:01:04.920439 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.920419 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d502423fad600cde246028741ddc497890313fea4a462729384b1fe123a39376"} err="failed to get container status \"d502423fad600cde246028741ddc497890313fea4a462729384b1fe123a39376\": rpc error: code = NotFound desc = could not find container \"d502423fad600cde246028741ddc497890313fea4a462729384b1fe123a39376\": container with ID starting with d502423fad600cde246028741ddc497890313fea4a462729384b1fe123a39376 not found: ID does not exist" Sep 19 00:01:04.920439 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.920440 2579 scope.go:117] "RemoveContainer" containerID="c49d0f849ce5633992ffca5290815fd5c4a6bed824a2f4629915dad086b57d3e" Sep 19 00:01:04.920689 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.920674 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c49d0f849ce5633992ffca5290815fd5c4a6bed824a2f4629915dad086b57d3e"} err="failed to get container status \"c49d0f849ce5633992ffca5290815fd5c4a6bed824a2f4629915dad086b57d3e\": rpc error: code = NotFound desc = could not find container \"c49d0f849ce5633992ffca5290815fd5c4a6bed824a2f4629915dad086b57d3e\": container with ID starting with c49d0f849ce5633992ffca5290815fd5c4a6bed824a2f4629915dad086b57d3e not found: ID does not exist" Sep 19 00:01:04.920772 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.920689 2579 scope.go:117] "RemoveContainer" containerID="43ce12170b1aa9ae03dcecf70b17d454857699be3cc1c0309946a88db3af4943" Sep 19 00:01:04.920991 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.920971 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43ce12170b1aa9ae03dcecf70b17d454857699be3cc1c0309946a88db3af4943"} err="failed to get container status \"43ce12170b1aa9ae03dcecf70b17d454857699be3cc1c0309946a88db3af4943\": rpc error: code = NotFound desc = could not find container \"43ce12170b1aa9ae03dcecf70b17d454857699be3cc1c0309946a88db3af4943\": container with ID starting with 43ce12170b1aa9ae03dcecf70b17d454857699be3cc1c0309946a88db3af4943 not found: ID does not exist" Sep 19 00:01:04.921070 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.920994 2579 scope.go:117] "RemoveContainer" containerID="80f358770d7989facae049a9426507417a9097b5a4d3e0919253ab538390b9bd" Sep 19 00:01:04.921264 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.921246 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80f358770d7989facae049a9426507417a9097b5a4d3e0919253ab538390b9bd"} err="failed to get container status \"80f358770d7989facae049a9426507417a9097b5a4d3e0919253ab538390b9bd\": rpc error: code = NotFound desc = could not find container \"80f358770d7989facae049a9426507417a9097b5a4d3e0919253ab538390b9bd\": container with ID starting with 80f358770d7989facae049a9426507417a9097b5a4d3e0919253ab538390b9bd not found: ID does not exist" Sep 19 00:01:04.921309 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.921265 2579 scope.go:117] "RemoveContainer" containerID="386ab59b469e5e01cf4a8d89fb257086afaf0119fb2bac0aebd0ab7708781592" Sep 19 00:01:04.921453 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.921436 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"386ab59b469e5e01cf4a8d89fb257086afaf0119fb2bac0aebd0ab7708781592"} err="failed to get container status \"386ab59b469e5e01cf4a8d89fb257086afaf0119fb2bac0aebd0ab7708781592\": rpc error: code = NotFound desc = could not find container \"386ab59b469e5e01cf4a8d89fb257086afaf0119fb2bac0aebd0ab7708781592\": container with ID starting with 386ab59b469e5e01cf4a8d89fb257086afaf0119fb2bac0aebd0ab7708781592 not found: ID does not exist" Sep 19 00:01:04.921513 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.921455 2579 scope.go:117] "RemoveContainer" containerID="df5dd3683cfb5b8aa55192c7457adb8fcc2792a98f92713d15be00cf372ae86c" Sep 19 00:01:04.921709 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.921691 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df5dd3683cfb5b8aa55192c7457adb8fcc2792a98f92713d15be00cf372ae86c"} err="failed to get container status \"df5dd3683cfb5b8aa55192c7457adb8fcc2792a98f92713d15be00cf372ae86c\": rpc error: code = NotFound desc = could not find container \"df5dd3683cfb5b8aa55192c7457adb8fcc2792a98f92713d15be00cf372ae86c\": container with ID starting with df5dd3683cfb5b8aa55192c7457adb8fcc2792a98f92713d15be00cf372ae86c not found: ID does not exist" Sep 19 00:01:04.921778 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.921711 2579 scope.go:117] "RemoveContainer" containerID="6266d47316c196714a1a23e1544f7b5b31ee8a26a2e0d26fe7350d5d969a92b0" Sep 19 00:01:04.921971 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.921956 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6266d47316c196714a1a23e1544f7b5b31ee8a26a2e0d26fe7350d5d969a92b0"} err="failed to get container status \"6266d47316c196714a1a23e1544f7b5b31ee8a26a2e0d26fe7350d5d969a92b0\": rpc error: code = NotFound desc = could not find container \"6266d47316c196714a1a23e1544f7b5b31ee8a26a2e0d26fe7350d5d969a92b0\": container with ID starting with 6266d47316c196714a1a23e1544f7b5b31ee8a26a2e0d26fe7350d5d969a92b0 not found: ID does not exist" Sep 19 00:01:04.922020 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.921971 2579 scope.go:117] "RemoveContainer" containerID="d502423fad600cde246028741ddc497890313fea4a462729384b1fe123a39376" Sep 19 00:01:04.922179 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.922160 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d502423fad600cde246028741ddc497890313fea4a462729384b1fe123a39376"} err="failed to get container status \"d502423fad600cde246028741ddc497890313fea4a462729384b1fe123a39376\": rpc error: code = NotFound desc = could not find container \"d502423fad600cde246028741ddc497890313fea4a462729384b1fe123a39376\": container with ID starting with d502423fad600cde246028741ddc497890313fea4a462729384b1fe123a39376 not found: ID does not exist" Sep 19 00:01:04.922248 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.922181 2579 scope.go:117] "RemoveContainer" containerID="c49d0f849ce5633992ffca5290815fd5c4a6bed824a2f4629915dad086b57d3e" Sep 19 00:01:04.922392 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.922378 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c49d0f849ce5633992ffca5290815fd5c4a6bed824a2f4629915dad086b57d3e"} err="failed to get container status \"c49d0f849ce5633992ffca5290815fd5c4a6bed824a2f4629915dad086b57d3e\": rpc error: code = NotFound desc = could not find container \"c49d0f849ce5633992ffca5290815fd5c4a6bed824a2f4629915dad086b57d3e\": container with ID starting with c49d0f849ce5633992ffca5290815fd5c4a6bed824a2f4629915dad086b57d3e not found: ID does not exist" Sep 19 00:01:04.922437 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.922392 2579 scope.go:117] "RemoveContainer" containerID="43ce12170b1aa9ae03dcecf70b17d454857699be3cc1c0309946a88db3af4943" Sep 19 00:01:04.922582 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.922566 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43ce12170b1aa9ae03dcecf70b17d454857699be3cc1c0309946a88db3af4943"} err="failed to get container status \"43ce12170b1aa9ae03dcecf70b17d454857699be3cc1c0309946a88db3af4943\": rpc error: code = NotFound desc = could not find container \"43ce12170b1aa9ae03dcecf70b17d454857699be3cc1c0309946a88db3af4943\": container with ID starting with 43ce12170b1aa9ae03dcecf70b17d454857699be3cc1c0309946a88db3af4943 not found: ID does not exist" Sep 19 00:01:04.922622 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.922583 2579 scope.go:117] "RemoveContainer" containerID="80f358770d7989facae049a9426507417a9097b5a4d3e0919253ab538390b9bd" Sep 19 00:01:04.922790 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.922770 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80f358770d7989facae049a9426507417a9097b5a4d3e0919253ab538390b9bd"} err="failed to get container status \"80f358770d7989facae049a9426507417a9097b5a4d3e0919253ab538390b9bd\": rpc error: code = NotFound desc = could not find container \"80f358770d7989facae049a9426507417a9097b5a4d3e0919253ab538390b9bd\": container with ID starting with 80f358770d7989facae049a9426507417a9097b5a4d3e0919253ab538390b9bd not found: ID does not exist" Sep 19 00:01:04.922832 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.922791 2579 scope.go:117] "RemoveContainer" containerID="386ab59b469e5e01cf4a8d89fb257086afaf0119fb2bac0aebd0ab7708781592" Sep 19 00:01:04.922998 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.922978 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"386ab59b469e5e01cf4a8d89fb257086afaf0119fb2bac0aebd0ab7708781592"} err="failed to get container status \"386ab59b469e5e01cf4a8d89fb257086afaf0119fb2bac0aebd0ab7708781592\": rpc error: code = NotFound desc = could not find container \"386ab59b469e5e01cf4a8d89fb257086afaf0119fb2bac0aebd0ab7708781592\": container with ID starting with 386ab59b469e5e01cf4a8d89fb257086afaf0119fb2bac0aebd0ab7708781592 not found: ID does not exist" Sep 19 00:01:04.923033 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.923000 2579 scope.go:117] "RemoveContainer" containerID="df5dd3683cfb5b8aa55192c7457adb8fcc2792a98f92713d15be00cf372ae86c" Sep 19 00:01:04.923220 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.923203 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df5dd3683cfb5b8aa55192c7457adb8fcc2792a98f92713d15be00cf372ae86c"} err="failed to get container status \"df5dd3683cfb5b8aa55192c7457adb8fcc2792a98f92713d15be00cf372ae86c\": rpc error: code = NotFound desc = could not find container \"df5dd3683cfb5b8aa55192c7457adb8fcc2792a98f92713d15be00cf372ae86c\": container with ID starting with df5dd3683cfb5b8aa55192c7457adb8fcc2792a98f92713d15be00cf372ae86c not found: ID does not exist" Sep 19 00:01:04.923258 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.923221 2579 scope.go:117] "RemoveContainer" containerID="6266d47316c196714a1a23e1544f7b5b31ee8a26a2e0d26fe7350d5d969a92b0" Sep 19 00:01:04.923454 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.923439 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6266d47316c196714a1a23e1544f7b5b31ee8a26a2e0d26fe7350d5d969a92b0"} err="failed to get container status \"6266d47316c196714a1a23e1544f7b5b31ee8a26a2e0d26fe7350d5d969a92b0\": rpc error: code = NotFound desc = could not find container \"6266d47316c196714a1a23e1544f7b5b31ee8a26a2e0d26fe7350d5d969a92b0\": container with ID starting with 6266d47316c196714a1a23e1544f7b5b31ee8a26a2e0d26fe7350d5d969a92b0 not found: ID does not exist" Sep 19 00:01:04.923454 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.923453 2579 scope.go:117] "RemoveContainer" containerID="d502423fad600cde246028741ddc497890313fea4a462729384b1fe123a39376" Sep 19 00:01:04.923668 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.923651 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 19 00:01:04.923799 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.923650 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d502423fad600cde246028741ddc497890313fea4a462729384b1fe123a39376"} err="failed to get container status \"d502423fad600cde246028741ddc497890313fea4a462729384b1fe123a39376\": rpc error: code = NotFound desc = could not find container \"d502423fad600cde246028741ddc497890313fea4a462729384b1fe123a39376\": container with ID starting with d502423fad600cde246028741ddc497890313fea4a462729384b1fe123a39376 not found: ID does not exist" Sep 19 00:01:04.924137 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.923803 2579 scope.go:117] "RemoveContainer" containerID="c49d0f849ce5633992ffca5290815fd5c4a6bed824a2f4629915dad086b57d3e" Sep 19 00:01:04.924281 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.924257 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c49d0f849ce5633992ffca5290815fd5c4a6bed824a2f4629915dad086b57d3e"} err="failed to get container status \"c49d0f849ce5633992ffca5290815fd5c4a6bed824a2f4629915dad086b57d3e\": rpc error: code = NotFound desc = could not find container \"c49d0f849ce5633992ffca5290815fd5c4a6bed824a2f4629915dad086b57d3e\": container with ID starting with c49d0f849ce5633992ffca5290815fd5c4a6bed824a2f4629915dad086b57d3e not found: ID does not exist" Sep 19 00:01:04.924281 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.924280 2579 scope.go:117] "RemoveContainer" containerID="43ce12170b1aa9ae03dcecf70b17d454857699be3cc1c0309946a88db3af4943" Sep 19 00:01:04.924555 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.924534 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43ce12170b1aa9ae03dcecf70b17d454857699be3cc1c0309946a88db3af4943"} err="failed to get container status \"43ce12170b1aa9ae03dcecf70b17d454857699be3cc1c0309946a88db3af4943\": rpc error: code = NotFound desc = could not find container \"43ce12170b1aa9ae03dcecf70b17d454857699be3cc1c0309946a88db3af4943\": container with ID starting with 43ce12170b1aa9ae03dcecf70b17d454857699be3cc1c0309946a88db3af4943 not found: ID does not exist" Sep 19 00:01:04.924638 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.924556 2579 scope.go:117] "RemoveContainer" containerID="80f358770d7989facae049a9426507417a9097b5a4d3e0919253ab538390b9bd" Sep 19 00:01:04.924810 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.924792 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80f358770d7989facae049a9426507417a9097b5a4d3e0919253ab538390b9bd"} err="failed to get container status \"80f358770d7989facae049a9426507417a9097b5a4d3e0919253ab538390b9bd\": rpc error: code = NotFound desc = could not find container \"80f358770d7989facae049a9426507417a9097b5a4d3e0919253ab538390b9bd\": container with ID starting with 80f358770d7989facae049a9426507417a9097b5a4d3e0919253ab538390b9bd not found: ID does not exist" Sep 19 00:01:04.924867 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.924810 2579 scope.go:117] "RemoveContainer" containerID="386ab59b469e5e01cf4a8d89fb257086afaf0119fb2bac0aebd0ab7708781592" Sep 19 00:01:04.925039 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.925012 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"386ab59b469e5e01cf4a8d89fb257086afaf0119fb2bac0aebd0ab7708781592"} err="failed to get container status \"386ab59b469e5e01cf4a8d89fb257086afaf0119fb2bac0aebd0ab7708781592\": rpc error: code = NotFound desc = could not find container \"386ab59b469e5e01cf4a8d89fb257086afaf0119fb2bac0aebd0ab7708781592\": container with ID starting with 386ab59b469e5e01cf4a8d89fb257086afaf0119fb2bac0aebd0ab7708781592 not found: ID does not exist" Sep 19 00:01:04.925086 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.925062 2579 scope.go:117] "RemoveContainer" containerID="df5dd3683cfb5b8aa55192c7457adb8fcc2792a98f92713d15be00cf372ae86c" Sep 19 00:01:04.925295 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.925278 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df5dd3683cfb5b8aa55192c7457adb8fcc2792a98f92713d15be00cf372ae86c"} err="failed to get container status \"df5dd3683cfb5b8aa55192c7457adb8fcc2792a98f92713d15be00cf372ae86c\": rpc error: code = NotFound desc = could not find container \"df5dd3683cfb5b8aa55192c7457adb8fcc2792a98f92713d15be00cf372ae86c\": container with ID starting with df5dd3683cfb5b8aa55192c7457adb8fcc2792a98f92713d15be00cf372ae86c not found: ID does not exist" Sep 19 00:01:04.925365 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.925297 2579 scope.go:117] "RemoveContainer" containerID="6266d47316c196714a1a23e1544f7b5b31ee8a26a2e0d26fe7350d5d969a92b0" Sep 19 00:01:04.925519 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.925503 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6266d47316c196714a1a23e1544f7b5b31ee8a26a2e0d26fe7350d5d969a92b0"} err="failed to get container status \"6266d47316c196714a1a23e1544f7b5b31ee8a26a2e0d26fe7350d5d969a92b0\": rpc error: code = NotFound desc = could not find container \"6266d47316c196714a1a23e1544f7b5b31ee8a26a2e0d26fe7350d5d969a92b0\": container with ID starting with 6266d47316c196714a1a23e1544f7b5b31ee8a26a2e0d26fe7350d5d969a92b0 not found: ID does not exist" Sep 19 00:01:04.925566 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.925519 2579 scope.go:117] "RemoveContainer" containerID="d502423fad600cde246028741ddc497890313fea4a462729384b1fe123a39376" Sep 19 00:01:04.925761 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.925732 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d502423fad600cde246028741ddc497890313fea4a462729384b1fe123a39376"} err="failed to get container status \"d502423fad600cde246028741ddc497890313fea4a462729384b1fe123a39376\": rpc error: code = NotFound desc = could not find container \"d502423fad600cde246028741ddc497890313fea4a462729384b1fe123a39376\": container with ID starting with d502423fad600cde246028741ddc497890313fea4a462729384b1fe123a39376 not found: ID does not exist" Sep 19 00:01:04.925831 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.925763 2579 scope.go:117] "RemoveContainer" containerID="c49d0f849ce5633992ffca5290815fd5c4a6bed824a2f4629915dad086b57d3e" Sep 19 00:01:04.925999 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.925981 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c49d0f849ce5633992ffca5290815fd5c4a6bed824a2f4629915dad086b57d3e"} err="failed to get container status \"c49d0f849ce5633992ffca5290815fd5c4a6bed824a2f4629915dad086b57d3e\": rpc error: code = NotFound desc = could not find container \"c49d0f849ce5633992ffca5290815fd5c4a6bed824a2f4629915dad086b57d3e\": container with ID starting with c49d0f849ce5633992ffca5290815fd5c4a6bed824a2f4629915dad086b57d3e not found: ID does not exist" Sep 19 00:01:04.926067 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.925999 2579 scope.go:117] "RemoveContainer" containerID="43ce12170b1aa9ae03dcecf70b17d454857699be3cc1c0309946a88db3af4943" Sep 19 00:01:04.926224 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.926206 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43ce12170b1aa9ae03dcecf70b17d454857699be3cc1c0309946a88db3af4943"} err="failed to get container status \"43ce12170b1aa9ae03dcecf70b17d454857699be3cc1c0309946a88db3af4943\": rpc error: code = NotFound desc = could not find container \"43ce12170b1aa9ae03dcecf70b17d454857699be3cc1c0309946a88db3af4943\": container with ID starting with 43ce12170b1aa9ae03dcecf70b17d454857699be3cc1c0309946a88db3af4943 not found: ID does not exist" Sep 19 00:01:04.926273 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.926226 2579 scope.go:117] "RemoveContainer" containerID="80f358770d7989facae049a9426507417a9097b5a4d3e0919253ab538390b9bd" Sep 19 00:01:04.926491 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.926451 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80f358770d7989facae049a9426507417a9097b5a4d3e0919253ab538390b9bd"} err="failed to get container status \"80f358770d7989facae049a9426507417a9097b5a4d3e0919253ab538390b9bd\": rpc error: code = NotFound desc = could not find container \"80f358770d7989facae049a9426507417a9097b5a4d3e0919253ab538390b9bd\": container with ID starting with 80f358770d7989facae049a9426507417a9097b5a4d3e0919253ab538390b9bd not found: ID does not exist" Sep 19 00:01:04.926491 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.926475 2579 scope.go:117] "RemoveContainer" containerID="386ab59b469e5e01cf4a8d89fb257086afaf0119fb2bac0aebd0ab7708781592" Sep 19 00:01:04.927021 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.926728 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"386ab59b469e5e01cf4a8d89fb257086afaf0119fb2bac0aebd0ab7708781592"} err="failed to get container status \"386ab59b469e5e01cf4a8d89fb257086afaf0119fb2bac0aebd0ab7708781592\": rpc error: code = NotFound desc = could not find container \"386ab59b469e5e01cf4a8d89fb257086afaf0119fb2bac0aebd0ab7708781592\": container with ID starting with 386ab59b469e5e01cf4a8d89fb257086afaf0119fb2bac0aebd0ab7708781592 not found: ID does not exist" Sep 19 00:01:04.927021 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.926770 2579 scope.go:117] "RemoveContainer" containerID="df5dd3683cfb5b8aa55192c7457adb8fcc2792a98f92713d15be00cf372ae86c" Sep 19 00:01:04.927021 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.926786 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 19 00:01:04.927021 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.926789 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 19 00:01:04.927021 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.926847 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 19 00:01:04.927021 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.926857 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 19 00:01:04.927021 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.926875 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 19 00:01:04.927021 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.926902 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 19 00:01:04.927021 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.926863 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-69g8nskjgtg97\"" Sep 19 00:01:04.927021 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.926981 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 19 00:01:04.927530 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.927042 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df5dd3683cfb5b8aa55192c7457adb8fcc2792a98f92713d15be00cf372ae86c"} err="failed to get container status \"df5dd3683cfb5b8aa55192c7457adb8fcc2792a98f92713d15be00cf372ae86c\": rpc error: code = NotFound desc = could not find container \"df5dd3683cfb5b8aa55192c7457adb8fcc2792a98f92713d15be00cf372ae86c\": container with ID starting with df5dd3683cfb5b8aa55192c7457adb8fcc2792a98f92713d15be00cf372ae86c not found: ID does not exist" Sep 19 00:01:04.927530 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.927063 2579 scope.go:117] "RemoveContainer" containerID="6266d47316c196714a1a23e1544f7b5b31ee8a26a2e0d26fe7350d5d969a92b0" Sep 19 00:01:04.927530 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.927136 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 19 00:01:04.927530 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.927176 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 19 00:01:04.927530 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.927188 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 19 00:01:04.927530 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.927341 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6266d47316c196714a1a23e1544f7b5b31ee8a26a2e0d26fe7350d5d969a92b0"} err="failed to get container status \"6266d47316c196714a1a23e1544f7b5b31ee8a26a2e0d26fe7350d5d969a92b0\": rpc error: code = NotFound desc = could not find container \"6266d47316c196714a1a23e1544f7b5b31ee8a26a2e0d26fe7350d5d969a92b0\": container with ID starting with 6266d47316c196714a1a23e1544f7b5b31ee8a26a2e0d26fe7350d5d969a92b0 not found: ID does not exist" Sep 19 00:01:04.927530 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.927367 2579 scope.go:117] "RemoveContainer" containerID="d502423fad600cde246028741ddc497890313fea4a462729384b1fe123a39376" Sep 19 00:01:04.927530 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.927493 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 19 00:01:04.927946 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.927626 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 19 00:01:04.927946 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.927632 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d502423fad600cde246028741ddc497890313fea4a462729384b1fe123a39376"} err="failed to get container status \"d502423fad600cde246028741ddc497890313fea4a462729384b1fe123a39376\": rpc error: code = NotFound desc = could not find container \"d502423fad600cde246028741ddc497890313fea4a462729384b1fe123a39376\": container with ID starting with d502423fad600cde246028741ddc497890313fea4a462729384b1fe123a39376 not found: ID does not exist" Sep 19 00:01:04.927946 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.927654 2579 scope.go:117] "RemoveContainer" containerID="c49d0f849ce5633992ffca5290815fd5c4a6bed824a2f4629915dad086b57d3e" Sep 19 00:01:04.927946 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.927679 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-xvfpc\"" Sep 19 00:01:04.927946 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.927927 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 19 00:01:04.928203 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.927946 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c49d0f849ce5633992ffca5290815fd5c4a6bed824a2f4629915dad086b57d3e"} err="failed to get container status \"c49d0f849ce5633992ffca5290815fd5c4a6bed824a2f4629915dad086b57d3e\": rpc error: code = NotFound desc = could not find container \"c49d0f849ce5633992ffca5290815fd5c4a6bed824a2f4629915dad086b57d3e\": container with ID starting with c49d0f849ce5633992ffca5290815fd5c4a6bed824a2f4629915dad086b57d3e not found: ID does not exist" Sep 19 00:01:04.928203 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.927972 2579 scope.go:117] "RemoveContainer" containerID="43ce12170b1aa9ae03dcecf70b17d454857699be3cc1c0309946a88db3af4943" Sep 19 00:01:04.928324 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.928254 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43ce12170b1aa9ae03dcecf70b17d454857699be3cc1c0309946a88db3af4943"} err="failed to get container status \"43ce12170b1aa9ae03dcecf70b17d454857699be3cc1c0309946a88db3af4943\": rpc error: code = NotFound desc = could not find container \"43ce12170b1aa9ae03dcecf70b17d454857699be3cc1c0309946a88db3af4943\": container with ID starting with 43ce12170b1aa9ae03dcecf70b17d454857699be3cc1c0309946a88db3af4943 not found: ID does not exist" Sep 19 00:01:04.928324 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.928280 2579 scope.go:117] "RemoveContainer" containerID="80f358770d7989facae049a9426507417a9097b5a4d3e0919253ab538390b9bd" Sep 19 00:01:04.928581 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.928553 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80f358770d7989facae049a9426507417a9097b5a4d3e0919253ab538390b9bd"} err="failed to get container status \"80f358770d7989facae049a9426507417a9097b5a4d3e0919253ab538390b9bd\": rpc error: code = NotFound desc = could not find container \"80f358770d7989facae049a9426507417a9097b5a4d3e0919253ab538390b9bd\": container with ID starting with 80f358770d7989facae049a9426507417a9097b5a4d3e0919253ab538390b9bd not found: ID does not exist" Sep 19 00:01:04.930170 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.930152 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 19 00:01:04.931946 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.931928 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 19 00:01:04.936732 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.936702 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 19 00:01:04.980554 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.980465 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/69c1bbe2-2717-4eeb-a9e8-3e80f4208e09-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"69c1bbe2-2717-4eeb-a9e8-3e80f4208e09\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 00:01:04.980554 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.980504 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69c1bbe2-2717-4eeb-a9e8-3e80f4208e09-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"69c1bbe2-2717-4eeb-a9e8-3e80f4208e09\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 00:01:04.980554 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.980531 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/69c1bbe2-2717-4eeb-a9e8-3e80f4208e09-config-out\") pod \"prometheus-k8s-0\" (UID: \"69c1bbe2-2717-4eeb-a9e8-3e80f4208e09\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 00:01:04.980554 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.980550 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/69c1bbe2-2717-4eeb-a9e8-3e80f4208e09-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"69c1bbe2-2717-4eeb-a9e8-3e80f4208e09\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 00:01:04.980825 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.980570 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/69c1bbe2-2717-4eeb-a9e8-3e80f4208e09-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"69c1bbe2-2717-4eeb-a9e8-3e80f4208e09\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 00:01:04.980825 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.980585 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/69c1bbe2-2717-4eeb-a9e8-3e80f4208e09-web-config\") pod \"prometheus-k8s-0\" (UID: \"69c1bbe2-2717-4eeb-a9e8-3e80f4208e09\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 00:01:04.980825 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.980599 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/69c1bbe2-2717-4eeb-a9e8-3e80f4208e09-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"69c1bbe2-2717-4eeb-a9e8-3e80f4208e09\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 00:01:04.980825 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.980614 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/69c1bbe2-2717-4eeb-a9e8-3e80f4208e09-config\") pod \"prometheus-k8s-0\" (UID: \"69c1bbe2-2717-4eeb-a9e8-3e80f4208e09\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 00:01:04.980825 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.980628 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/69c1bbe2-2717-4eeb-a9e8-3e80f4208e09-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"69c1bbe2-2717-4eeb-a9e8-3e80f4208e09\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 00:01:04.980825 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.980656 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/69c1bbe2-2717-4eeb-a9e8-3e80f4208e09-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"69c1bbe2-2717-4eeb-a9e8-3e80f4208e09\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 00:01:04.980825 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.980714 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrlz2\" (UniqueName: \"kubernetes.io/projected/69c1bbe2-2717-4eeb-a9e8-3e80f4208e09-kube-api-access-qrlz2\") pod \"prometheus-k8s-0\" (UID: \"69c1bbe2-2717-4eeb-a9e8-3e80f4208e09\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 00:01:04.980825 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.980733 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69c1bbe2-2717-4eeb-a9e8-3e80f4208e09-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"69c1bbe2-2717-4eeb-a9e8-3e80f4208e09\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 00:01:04.980825 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.980771 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/69c1bbe2-2717-4eeb-a9e8-3e80f4208e09-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"69c1bbe2-2717-4eeb-a9e8-3e80f4208e09\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 00:01:04.980825 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.980788 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/69c1bbe2-2717-4eeb-a9e8-3e80f4208e09-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"69c1bbe2-2717-4eeb-a9e8-3e80f4208e09\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 00:01:04.980825 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.980803 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/69c1bbe2-2717-4eeb-a9e8-3e80f4208e09-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"69c1bbe2-2717-4eeb-a9e8-3e80f4208e09\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 00:01:04.980825 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.980816 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/69c1bbe2-2717-4eeb-a9e8-3e80f4208e09-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"69c1bbe2-2717-4eeb-a9e8-3e80f4208e09\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 00:01:04.981163 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.980833 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/69c1bbe2-2717-4eeb-a9e8-3e80f4208e09-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"69c1bbe2-2717-4eeb-a9e8-3e80f4208e09\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 00:01:04.981163 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.980852 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69c1bbe2-2717-4eeb-a9e8-3e80f4208e09-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"69c1bbe2-2717-4eeb-a9e8-3e80f4208e09\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 00:01:04.981163 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.980902 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69c1bbe2-2717-4eeb-a9e8-3e80f4208e09-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"69c1bbe2-2717-4eeb-a9e8-3e80f4208e09\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 00:01:04.981163 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:04.980924 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/69c1bbe2-2717-4eeb-a9e8-3e80f4208e09-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"69c1bbe2-2717-4eeb-a9e8-3e80f4208e09\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 00:01:05.081865 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:05.081818 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/69c1bbe2-2717-4eeb-a9e8-3e80f4208e09-config-out\") pod \"prometheus-k8s-0\" (UID: \"69c1bbe2-2717-4eeb-a9e8-3e80f4208e09\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 00:01:05.081865 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:05.081867 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/69c1bbe2-2717-4eeb-a9e8-3e80f4208e09-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"69c1bbe2-2717-4eeb-a9e8-3e80f4208e09\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 00:01:05.082071 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:05.081980 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/69c1bbe2-2717-4eeb-a9e8-3e80f4208e09-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"69c1bbe2-2717-4eeb-a9e8-3e80f4208e09\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 00:01:05.082071 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:05.082013 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/69c1bbe2-2717-4eeb-a9e8-3e80f4208e09-web-config\") pod \"prometheus-k8s-0\" (UID: \"69c1bbe2-2717-4eeb-a9e8-3e80f4208e09\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 00:01:05.082071 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:05.082030 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/69c1bbe2-2717-4eeb-a9e8-3e80f4208e09-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"69c1bbe2-2717-4eeb-a9e8-3e80f4208e09\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 00:01:05.082071 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:05.082054 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/69c1bbe2-2717-4eeb-a9e8-3e80f4208e09-config\") pod \"prometheus-k8s-0\" (UID: \"69c1bbe2-2717-4eeb-a9e8-3e80f4208e09\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 00:01:05.082646 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:05.082077 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/69c1bbe2-2717-4eeb-a9e8-3e80f4208e09-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"69c1bbe2-2717-4eeb-a9e8-3e80f4208e09\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 00:01:05.082646 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:05.082101 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/69c1bbe2-2717-4eeb-a9e8-3e80f4208e09-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"69c1bbe2-2717-4eeb-a9e8-3e80f4208e09\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 00:01:05.082646 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:05.082149 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrlz2\" (UniqueName: \"kubernetes.io/projected/69c1bbe2-2717-4eeb-a9e8-3e80f4208e09-kube-api-access-qrlz2\") pod \"prometheus-k8s-0\" (UID: \"69c1bbe2-2717-4eeb-a9e8-3e80f4208e09\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 00:01:05.082646 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:05.082176 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69c1bbe2-2717-4eeb-a9e8-3e80f4208e09-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"69c1bbe2-2717-4eeb-a9e8-3e80f4208e09\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 00:01:05.082646 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:05.082210 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/69c1bbe2-2717-4eeb-a9e8-3e80f4208e09-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"69c1bbe2-2717-4eeb-a9e8-3e80f4208e09\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 00:01:05.082646 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:05.082238 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/69c1bbe2-2717-4eeb-a9e8-3e80f4208e09-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"69c1bbe2-2717-4eeb-a9e8-3e80f4208e09\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 00:01:05.082646 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:05.082267 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/69c1bbe2-2717-4eeb-a9e8-3e80f4208e09-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"69c1bbe2-2717-4eeb-a9e8-3e80f4208e09\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 00:01:05.082646 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:05.082290 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/69c1bbe2-2717-4eeb-a9e8-3e80f4208e09-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"69c1bbe2-2717-4eeb-a9e8-3e80f4208e09\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 00:01:05.082646 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:05.082319 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/69c1bbe2-2717-4eeb-a9e8-3e80f4208e09-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"69c1bbe2-2717-4eeb-a9e8-3e80f4208e09\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 00:01:05.082646 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:05.082356 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69c1bbe2-2717-4eeb-a9e8-3e80f4208e09-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"69c1bbe2-2717-4eeb-a9e8-3e80f4208e09\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 00:01:05.082646 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:05.082403 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69c1bbe2-2717-4eeb-a9e8-3e80f4208e09-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"69c1bbe2-2717-4eeb-a9e8-3e80f4208e09\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 00:01:05.082646 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:05.082437 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/69c1bbe2-2717-4eeb-a9e8-3e80f4208e09-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"69c1bbe2-2717-4eeb-a9e8-3e80f4208e09\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 00:01:05.082646 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:05.082468 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/69c1bbe2-2717-4eeb-a9e8-3e80f4208e09-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"69c1bbe2-2717-4eeb-a9e8-3e80f4208e09\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 00:01:05.082646 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:05.082506 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69c1bbe2-2717-4eeb-a9e8-3e80f4208e09-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"69c1bbe2-2717-4eeb-a9e8-3e80f4208e09\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 00:01:05.083359 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:05.083277 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69c1bbe2-2717-4eeb-a9e8-3e80f4208e09-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"69c1bbe2-2717-4eeb-a9e8-3e80f4208e09\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 00:01:05.085681 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:05.084893 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/69c1bbe2-2717-4eeb-a9e8-3e80f4208e09-config-out\") pod \"prometheus-k8s-0\" (UID: \"69c1bbe2-2717-4eeb-a9e8-3e80f4208e09\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 00:01:05.085681 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:05.084971 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/69c1bbe2-2717-4eeb-a9e8-3e80f4208e09-config\") pod \"prometheus-k8s-0\" (UID: \"69c1bbe2-2717-4eeb-a9e8-3e80f4208e09\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 00:01:05.085681 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:05.085055 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/69c1bbe2-2717-4eeb-a9e8-3e80f4208e09-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"69c1bbe2-2717-4eeb-a9e8-3e80f4208e09\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 00:01:05.085681 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:05.085058 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/69c1bbe2-2717-4eeb-a9e8-3e80f4208e09-web-config\") pod \"prometheus-k8s-0\" (UID: \"69c1bbe2-2717-4eeb-a9e8-3e80f4208e09\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 00:01:05.085681 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:05.085191 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/69c1bbe2-2717-4eeb-a9e8-3e80f4208e09-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"69c1bbe2-2717-4eeb-a9e8-3e80f4208e09\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 00:01:05.085681 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:05.085252 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/69c1bbe2-2717-4eeb-a9e8-3e80f4208e09-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"69c1bbe2-2717-4eeb-a9e8-3e80f4208e09\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 00:01:05.085681 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:05.085268 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/69c1bbe2-2717-4eeb-a9e8-3e80f4208e09-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"69c1bbe2-2717-4eeb-a9e8-3e80f4208e09\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 00:01:05.085681 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:05.085397 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/69c1bbe2-2717-4eeb-a9e8-3e80f4208e09-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"69c1bbe2-2717-4eeb-a9e8-3e80f4208e09\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 00:01:05.085681 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:05.085576 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/69c1bbe2-2717-4eeb-a9e8-3e80f4208e09-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"69c1bbe2-2717-4eeb-a9e8-3e80f4208e09\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 00:01:05.086239 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:05.085909 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/69c1bbe2-2717-4eeb-a9e8-3e80f4208e09-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"69c1bbe2-2717-4eeb-a9e8-3e80f4208e09\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 00:01:05.086239 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:05.085977 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69c1bbe2-2717-4eeb-a9e8-3e80f4208e09-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"69c1bbe2-2717-4eeb-a9e8-3e80f4208e09\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 00:01:05.086239 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:05.086059 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/69c1bbe2-2717-4eeb-a9e8-3e80f4208e09-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"69c1bbe2-2717-4eeb-a9e8-3e80f4208e09\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 00:01:05.086401 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:05.086312 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69c1bbe2-2717-4eeb-a9e8-3e80f4208e09-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"69c1bbe2-2717-4eeb-a9e8-3e80f4208e09\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 00:01:05.086401 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:05.086371 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69c1bbe2-2717-4eeb-a9e8-3e80f4208e09-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"69c1bbe2-2717-4eeb-a9e8-3e80f4208e09\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 00:01:05.087411 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:05.087387 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/69c1bbe2-2717-4eeb-a9e8-3e80f4208e09-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"69c1bbe2-2717-4eeb-a9e8-3e80f4208e09\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 00:01:05.087712 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:05.087694 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/69c1bbe2-2717-4eeb-a9e8-3e80f4208e09-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"69c1bbe2-2717-4eeb-a9e8-3e80f4208e09\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 00:01:05.088121 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:05.088102 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/69c1bbe2-2717-4eeb-a9e8-3e80f4208e09-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"69c1bbe2-2717-4eeb-a9e8-3e80f4208e09\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 00:01:05.088194 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:05.088175 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/69c1bbe2-2717-4eeb-a9e8-3e80f4208e09-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"69c1bbe2-2717-4eeb-a9e8-3e80f4208e09\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 00:01:05.093354 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:05.093337 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrlz2\" (UniqueName: \"kubernetes.io/projected/69c1bbe2-2717-4eeb-a9e8-3e80f4208e09-kube-api-access-qrlz2\") pod \"prometheus-k8s-0\" (UID: \"69c1bbe2-2717-4eeb-a9e8-3e80f4208e09\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 00:01:05.233899 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:05.233821 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 19 00:01:05.514075 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:05.513993 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 19 00:01:05.516717 ip-10-0-130-53 kubenswrapper[2579]: W0919 00:01:05.516677 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69c1bbe2_2717_4eeb_a9e8_3e80f4208e09.slice/crio-915fee3f97576ecc1e3c4fed4d63bbf567acd46655b49106e320a0af8a9f6f22 WatchSource:0}: Error finding container 915fee3f97576ecc1e3c4fed4d63bbf567acd46655b49106e320a0af8a9f6f22: Status 404 returned error can't find the container with id 915fee3f97576ecc1e3c4fed4d63bbf567acd46655b49106e320a0af8a9f6f22 Sep 19 00:01:05.864321 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:05.864224 2579 generic.go:356] "Generic (PLEG): container finished" podID="69c1bbe2-2717-4eeb-a9e8-3e80f4208e09" containerID="905f56fa7b104a4df4b9eaf81c64a14593a3921e7e49c20502955f6a1d11504e" exitCode=0 Sep 19 00:01:05.864321 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:05.864311 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"69c1bbe2-2717-4eeb-a9e8-3e80f4208e09","Type":"ContainerDied","Data":"905f56fa7b104a4df4b9eaf81c64a14593a3921e7e49c20502955f6a1d11504e"} Sep 19 00:01:05.864541 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:05.864384 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"69c1bbe2-2717-4eeb-a9e8-3e80f4208e09","Type":"ContainerStarted","Data":"915fee3f97576ecc1e3c4fed4d63bbf567acd46655b49106e320a0af8a9f6f22"} Sep 19 00:01:06.078213 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:06.078147 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13a17989-270b-490a-a785-69b15683aa61" path="/var/lib/kubelet/pods/13a17989-270b-490a-a785-69b15683aa61/volumes" Sep 19 00:01:06.871774 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:06.871667 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"69c1bbe2-2717-4eeb-a9e8-3e80f4208e09","Type":"ContainerStarted","Data":"4e1017eb6e7fd9e77edd0e4c4fcbc327b943d5ca2b8cfb9b8320ff9cb23056e4"} Sep 19 00:01:06.872162 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:06.871789 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"69c1bbe2-2717-4eeb-a9e8-3e80f4208e09","Type":"ContainerStarted","Data":"e075441d5ee99620ffd4c15861e4083b5d398adf5e6d91fd88352fa5fffea3f8"} Sep 19 00:01:06.872162 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:06.871819 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"69c1bbe2-2717-4eeb-a9e8-3e80f4208e09","Type":"ContainerStarted","Data":"41c9fda1c06c5461f0a566ed019e6102ce711986e201a42633437e8e7ff46d43"} Sep 19 00:01:06.872162 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:06.871843 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"69c1bbe2-2717-4eeb-a9e8-3e80f4208e09","Type":"ContainerStarted","Data":"222309aca40db8449591f055b251eedebd419494a969a10fb21b951ce8db77c2"} Sep 19 00:01:06.872162 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:06.871867 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"69c1bbe2-2717-4eeb-a9e8-3e80f4208e09","Type":"ContainerStarted","Data":"6240b4c0e5cbd766bf44dc37c5cffeeb750bead5d88c65d4a4ad5477d3b933b8"} Sep 19 00:01:06.872162 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:06.871888 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"69c1bbe2-2717-4eeb-a9e8-3e80f4208e09","Type":"ContainerStarted","Data":"ba78fae505f6e567b62709ac63ef83e9146a15d9ba4abf149b142dd52ead384b"} Sep 19 00:01:06.899380 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:06.899306 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.880193089 podStartE2EDuration="2.899284479s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.09139ms" isStatefulPod=false podCreationTimestamp="2026-09-19 00:01:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 00:01:06.897385052 +0000 UTC m=+158.873593520" watchObservedRunningTime="2026-09-19 00:01:06.899284479 +0000 UTC m=+158.875492952" Sep 19 00:01:10.234788 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:01:10.234735 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 19 00:02:05.234774 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:02:05.234706 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 19 00:02:05.249956 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:02:05.249928 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 19 00:02:06.101944 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:02:06.101917 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 19 00:03:29.921885 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:03:29.921857 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6j92q_558d514a-4560-4e46-96af-e19cb4d741f8/ovn-acl-logging/0.log" Sep 19 00:03:29.924566 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:03:29.924531 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6j92q_558d514a-4560-4e46-96af-e19cb4d741f8/ovn-acl-logging/0.log" Sep 19 00:03:29.928677 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:03:29.928656 2579 kubelet.go:1648] "Image garbage collection succeeded" Sep 19 00:04:00.806448 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:04:00.806389 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-b92p4"] Sep 19 00:04:00.809735 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:04:00.809718 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-b92p4" Sep 19 00:04:00.812007 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:04:00.811979 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Sep 19 00:04:00.812974 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:04:00.812954 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Sep 19 00:04:00.813058 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:04:00.812966 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-j9kr4\"" Sep 19 00:04:00.816609 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:04:00.816407 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-b92p4"] Sep 19 00:04:00.961172 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:04:00.961137 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a6d43ad-2368-4bea-81ff-f2a4d3ce1890-tmp\") pod \"openshift-lws-operator-fd8ccff4c-b92p4\" (UID: \"2a6d43ad-2368-4bea-81ff-f2a4d3ce1890\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-b92p4" Sep 19 00:04:00.961352 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:04:00.961190 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t272g\" (UniqueName: \"kubernetes.io/projected/2a6d43ad-2368-4bea-81ff-f2a4d3ce1890-kube-api-access-t272g\") pod \"openshift-lws-operator-fd8ccff4c-b92p4\" (UID: \"2a6d43ad-2368-4bea-81ff-f2a4d3ce1890\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-b92p4" Sep 19 00:04:01.062444 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:04:01.062353 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t272g\" (UniqueName: \"kubernetes.io/projected/2a6d43ad-2368-4bea-81ff-f2a4d3ce1890-kube-api-access-t272g\") pod \"openshift-lws-operator-fd8ccff4c-b92p4\" (UID: \"2a6d43ad-2368-4bea-81ff-f2a4d3ce1890\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-b92p4" Sep 19 00:04:01.062444 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:04:01.062416 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a6d43ad-2368-4bea-81ff-f2a4d3ce1890-tmp\") pod \"openshift-lws-operator-fd8ccff4c-b92p4\" (UID: \"2a6d43ad-2368-4bea-81ff-f2a4d3ce1890\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-b92p4" Sep 19 00:04:01.062791 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:04:01.062776 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a6d43ad-2368-4bea-81ff-f2a4d3ce1890-tmp\") pod \"openshift-lws-operator-fd8ccff4c-b92p4\" (UID: \"2a6d43ad-2368-4bea-81ff-f2a4d3ce1890\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-b92p4" Sep 19 00:04:01.069869 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:04:01.069847 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t272g\" (UniqueName: \"kubernetes.io/projected/2a6d43ad-2368-4bea-81ff-f2a4d3ce1890-kube-api-access-t272g\") pod \"openshift-lws-operator-fd8ccff4c-b92p4\" (UID: \"2a6d43ad-2368-4bea-81ff-f2a4d3ce1890\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-b92p4" Sep 19 00:04:01.119339 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:04:01.119307 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-b92p4" Sep 19 00:04:01.390905 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:04:01.390870 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-b92p4"] Sep 19 00:04:01.393730 ip-10-0-130-53 kubenswrapper[2579]: W0919 00:04:01.393701 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2a6d43ad_2368_4bea_81ff_f2a4d3ce1890.slice/crio-1c4933e56eb476f99d1c78bcdc6ee3173b6ed0e2b750673ddcb26b6577e3632f WatchSource:0}: Error finding container 1c4933e56eb476f99d1c78bcdc6ee3173b6ed0e2b750673ddcb26b6577e3632f: Status 404 returned error can't find the container with id 1c4933e56eb476f99d1c78bcdc6ee3173b6ed0e2b750673ddcb26b6577e3632f Sep 19 00:04:01.395178 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:04:01.395160 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 19 00:04:01.508853 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:04:01.508819 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-b92p4" event={"ID":"2a6d43ad-2368-4bea-81ff-f2a4d3ce1890","Type":"ContainerStarted","Data":"1c4933e56eb476f99d1c78bcdc6ee3173b6ed0e2b750673ddcb26b6577e3632f"} Sep 19 00:04:04.523267 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:04:04.523224 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-b92p4" event={"ID":"2a6d43ad-2368-4bea-81ff-f2a4d3ce1890","Type":"ContainerStarted","Data":"e06c22aa1cc66f9bf9569ee629dba5da5a9367de7f6549493227ebc043f67d73"} Sep 19 00:04:04.538873 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:04:04.538821 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-b92p4" podStartSLOduration=1.923480394 podStartE2EDuration="4.538805619s" totalImagesPullingTime="2.615325225s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 00:04:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 00:04:04.537583573 +0000 UTC m=+336.513792041" watchObservedRunningTime="2026-09-19 00:04:04.538805619 +0000 UTC m=+336.515014086" Sep 19 00:04:23.734919 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:04:23.734884 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-577c99c85d-pfrzh"] Sep 19 00:04:23.737966 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:04:23.737948 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-577c99c85d-pfrzh" Sep 19 00:04:23.740690 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:04:23.740670 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 19 00:04:23.741065 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:04:23.741048 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Sep 19 00:04:23.741286 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:04:23.741271 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Sep 19 00:04:23.741397 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:04:23.741372 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-tz5mp\"" Sep 19 00:04:23.741487 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:04:23.741472 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 19 00:04:23.774571 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:04:23.774535 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-577c99c85d-pfrzh"] Sep 19 00:04:23.854683 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:04:23.854640 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5dc616e-1bca-4178-9f56-5a526ed06c8e-tmp\") pod \"opendatahub-operator-controller-manager-577c99c85d-pfrzh\" (UID: \"e5dc616e-1bca-4178-9f56-5a526ed06c8e\") " pod="opendatahub/opendatahub-operator-controller-manager-577c99c85d-pfrzh" Sep 19 00:04:23.854887 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:04:23.854704 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e5dc616e-1bca-4178-9f56-5a526ed06c8e-webhook-cert\") pod \"opendatahub-operator-controller-manager-577c99c85d-pfrzh\" (UID: \"e5dc616e-1bca-4178-9f56-5a526ed06c8e\") " pod="opendatahub/opendatahub-operator-controller-manager-577c99c85d-pfrzh" Sep 19 00:04:23.854887 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:04:23.854819 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e5dc616e-1bca-4178-9f56-5a526ed06c8e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-577c99c85d-pfrzh\" (UID: \"e5dc616e-1bca-4178-9f56-5a526ed06c8e\") " pod="opendatahub/opendatahub-operator-controller-manager-577c99c85d-pfrzh" Sep 19 00:04:23.854887 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:04:23.854854 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e5dc616e-1bca-4178-9f56-5a526ed06c8e-manifests\") pod \"opendatahub-operator-controller-manager-577c99c85d-pfrzh\" (UID: \"e5dc616e-1bca-4178-9f56-5a526ed06c8e\") " pod="opendatahub/opendatahub-operator-controller-manager-577c99c85d-pfrzh" Sep 19 00:04:23.855047 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:04:23.854907 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nd24k\" (UniqueName: \"kubernetes.io/projected/e5dc616e-1bca-4178-9f56-5a526ed06c8e-kube-api-access-nd24k\") pod \"opendatahub-operator-controller-manager-577c99c85d-pfrzh\" (UID: \"e5dc616e-1bca-4178-9f56-5a526ed06c8e\") " pod="opendatahub/opendatahub-operator-controller-manager-577c99c85d-pfrzh" Sep 19 00:04:23.956204 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:04:23.956171 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e5dc616e-1bca-4178-9f56-5a526ed06c8e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-577c99c85d-pfrzh\" (UID: \"e5dc616e-1bca-4178-9f56-5a526ed06c8e\") " pod="opendatahub/opendatahub-operator-controller-manager-577c99c85d-pfrzh" Sep 19 00:04:23.956376 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:04:23.956218 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e5dc616e-1bca-4178-9f56-5a526ed06c8e-manifests\") pod \"opendatahub-operator-controller-manager-577c99c85d-pfrzh\" (UID: \"e5dc616e-1bca-4178-9f56-5a526ed06c8e\") " pod="opendatahub/opendatahub-operator-controller-manager-577c99c85d-pfrzh" Sep 19 00:04:23.956376 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:04:23.956238 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nd24k\" (UniqueName: \"kubernetes.io/projected/e5dc616e-1bca-4178-9f56-5a526ed06c8e-kube-api-access-nd24k\") pod \"opendatahub-operator-controller-manager-577c99c85d-pfrzh\" (UID: \"e5dc616e-1bca-4178-9f56-5a526ed06c8e\") " pod="opendatahub/opendatahub-operator-controller-manager-577c99c85d-pfrzh" Sep 19 00:04:23.956376 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:04:23.956358 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5dc616e-1bca-4178-9f56-5a526ed06c8e-tmp\") pod \"opendatahub-operator-controller-manager-577c99c85d-pfrzh\" (UID: \"e5dc616e-1bca-4178-9f56-5a526ed06c8e\") " pod="opendatahub/opendatahub-operator-controller-manager-577c99c85d-pfrzh" Sep 19 00:04:23.956532 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:04:23.956420 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e5dc616e-1bca-4178-9f56-5a526ed06c8e-webhook-cert\") pod \"opendatahub-operator-controller-manager-577c99c85d-pfrzh\" (UID: \"e5dc616e-1bca-4178-9f56-5a526ed06c8e\") " pod="opendatahub/opendatahub-operator-controller-manager-577c99c85d-pfrzh" Sep 19 00:04:23.956619 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:04:23.956598 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e5dc616e-1bca-4178-9f56-5a526ed06c8e-manifests\") pod \"opendatahub-operator-controller-manager-577c99c85d-pfrzh\" (UID: \"e5dc616e-1bca-4178-9f56-5a526ed06c8e\") " pod="opendatahub/opendatahub-operator-controller-manager-577c99c85d-pfrzh" Sep 19 00:04:23.958588 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:04:23.958561 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5dc616e-1bca-4178-9f56-5a526ed06c8e-tmp\") pod \"opendatahub-operator-controller-manager-577c99c85d-pfrzh\" (UID: \"e5dc616e-1bca-4178-9f56-5a526ed06c8e\") " pod="opendatahub/opendatahub-operator-controller-manager-577c99c85d-pfrzh" Sep 19 00:04:23.958685 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:04:23.958674 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e5dc616e-1bca-4178-9f56-5a526ed06c8e-webhook-cert\") pod \"opendatahub-operator-controller-manager-577c99c85d-pfrzh\" (UID: \"e5dc616e-1bca-4178-9f56-5a526ed06c8e\") " pod="opendatahub/opendatahub-operator-controller-manager-577c99c85d-pfrzh" Sep 19 00:04:23.958789 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:04:23.958745 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e5dc616e-1bca-4178-9f56-5a526ed06c8e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-577c99c85d-pfrzh\" (UID: \"e5dc616e-1bca-4178-9f56-5a526ed06c8e\") " pod="opendatahub/opendatahub-operator-controller-manager-577c99c85d-pfrzh" Sep 19 00:04:23.968392 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:04:23.968366 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nd24k\" (UniqueName: \"kubernetes.io/projected/e5dc616e-1bca-4178-9f56-5a526ed06c8e-kube-api-access-nd24k\") pod \"opendatahub-operator-controller-manager-577c99c85d-pfrzh\" (UID: \"e5dc616e-1bca-4178-9f56-5a526ed06c8e\") " pod="opendatahub/opendatahub-operator-controller-manager-577c99c85d-pfrzh" Sep 19 00:04:24.048369 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:04:24.048274 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-577c99c85d-pfrzh" Sep 19 00:04:24.322744 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:04:24.322668 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-577c99c85d-pfrzh"] Sep 19 00:04:24.325608 ip-10-0-130-53 kubenswrapper[2579]: W0919 00:04:24.325577 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5dc616e_1bca_4178_9f56_5a526ed06c8e.slice/crio-bb1cbdd816d93b83ce9618c08f6f3264ae16173211a66951f9ac68c67a8a8748 WatchSource:0}: Error finding container bb1cbdd816d93b83ce9618c08f6f3264ae16173211a66951f9ac68c67a8a8748: Status 404 returned error can't find the container with id bb1cbdd816d93b83ce9618c08f6f3264ae16173211a66951f9ac68c67a8a8748 Sep 19 00:04:24.598465 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:04:24.598373 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-577c99c85d-pfrzh" event={"ID":"e5dc616e-1bca-4178-9f56-5a526ed06c8e","Type":"ContainerStarted","Data":"bb1cbdd816d93b83ce9618c08f6f3264ae16173211a66951f9ac68c67a8a8748"} Sep 19 00:04:27.612127 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:04:27.612017 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-577c99c85d-pfrzh" event={"ID":"e5dc616e-1bca-4178-9f56-5a526ed06c8e","Type":"ContainerStarted","Data":"757d61063428f77a4e5d8e842d5203d82d44021029c7a6e5136a3c6c290d1096"} Sep 19 00:04:28.617195 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:04:28.617158 2579 generic.go:356] "Generic (PLEG): container finished" podID="e5dc616e-1bca-4178-9f56-5a526ed06c8e" containerID="757d61063428f77a4e5d8e842d5203d82d44021029c7a6e5136a3c6c290d1096" exitCode=0 Sep 19 00:04:28.617673 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:04:28.617247 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-577c99c85d-pfrzh" event={"ID":"e5dc616e-1bca-4178-9f56-5a526ed06c8e","Type":"ContainerDied","Data":"757d61063428f77a4e5d8e842d5203d82d44021029c7a6e5136a3c6c290d1096"} Sep 19 00:04:29.625206 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:04:29.625175 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-577c99c85d-pfrzh" event={"ID":"e5dc616e-1bca-4178-9f56-5a526ed06c8e","Type":"ContainerStarted","Data":"05e2d11d29b2ccb8406d99706151d39fa77fbd03b1b65eb4e239269dd4856e02"} Sep 19 00:04:29.625577 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:04:29.625300 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-577c99c85d-pfrzh" Sep 19 00:04:29.647542 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:04:29.647495 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-577c99c85d-pfrzh" podStartSLOduration=2.117502631 podStartE2EDuration="6.64747699s" totalImagesPullingTime="3.495875012s" totalInitContainerRuntime="1.034099347s" isStatefulPod=false podCreationTimestamp="2026-09-19 00:04:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 00:04:29.646358581 +0000 UTC m=+361.622567075" watchObservedRunningTime="2026-09-19 00:04:29.64747699 +0000 UTC m=+361.623685457" Sep 19 00:04:40.631492 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:04:40.631457 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-577c99c85d-pfrzh" Sep 19 00:05:00.585397 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:05:00.585361 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7968c85699-7zkjf"] Sep 19 00:05:00.594818 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:05:00.594797 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7968c85699-7zkjf" Sep 19 00:05:00.599613 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:05:00.599586 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Sep 19 00:05:00.599746 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:05:00.599623 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-lvwnq\"" Sep 19 00:05:00.599746 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:05:00.599666 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Sep 19 00:05:00.600033 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:05:00.600011 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Sep 19 00:05:00.621463 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:05:00.621426 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7968c85699-7zkjf"] Sep 19 00:05:00.667284 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:05:00.667247 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a4eac14f-03cd-423d-b4d2-098be288bbb5-cert\") pod \"lws-controller-manager-7968c85699-7zkjf\" (UID: \"a4eac14f-03cd-423d-b4d2-098be288bbb5\") " pod="openshift-lws-operator/lws-controller-manager-7968c85699-7zkjf" Sep 19 00:05:00.667472 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:05:00.667307 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jnsr\" (UniqueName: \"kubernetes.io/projected/a4eac14f-03cd-423d-b4d2-098be288bbb5-kube-api-access-7jnsr\") pod \"lws-controller-manager-7968c85699-7zkjf\" (UID: \"a4eac14f-03cd-423d-b4d2-098be288bbb5\") " pod="openshift-lws-operator/lws-controller-manager-7968c85699-7zkjf" Sep 19 00:05:00.667472 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:05:00.667340 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a4eac14f-03cd-423d-b4d2-098be288bbb5-manager-config\") pod \"lws-controller-manager-7968c85699-7zkjf\" (UID: \"a4eac14f-03cd-423d-b4d2-098be288bbb5\") " pod="openshift-lws-operator/lws-controller-manager-7968c85699-7zkjf" Sep 19 00:05:00.667472 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:05:00.667364 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a4eac14f-03cd-423d-b4d2-098be288bbb5-metrics-cert\") pod \"lws-controller-manager-7968c85699-7zkjf\" (UID: \"a4eac14f-03cd-423d-b4d2-098be288bbb5\") " pod="openshift-lws-operator/lws-controller-manager-7968c85699-7zkjf" Sep 19 00:05:00.768319 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:05:00.768287 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jnsr\" (UniqueName: \"kubernetes.io/projected/a4eac14f-03cd-423d-b4d2-098be288bbb5-kube-api-access-7jnsr\") pod \"lws-controller-manager-7968c85699-7zkjf\" (UID: \"a4eac14f-03cd-423d-b4d2-098be288bbb5\") " pod="openshift-lws-operator/lws-controller-manager-7968c85699-7zkjf" Sep 19 00:05:00.768319 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:05:00.768327 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a4eac14f-03cd-423d-b4d2-098be288bbb5-manager-config\") pod \"lws-controller-manager-7968c85699-7zkjf\" (UID: \"a4eac14f-03cd-423d-b4d2-098be288bbb5\") " pod="openshift-lws-operator/lws-controller-manager-7968c85699-7zkjf" Sep 19 00:05:00.768582 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:05:00.768457 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a4eac14f-03cd-423d-b4d2-098be288bbb5-metrics-cert\") pod \"lws-controller-manager-7968c85699-7zkjf\" (UID: \"a4eac14f-03cd-423d-b4d2-098be288bbb5\") " pod="openshift-lws-operator/lws-controller-manager-7968c85699-7zkjf" Sep 19 00:05:00.768582 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:05:00.768556 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a4eac14f-03cd-423d-b4d2-098be288bbb5-cert\") pod \"lws-controller-manager-7968c85699-7zkjf\" (UID: \"a4eac14f-03cd-423d-b4d2-098be288bbb5\") " pod="openshift-lws-operator/lws-controller-manager-7968c85699-7zkjf" Sep 19 00:05:00.769058 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:05:00.769030 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a4eac14f-03cd-423d-b4d2-098be288bbb5-manager-config\") pod \"lws-controller-manager-7968c85699-7zkjf\" (UID: \"a4eac14f-03cd-423d-b4d2-098be288bbb5\") " pod="openshift-lws-operator/lws-controller-manager-7968c85699-7zkjf" Sep 19 00:05:00.771208 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:05:00.771178 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a4eac14f-03cd-423d-b4d2-098be288bbb5-metrics-cert\") pod \"lws-controller-manager-7968c85699-7zkjf\" (UID: \"a4eac14f-03cd-423d-b4d2-098be288bbb5\") " pod="openshift-lws-operator/lws-controller-manager-7968c85699-7zkjf" Sep 19 00:05:00.771311 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:05:00.771227 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a4eac14f-03cd-423d-b4d2-098be288bbb5-cert\") pod \"lws-controller-manager-7968c85699-7zkjf\" (UID: \"a4eac14f-03cd-423d-b4d2-098be288bbb5\") " pod="openshift-lws-operator/lws-controller-manager-7968c85699-7zkjf" Sep 19 00:05:00.775172 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:05:00.775151 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jnsr\" (UniqueName: \"kubernetes.io/projected/a4eac14f-03cd-423d-b4d2-098be288bbb5-kube-api-access-7jnsr\") pod \"lws-controller-manager-7968c85699-7zkjf\" (UID: \"a4eac14f-03cd-423d-b4d2-098be288bbb5\") " pod="openshift-lws-operator/lws-controller-manager-7968c85699-7zkjf" Sep 19 00:05:00.904947 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:05:00.904906 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7968c85699-7zkjf" Sep 19 00:05:01.191787 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:05:01.191687 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7968c85699-7zkjf"] Sep 19 00:05:01.194782 ip-10-0-130-53 kubenswrapper[2579]: W0919 00:05:01.194736 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4eac14f_03cd_423d_b4d2_098be288bbb5.slice/crio-ee22596163ed1391b93cc17a4a2a6229abf7f399189bfb01cb7b6bae0e5363ed WatchSource:0}: Error finding container ee22596163ed1391b93cc17a4a2a6229abf7f399189bfb01cb7b6bae0e5363ed: Status 404 returned error can't find the container with id ee22596163ed1391b93cc17a4a2a6229abf7f399189bfb01cb7b6bae0e5363ed Sep 19 00:05:01.753898 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:05:01.753861 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7968c85699-7zkjf" event={"ID":"a4eac14f-03cd-423d-b4d2-098be288bbb5","Type":"ContainerStarted","Data":"ee22596163ed1391b93cc17a4a2a6229abf7f399189bfb01cb7b6bae0e5363ed"} Sep 19 00:05:03.936826 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:05:03.936789 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-p7rhf"] Sep 19 00:05:03.942094 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:05:03.942065 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-p7rhf" Sep 19 00:05:03.944816 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:05:03.944790 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-fd9db\"" Sep 19 00:05:03.945029 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:05:03.944911 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Sep 19 00:05:03.949477 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:05:03.949450 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-p7rhf"] Sep 19 00:05:04.002488 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:05:04.002452 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/94970d15-7512-4e26-91b4-9ce2137b32fb-cert\") pod \"kserve-controller-manager-d6f4b65b8-p7rhf\" (UID: \"94970d15-7512-4e26-91b4-9ce2137b32fb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-p7rhf" Sep 19 00:05:04.002706 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:05:04.002507 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bg2j9\" (UniqueName: \"kubernetes.io/projected/94970d15-7512-4e26-91b4-9ce2137b32fb-kube-api-access-bg2j9\") pod \"kserve-controller-manager-d6f4b65b8-p7rhf\" (UID: \"94970d15-7512-4e26-91b4-9ce2137b32fb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-p7rhf" Sep 19 00:05:04.103629 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:05:04.103597 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/94970d15-7512-4e26-91b4-9ce2137b32fb-cert\") pod \"kserve-controller-manager-d6f4b65b8-p7rhf\" (UID: \"94970d15-7512-4e26-91b4-9ce2137b32fb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-p7rhf" Sep 19 00:05:04.103629 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:05:04.103634 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bg2j9\" (UniqueName: \"kubernetes.io/projected/94970d15-7512-4e26-91b4-9ce2137b32fb-kube-api-access-bg2j9\") pod \"kserve-controller-manager-d6f4b65b8-p7rhf\" (UID: \"94970d15-7512-4e26-91b4-9ce2137b32fb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-p7rhf" Sep 19 00:05:04.106164 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:05:04.106139 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/94970d15-7512-4e26-91b4-9ce2137b32fb-cert\") pod \"kserve-controller-manager-d6f4b65b8-p7rhf\" (UID: \"94970d15-7512-4e26-91b4-9ce2137b32fb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-p7rhf" Sep 19 00:05:04.114103 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:05:04.114075 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bg2j9\" (UniqueName: \"kubernetes.io/projected/94970d15-7512-4e26-91b4-9ce2137b32fb-kube-api-access-bg2j9\") pod \"kserve-controller-manager-d6f4b65b8-p7rhf\" (UID: \"94970d15-7512-4e26-91b4-9ce2137b32fb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-p7rhf" Sep 19 00:05:04.263708 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:05:04.263614 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-p7rhf" Sep 19 00:05:04.534486 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:05:04.534401 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-p7rhf"] Sep 19 00:05:04.537449 ip-10-0-130-53 kubenswrapper[2579]: W0919 00:05:04.537416 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94970d15_7512_4e26_91b4_9ce2137b32fb.slice/crio-284087fb13f4b8ff112fff011ca0446545e81c3cb757d6ec4f68d2bc66afad9e WatchSource:0}: Error finding container 284087fb13f4b8ff112fff011ca0446545e81c3cb757d6ec4f68d2bc66afad9e: Status 404 returned error can't find the container with id 284087fb13f4b8ff112fff011ca0446545e81c3cb757d6ec4f68d2bc66afad9e Sep 19 00:05:04.770112 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:05:04.769953 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-p7rhf" event={"ID":"94970d15-7512-4e26-91b4-9ce2137b32fb","Type":"ContainerStarted","Data":"284087fb13f4b8ff112fff011ca0446545e81c3cb757d6ec4f68d2bc66afad9e"} Sep 19 00:05:07.799415 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:05:07.799378 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-p7rhf" event={"ID":"94970d15-7512-4e26-91b4-9ce2137b32fb","Type":"ContainerStarted","Data":"98d4699a3072c5729628370e6e399241d60b5bd7fd928f70281178ae23bb4945"} Sep 19 00:05:07.799908 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:05:07.799589 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-p7rhf" Sep 19 00:05:07.814597 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:05:07.814532 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-p7rhf" podStartSLOduration=2.064701498 podStartE2EDuration="4.814508357s" totalImagesPullingTime="2.749806859s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 00:05:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 00:05:07.81316075 +0000 UTC m=+399.789369219" watchObservedRunningTime="2026-09-19 00:05:07.814508357 +0000 UTC m=+399.790716827" Sep 19 00:05:08.804814 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:05:08.804749 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7968c85699-7zkjf" event={"ID":"a4eac14f-03cd-423d-b4d2-098be288bbb5","Type":"ContainerStarted","Data":"45531231f3e3a2be79a8445133a4a0013b1a48f4a7659cd4c6e512dfda3ed332"} Sep 19 00:05:08.822575 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:05:08.822524 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7968c85699-7zkjf" podStartSLOduration=1.698141293 podStartE2EDuration="8.82250709s" totalImagesPullingTime="7.124365797s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 00:05:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 00:05:08.821036308 +0000 UTC m=+400.797244776" watchObservedRunningTime="2026-09-19 00:05:08.82250709 +0000 UTC m=+400.798715600" Sep 19 00:05:09.809342 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:05:09.809311 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7968c85699-7zkjf" Sep 19 00:05:20.815349 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:05:20.815320 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7968c85699-7zkjf" Sep 19 00:05:38.810549 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:05:38.810513 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-p7rhf" Sep 19 00:06:11.169995 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:11.169959 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-r9t5p"] Sep 19 00:06:11.173650 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:11.173628 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-r9t5p" Sep 19 00:06:11.180086 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:11.179833 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Sep 19 00:06:11.180086 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:11.179918 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-pv9tv\"" Sep 19 00:06:11.180648 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:11.180623 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Sep 19 00:06:11.188501 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:11.188472 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-r9t5p"] Sep 19 00:06:11.266858 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:11.266810 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4nqc\" (UniqueName: \"kubernetes.io/projected/d9d8d990-4202-491d-a4a1-668e6beacb56-kube-api-access-f4nqc\") pod \"limitador-operator-controller-manager-74495c69f8-r9t5p\" (UID: \"d9d8d990-4202-491d-a4a1-668e6beacb56\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-r9t5p" Sep 19 00:06:11.367588 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:11.367553 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4nqc\" (UniqueName: \"kubernetes.io/projected/d9d8d990-4202-491d-a4a1-668e6beacb56-kube-api-access-f4nqc\") pod \"limitador-operator-controller-manager-74495c69f8-r9t5p\" (UID: \"d9d8d990-4202-491d-a4a1-668e6beacb56\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-r9t5p" Sep 19 00:06:11.377936 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:11.377908 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4nqc\" (UniqueName: \"kubernetes.io/projected/d9d8d990-4202-491d-a4a1-668e6beacb56-kube-api-access-f4nqc\") pod \"limitador-operator-controller-manager-74495c69f8-r9t5p\" (UID: \"d9d8d990-4202-491d-a4a1-668e6beacb56\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-r9t5p" Sep 19 00:06:11.483773 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:11.483673 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-r9t5p" Sep 19 00:06:11.756794 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:11.756718 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-r9t5p"] Sep 19 00:06:11.759460 ip-10-0-130-53 kubenswrapper[2579]: W0919 00:06:11.759431 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9d8d990_4202_491d_a4a1_668e6beacb56.slice/crio-a4500431236df0417ab75691260e0e1c892825efce21e840dd36f9e03810e336 WatchSource:0}: Error finding container a4500431236df0417ab75691260e0e1c892825efce21e840dd36f9e03810e336: Status 404 returned error can't find the container with id a4500431236df0417ab75691260e0e1c892825efce21e840dd36f9e03810e336 Sep 19 00:06:12.067164 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:12.067076 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-r9t5p" event={"ID":"d9d8d990-4202-491d-a4a1-668e6beacb56","Type":"ContainerStarted","Data":"a4500431236df0417ab75691260e0e1c892825efce21e840dd36f9e03810e336"} Sep 19 00:06:17.092544 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:17.092496 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-r9t5p" event={"ID":"d9d8d990-4202-491d-a4a1-668e6beacb56","Type":"ContainerStarted","Data":"c184b288f25c0e171727f944327e7abcc3a4cff6327b3e82d001ac320bc8b22e"} Sep 19 00:06:17.092977 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:17.092560 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-r9t5p" Sep 19 00:06:17.110494 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:17.110439 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-r9t5p" podStartSLOduration=1.778858823 podStartE2EDuration="6.110422779s" totalImagesPullingTime="4.331563956s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 00:06:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 00:06:17.109727356 +0000 UTC m=+469.085935850" watchObservedRunningTime="2026-09-19 00:06:17.110422779 +0000 UTC m=+469.086631246" Sep 19 00:06:18.225365 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:18.225320 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-68jlc"] Sep 19 00:06:18.229020 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:18.228997 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-68jlc" Sep 19 00:06:18.232654 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:18.232628 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-94867\"" Sep 19 00:06:18.239845 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:18.239822 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-68jlc"] Sep 19 00:06:18.327352 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:18.327316 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2flf\" (UniqueName: \"kubernetes.io/projected/79867a33-63af-4038-acba-59c1b7304bdd-kube-api-access-k2flf\") pod \"kuadrant-operator-controller-manager-76f8f686bf-68jlc\" (UID: \"79867a33-63af-4038-acba-59c1b7304bdd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-68jlc" Sep 19 00:06:18.327352 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:18.327362 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/79867a33-63af-4038-acba-59c1b7304bdd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-68jlc\" (UID: \"79867a33-63af-4038-acba-59c1b7304bdd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-68jlc" Sep 19 00:06:18.428800 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:18.428729 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/79867a33-63af-4038-acba-59c1b7304bdd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-68jlc\" (UID: \"79867a33-63af-4038-acba-59c1b7304bdd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-68jlc" Sep 19 00:06:18.428975 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:18.428879 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2flf\" (UniqueName: \"kubernetes.io/projected/79867a33-63af-4038-acba-59c1b7304bdd-kube-api-access-k2flf\") pod \"kuadrant-operator-controller-manager-76f8f686bf-68jlc\" (UID: \"79867a33-63af-4038-acba-59c1b7304bdd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-68jlc" Sep 19 00:06:18.429198 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:18.429178 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/79867a33-63af-4038-acba-59c1b7304bdd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-68jlc\" (UID: \"79867a33-63af-4038-acba-59c1b7304bdd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-68jlc" Sep 19 00:06:18.441515 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:18.441484 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2flf\" (UniqueName: \"kubernetes.io/projected/79867a33-63af-4038-acba-59c1b7304bdd-kube-api-access-k2flf\") pod \"kuadrant-operator-controller-manager-76f8f686bf-68jlc\" (UID: \"79867a33-63af-4038-acba-59c1b7304bdd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-68jlc" Sep 19 00:06:18.541555 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:18.541467 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-68jlc" Sep 19 00:06:18.820615 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:18.820586 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-68jlc"] Sep 19 00:06:18.823392 ip-10-0-130-53 kubenswrapper[2579]: W0919 00:06:18.823359 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79867a33_63af_4038_acba_59c1b7304bdd.slice/crio-affc33e89d7f92de3278ff5970e3e7c76e9de8e3bd8ca94bf3de9e923bab4b11 WatchSource:0}: Error finding container affc33e89d7f92de3278ff5970e3e7c76e9de8e3bd8ca94bf3de9e923bab4b11: Status 404 returned error can't find the container with id affc33e89d7f92de3278ff5970e3e7c76e9de8e3bd8ca94bf3de9e923bab4b11 Sep 19 00:06:19.101269 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:19.101174 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-68jlc" event={"ID":"79867a33-63af-4038-acba-59c1b7304bdd","Type":"ContainerStarted","Data":"affc33e89d7f92de3278ff5970e3e7c76e9de8e3bd8ca94bf3de9e923bab4b11"} Sep 19 00:06:24.122978 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:24.122945 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-68jlc" event={"ID":"79867a33-63af-4038-acba-59c1b7304bdd","Type":"ContainerStarted","Data":"2ecee7a32bdf587b99eff7d53126c7a3dcfd21f34de6726913a6bf50c3691038"} Sep 19 00:06:24.123373 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:24.123031 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-68jlc" Sep 19 00:06:24.153860 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:24.153786 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-68jlc" podStartSLOduration=1.585233279 podStartE2EDuration="6.153765542s" totalImagesPullingTime="4.568532263s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 00:06:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 00:06:24.151257785 +0000 UTC m=+476.127466273" watchObservedRunningTime="2026-09-19 00:06:24.153765542 +0000 UTC m=+476.129974004" Sep 19 00:06:28.098425 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:28.098386 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-r9t5p" Sep 19 00:06:35.129972 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:35.129943 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-68jlc" Sep 19 00:06:37.167895 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:37.167861 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-68jlc"] Sep 19 00:06:37.168312 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:37.168079 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-68jlc" podUID="79867a33-63af-4038-acba-59c1b7304bdd" containerName="manager" containerID="cri-o://2ecee7a32bdf587b99eff7d53126c7a3dcfd21f34de6726913a6bf50c3691038" gracePeriod=2 Sep 19 00:06:37.177066 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:37.177040 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-68jlc"] Sep 19 00:06:37.180830 ip-10-0-130-53 kubenswrapper[2579]: E0919 00:06:37.180789 2579 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"79867a33-63af-4038-acba-59c1b7304bdd\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-76f8f686bf-68jlc\": pods \"kuadrant-operator-controller-manager-76f8f686bf-68jlc\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-68jlc" Sep 19 00:06:37.194444 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:37.194388 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-r9t5p"] Sep 19 00:06:37.194671 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:37.194630 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-r9t5p" podUID="d9d8d990-4202-491d-a4a1-668e6beacb56" containerName="manager" containerID="cri-o://c184b288f25c0e171727f944327e7abcc3a4cff6327b3e82d001ac320bc8b22e" gracePeriod=2 Sep 19 00:06:37.196589 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:37.196554 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d48hx"] Sep 19 00:06:37.197188 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:37.197167 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79867a33-63af-4038-acba-59c1b7304bdd" containerName="manager" Sep 19 00:06:37.197188 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:37.197187 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="79867a33-63af-4038-acba-59c1b7304bdd" containerName="manager" Sep 19 00:06:37.197305 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:37.197254 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="79867a33-63af-4038-acba-59c1b7304bdd" containerName="manager" Sep 19 00:06:37.200424 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:37.200408 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d48hx" Sep 19 00:06:37.211773 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:37.211726 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d48hx"] Sep 19 00:06:37.216806 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:37.216779 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-r9t5p"] Sep 19 00:06:37.219133 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:37.219110 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-z2zk2"] Sep 19 00:06:37.219642 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:37.219621 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9d8d990-4202-491d-a4a1-668e6beacb56" containerName="manager" Sep 19 00:06:37.219642 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:37.219644 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9d8d990-4202-491d-a4a1-668e6beacb56" containerName="manager" Sep 19 00:06:37.219812 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:37.219724 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9d8d990-4202-491d-a4a1-668e6beacb56" containerName="manager" Sep 19 00:06:37.222891 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:37.222872 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-z2zk2" Sep 19 00:06:37.225876 ip-10-0-130-53 kubenswrapper[2579]: E0919 00:06:37.225838 2579 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"d9d8d990-4202-491d-a4a1-668e6beacb56\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-74495c69f8-r9t5p\": pods \"limitador-operator-controller-manager-74495c69f8-r9t5p\" not found" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-r9t5p" Sep 19 00:06:37.227466 ip-10-0-130-53 kubenswrapper[2579]: E0919 00:06:37.227443 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-68jlc\" is forbidden: User \"system:node:ip-10-0-130-53.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-53.ec2.internal' and this object" podUID="79867a33-63af-4038-acba-59c1b7304bdd" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-68jlc" Sep 19 00:06:37.236466 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:37.236438 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-z2zk2"] Sep 19 00:06:37.248125 ip-10-0-130-53 kubenswrapper[2579]: E0919 00:06:37.248084 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-r9t5p\" is forbidden: User \"system:node:ip-10-0-130-53.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-53.ec2.internal' and this object" podUID="d9d8d990-4202-491d-a4a1-668e6beacb56" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-r9t5p" Sep 19 00:06:37.270170 ip-10-0-130-53 kubenswrapper[2579]: E0919 00:06:37.270126 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-68jlc\" is forbidden: User \"system:node:ip-10-0-130-53.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-53.ec2.internal' and this object" podUID="79867a33-63af-4038-acba-59c1b7304bdd" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-68jlc" Sep 19 00:06:37.273535 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:37.273503 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pg2p\" (UniqueName: \"kubernetes.io/projected/dd8697ec-a5b5-4c9d-a665-d02b0244f352-kube-api-access-6pg2p\") pod \"limitador-operator-controller-manager-74495c69f8-z2zk2\" (UID: \"dd8697ec-a5b5-4c9d-a665-d02b0244f352\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-z2zk2" Sep 19 00:06:37.273661 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:37.273550 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8qdr\" (UniqueName: \"kubernetes.io/projected/ce7cb2fb-5e45-43d9-84e1-f451669847bc-kube-api-access-k8qdr\") pod \"kuadrant-operator-controller-manager-76f8f686bf-d48hx\" (UID: \"ce7cb2fb-5e45-43d9-84e1-f451669847bc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d48hx" Sep 19 00:06:37.273661 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:37.273568 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ce7cb2fb-5e45-43d9-84e1-f451669847bc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-d48hx\" (UID: \"ce7cb2fb-5e45-43d9-84e1-f451669847bc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d48hx" Sep 19 00:06:37.374253 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:37.374199 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8qdr\" (UniqueName: \"kubernetes.io/projected/ce7cb2fb-5e45-43d9-84e1-f451669847bc-kube-api-access-k8qdr\") pod \"kuadrant-operator-controller-manager-76f8f686bf-d48hx\" (UID: \"ce7cb2fb-5e45-43d9-84e1-f451669847bc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d48hx" Sep 19 00:06:37.374349 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:37.374277 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ce7cb2fb-5e45-43d9-84e1-f451669847bc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-d48hx\" (UID: \"ce7cb2fb-5e45-43d9-84e1-f451669847bc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d48hx" Sep 19 00:06:37.374397 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:37.374363 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pg2p\" (UniqueName: \"kubernetes.io/projected/dd8697ec-a5b5-4c9d-a665-d02b0244f352-kube-api-access-6pg2p\") pod \"limitador-operator-controller-manager-74495c69f8-z2zk2\" (UID: \"dd8697ec-a5b5-4c9d-a665-d02b0244f352\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-z2zk2" Sep 19 00:06:37.374732 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:37.374710 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ce7cb2fb-5e45-43d9-84e1-f451669847bc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-d48hx\" (UID: \"ce7cb2fb-5e45-43d9-84e1-f451669847bc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d48hx" Sep 19 00:06:37.383319 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:37.383286 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8qdr\" (UniqueName: \"kubernetes.io/projected/ce7cb2fb-5e45-43d9-84e1-f451669847bc-kube-api-access-k8qdr\") pod \"kuadrant-operator-controller-manager-76f8f686bf-d48hx\" (UID: \"ce7cb2fb-5e45-43d9-84e1-f451669847bc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d48hx" Sep 19 00:06:37.383526 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:37.383505 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pg2p\" (UniqueName: \"kubernetes.io/projected/dd8697ec-a5b5-4c9d-a665-d02b0244f352-kube-api-access-6pg2p\") pod \"limitador-operator-controller-manager-74495c69f8-z2zk2\" (UID: \"dd8697ec-a5b5-4c9d-a665-d02b0244f352\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-z2zk2" Sep 19 00:06:37.432785 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:37.432740 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-68jlc" Sep 19 00:06:37.434720 ip-10-0-130-53 kubenswrapper[2579]: E0919 00:06:37.434696 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-68jlc\" is forbidden: User \"system:node:ip-10-0-130-53.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-53.ec2.internal' and this object" podUID="79867a33-63af-4038-acba-59c1b7304bdd" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-68jlc" Sep 19 00:06:37.435344 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:37.435328 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-r9t5p" Sep 19 00:06:37.436410 ip-10-0-130-53 kubenswrapper[2579]: E0919 00:06:37.436390 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-r9t5p\" is forbidden: User \"system:node:ip-10-0-130-53.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-53.ec2.internal' and this object" podUID="d9d8d990-4202-491d-a4a1-668e6beacb56" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-r9t5p" Sep 19 00:06:37.438036 ip-10-0-130-53 kubenswrapper[2579]: E0919 00:06:37.438012 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-68jlc\" is forbidden: User \"system:node:ip-10-0-130-53.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-53.ec2.internal' and this object" podUID="79867a33-63af-4038-acba-59c1b7304bdd" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-68jlc" Sep 19 00:06:37.439486 ip-10-0-130-53 kubenswrapper[2579]: E0919 00:06:37.439466 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-r9t5p\" is forbidden: User \"system:node:ip-10-0-130-53.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-53.ec2.internal' and this object" podUID="d9d8d990-4202-491d-a4a1-668e6beacb56" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-r9t5p" Sep 19 00:06:37.475098 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:37.475064 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/79867a33-63af-4038-acba-59c1b7304bdd-extensions-socket-volume\") pod \"79867a33-63af-4038-acba-59c1b7304bdd\" (UID: \"79867a33-63af-4038-acba-59c1b7304bdd\") " Sep 19 00:06:37.475263 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:37.475110 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k2flf\" (UniqueName: \"kubernetes.io/projected/79867a33-63af-4038-acba-59c1b7304bdd-kube-api-access-k2flf\") pod \"79867a33-63af-4038-acba-59c1b7304bdd\" (UID: \"79867a33-63af-4038-acba-59c1b7304bdd\") " Sep 19 00:06:37.475263 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:37.475155 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f4nqc\" (UniqueName: \"kubernetes.io/projected/d9d8d990-4202-491d-a4a1-668e6beacb56-kube-api-access-f4nqc\") pod \"d9d8d990-4202-491d-a4a1-668e6beacb56\" (UID: \"d9d8d990-4202-491d-a4a1-668e6beacb56\") " Sep 19 00:06:37.475560 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:37.475533 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79867a33-63af-4038-acba-59c1b7304bdd-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "79867a33-63af-4038-acba-59c1b7304bdd" (UID: "79867a33-63af-4038-acba-59c1b7304bdd"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 19 00:06:37.477488 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:37.477460 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79867a33-63af-4038-acba-59c1b7304bdd-kube-api-access-k2flf" (OuterVolumeSpecName: "kube-api-access-k2flf") pod "79867a33-63af-4038-acba-59c1b7304bdd" (UID: "79867a33-63af-4038-acba-59c1b7304bdd"). InnerVolumeSpecName "kube-api-access-k2flf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 00:06:37.477617 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:37.477492 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9d8d990-4202-491d-a4a1-668e6beacb56-kube-api-access-f4nqc" (OuterVolumeSpecName: "kube-api-access-f4nqc") pod "d9d8d990-4202-491d-a4a1-668e6beacb56" (UID: "d9d8d990-4202-491d-a4a1-668e6beacb56"). InnerVolumeSpecName "kube-api-access-f4nqc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 00:06:37.576111 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:37.576074 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f4nqc\" (UniqueName: \"kubernetes.io/projected/d9d8d990-4202-491d-a4a1-668e6beacb56-kube-api-access-f4nqc\") on node \"ip-10-0-130-53.ec2.internal\" DevicePath \"\"" Sep 19 00:06:37.576111 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:37.576103 2579 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/79867a33-63af-4038-acba-59c1b7304bdd-extensions-socket-volume\") on node \"ip-10-0-130-53.ec2.internal\" DevicePath \"\"" Sep 19 00:06:37.576111 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:37.576112 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k2flf\" (UniqueName: \"kubernetes.io/projected/79867a33-63af-4038-acba-59c1b7304bdd-kube-api-access-k2flf\") on node \"ip-10-0-130-53.ec2.internal\" DevicePath \"\"" Sep 19 00:06:37.600628 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:37.600595 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d48hx" Sep 19 00:06:37.607779 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:37.607736 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-z2zk2" Sep 19 00:06:37.880846 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:37.880763 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d48hx"] Sep 19 00:06:37.882500 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:37.882478 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-z2zk2"] Sep 19 00:06:37.885285 ip-10-0-130-53 kubenswrapper[2579]: W0919 00:06:37.885256 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd8697ec_a5b5_4c9d_a665_d02b0244f352.slice/crio-16780b6bc902abd963b6f57d2983b957f8dae81acabc8b5e15c36ac6d521ffd9 WatchSource:0}: Error finding container 16780b6bc902abd963b6f57d2983b957f8dae81acabc8b5e15c36ac6d521ffd9: Status 404 returned error can't find the container with id 16780b6bc902abd963b6f57d2983b957f8dae81acabc8b5e15c36ac6d521ffd9 Sep 19 00:06:37.886072 ip-10-0-130-53 kubenswrapper[2579]: W0919 00:06:37.886049 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce7cb2fb_5e45_43d9_84e1_f451669847bc.slice/crio-f66067a3da9433c2652ae948df9bb8fa5daa04fd7f09d2344046e2bf33e526b4 WatchSource:0}: Error finding container f66067a3da9433c2652ae948df9bb8fa5daa04fd7f09d2344046e2bf33e526b4: Status 404 returned error can't find the container with id f66067a3da9433c2652ae948df9bb8fa5daa04fd7f09d2344046e2bf33e526b4 Sep 19 00:06:38.078177 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:38.078146 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79867a33-63af-4038-acba-59c1b7304bdd" path="/var/lib/kubelet/pods/79867a33-63af-4038-acba-59c1b7304bdd/volumes" Sep 19 00:06:38.078476 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:38.078464 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9d8d990-4202-491d-a4a1-668e6beacb56" path="/var/lib/kubelet/pods/d9d8d990-4202-491d-a4a1-668e6beacb56/volumes" Sep 19 00:06:38.189148 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:38.189016 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-z2zk2" event={"ID":"dd8697ec-a5b5-4c9d-a665-d02b0244f352","Type":"ContainerStarted","Data":"3982f9eebb5382b9affba181190e43c3edafd2050b534f46d76fe3cb3859a4fc"} Sep 19 00:06:38.189148 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:38.189070 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-z2zk2" event={"ID":"dd8697ec-a5b5-4c9d-a665-d02b0244f352","Type":"ContainerStarted","Data":"16780b6bc902abd963b6f57d2983b957f8dae81acabc8b5e15c36ac6d521ffd9"} Sep 19 00:06:38.189542 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:38.189175 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-z2zk2" Sep 19 00:06:38.190829 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:38.190801 2579 generic.go:356] "Generic (PLEG): container finished" podID="d9d8d990-4202-491d-a4a1-668e6beacb56" containerID="c184b288f25c0e171727f944327e7abcc3a4cff6327b3e82d001ac320bc8b22e" exitCode=0 Sep 19 00:06:38.190829 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:38.190839 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-r9t5p" Sep 19 00:06:38.191119 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:38.190908 2579 scope.go:117] "RemoveContainer" containerID="c184b288f25c0e171727f944327e7abcc3a4cff6327b3e82d001ac320bc8b22e" Sep 19 00:06:38.192790 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:38.192576 2579 generic.go:356] "Generic (PLEG): container finished" podID="79867a33-63af-4038-acba-59c1b7304bdd" containerID="2ecee7a32bdf587b99eff7d53126c7a3dcfd21f34de6726913a6bf50c3691038" exitCode=0 Sep 19 00:06:38.192790 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:38.192612 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-68jlc" Sep 19 00:06:38.194628 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:38.194603 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d48hx" event={"ID":"ce7cb2fb-5e45-43d9-84e1-f451669847bc","Type":"ContainerStarted","Data":"5a75491e961d76d4b3a7dd95f99fa892bb759596e5aa7e7a2bcb2c06470299fd"} Sep 19 00:06:38.194745 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:38.194654 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d48hx" event={"ID":"ce7cb2fb-5e45-43d9-84e1-f451669847bc","Type":"ContainerStarted","Data":"f66067a3da9433c2652ae948df9bb8fa5daa04fd7f09d2344046e2bf33e526b4"} Sep 19 00:06:38.194745 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:38.194680 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d48hx" Sep 19 00:06:38.199840 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:38.199824 2579 scope.go:117] "RemoveContainer" containerID="c184b288f25c0e171727f944327e7abcc3a4cff6327b3e82d001ac320bc8b22e" Sep 19 00:06:38.200134 ip-10-0-130-53 kubenswrapper[2579]: E0919 00:06:38.200116 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c184b288f25c0e171727f944327e7abcc3a4cff6327b3e82d001ac320bc8b22e\": container with ID starting with c184b288f25c0e171727f944327e7abcc3a4cff6327b3e82d001ac320bc8b22e not found: ID does not exist" containerID="c184b288f25c0e171727f944327e7abcc3a4cff6327b3e82d001ac320bc8b22e" Sep 19 00:06:38.200191 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:38.200142 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c184b288f25c0e171727f944327e7abcc3a4cff6327b3e82d001ac320bc8b22e"} err="failed to get container status \"c184b288f25c0e171727f944327e7abcc3a4cff6327b3e82d001ac320bc8b22e\": rpc error: code = NotFound desc = could not find container \"c184b288f25c0e171727f944327e7abcc3a4cff6327b3e82d001ac320bc8b22e\": container with ID starting with c184b288f25c0e171727f944327e7abcc3a4cff6327b3e82d001ac320bc8b22e not found: ID does not exist" Sep 19 00:06:38.200191 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:38.200160 2579 scope.go:117] "RemoveContainer" containerID="2ecee7a32bdf587b99eff7d53126c7a3dcfd21f34de6726913a6bf50c3691038" Sep 19 00:06:38.206698 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:38.206640 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-z2zk2" podStartSLOduration=1.206623269 podStartE2EDuration="1.206623269s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 00:06:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 00:06:38.206322629 +0000 UTC m=+490.182531097" watchObservedRunningTime="2026-09-19 00:06:38.206623269 +0000 UTC m=+490.182831738" Sep 19 00:06:38.208193 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:38.208169 2579 scope.go:117] "RemoveContainer" containerID="2ecee7a32bdf587b99eff7d53126c7a3dcfd21f34de6726913a6bf50c3691038" Sep 19 00:06:38.208442 ip-10-0-130-53 kubenswrapper[2579]: E0919 00:06:38.208425 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ecee7a32bdf587b99eff7d53126c7a3dcfd21f34de6726913a6bf50c3691038\": container with ID starting with 2ecee7a32bdf587b99eff7d53126c7a3dcfd21f34de6726913a6bf50c3691038 not found: ID does not exist" containerID="2ecee7a32bdf587b99eff7d53126c7a3dcfd21f34de6726913a6bf50c3691038" Sep 19 00:06:38.208490 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:38.208450 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ecee7a32bdf587b99eff7d53126c7a3dcfd21f34de6726913a6bf50c3691038"} err="failed to get container status \"2ecee7a32bdf587b99eff7d53126c7a3dcfd21f34de6726913a6bf50c3691038\": rpc error: code = NotFound desc = could not find container \"2ecee7a32bdf587b99eff7d53126c7a3dcfd21f34de6726913a6bf50c3691038\": container with ID starting with 2ecee7a32bdf587b99eff7d53126c7a3dcfd21f34de6726913a6bf50c3691038 not found: ID does not exist" Sep 19 00:06:38.225253 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:38.225206 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d48hx" podStartSLOduration=1.225192308 podStartE2EDuration="1.225192308s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 00:06:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 00:06:38.224180206 +0000 UTC m=+490.200388696" watchObservedRunningTime="2026-09-19 00:06:38.225192308 +0000 UTC m=+490.201400776" Sep 19 00:06:49.203219 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:49.203187 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-z2zk2" Sep 19 00:06:49.203594 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:49.203266 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d48hx" Sep 19 00:06:53.704907 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:53.704873 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d48hx"] Sep 19 00:06:53.705285 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:53.705082 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d48hx" podUID="ce7cb2fb-5e45-43d9-84e1-f451669847bc" containerName="manager" containerID="cri-o://5a75491e961d76d4b3a7dd95f99fa892bb759596e5aa7e7a2bcb2c06470299fd" gracePeriod=10 Sep 19 00:06:53.946832 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:53.946797 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-gj9w7"] Sep 19 00:06:53.964211 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:53.964174 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-gj9w7"] Sep 19 00:06:53.964351 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:53.964308 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-gj9w7" Sep 19 00:06:53.992770 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:53.992729 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d48hx" Sep 19 00:06:54.022740 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:54.022707 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lf588\" (UniqueName: \"kubernetes.io/projected/7a8abd2e-3c37-4a8b-9ddb-12140614fe76-kube-api-access-lf588\") pod \"kuadrant-operator-controller-manager-5769f99d9f-gj9w7\" (UID: \"7a8abd2e-3c37-4a8b-9ddb-12140614fe76\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-gj9w7" Sep 19 00:06:54.022929 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:54.022744 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7a8abd2e-3c37-4a8b-9ddb-12140614fe76-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-gj9w7\" (UID: \"7a8abd2e-3c37-4a8b-9ddb-12140614fe76\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-gj9w7" Sep 19 00:06:54.123863 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:54.123829 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k8qdr\" (UniqueName: \"kubernetes.io/projected/ce7cb2fb-5e45-43d9-84e1-f451669847bc-kube-api-access-k8qdr\") pod \"ce7cb2fb-5e45-43d9-84e1-f451669847bc\" (UID: \"ce7cb2fb-5e45-43d9-84e1-f451669847bc\") " Sep 19 00:06:54.124035 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:54.123911 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ce7cb2fb-5e45-43d9-84e1-f451669847bc-extensions-socket-volume\") pod \"ce7cb2fb-5e45-43d9-84e1-f451669847bc\" (UID: \"ce7cb2fb-5e45-43d9-84e1-f451669847bc\") " Sep 19 00:06:54.124133 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:54.124115 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lf588\" (UniqueName: \"kubernetes.io/projected/7a8abd2e-3c37-4a8b-9ddb-12140614fe76-kube-api-access-lf588\") pod \"kuadrant-operator-controller-manager-5769f99d9f-gj9w7\" (UID: \"7a8abd2e-3c37-4a8b-9ddb-12140614fe76\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-gj9w7" Sep 19 00:06:54.124198 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:54.124171 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7a8abd2e-3c37-4a8b-9ddb-12140614fe76-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-gj9w7\" (UID: \"7a8abd2e-3c37-4a8b-9ddb-12140614fe76\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-gj9w7" Sep 19 00:06:54.124372 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:54.124342 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce7cb2fb-5e45-43d9-84e1-f451669847bc-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ce7cb2fb-5e45-43d9-84e1-f451669847bc" (UID: "ce7cb2fb-5e45-43d9-84e1-f451669847bc"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 19 00:06:54.124620 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:54.124594 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7a8abd2e-3c37-4a8b-9ddb-12140614fe76-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-gj9w7\" (UID: \"7a8abd2e-3c37-4a8b-9ddb-12140614fe76\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-gj9w7" Sep 19 00:06:54.126126 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:54.126103 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce7cb2fb-5e45-43d9-84e1-f451669847bc-kube-api-access-k8qdr" (OuterVolumeSpecName: "kube-api-access-k8qdr") pod "ce7cb2fb-5e45-43d9-84e1-f451669847bc" (UID: "ce7cb2fb-5e45-43d9-84e1-f451669847bc"). InnerVolumeSpecName "kube-api-access-k8qdr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 00:06:54.134729 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:54.134696 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lf588\" (UniqueName: \"kubernetes.io/projected/7a8abd2e-3c37-4a8b-9ddb-12140614fe76-kube-api-access-lf588\") pod \"kuadrant-operator-controller-manager-5769f99d9f-gj9w7\" (UID: \"7a8abd2e-3c37-4a8b-9ddb-12140614fe76\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-gj9w7" Sep 19 00:06:54.225564 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:54.225478 2579 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ce7cb2fb-5e45-43d9-84e1-f451669847bc-extensions-socket-volume\") on node \"ip-10-0-130-53.ec2.internal\" DevicePath \"\"" Sep 19 00:06:54.225564 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:54.225508 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k8qdr\" (UniqueName: \"kubernetes.io/projected/ce7cb2fb-5e45-43d9-84e1-f451669847bc-kube-api-access-k8qdr\") on node \"ip-10-0-130-53.ec2.internal\" DevicePath \"\"" Sep 19 00:06:54.273863 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:54.273831 2579 generic.go:356] "Generic (PLEG): container finished" podID="ce7cb2fb-5e45-43d9-84e1-f451669847bc" containerID="5a75491e961d76d4b3a7dd95f99fa892bb759596e5aa7e7a2bcb2c06470299fd" exitCode=0 Sep 19 00:06:54.274036 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:54.273877 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d48hx" Sep 19 00:06:54.274036 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:54.273911 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d48hx" event={"ID":"ce7cb2fb-5e45-43d9-84e1-f451669847bc","Type":"ContainerDied","Data":"5a75491e961d76d4b3a7dd95f99fa892bb759596e5aa7e7a2bcb2c06470299fd"} Sep 19 00:06:54.274036 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:54.273963 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d48hx" event={"ID":"ce7cb2fb-5e45-43d9-84e1-f451669847bc","Type":"ContainerDied","Data":"f66067a3da9433c2652ae948df9bb8fa5daa04fd7f09d2344046e2bf33e526b4"} Sep 19 00:06:54.274036 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:54.273984 2579 scope.go:117] "RemoveContainer" containerID="5a75491e961d76d4b3a7dd95f99fa892bb759596e5aa7e7a2bcb2c06470299fd" Sep 19 00:06:54.282867 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:54.282845 2579 scope.go:117] "RemoveContainer" containerID="5a75491e961d76d4b3a7dd95f99fa892bb759596e5aa7e7a2bcb2c06470299fd" Sep 19 00:06:54.283151 ip-10-0-130-53 kubenswrapper[2579]: E0919 00:06:54.283130 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a75491e961d76d4b3a7dd95f99fa892bb759596e5aa7e7a2bcb2c06470299fd\": container with ID starting with 5a75491e961d76d4b3a7dd95f99fa892bb759596e5aa7e7a2bcb2c06470299fd not found: ID does not exist" containerID="5a75491e961d76d4b3a7dd95f99fa892bb759596e5aa7e7a2bcb2c06470299fd" Sep 19 00:06:54.283242 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:54.283159 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a75491e961d76d4b3a7dd95f99fa892bb759596e5aa7e7a2bcb2c06470299fd"} err="failed to get container status \"5a75491e961d76d4b3a7dd95f99fa892bb759596e5aa7e7a2bcb2c06470299fd\": rpc error: code = NotFound desc = could not find container \"5a75491e961d76d4b3a7dd95f99fa892bb759596e5aa7e7a2bcb2c06470299fd\": container with ID starting with 5a75491e961d76d4b3a7dd95f99fa892bb759596e5aa7e7a2bcb2c06470299fd not found: ID does not exist" Sep 19 00:06:54.286202 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:54.286157 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-gj9w7" Sep 19 00:06:54.320630 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:54.320597 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d48hx"] Sep 19 00:06:54.325210 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:54.325185 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d48hx"] Sep 19 00:06:54.591675 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:54.591594 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-gj9w7"] Sep 19 00:06:54.594571 ip-10-0-130-53 kubenswrapper[2579]: W0919 00:06:54.594544 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a8abd2e_3c37_4a8b_9ddb_12140614fe76.slice/crio-bc82c734dc3cfd9ee11cea5ccc6623b948d41215003f925b99bcf580ec3a2ab6 WatchSource:0}: Error finding container bc82c734dc3cfd9ee11cea5ccc6623b948d41215003f925b99bcf580ec3a2ab6: Status 404 returned error can't find the container with id bc82c734dc3cfd9ee11cea5ccc6623b948d41215003f925b99bcf580ec3a2ab6 Sep 19 00:06:55.283429 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:55.283386 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-gj9w7" event={"ID":"7a8abd2e-3c37-4a8b-9ddb-12140614fe76","Type":"ContainerStarted","Data":"91a58257fe766f4d60cb3b0c5a6e57508e5f9dbae2f332facd6eb531a99fbc7d"} Sep 19 00:06:55.283891 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:55.283452 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-gj9w7" event={"ID":"7a8abd2e-3c37-4a8b-9ddb-12140614fe76","Type":"ContainerStarted","Data":"bc82c734dc3cfd9ee11cea5ccc6623b948d41215003f925b99bcf580ec3a2ab6"} Sep 19 00:06:55.283891 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:55.283479 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-gj9w7" Sep 19 00:06:55.303383 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:55.303328 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-gj9w7" podStartSLOduration=2.303308971 podStartE2EDuration="2.303308971s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 00:06:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 00:06:55.301594533 +0000 UTC m=+507.277803023" watchObservedRunningTime="2026-09-19 00:06:55.303308971 +0000 UTC m=+507.279517440" Sep 19 00:06:56.076822 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:06:56.076790 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce7cb2fb-5e45-43d9-84e1-f451669847bc" path="/var/lib/kubelet/pods/ce7cb2fb-5e45-43d9-84e1-f451669847bc/volumes" Sep 19 00:07:06.291181 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:07:06.291144 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-gj9w7" Sep 19 00:07:24.611954 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:07:24.611919 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-mwjnl"] Sep 19 00:07:24.612356 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:07:24.612262 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce7cb2fb-5e45-43d9-84e1-f451669847bc" containerName="manager" Sep 19 00:07:24.612356 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:07:24.612275 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce7cb2fb-5e45-43d9-84e1-f451669847bc" containerName="manager" Sep 19 00:07:24.612356 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:07:24.612345 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce7cb2fb-5e45-43d9-84e1-f451669847bc" containerName="manager" Sep 19 00:07:24.615283 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:07:24.615262 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-mwjnl" Sep 19 00:07:24.617466 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:07:24.617434 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Sep 19 00:07:24.617585 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:07:24.617517 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-rfshb\"" Sep 19 00:07:24.626363 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:07:24.626338 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-mwjnl"] Sep 19 00:07:24.654046 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:07:24.649214 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-mwjnl"] Sep 19 00:07:24.694880 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:07:24.694836 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pblv\" (UniqueName: \"kubernetes.io/projected/9b210c76-5963-4997-a8f9-2b96673a351a-kube-api-access-8pblv\") pod \"limitador-limitador-84994f7ffc-mwjnl\" (UID: \"9b210c76-5963-4997-a8f9-2b96673a351a\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-mwjnl" Sep 19 00:07:24.695060 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:07:24.694923 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9b210c76-5963-4997-a8f9-2b96673a351a-config-file\") pod \"limitador-limitador-84994f7ffc-mwjnl\" (UID: \"9b210c76-5963-4997-a8f9-2b96673a351a\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-mwjnl" Sep 19 00:07:24.796384 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:07:24.796347 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pblv\" (UniqueName: \"kubernetes.io/projected/9b210c76-5963-4997-a8f9-2b96673a351a-kube-api-access-8pblv\") pod \"limitador-limitador-84994f7ffc-mwjnl\" (UID: \"9b210c76-5963-4997-a8f9-2b96673a351a\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-mwjnl" Sep 19 00:07:24.796559 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:07:24.796415 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9b210c76-5963-4997-a8f9-2b96673a351a-config-file\") pod \"limitador-limitador-84994f7ffc-mwjnl\" (UID: \"9b210c76-5963-4997-a8f9-2b96673a351a\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-mwjnl" Sep 19 00:07:24.797030 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:07:24.797012 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9b210c76-5963-4997-a8f9-2b96673a351a-config-file\") pod \"limitador-limitador-84994f7ffc-mwjnl\" (UID: \"9b210c76-5963-4997-a8f9-2b96673a351a\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-mwjnl" Sep 19 00:07:24.806004 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:07:24.805983 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pblv\" (UniqueName: \"kubernetes.io/projected/9b210c76-5963-4997-a8f9-2b96673a351a-kube-api-access-8pblv\") pod \"limitador-limitador-84994f7ffc-mwjnl\" (UID: \"9b210c76-5963-4997-a8f9-2b96673a351a\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-mwjnl" Sep 19 00:07:24.926413 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:07:24.926367 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-mwjnl" Sep 19 00:07:25.199352 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:07:25.199275 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-mwjnl"] Sep 19 00:07:25.202796 ip-10-0-130-53 kubenswrapper[2579]: W0919 00:07:25.202767 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b210c76_5963_4997_a8f9_2b96673a351a.slice/crio-071347ac8501c5973d66ebf5b39a169422a47ee537b6dc0bc175aa98fc86f099 WatchSource:0}: Error finding container 071347ac8501c5973d66ebf5b39a169422a47ee537b6dc0bc175aa98fc86f099: Status 404 returned error can't find the container with id 071347ac8501c5973d66ebf5b39a169422a47ee537b6dc0bc175aa98fc86f099 Sep 19 00:07:25.419581 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:07:25.419544 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-mwjnl" event={"ID":"9b210c76-5963-4997-a8f9-2b96673a351a","Type":"ContainerStarted","Data":"071347ac8501c5973d66ebf5b39a169422a47ee537b6dc0bc175aa98fc86f099"} Sep 19 00:07:26.427326 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:07:26.427285 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-mwjnl" event={"ID":"9b210c76-5963-4997-a8f9-2b96673a351a","Type":"ContainerStarted","Data":"139f967acc3564269a0a3dc18beda2beb85c578c86b0aabd4cb67beb415c0fd2"} Sep 19 00:07:26.427715 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:07:26.427348 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-mwjnl" Sep 19 00:07:26.442175 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:07:26.442126 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-mwjnl" podStartSLOduration=1.397483335 podStartE2EDuration="2.442110952s" totalImagesPullingTime="1.044627617s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 00:07:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 00:07:26.440616946 +0000 UTC m=+538.416825440" watchObservedRunningTime="2026-09-19 00:07:26.442110952 +0000 UTC m=+538.418319419" Sep 19 00:07:37.433644 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:07:37.433610 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-mwjnl" Sep 19 00:08:29.949267 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:08:29.949237 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6j92q_558d514a-4560-4e46-96af-e19cb4d741f8/ovn-acl-logging/0.log" Sep 19 00:08:29.950411 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:08:29.950382 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6j92q_558d514a-4560-4e46-96af-e19cb4d741f8/ovn-acl-logging/0.log" Sep 19 00:08:39.607881 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:08:39.607838 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-qwj4p"] Sep 19 00:08:39.611632 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:08:39.611605 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-qwj4p" Sep 19 00:08:39.613675 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:08:39.613651 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Sep 19 00:08:39.614618 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:08:39.614599 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 19 00:08:39.614715 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:08:39.614602 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-b8f9j\"" Sep 19 00:08:39.614715 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:08:39.614661 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 19 00:08:39.620956 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:08:39.620933 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-qwj4p"] Sep 19 00:08:39.704476 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:08:39.704437 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-mwjnl"] Sep 19 00:08:39.711159 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:08:39.711132 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcvbn\" (UniqueName: \"kubernetes.io/projected/8ef63aa4-822d-4fce-9718-4101a0c59dbc-kube-api-access-hcvbn\") pod \"payload-processing-5b54b7fbb7-qwj4p\" (UID: \"8ef63aa4-822d-4fce-9718-4101a0c59dbc\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-qwj4p" Sep 19 00:08:39.711270 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:08:39.711175 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8ef63aa4-822d-4fce-9718-4101a0c59dbc-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-qwj4p\" (UID: \"8ef63aa4-822d-4fce-9718-4101a0c59dbc\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-qwj4p" Sep 19 00:08:39.812543 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:08:39.812503 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcvbn\" (UniqueName: \"kubernetes.io/projected/8ef63aa4-822d-4fce-9718-4101a0c59dbc-kube-api-access-hcvbn\") pod \"payload-processing-5b54b7fbb7-qwj4p\" (UID: \"8ef63aa4-822d-4fce-9718-4101a0c59dbc\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-qwj4p" Sep 19 00:08:39.812842 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:08:39.812556 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8ef63aa4-822d-4fce-9718-4101a0c59dbc-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-qwj4p\" (UID: \"8ef63aa4-822d-4fce-9718-4101a0c59dbc\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-qwj4p" Sep 19 00:08:39.813380 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:08:39.813352 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8ef63aa4-822d-4fce-9718-4101a0c59dbc-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-qwj4p\" (UID: \"8ef63aa4-822d-4fce-9718-4101a0c59dbc\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-qwj4p" Sep 19 00:08:39.819605 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:08:39.819580 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcvbn\" (UniqueName: \"kubernetes.io/projected/8ef63aa4-822d-4fce-9718-4101a0c59dbc-kube-api-access-hcvbn\") pod \"payload-processing-5b54b7fbb7-qwj4p\" (UID: \"8ef63aa4-822d-4fce-9718-4101a0c59dbc\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-qwj4p" Sep 19 00:08:39.923270 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:08:39.923232 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-qwj4p" Sep 19 00:08:40.195822 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:08:40.195797 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-qwj4p"] Sep 19 00:08:40.198261 ip-10-0-130-53 kubenswrapper[2579]: W0919 00:08:40.198234 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ef63aa4_822d_4fce_9718_4101a0c59dbc.slice/crio-d2542f6931f6366eada345c73a32e1aae83d23cdfc8ab37a77351fd57fa30b2a WatchSource:0}: Error finding container d2542f6931f6366eada345c73a32e1aae83d23cdfc8ab37a77351fd57fa30b2a: Status 404 returned error can't find the container with id d2542f6931f6366eada345c73a32e1aae83d23cdfc8ab37a77351fd57fa30b2a Sep 19 00:08:40.747502 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:08:40.747465 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-qwj4p" event={"ID":"8ef63aa4-822d-4fce-9718-4101a0c59dbc","Type":"ContainerStarted","Data":"d2542f6931f6366eada345c73a32e1aae83d23cdfc8ab37a77351fd57fa30b2a"} Sep 19 00:08:43.762111 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:08:43.762066 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-qwj4p" event={"ID":"8ef63aa4-822d-4fce-9718-4101a0c59dbc","Type":"ContainerStarted","Data":"50516e9022ab6e16ea9632bfdb554e5160b2fb4f2a522a272d5a46f5678f4146"} Sep 19 00:08:43.762506 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:08:43.762157 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-qwj4p" Sep 19 00:08:43.777374 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:08:43.777323 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-qwj4p" podStartSLOduration=2.217357385 podStartE2EDuration="4.777307179s" totalImagesPullingTime="2.559949794s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 00:08:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 00:08:43.776129244 +0000 UTC m=+615.752337713" watchObservedRunningTime="2026-09-19 00:08:43.777307179 +0000 UTC m=+615.753515712" Sep 19 00:08:54.768164 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:08:54.768131 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-qwj4p" Sep 19 00:09:04.098693 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:09:04.098655 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-mwjnl"] Sep 19 00:09:14.705603 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:09:14.705567 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-mwjnl"] Sep 19 00:09:20.710400 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:09:20.710363 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-mwjnl"] Sep 19 00:09:23.905482 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:09:23.905447 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-mwjnl"] Sep 19 00:09:36.509411 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:09:36.509373 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-mwjnl"] Sep 19 00:09:37.992667 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:09:37.992636 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-54cqp"] Sep 19 00:09:37.996186 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:09:37.996166 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-54cqp" Sep 19 00:09:37.999145 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:09:37.999123 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Sep 19 00:09:37.999145 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:09:37.999133 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Sep 19 00:09:37.999145 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:09:37.999142 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-shsj8\"" Sep 19 00:09:37.999323 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:09:37.999133 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Sep 19 00:09:38.004878 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:09:38.004858 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-54cqp"] Sep 19 00:09:38.133267 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:09:38.133231 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91b371f0-d627-4ed5-b144-782c92ce0f69-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-54cqp\" (UID: \"91b371f0-d627-4ed5-b144-782c92ce0f69\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-54cqp" Sep 19 00:09:38.133267 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:09:38.133274 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/91b371f0-d627-4ed5-b144-782c92ce0f69-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-54cqp\" (UID: \"91b371f0-d627-4ed5-b144-782c92ce0f69\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-54cqp" Sep 19 00:09:38.133501 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:09:38.133295 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jx6mk\" (UniqueName: \"kubernetes.io/projected/91b371f0-d627-4ed5-b144-782c92ce0f69-kube-api-access-jx6mk\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-54cqp\" (UID: \"91b371f0-d627-4ed5-b144-782c92ce0f69\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-54cqp" Sep 19 00:09:38.133501 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:09:38.133377 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/91b371f0-d627-4ed5-b144-782c92ce0f69-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-54cqp\" (UID: \"91b371f0-d627-4ed5-b144-782c92ce0f69\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-54cqp" Sep 19 00:09:38.133501 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:09:38.133483 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/91b371f0-d627-4ed5-b144-782c92ce0f69-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-54cqp\" (UID: \"91b371f0-d627-4ed5-b144-782c92ce0f69\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-54cqp" Sep 19 00:09:38.133668 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:09:38.133525 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91b371f0-d627-4ed5-b144-782c92ce0f69-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-54cqp\" (UID: \"91b371f0-d627-4ed5-b144-782c92ce0f69\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-54cqp" Sep 19 00:09:38.234187 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:09:38.234156 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91b371f0-d627-4ed5-b144-782c92ce0f69-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-54cqp\" (UID: \"91b371f0-d627-4ed5-b144-782c92ce0f69\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-54cqp" Sep 19 00:09:38.234377 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:09:38.234197 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/91b371f0-d627-4ed5-b144-782c92ce0f69-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-54cqp\" (UID: \"91b371f0-d627-4ed5-b144-782c92ce0f69\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-54cqp" Sep 19 00:09:38.234377 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:09:38.234222 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jx6mk\" (UniqueName: \"kubernetes.io/projected/91b371f0-d627-4ed5-b144-782c92ce0f69-kube-api-access-jx6mk\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-54cqp\" (UID: \"91b371f0-d627-4ed5-b144-782c92ce0f69\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-54cqp" Sep 19 00:09:38.234377 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:09:38.234265 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/91b371f0-d627-4ed5-b144-782c92ce0f69-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-54cqp\" (UID: \"91b371f0-d627-4ed5-b144-782c92ce0f69\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-54cqp" Sep 19 00:09:38.234377 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:09:38.234312 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/91b371f0-d627-4ed5-b144-782c92ce0f69-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-54cqp\" (UID: \"91b371f0-d627-4ed5-b144-782c92ce0f69\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-54cqp" Sep 19 00:09:38.234377 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:09:38.234348 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91b371f0-d627-4ed5-b144-782c92ce0f69-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-54cqp\" (UID: \"91b371f0-d627-4ed5-b144-782c92ce0f69\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-54cqp" Sep 19 00:09:38.234717 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:09:38.234689 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/91b371f0-d627-4ed5-b144-782c92ce0f69-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-54cqp\" (UID: \"91b371f0-d627-4ed5-b144-782c92ce0f69\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-54cqp" Sep 19 00:09:38.234831 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:09:38.234736 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/91b371f0-d627-4ed5-b144-782c92ce0f69-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-54cqp\" (UID: \"91b371f0-d627-4ed5-b144-782c92ce0f69\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-54cqp" Sep 19 00:09:38.234831 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:09:38.234746 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91b371f0-d627-4ed5-b144-782c92ce0f69-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-54cqp\" (UID: \"91b371f0-d627-4ed5-b144-782c92ce0f69\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-54cqp" Sep 19 00:09:38.236496 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:09:38.236467 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/91b371f0-d627-4ed5-b144-782c92ce0f69-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-54cqp\" (UID: \"91b371f0-d627-4ed5-b144-782c92ce0f69\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-54cqp" Sep 19 00:09:38.236789 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:09:38.236771 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91b371f0-d627-4ed5-b144-782c92ce0f69-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-54cqp\" (UID: \"91b371f0-d627-4ed5-b144-782c92ce0f69\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-54cqp" Sep 19 00:09:38.241709 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:09:38.241686 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jx6mk\" (UniqueName: \"kubernetes.io/projected/91b371f0-d627-4ed5-b144-782c92ce0f69-kube-api-access-jx6mk\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-54cqp\" (UID: \"91b371f0-d627-4ed5-b144-782c92ce0f69\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-54cqp" Sep 19 00:09:38.307442 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:09:38.307359 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-54cqp" Sep 19 00:09:38.577199 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:09:38.577134 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-54cqp"] Sep 19 00:09:38.579411 ip-10-0-130-53 kubenswrapper[2579]: W0919 00:09:38.579374 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91b371f0_d627_4ed5_b144_782c92ce0f69.slice/crio-804d4b7d4dcf0752edaf0bf16b1e35a4a48d378234b8bd971e5b00ad2bb1ba11 WatchSource:0}: Error finding container 804d4b7d4dcf0752edaf0bf16b1e35a4a48d378234b8bd971e5b00ad2bb1ba11: Status 404 returned error can't find the container with id 804d4b7d4dcf0752edaf0bf16b1e35a4a48d378234b8bd971e5b00ad2bb1ba11 Sep 19 00:09:38.580861 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:09:38.580842 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 19 00:09:39.000257 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:09:39.000214 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-54cqp" event={"ID":"91b371f0-d627-4ed5-b144-782c92ce0f69","Type":"ContainerStarted","Data":"804d4b7d4dcf0752edaf0bf16b1e35a4a48d378234b8bd971e5b00ad2bb1ba11"} Sep 19 00:09:40.006002 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:09:40.005964 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-54cqp" event={"ID":"91b371f0-d627-4ed5-b144-782c92ce0f69","Type":"ContainerStarted","Data":"4aa5053b5bc441b5121c894db719ec9be561b89ede996e97fad47c0b53b5698f"} Sep 19 00:09:40.020791 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:09:40.020724 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-54cqp" podStartSLOduration=2.010907899 podStartE2EDuration="3.020707377s" totalImagesPullingTime="1.009799478s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 00:09:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 00:09:40.020256304 +0000 UTC m=+671.996464799" watchObservedRunningTime="2026-09-19 00:09:40.020707377 +0000 UTC m=+671.996915844" Sep 19 00:09:45.207936 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:09:45.207901 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-mwjnl"] Sep 19 00:09:48.308411 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:09:48.308374 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-54cqp" Sep 19 00:09:48.308964 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:09:48.308453 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-54cqp" Sep 19 00:09:48.320895 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:09:48.320866 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-54cqp" Sep 19 00:09:49.061673 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:09:49.061641 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-54cqp" Sep 19 00:11:19.466090 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:11:19.466053 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/ai-gateway-controller-d4799c777-x4z6h"] Sep 19 00:11:19.469944 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:11:19.469923 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-d4799c777-x4z6h" Sep 19 00:11:19.472417 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:11:19.472398 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"ai-gateway-controller-dockercfg-4hppn\"" Sep 19 00:11:19.472545 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:11:19.472426 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"ai-gateway-controller-parameters\"" Sep 19 00:11:19.475439 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:11:19.475416 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-d4799c777-x4z6h"] Sep 19 00:11:19.637094 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:11:19.637040 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9sx4\" (UniqueName: \"kubernetes.io/projected/a710b713-c312-4910-92b7-ca728c1ac48a-kube-api-access-t9sx4\") pod \"ai-gateway-controller-d4799c777-x4z6h\" (UID: \"a710b713-c312-4910-92b7-ca728c1ac48a\") " pod="opendatahub/ai-gateway-controller-d4799c777-x4z6h" Sep 19 00:11:19.738372 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:11:19.738281 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9sx4\" (UniqueName: \"kubernetes.io/projected/a710b713-c312-4910-92b7-ca728c1ac48a-kube-api-access-t9sx4\") pod \"ai-gateway-controller-d4799c777-x4z6h\" (UID: \"a710b713-c312-4910-92b7-ca728c1ac48a\") " pod="opendatahub/ai-gateway-controller-d4799c777-x4z6h" Sep 19 00:11:19.746005 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:11:19.745972 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9sx4\" (UniqueName: \"kubernetes.io/projected/a710b713-c312-4910-92b7-ca728c1ac48a-kube-api-access-t9sx4\") pod \"ai-gateway-controller-d4799c777-x4z6h\" (UID: \"a710b713-c312-4910-92b7-ca728c1ac48a\") " pod="opendatahub/ai-gateway-controller-d4799c777-x4z6h" Sep 19 00:11:19.781909 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:11:19.781874 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-d4799c777-x4z6h" Sep 19 00:11:20.047600 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:11:20.047507 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-d4799c777-x4z6h"] Sep 19 00:11:20.050525 ip-10-0-130-53 kubenswrapper[2579]: W0919 00:11:20.050499 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda710b713_c312_4910_92b7_ca728c1ac48a.slice/crio-3995dddb6d083c450aaf26162006869e1c769341526fd2f93a63adfb6ba366ce WatchSource:0}: Error finding container 3995dddb6d083c450aaf26162006869e1c769341526fd2f93a63adfb6ba366ce: Status 404 returned error can't find the container with id 3995dddb6d083c450aaf26162006869e1c769341526fd2f93a63adfb6ba366ce Sep 19 00:11:20.462670 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:11:20.462633 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-d4799c777-x4z6h" event={"ID":"a710b713-c312-4910-92b7-ca728c1ac48a","Type":"ContainerStarted","Data":"3995dddb6d083c450aaf26162006869e1c769341526fd2f93a63adfb6ba366ce"} Sep 19 00:11:22.481104 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:11:22.481068 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-d4799c777-x4z6h" event={"ID":"a710b713-c312-4910-92b7-ca728c1ac48a","Type":"ContainerStarted","Data":"b6b4466e5e0d1d6be7e0365cfeb21769b12e521904381c02ee3d5cbd591116ef"} Sep 19 00:11:22.481470 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:11:22.481180 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/ai-gateway-controller-d4799c777-x4z6h" Sep 19 00:11:22.494159 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:11:22.494110 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/ai-gateway-controller-d4799c777-x4z6h" podStartSLOduration=1.174605982 podStartE2EDuration="3.494096687s" totalImagesPullingTime="2.319490705s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 00:11:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 00:11:22.492704728 +0000 UTC m=+774.468913197" watchObservedRunningTime="2026-09-19 00:11:22.494096687 +0000 UTC m=+774.470305156" Sep 19 00:11:33.487409 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:11:33.487378 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/ai-gateway-controller-d4799c777-x4z6h" Sep 19 00:11:34.209880 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:11:34.209842 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-qwj4p"] Sep 19 00:11:34.210138 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:11:34.210096 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-5b54b7fbb7-qwj4p" podUID="8ef63aa4-822d-4fce-9718-4101a0c59dbc" containerName="payload-processing" containerID="cri-o://50516e9022ab6e16ea9632bfdb554e5160b2fb4f2a522a272d5a46f5678f4146" gracePeriod=30 Sep 19 00:11:34.459054 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:11:34.459027 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-qwj4p" Sep 19 00:11:34.469437 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:11:34.469375 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8ef63aa4-822d-4fce-9718-4101a0c59dbc-plugins-config-volume\") pod \"8ef63aa4-822d-4fce-9718-4101a0c59dbc\" (UID: \"8ef63aa4-822d-4fce-9718-4101a0c59dbc\") " Sep 19 00:11:34.469437 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:11:34.469431 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hcvbn\" (UniqueName: \"kubernetes.io/projected/8ef63aa4-822d-4fce-9718-4101a0c59dbc-kube-api-access-hcvbn\") pod \"8ef63aa4-822d-4fce-9718-4101a0c59dbc\" (UID: \"8ef63aa4-822d-4fce-9718-4101a0c59dbc\") " Sep 19 00:11:34.469709 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:11:34.469687 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ef63aa4-822d-4fce-9718-4101a0c59dbc-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8ef63aa4-822d-4fce-9718-4101a0c59dbc" (UID: "8ef63aa4-822d-4fce-9718-4101a0c59dbc"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 00:11:34.471548 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:11:34.471526 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ef63aa4-822d-4fce-9718-4101a0c59dbc-kube-api-access-hcvbn" (OuterVolumeSpecName: "kube-api-access-hcvbn") pod "8ef63aa4-822d-4fce-9718-4101a0c59dbc" (UID: "8ef63aa4-822d-4fce-9718-4101a0c59dbc"). InnerVolumeSpecName "kube-api-access-hcvbn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 00:11:34.535470 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:11:34.535437 2579 generic.go:356] "Generic (PLEG): container finished" podID="8ef63aa4-822d-4fce-9718-4101a0c59dbc" containerID="50516e9022ab6e16ea9632bfdb554e5160b2fb4f2a522a272d5a46f5678f4146" exitCode=0 Sep 19 00:11:34.535920 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:11:34.535487 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-qwj4p" Sep 19 00:11:34.535920 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:11:34.535498 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-qwj4p" event={"ID":"8ef63aa4-822d-4fce-9718-4101a0c59dbc","Type":"ContainerDied","Data":"50516e9022ab6e16ea9632bfdb554e5160b2fb4f2a522a272d5a46f5678f4146"} Sep 19 00:11:34.535920 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:11:34.535540 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-qwj4p" event={"ID":"8ef63aa4-822d-4fce-9718-4101a0c59dbc","Type":"ContainerDied","Data":"d2542f6931f6366eada345c73a32e1aae83d23cdfc8ab37a77351fd57fa30b2a"} Sep 19 00:11:34.535920 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:11:34.535562 2579 scope.go:117] "RemoveContainer" containerID="50516e9022ab6e16ea9632bfdb554e5160b2fb4f2a522a272d5a46f5678f4146" Sep 19 00:11:34.544066 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:11:34.544046 2579 scope.go:117] "RemoveContainer" containerID="50516e9022ab6e16ea9632bfdb554e5160b2fb4f2a522a272d5a46f5678f4146" Sep 19 00:11:34.544333 ip-10-0-130-53 kubenswrapper[2579]: E0919 00:11:34.544318 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50516e9022ab6e16ea9632bfdb554e5160b2fb4f2a522a272d5a46f5678f4146\": container with ID starting with 50516e9022ab6e16ea9632bfdb554e5160b2fb4f2a522a272d5a46f5678f4146 not found: ID does not exist" containerID="50516e9022ab6e16ea9632bfdb554e5160b2fb4f2a522a272d5a46f5678f4146" Sep 19 00:11:34.544382 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:11:34.544340 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50516e9022ab6e16ea9632bfdb554e5160b2fb4f2a522a272d5a46f5678f4146"} err="failed to get container status \"50516e9022ab6e16ea9632bfdb554e5160b2fb4f2a522a272d5a46f5678f4146\": rpc error: code = NotFound desc = could not find container \"50516e9022ab6e16ea9632bfdb554e5160b2fb4f2a522a272d5a46f5678f4146\": container with ID starting with 50516e9022ab6e16ea9632bfdb554e5160b2fb4f2a522a272d5a46f5678f4146 not found: ID does not exist" Sep 19 00:11:34.556954 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:11:34.556925 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-qwj4p"] Sep 19 00:11:34.560179 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:11:34.560157 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-qwj4p"] Sep 19 00:11:34.570091 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:11:34.570069 2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8ef63aa4-822d-4fce-9718-4101a0c59dbc-plugins-config-volume\") on node \"ip-10-0-130-53.ec2.internal\" DevicePath \"\"" Sep 19 00:11:34.570091 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:11:34.570089 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hcvbn\" (UniqueName: \"kubernetes.io/projected/8ef63aa4-822d-4fce-9718-4101a0c59dbc-kube-api-access-hcvbn\") on node \"ip-10-0-130-53.ec2.internal\" DevicePath \"\"" Sep 19 00:11:34.784032 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:11:34.783942 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-6t4w9"] Sep 19 00:11:34.784374 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:11:34.784356 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ef63aa4-822d-4fce-9718-4101a0c59dbc" containerName="payload-processing" Sep 19 00:11:34.784458 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:11:34.784376 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ef63aa4-822d-4fce-9718-4101a0c59dbc" containerName="payload-processing" Sep 19 00:11:34.784507 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:11:34.784466 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ef63aa4-822d-4fce-9718-4101a0c59dbc" containerName="payload-processing" Sep 19 00:11:34.789543 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:11:34.789516 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-6t4w9" Sep 19 00:11:34.792613 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:11:34.792579 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-8dxcn\"" Sep 19 00:11:34.792613 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:11:34.792604 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 19 00:11:34.792613 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:11:34.792610 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Sep 19 00:11:34.792852 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:11:34.792624 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 19 00:11:34.797217 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:11:34.797192 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-6t4w9"] Sep 19 00:11:34.873646 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:11:34.873614 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a9533ac9-0220-4073-8809-9d18c4e223f4-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-6t4w9\" (UID: \"a9533ac9-0220-4073-8809-9d18c4e223f4\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-6t4w9" Sep 19 00:11:34.873852 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:11:34.873678 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5f7c\" (UniqueName: \"kubernetes.io/projected/a9533ac9-0220-4073-8809-9d18c4e223f4-kube-api-access-x5f7c\") pod \"payload-processing-5b54b7fbb7-6t4w9\" (UID: \"a9533ac9-0220-4073-8809-9d18c4e223f4\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-6t4w9" Sep 19 00:11:34.974271 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:11:34.974231 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5f7c\" (UniqueName: \"kubernetes.io/projected/a9533ac9-0220-4073-8809-9d18c4e223f4-kube-api-access-x5f7c\") pod \"payload-processing-5b54b7fbb7-6t4w9\" (UID: \"a9533ac9-0220-4073-8809-9d18c4e223f4\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-6t4w9" Sep 19 00:11:34.974461 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:11:34.974332 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a9533ac9-0220-4073-8809-9d18c4e223f4-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-6t4w9\" (UID: \"a9533ac9-0220-4073-8809-9d18c4e223f4\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-6t4w9" Sep 19 00:11:34.975135 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:11:34.975114 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a9533ac9-0220-4073-8809-9d18c4e223f4-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-6t4w9\" (UID: \"a9533ac9-0220-4073-8809-9d18c4e223f4\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-6t4w9" Sep 19 00:11:34.981601 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:11:34.981572 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5f7c\" (UniqueName: \"kubernetes.io/projected/a9533ac9-0220-4073-8809-9d18c4e223f4-kube-api-access-x5f7c\") pod \"payload-processing-5b54b7fbb7-6t4w9\" (UID: \"a9533ac9-0220-4073-8809-9d18c4e223f4\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-6t4w9" Sep 19 00:11:35.101931 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:11:35.101839 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-6t4w9" Sep 19 00:11:35.370687 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:11:35.370608 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-6t4w9"] Sep 19 00:11:35.374310 ip-10-0-130-53 kubenswrapper[2579]: W0919 00:11:35.374277 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9533ac9_0220_4073_8809_9d18c4e223f4.slice/crio-836acb8a30cf0f9f95edc7cdb5d42a724b2e697dd15afc65915740d2cbbd52d5 WatchSource:0}: Error finding container 836acb8a30cf0f9f95edc7cdb5d42a724b2e697dd15afc65915740d2cbbd52d5: Status 404 returned error can't find the container with id 836acb8a30cf0f9f95edc7cdb5d42a724b2e697dd15afc65915740d2cbbd52d5 Sep 19 00:11:35.542799 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:11:35.542748 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-6t4w9" event={"ID":"a9533ac9-0220-4073-8809-9d18c4e223f4","Type":"ContainerStarted","Data":"678a7b879ac2d67f8f2471d8a3efe089ce6a49df94e576d4113db1b7ebb75be7"} Sep 19 00:11:35.543285 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:11:35.542920 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-6t4w9" Sep 19 00:11:35.543285 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:11:35.542981 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-6t4w9" event={"ID":"a9533ac9-0220-4073-8809-9d18c4e223f4","Type":"ContainerStarted","Data":"836acb8a30cf0f9f95edc7cdb5d42a724b2e697dd15afc65915740d2cbbd52d5"} Sep 19 00:11:35.559157 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:11:35.558976 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-6t4w9" podStartSLOduration=1.558960947 podStartE2EDuration="1.558960947s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 00:11:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 00:11:35.557985469 +0000 UTC m=+787.534193936" watchObservedRunningTime="2026-09-19 00:11:35.558960947 +0000 UTC m=+787.535169414" Sep 19 00:11:36.077274 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:11:36.077241 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ef63aa4-822d-4fce-9718-4101a0c59dbc" path="/var/lib/kubelet/pods/8ef63aa4-822d-4fce-9718-4101a0c59dbc/volumes" Sep 19 00:11:46.551270 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:11:46.551187 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-6t4w9" Sep 19 00:13:29.981299 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:13:29.981273 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6j92q_558d514a-4560-4e46-96af-e19cb4d741f8/ovn-acl-logging/0.log" Sep 19 00:13:29.981809 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:13:29.981333 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6j92q_558d514a-4560-4e46-96af-e19cb4d741f8/ovn-acl-logging/0.log" Sep 19 00:15:00.138033 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:15:00.137951 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29829615-6pps7"] Sep 19 00:15:00.141534 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:15:00.141519 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829615-6pps7" Sep 19 00:15:00.143708 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:15:00.143687 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kcw2f\"" Sep 19 00:15:00.150705 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:15:00.150689 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829615-6pps7" Sep 19 00:15:00.154286 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:15:00.154269 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29829615-6pps7"] Sep 19 00:15:00.419830 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:15:00.419747 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29829615-6pps7"] Sep 19 00:15:00.423568 ip-10-0-130-53 kubenswrapper[2579]: W0919 00:15:00.423541 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96061179_e03f_4069_9f08_ec397a41c0ff.slice/crio-787dccf055f792a3925b23ca7db3e311cc9de9ea4383a257b92f9cb4b9e8439c WatchSource:0}: Error finding container 787dccf055f792a3925b23ca7db3e311cc9de9ea4383a257b92f9cb4b9e8439c: Status 404 returned error can't find the container with id 787dccf055f792a3925b23ca7db3e311cc9de9ea4383a257b92f9cb4b9e8439c Sep 19 00:15:00.425533 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:15:00.425511 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 19 00:15:00.459178 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:15:00.459138 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829615-6pps7" event={"ID":"96061179-e03f-4069-9f08-ec397a41c0ff","Type":"ContainerStarted","Data":"787dccf055f792a3925b23ca7db3e311cc9de9ea4383a257b92f9cb4b9e8439c"} Sep 19 00:15:03.475376 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:15:03.475341 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829615-6pps7" event={"ID":"96061179-e03f-4069-9f08-ec397a41c0ff","Type":"ContainerStarted","Data":"2e102624de010ee45afa9e7b6acb2e1d8448afcf5c6b6e9046d76c797879b35f"} Sep 19 00:15:03.489064 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:15:03.489010 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829615-6pps7" podStartSLOduration=1.050160907 podStartE2EDuration="3.488991011s" totalImagesPullingTime="2.438830104s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 00:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 00:15:03.488006742 +0000 UTC m=+995.464215231" watchObservedRunningTime="2026-09-19 00:15:03.488991011 +0000 UTC m=+995.465199491" Sep 19 00:15:04.481643 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:15:04.481609 2579 generic.go:356] "Generic (PLEG): container finished" podID="96061179-e03f-4069-9f08-ec397a41c0ff" containerID="2e102624de010ee45afa9e7b6acb2e1d8448afcf5c6b6e9046d76c797879b35f" exitCode=0 Sep 19 00:15:04.482052 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:15:04.481693 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829615-6pps7" event={"ID":"96061179-e03f-4069-9f08-ec397a41c0ff","Type":"ContainerDied","Data":"2e102624de010ee45afa9e7b6acb2e1d8448afcf5c6b6e9046d76c797879b35f"} Sep 19 00:15:05.624361 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:15:05.624336 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829615-6pps7" Sep 19 00:15:06.492911 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:15:06.492872 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829615-6pps7" event={"ID":"96061179-e03f-4069-9f08-ec397a41c0ff","Type":"ContainerDied","Data":"787dccf055f792a3925b23ca7db3e311cc9de9ea4383a257b92f9cb4b9e8439c"} Sep 19 00:15:06.493113 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:15:06.492929 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="787dccf055f792a3925b23ca7db3e311cc9de9ea4383a257b92f9cb4b9e8439c" Sep 19 00:15:06.493113 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:15:06.492885 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829615-6pps7" Sep 19 00:16:35.137305 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:16:35.137266 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-hc7q4"] Sep 19 00:16:35.137832 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:16:35.137599 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96061179-e03f-4069-9f08-ec397a41c0ff" containerName="cleanup" Sep 19 00:16:35.137832 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:16:35.137612 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="96061179-e03f-4069-9f08-ec397a41c0ff" containerName="cleanup" Sep 19 00:16:35.137832 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:16:35.137682 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="96061179-e03f-4069-9f08-ec397a41c0ff" containerName="cleanup" Sep 19 00:16:35.140636 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:16:35.140619 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-hc7q4" Sep 19 00:16:35.151951 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:16:35.151924 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-hc7q4"] Sep 19 00:16:35.286328 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:16:35.286291 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lms6d\" (UniqueName: \"kubernetes.io/projected/29cbf5bb-b121-4f33-9f2c-0081ee8fda94-kube-api-access-lms6d\") pod \"payload-pre-processing-59fbc47bf8-hc7q4\" (UID: \"29cbf5bb-b121-4f33-9f2c-0081ee8fda94\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-hc7q4" Sep 19 00:16:35.286328 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:16:35.286347 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/29cbf5bb-b121-4f33-9f2c-0081ee8fda94-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-hc7q4\" (UID: \"29cbf5bb-b121-4f33-9f2c-0081ee8fda94\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-hc7q4" Sep 19 00:16:35.387635 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:16:35.387546 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lms6d\" (UniqueName: \"kubernetes.io/projected/29cbf5bb-b121-4f33-9f2c-0081ee8fda94-kube-api-access-lms6d\") pod \"payload-pre-processing-59fbc47bf8-hc7q4\" (UID: \"29cbf5bb-b121-4f33-9f2c-0081ee8fda94\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-hc7q4" Sep 19 00:16:35.387635 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:16:35.387599 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/29cbf5bb-b121-4f33-9f2c-0081ee8fda94-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-hc7q4\" (UID: \"29cbf5bb-b121-4f33-9f2c-0081ee8fda94\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-hc7q4" Sep 19 00:16:35.388311 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:16:35.388291 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/29cbf5bb-b121-4f33-9f2c-0081ee8fda94-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-hc7q4\" (UID: \"29cbf5bb-b121-4f33-9f2c-0081ee8fda94\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-hc7q4" Sep 19 00:16:35.395060 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:16:35.395029 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lms6d\" (UniqueName: \"kubernetes.io/projected/29cbf5bb-b121-4f33-9f2c-0081ee8fda94-kube-api-access-lms6d\") pod \"payload-pre-processing-59fbc47bf8-hc7q4\" (UID: \"29cbf5bb-b121-4f33-9f2c-0081ee8fda94\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-hc7q4" Sep 19 00:16:35.450730 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:16:35.450690 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-hc7q4" Sep 19 00:16:35.718453 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:16:35.718428 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-hc7q4"] Sep 19 00:16:35.720499 ip-10-0-130-53 kubenswrapper[2579]: W0919 00:16:35.720471 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29cbf5bb_b121_4f33_9f2c_0081ee8fda94.slice/crio-d53429f3c224c9bbe5816705bbd844f03c6fba354a2b8598969fb577add58508 WatchSource:0}: Error finding container d53429f3c224c9bbe5816705bbd844f03c6fba354a2b8598969fb577add58508: Status 404 returned error can't find the container with id d53429f3c224c9bbe5816705bbd844f03c6fba354a2b8598969fb577add58508 Sep 19 00:16:35.919815 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:16:35.919772 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-hc7q4" event={"ID":"29cbf5bb-b121-4f33-9f2c-0081ee8fda94","Type":"ContainerStarted","Data":"9586c03beabc45ce2e18757fc8863b3981ce9dad9b1837aa0bf0c8a4c970d8ba"} Sep 19 00:16:35.919996 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:16:35.919826 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-hc7q4" event={"ID":"29cbf5bb-b121-4f33-9f2c-0081ee8fda94","Type":"ContainerStarted","Data":"d53429f3c224c9bbe5816705bbd844f03c6fba354a2b8598969fb577add58508"} Sep 19 00:16:35.919996 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:16:35.919879 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-hc7q4" Sep 19 00:16:35.934362 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:16:35.934306 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-hc7q4" podStartSLOduration=0.93428726 podStartE2EDuration="934.28726ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 00:16:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 00:16:35.9336098 +0000 UTC m=+1087.909818288" watchObservedRunningTime="2026-09-19 00:16:35.93428726 +0000 UTC m=+1087.910495757" Sep 19 00:16:46.926841 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:16:46.926810 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-hc7q4" Sep 19 00:18:30.008658 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:18:30.008627 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6j92q_558d514a-4560-4e46-96af-e19cb4d741f8/ovn-acl-logging/0.log" Sep 19 00:18:30.009256 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:18:30.008627 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6j92q_558d514a-4560-4e46-96af-e19cb4d741f8/ovn-acl-logging/0.log" Sep 19 00:18:35.761468 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:18:35.761435 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-d4799c777-x4z6h_a710b713-c312-4910-92b7-ca728c1ac48a/manager/0.log" Sep 19 00:18:39.692591 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:18:39.692563 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-dhgxl_2fa576fe-0727-4d71-9477-d92c65eedf38/global-pull-secret-syncer/0.log" Sep 19 00:18:39.795360 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:18:39.795333 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-hb5v7_70a2849d-3338-436b-9bdf-e136af4ae1b9/konnectivity-agent/0.log" Sep 19 00:18:39.868462 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:18:39.868437 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-53.ec2.internal_16b0fef0d964298ff4a2b765bfad6222/haproxy/0.log" Sep 19 00:18:44.049069 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:18:44.049031 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-gj9w7_7a8abd2e-3c37-4a8b-9ddb-12140614fe76/manager/0.log" Sep 19 00:18:44.084292 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:18:44.084254 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-mwjnl_9b210c76-5963-4997-a8f9-2b96673a351a/limitador/0.log" Sep 19 00:18:44.116277 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:18:44.116246 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-z2zk2_dd8697ec-a5b5-4c9d-a665-d02b0244f352/manager/0.log" Sep 19 00:18:46.007999 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:18:46.007956 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-w92l8_891a13b3-ecd6-4ffd-b771-860e063976f1/kube-state-metrics/0.log" Sep 19 00:18:46.025431 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:18:46.025401 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-w92l8_891a13b3-ecd6-4ffd-b771-860e063976f1/kube-rbac-proxy-main/0.log" Sep 19 00:18:46.045379 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:18:46.045350 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-w92l8_891a13b3-ecd6-4ffd-b771-860e063976f1/kube-rbac-proxy-self/0.log" Sep 19 00:18:46.135537 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:18:46.135509 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cdhx6_8bb579ec-3570-4b4a-8d17-fc5eb0e58a4a/node-exporter/0.log" Sep 19 00:18:46.154501 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:18:46.154474 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cdhx6_8bb579ec-3570-4b4a-8d17-fc5eb0e58a4a/kube-rbac-proxy/0.log" Sep 19 00:18:46.174351 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:18:46.174326 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cdhx6_8bb579ec-3570-4b4a-8d17-fc5eb0e58a4a/init-textfile/0.log" Sep 19 00:18:46.430931 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:18:46.430904 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_69c1bbe2-2717-4eeb-a9e8-3e80f4208e09/prometheus/0.log" Sep 19 00:18:46.456251 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:18:46.456218 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_69c1bbe2-2717-4eeb-a9e8-3e80f4208e09/config-reloader/0.log" Sep 19 00:18:46.476693 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:18:46.476659 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_69c1bbe2-2717-4eeb-a9e8-3e80f4208e09/thanos-sidecar/0.log" Sep 19 00:18:46.496082 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:18:46.496061 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_69c1bbe2-2717-4eeb-a9e8-3e80f4208e09/kube-rbac-proxy-web/0.log" Sep 19 00:18:46.517304 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:18:46.517277 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_69c1bbe2-2717-4eeb-a9e8-3e80f4208e09/kube-rbac-proxy/0.log" Sep 19 00:18:46.537357 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:18:46.537329 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_69c1bbe2-2717-4eeb-a9e8-3e80f4208e09/kube-rbac-proxy-thanos/0.log" Sep 19 00:18:46.557053 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:18:46.557024 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_69c1bbe2-2717-4eeb-a9e8-3e80f4208e09/init-config-reloader/0.log" Sep 19 00:18:46.589033 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:18:46.589002 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-xjkjs_952f3a1f-98f2-4f76-b7ba-f129bbfc1726/prometheus-operator/0.log" Sep 19 00:18:46.607640 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:18:46.607602 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-xjkjs_952f3a1f-98f2-4f76-b7ba-f129bbfc1726/kube-rbac-proxy/0.log" Sep 19 00:18:50.196194 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:18:50.196157 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9kf4c/perf-node-gather-daemonset-lllwk"] Sep 19 00:18:50.199579 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:18:50.199557 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9kf4c/perf-node-gather-daemonset-lllwk" Sep 19 00:18:50.201716 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:18:50.201696 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9kf4c\"/\"openshift-service-ca.crt\"" Sep 19 00:18:50.201849 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:18:50.201697 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9kf4c\"/\"default-dockercfg-hdlp4\"" Sep 19 00:18:50.202439 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:18:50.202424 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9kf4c\"/\"kube-root-ca.crt\"" Sep 19 00:18:50.207156 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:18:50.207127 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9kf4c/perf-node-gather-daemonset-lllwk"] Sep 19 00:18:50.335911 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:18:50.335873 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6bb71860-627c-42ce-add7-b03fcf1445f4-podres\") pod \"perf-node-gather-daemonset-lllwk\" (UID: \"6bb71860-627c-42ce-add7-b03fcf1445f4\") " pod="openshift-must-gather-9kf4c/perf-node-gather-daemonset-lllwk" Sep 19 00:18:50.336096 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:18:50.335922 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6bb71860-627c-42ce-add7-b03fcf1445f4-sys\") pod \"perf-node-gather-daemonset-lllwk\" (UID: \"6bb71860-627c-42ce-add7-b03fcf1445f4\") " pod="openshift-must-gather-9kf4c/perf-node-gather-daemonset-lllwk" Sep 19 00:18:50.336096 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:18:50.335972 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6bb71860-627c-42ce-add7-b03fcf1445f4-lib-modules\") pod \"perf-node-gather-daemonset-lllwk\" (UID: \"6bb71860-627c-42ce-add7-b03fcf1445f4\") " pod="openshift-must-gather-9kf4c/perf-node-gather-daemonset-lllwk" Sep 19 00:18:50.336096 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:18:50.336001 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6bb71860-627c-42ce-add7-b03fcf1445f4-proc\") pod \"perf-node-gather-daemonset-lllwk\" (UID: \"6bb71860-627c-42ce-add7-b03fcf1445f4\") " pod="openshift-must-gather-9kf4c/perf-node-gather-daemonset-lllwk" Sep 19 00:18:50.336096 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:18:50.336032 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2k29b\" (UniqueName: \"kubernetes.io/projected/6bb71860-627c-42ce-add7-b03fcf1445f4-kube-api-access-2k29b\") pod \"perf-node-gather-daemonset-lllwk\" (UID: \"6bb71860-627c-42ce-add7-b03fcf1445f4\") " pod="openshift-must-gather-9kf4c/perf-node-gather-daemonset-lllwk" Sep 19 00:18:50.437433 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:18:50.437398 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6bb71860-627c-42ce-add7-b03fcf1445f4-podres\") pod \"perf-node-gather-daemonset-lllwk\" (UID: \"6bb71860-627c-42ce-add7-b03fcf1445f4\") " pod="openshift-must-gather-9kf4c/perf-node-gather-daemonset-lllwk" Sep 19 00:18:50.437433 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:18:50.437444 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6bb71860-627c-42ce-add7-b03fcf1445f4-sys\") pod \"perf-node-gather-daemonset-lllwk\" (UID: \"6bb71860-627c-42ce-add7-b03fcf1445f4\") " pod="openshift-must-gather-9kf4c/perf-node-gather-daemonset-lllwk" Sep 19 00:18:50.437649 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:18:50.437475 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6bb71860-627c-42ce-add7-b03fcf1445f4-lib-modules\") pod \"perf-node-gather-daemonset-lllwk\" (UID: \"6bb71860-627c-42ce-add7-b03fcf1445f4\") " pod="openshift-must-gather-9kf4c/perf-node-gather-daemonset-lllwk" Sep 19 00:18:50.437649 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:18:50.437511 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6bb71860-627c-42ce-add7-b03fcf1445f4-proc\") pod \"perf-node-gather-daemonset-lllwk\" (UID: \"6bb71860-627c-42ce-add7-b03fcf1445f4\") " pod="openshift-must-gather-9kf4c/perf-node-gather-daemonset-lllwk" Sep 19 00:18:50.437649 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:18:50.437530 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2k29b\" (UniqueName: \"kubernetes.io/projected/6bb71860-627c-42ce-add7-b03fcf1445f4-kube-api-access-2k29b\") pod \"perf-node-gather-daemonset-lllwk\" (UID: \"6bb71860-627c-42ce-add7-b03fcf1445f4\") " pod="openshift-must-gather-9kf4c/perf-node-gather-daemonset-lllwk" Sep 19 00:18:50.437649 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:18:50.437558 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6bb71860-627c-42ce-add7-b03fcf1445f4-sys\") pod \"perf-node-gather-daemonset-lllwk\" (UID: \"6bb71860-627c-42ce-add7-b03fcf1445f4\") " pod="openshift-must-gather-9kf4c/perf-node-gather-daemonset-lllwk" Sep 19 00:18:50.437649 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:18:50.437595 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6bb71860-627c-42ce-add7-b03fcf1445f4-podres\") pod \"perf-node-gather-daemonset-lllwk\" (UID: \"6bb71860-627c-42ce-add7-b03fcf1445f4\") " pod="openshift-must-gather-9kf4c/perf-node-gather-daemonset-lllwk" Sep 19 00:18:50.437649 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:18:50.437627 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6bb71860-627c-42ce-add7-b03fcf1445f4-proc\") pod \"perf-node-gather-daemonset-lllwk\" (UID: \"6bb71860-627c-42ce-add7-b03fcf1445f4\") " pod="openshift-must-gather-9kf4c/perf-node-gather-daemonset-lllwk" Sep 19 00:18:50.437861 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:18:50.437666 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6bb71860-627c-42ce-add7-b03fcf1445f4-lib-modules\") pod \"perf-node-gather-daemonset-lllwk\" (UID: \"6bb71860-627c-42ce-add7-b03fcf1445f4\") " pod="openshift-must-gather-9kf4c/perf-node-gather-daemonset-lllwk" Sep 19 00:18:50.445988 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:18:50.445968 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2k29b\" (UniqueName: \"kubernetes.io/projected/6bb71860-627c-42ce-add7-b03fcf1445f4-kube-api-access-2k29b\") pod \"perf-node-gather-daemonset-lllwk\" (UID: \"6bb71860-627c-42ce-add7-b03fcf1445f4\") " pod="openshift-must-gather-9kf4c/perf-node-gather-daemonset-lllwk" Sep 19 00:18:50.510111 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:18:50.510018 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9kf4c/perf-node-gather-daemonset-lllwk" Sep 19 00:18:50.778033 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:18:50.777881 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9kf4c/perf-node-gather-daemonset-lllwk"] Sep 19 00:18:50.780548 ip-10-0-130-53 kubenswrapper[2579]: W0919 00:18:50.780518 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod6bb71860_627c_42ce_add7_b03fcf1445f4.slice/crio-737176e300ebf6c4028c72c02e7c6c26020fb22b5ef732507b71a9e3034f6b6e WatchSource:0}: Error finding container 737176e300ebf6c4028c72c02e7c6c26020fb22b5ef732507b71a9e3034f6b6e: Status 404 returned error can't find the container with id 737176e300ebf6c4028c72c02e7c6c26020fb22b5ef732507b71a9e3034f6b6e Sep 19 00:18:51.535125 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:18:51.535090 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9kf4c/perf-node-gather-daemonset-lllwk" event={"ID":"6bb71860-627c-42ce-add7-b03fcf1445f4","Type":"ContainerStarted","Data":"07c873ba1f46600399305d95e8264a71ad8fe10ce7d6f62d2486df20d0560300"} Sep 19 00:18:51.535523 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:18:51.535143 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9kf4c/perf-node-gather-daemonset-lllwk" event={"ID":"6bb71860-627c-42ce-add7-b03fcf1445f4","Type":"ContainerStarted","Data":"737176e300ebf6c4028c72c02e7c6c26020fb22b5ef732507b71a9e3034f6b6e"} Sep 19 00:18:51.535523 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:18:51.535165 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9kf4c/perf-node-gather-daemonset-lllwk" Sep 19 00:18:51.550552 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:18:51.550504 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9kf4c/perf-node-gather-daemonset-lllwk" podStartSLOduration=1.550488175 podStartE2EDuration="1.550488175s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 00:18:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 00:18:51.5489286 +0000 UTC m=+1223.525137072" watchObservedRunningTime="2026-09-19 00:18:51.550488175 +0000 UTC m=+1223.526696685" Sep 19 00:18:51.697656 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:18:51.697627 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rvv44_e0a7fd40-c030-4559-981d-cb21383efcd4/dns/0.log" Sep 19 00:18:51.731617 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:18:51.731587 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rvv44_e0a7fd40-c030-4559-981d-cb21383efcd4/kube-rbac-proxy/0.log" Sep 19 00:18:51.791499 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:18:51.791420 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pz7c5_8e7fd7f0-d5f2-4928-a6de-c7d241bd6b7c/dns-node-resolver/0.log" Sep 19 00:18:52.343964 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:18:52.343931 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-8598f7b4-qccdt_806e0903-3678-40b1-b452-188dd9b91dda/registry/0.log" Sep 19 00:18:52.405703 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:18:52.405672 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qlfrm_cdff8643-b1e0-4122-8a03-906835642896/node-ca/0.log" Sep 19 00:18:53.434586 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:18:53.434556 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-hc7q4_29cbf5bb-b121-4f33-9f2c-0081ee8fda94/payload-pre-processing/0.log" Sep 19 00:18:53.459258 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:18:53.459227 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-6t4w9_a9533ac9-0220-4073-8809-9d18c4e223f4/payload-processing/0.log" Sep 19 00:18:54.109154 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:18:54.109127 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gw8q6_7d3f64f3-edc0-472e-9e12-4980ef2d9a26/serve-healthcheck-canary/0.log" Sep 19 00:18:54.718618 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:18:54.718585 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vpjpz_fafc2259-0ac4-460d-a796-9e1d5c4f0f15/kube-rbac-proxy/0.log" Sep 19 00:18:54.738200 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:18:54.738169 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vpjpz_fafc2259-0ac4-460d-a796-9e1d5c4f0f15/exporter/0.log" Sep 19 00:18:54.759528 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:18:54.759493 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vpjpz_fafc2259-0ac4-460d-a796-9e1d5c4f0f15/extractor/0.log" Sep 19 00:18:56.794059 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:18:56.794032 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-d4799c777-x4z6h_a710b713-c312-4910-92b7-ca728c1ac48a/manager/0.log" Sep 19 00:18:56.817394 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:18:56.817369 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-p7rhf_94970d15-7512-4e26-91b4-9ce2137b32fb/manager/0.log" Sep 19 00:18:57.125017 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:18:57.124943 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-577c99c85d-pfrzh_e5dc616e-1bca-4178-9f56-5a526ed06c8e/manager/0.log" Sep 19 00:18:57.140745 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:18:57.140719 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-577c99c85d-pfrzh_e5dc616e-1bca-4178-9f56-5a526ed06c8e/copy-manifests/0.log" Sep 19 00:18:57.552449 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:18:57.552424 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9kf4c/perf-node-gather-daemonset-lllwk" Sep 19 00:18:58.265741 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:18:58.265708 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7968c85699-7zkjf_a4eac14f-03cd-423d-b4d2-098be288bbb5/manager/0.log" Sep 19 00:18:58.315327 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:18:58.315288 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-b92p4_2a6d43ad-2368-4bea-81ff-f2a4d3ce1890/openshift-lws-operator/0.log" Sep 19 00:19:00.355827 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:19:00.355777 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-hc7q4_29cbf5bb-b121-4f33-9f2c-0081ee8fda94/payload-pre-processing/0.log" Sep 19 00:19:00.370261 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:19:00.370238 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-6t4w9_a9533ac9-0220-4073-8809-9d18c4e223f4/payload-processing/0.log" Sep 19 00:19:01.585065 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:19:01.585029 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-hc7q4_29cbf5bb-b121-4f33-9f2c-0081ee8fda94/payload-pre-processing/0.log" Sep 19 00:19:01.599518 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:19:01.599483 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-6t4w9_a9533ac9-0220-4073-8809-9d18c4e223f4/payload-processing/0.log" Sep 19 00:19:05.036188 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:19:05.036159 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-99rrr_c366c450-b973-4a84-b562-b1970ebf743e/kube-multus-additional-cni-plugins/0.log" Sep 19 00:19:05.060330 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:19:05.060286 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-99rrr_c366c450-b973-4a84-b562-b1970ebf743e/egress-router-binary-copy/0.log" Sep 19 00:19:05.080577 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:19:05.080548 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-99rrr_c366c450-b973-4a84-b562-b1970ebf743e/cni-plugins/0.log" Sep 19 00:19:05.144027 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:19:05.143981 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-99rrr_c366c450-b973-4a84-b562-b1970ebf743e/bond-cni-plugin/0.log" Sep 19 00:19:05.166098 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:19:05.166067 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-99rrr_c366c450-b973-4a84-b562-b1970ebf743e/routeoverride-cni/0.log" Sep 19 00:19:05.187879 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:19:05.187841 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-99rrr_c366c450-b973-4a84-b562-b1970ebf743e/whereabouts-cni-bincopy/0.log" Sep 19 00:19:05.207206 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:19:05.207175 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-99rrr_c366c450-b973-4a84-b562-b1970ebf743e/whereabouts-cni/0.log" Sep 19 00:19:05.396398 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:19:05.396364 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-c2k4w_a5e78d3a-6dc9-4904-ba1d-fedfcf5f8614/kube-multus/0.log" Sep 19 00:19:05.566201 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:19:05.566171 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-tvsd7_4319f89f-3b39-4c12-8ca8-3e3cf20d5b84/network-metrics-daemon/0.log" Sep 19 00:19:05.583585 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:19:05.583552 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-tvsd7_4319f89f-3b39-4c12-8ca8-3e3cf20d5b84/kube-rbac-proxy/0.log" Sep 19 00:19:06.368658 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:19:06.368575 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6j92q_558d514a-4560-4e46-96af-e19cb4d741f8/ovn-controller/0.log" Sep 19 00:19:06.384548 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:19:06.384506 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6j92q_558d514a-4560-4e46-96af-e19cb4d741f8/ovn-acl-logging/0.log" Sep 19 00:19:06.384715 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:19:06.384557 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6j92q_558d514a-4560-4e46-96af-e19cb4d741f8/ovn-acl-logging/1.log" Sep 19 00:19:06.401356 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:19:06.401326 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6j92q_558d514a-4560-4e46-96af-e19cb4d741f8/kube-rbac-proxy-node/0.log" Sep 19 00:19:06.421127 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:19:06.421102 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6j92q_558d514a-4560-4e46-96af-e19cb4d741f8/kube-rbac-proxy-ovn-metrics/0.log" Sep 19 00:19:06.439300 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:19:06.439275 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6j92q_558d514a-4560-4e46-96af-e19cb4d741f8/northd/0.log" Sep 19 00:19:06.459131 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:19:06.459104 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6j92q_558d514a-4560-4e46-96af-e19cb4d741f8/nbdb/0.log" Sep 19 00:19:06.478712 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:19:06.478686 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6j92q_558d514a-4560-4e46-96af-e19cb4d741f8/sbdb/0.log" Sep 19 00:19:06.528166 ip-10-0-130-53 kubenswrapper[2579]: I0919 00:19:06.528132 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6j92q_558d514a-4560-4e46-96af-e19cb4d741f8/ovnkube-controller/0.log"