May 20 15:30:05.869888 ip-10-0-130-228 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory May 20 15:30:05.869900 ip-10-0-130-228 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory May 20 15:30:05.869908 ip-10-0-130-228 systemd[1]: kubelet.service: Failed with result 'resources'. May 20 15:30:05.870159 ip-10-0-130-228 systemd[1]: Failed to start Kubernetes Kubelet. May 20 15:30:15.875605 ip-10-0-130-228 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. May 20 15:30:15.875625 ip-10-0-130-228 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot f31f0f2764e94ad9825eaf8ba89acded -- May 20 15:32:48.660187 ip-10-0-130-228 systemd[1]: Starting Kubernetes Kubelet... May 20 15:32:49.126453 ip-10-0-130-228 kubenswrapper[2557]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 20 15:32:49.126453 ip-10-0-130-228 kubenswrapper[2557]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 20 15:32:49.126453 ip-10-0-130-228 kubenswrapper[2557]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 20 15:32:49.126453 ip-10-0-130-228 kubenswrapper[2557]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 20 15:32:49.126453 ip-10-0-130-228 kubenswrapper[2557]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 20 15:32:49.127478 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.127391 2557 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 20 15:32:49.133293 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133269 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 20 15:32:49.133293 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133288 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 20 15:32:49.133293 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133295 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 20 15:32:49.133293 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133300 2557 feature_gate.go:328] unrecognized feature gate: NewOLM May 20 15:32:49.133545 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133304 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 20 15:32:49.133545 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133308 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 20 15:32:49.133545 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133312 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 20 15:32:49.133545 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133315 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 20 15:32:49.133545 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133326 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 20 15:32:49.133545 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133330 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 20 15:32:49.133545 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133333 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 20 15:32:49.133545 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133337 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 20 15:32:49.133545 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133341 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 20 15:32:49.133545 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133346 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 20 15:32:49.133545 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133349 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 20 15:32:49.133545 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133352 2557 feature_gate.go:328] unrecognized feature gate: DualReplica May 20 15:32:49.133545 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133356 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 20 15:32:49.133545 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133360 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 20 15:32:49.133545 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133363 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 20 15:32:49.133545 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133367 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 20 15:32:49.133545 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133371 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 20 15:32:49.133545 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133408 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 20 15:32:49.133545 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133413 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 20 15:32:49.133545 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133418 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 20 15:32:49.134375 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133422 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 20 15:32:49.134375 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133427 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 20 15:32:49.134375 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133431 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 20 15:32:49.134375 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133436 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 20 15:32:49.134375 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133442 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 20 15:32:49.134375 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133447 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 20 15:32:49.134375 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133452 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 20 15:32:49.134375 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133456 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 20 15:32:49.134375 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133460 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 20 15:32:49.134375 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133464 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability May 20 15:32:49.134375 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133468 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 20 15:32:49.134375 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133473 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 20 15:32:49.134375 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133477 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 20 15:32:49.134375 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133482 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 20 15:32:49.134375 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133486 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 20 15:32:49.134375 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133490 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 20 15:32:49.134375 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133495 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 20 15:32:49.134375 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133499 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores May 20 15:32:49.134375 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133503 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 20 15:32:49.135128 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133507 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 20 15:32:49.135128 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133511 2557 feature_gate.go:328] unrecognized feature gate: Example May 20 15:32:49.135128 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133519 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 20 15:32:49.135128 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133526 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 20 15:32:49.135128 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133531 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 20 15:32:49.135128 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133535 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 20 15:32:49.135128 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133539 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 20 15:32:49.135128 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133543 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 20 15:32:49.135128 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133548 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 20 15:32:49.135128 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133552 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 20 15:32:49.135128 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133556 2557 feature_gate.go:328] unrecognized feature gate: Example2 May 20 15:32:49.135128 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133560 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 20 15:32:49.135128 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133565 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 20 15:32:49.135128 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133569 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 20 15:32:49.135128 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133573 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 20 15:32:49.135128 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133577 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 20 15:32:49.135128 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133582 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 20 15:32:49.135128 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133586 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 20 15:32:49.135128 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133591 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 20 15:32:49.135128 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133596 2557 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 20 15:32:49.135669 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133602 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 20 15:32:49.135669 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133606 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 20 15:32:49.135669 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133610 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 20 15:32:49.135669 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133615 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages May 20 15:32:49.135669 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133619 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 20 15:32:49.135669 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133623 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 20 15:32:49.135669 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133628 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 20 15:32:49.135669 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133632 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 20 15:32:49.135669 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133636 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 20 15:32:49.135669 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133640 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 20 15:32:49.135669 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133645 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 20 15:32:49.135669 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133648 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 20 15:32:49.135669 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133653 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 20 15:32:49.135669 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133657 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 20 15:32:49.135669 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133661 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 20 15:32:49.135669 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133666 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 20 15:32:49.135669 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133673 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 20 15:32:49.135669 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133679 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 20 15:32:49.135669 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133684 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 20 15:32:49.136162 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133688 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 20 15:32:49.136162 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133692 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 20 15:32:49.136162 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133696 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 20 15:32:49.136162 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.133700 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 20 15:32:49.136162 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134389 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 20 15:32:49.136162 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134401 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 20 15:32:49.136162 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134405 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 20 15:32:49.136162 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134410 2557 feature_gate.go:328] unrecognized feature gate: DualReplica May 20 15:32:49.136162 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134414 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 20 15:32:49.136162 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134418 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 20 15:32:49.136162 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134422 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 20 15:32:49.136162 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134426 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 20 15:32:49.136162 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134430 2557 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 20 15:32:49.136162 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134434 2557 feature_gate.go:328] unrecognized feature gate: Example May 20 15:32:49.136162 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134438 2557 feature_gate.go:328] unrecognized feature gate: NewOLM May 20 15:32:49.136162 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134442 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores May 20 15:32:49.136162 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134446 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 20 15:32:49.136162 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134450 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 20 15:32:49.136162 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134454 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 20 15:32:49.136162 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134461 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 20 15:32:49.137024 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134466 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 20 15:32:49.137024 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134474 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 20 15:32:49.137024 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134481 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 20 15:32:49.137024 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134486 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 20 15:32:49.137024 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134490 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 20 15:32:49.137024 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134495 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 20 15:32:49.137024 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134499 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability May 20 15:32:49.137024 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134503 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 20 15:32:49.137024 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134508 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 20 15:32:49.137024 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134513 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 20 15:32:49.137024 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134517 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 20 15:32:49.137024 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134521 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 20 15:32:49.137024 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134526 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 20 15:32:49.137024 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134530 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 20 15:32:49.137024 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134534 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 20 15:32:49.137024 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134538 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 20 15:32:49.137024 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134542 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 20 15:32:49.137024 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134548 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 20 15:32:49.137024 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134577 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 20 15:32:49.137727 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134584 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 20 15:32:49.137727 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134588 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 20 15:32:49.137727 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134594 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 20 15:32:49.137727 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134599 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 20 15:32:49.137727 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134604 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 20 15:32:49.137727 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134609 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 20 15:32:49.137727 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134613 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 20 15:32:49.137727 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134618 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 20 15:32:49.137727 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134623 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 20 15:32:49.137727 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134627 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 20 15:32:49.137727 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134632 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 20 15:32:49.137727 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134636 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 20 15:32:49.137727 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134640 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 20 15:32:49.137727 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134645 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 20 15:32:49.137727 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134650 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 20 15:32:49.137727 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134654 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 20 15:32:49.137727 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134658 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 20 15:32:49.137727 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134663 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 20 15:32:49.137727 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134668 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 20 15:32:49.138268 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134672 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 20 15:32:49.138268 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134676 2557 feature_gate.go:328] unrecognized feature gate: Example2 May 20 15:32:49.138268 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134681 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 20 15:32:49.138268 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134686 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 20 15:32:49.138268 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134690 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 20 15:32:49.138268 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134695 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 20 15:32:49.138268 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134699 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 20 15:32:49.138268 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134704 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 20 15:32:49.138268 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134708 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 20 15:32:49.138268 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134712 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 20 15:32:49.138268 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134716 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 20 15:32:49.138268 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134723 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 20 15:32:49.138268 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134729 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 20 15:32:49.138268 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134733 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 20 15:32:49.138268 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134737 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 20 15:32:49.138268 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134741 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 20 15:32:49.138268 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134745 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages May 20 15:32:49.138268 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134751 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 20 15:32:49.138268 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134755 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 20 15:32:49.138834 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134760 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 20 15:32:49.138834 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134764 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 20 15:32:49.138834 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134769 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 20 15:32:49.138834 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134773 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 20 15:32:49.138834 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134777 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 20 15:32:49.138834 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134781 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 20 15:32:49.138834 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134785 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 20 15:32:49.138834 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134790 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 20 15:32:49.138834 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134794 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 20 15:32:49.138834 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134798 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 20 15:32:49.138834 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134803 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 20 15:32:49.138834 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134807 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 20 15:32:49.138834 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.134833 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 20 15:32:49.138834 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136124 2557 flags.go:64] FLAG: --address="0.0.0.0" May 20 15:32:49.138834 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136141 2557 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 20 15:32:49.138834 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136154 2557 flags.go:64] FLAG: --anonymous-auth="true" May 20 15:32:49.138834 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136161 2557 flags.go:64] FLAG: --application-metrics-count-limit="100" May 20 15:32:49.138834 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136168 2557 flags.go:64] FLAG: --authentication-token-webhook="false" May 20 15:32:49.138834 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136173 2557 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 20 15:32:49.138834 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136179 2557 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 20 15:32:49.138834 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136185 2557 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 20 15:32:49.139464 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136191 2557 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 20 15:32:49.139464 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136196 2557 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 20 15:32:49.139464 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136201 2557 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 20 15:32:49.139464 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136206 2557 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 20 15:32:49.139464 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136211 2557 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 20 15:32:49.139464 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136216 2557 flags.go:64] FLAG: --cgroup-root="" May 20 15:32:49.139464 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136221 2557 flags.go:64] FLAG: --cgroups-per-qos="true" May 20 15:32:49.139464 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136225 2557 flags.go:64] FLAG: --client-ca-file="" May 20 15:32:49.139464 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136229 2557 flags.go:64] FLAG: --cloud-config="" May 20 15:32:49.139464 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136234 2557 flags.go:64] FLAG: --cloud-provider="external" May 20 15:32:49.139464 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136238 2557 flags.go:64] FLAG: --cluster-dns="[]" May 20 15:32:49.139464 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136245 2557 flags.go:64] FLAG: --cluster-domain="" May 20 15:32:49.139464 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136250 2557 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 20 15:32:49.139464 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136255 2557 flags.go:64] FLAG: --config-dir="" May 20 15:32:49.139464 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136259 2557 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 20 15:32:49.139464 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136265 2557 flags.go:64] FLAG: --container-log-max-files="5" May 20 15:32:49.139464 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136270 2557 flags.go:64] FLAG: --container-log-max-size="10Mi" May 20 15:32:49.139464 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136276 2557 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 20 15:32:49.139464 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136282 2557 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 20 15:32:49.139464 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136288 2557 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 20 15:32:49.139464 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136293 2557 flags.go:64] FLAG: --contention-profiling="false" May 20 15:32:49.139464 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136297 2557 flags.go:64] FLAG: --cpu-cfs-quota="true" May 20 15:32:49.139464 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136302 2557 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 20 15:32:49.139464 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136306 2557 flags.go:64] FLAG: --cpu-manager-policy="none" May 20 15:32:49.139464 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136311 2557 flags.go:64] FLAG: --cpu-manager-policy-options="" May 20 15:32:49.140135 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136319 2557 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 20 15:32:49.140135 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136324 2557 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 20 15:32:49.140135 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136328 2557 flags.go:64] FLAG: --enable-debugging-handlers="true" May 20 15:32:49.140135 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136333 2557 flags.go:64] FLAG: --enable-load-reader="false" May 20 15:32:49.140135 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136339 2557 flags.go:64] FLAG: --enable-server="true" May 20 15:32:49.140135 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136343 2557 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 20 15:32:49.140135 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136351 2557 flags.go:64] FLAG: --event-burst="100" May 20 15:32:49.140135 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136356 2557 flags.go:64] FLAG: --event-qps="50" May 20 15:32:49.140135 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136361 2557 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 20 15:32:49.140135 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136366 2557 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 20 15:32:49.140135 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136370 2557 flags.go:64] FLAG: --eviction-hard="" May 20 15:32:49.140135 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136376 2557 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 20 15:32:49.140135 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136381 2557 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 20 15:32:49.140135 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136386 2557 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 20 15:32:49.140135 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136390 2557 flags.go:64] FLAG: --eviction-soft="" May 20 15:32:49.140135 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136396 2557 flags.go:64] FLAG: --eviction-soft-grace-period="" May 20 15:32:49.140135 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136400 2557 flags.go:64] FLAG: --exit-on-lock-contention="false" May 20 15:32:49.140135 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136406 2557 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 20 15:32:49.140135 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136410 2557 flags.go:64] FLAG: --experimental-mounter-path="" May 20 15:32:49.140135 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136415 2557 flags.go:64] FLAG: --fail-cgroupv1="false" May 20 15:32:49.140135 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136420 2557 flags.go:64] FLAG: --fail-swap-on="true" May 20 15:32:49.140135 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136424 2557 flags.go:64] FLAG: --feature-gates="" May 20 15:32:49.140135 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136430 2557 flags.go:64] FLAG: --file-check-frequency="20s" May 20 15:32:49.140135 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136435 2557 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 20 15:32:49.140135 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136440 2557 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 20 15:32:49.140731 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136446 2557 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 20 15:32:49.140731 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136450 2557 flags.go:64] FLAG: --healthz-port="10248" May 20 15:32:49.140731 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136455 2557 flags.go:64] FLAG: --help="false" May 20 15:32:49.140731 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136460 2557 flags.go:64] FLAG: --hostname-override="ip-10-0-130-228.ec2.internal" May 20 15:32:49.140731 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136465 2557 flags.go:64] FLAG: --housekeeping-interval="10s" May 20 15:32:49.140731 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136470 2557 flags.go:64] FLAG: --http-check-frequency="20s" May 20 15:32:49.140731 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136474 2557 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 20 15:32:49.140731 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136480 2557 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 20 15:32:49.140731 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136485 2557 flags.go:64] FLAG: --image-gc-high-threshold="85" May 20 15:32:49.140731 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136490 2557 flags.go:64] FLAG: --image-gc-low-threshold="80" May 20 15:32:49.140731 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136495 2557 flags.go:64] FLAG: --image-service-endpoint="" May 20 15:32:49.140731 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136499 2557 flags.go:64] FLAG: --kernel-memcg-notification="false" May 20 15:32:49.140731 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136504 2557 flags.go:64] FLAG: --kube-api-burst="100" May 20 15:32:49.140731 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136509 2557 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 20 15:32:49.140731 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136514 2557 flags.go:64] FLAG: --kube-api-qps="50" May 20 15:32:49.140731 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136519 2557 flags.go:64] FLAG: --kube-reserved="" May 20 15:32:49.140731 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136523 2557 flags.go:64] FLAG: --kube-reserved-cgroup="" May 20 15:32:49.140731 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136527 2557 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 20 15:32:49.140731 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136532 2557 flags.go:64] FLAG: --kubelet-cgroups="" May 20 15:32:49.140731 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136537 2557 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 20 15:32:49.140731 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136541 2557 flags.go:64] FLAG: --lock-file="" May 20 15:32:49.140731 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136546 2557 flags.go:64] FLAG: --log-cadvisor-usage="false" May 20 15:32:49.140731 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136550 2557 flags.go:64] FLAG: --log-flush-frequency="5s" May 20 15:32:49.140731 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136555 2557 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 20 15:32:49.141334 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136564 2557 flags.go:64] FLAG: --log-json-split-stream="false" May 20 15:32:49.141334 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136569 2557 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 20 15:32:49.141334 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136574 2557 flags.go:64] FLAG: --log-text-split-stream="false" May 20 15:32:49.141334 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136578 2557 flags.go:64] FLAG: --logging-format="text" May 20 15:32:49.141334 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136583 2557 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 20 15:32:49.141334 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136588 2557 flags.go:64] FLAG: --make-iptables-util-chains="true" May 20 15:32:49.141334 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136596 2557 flags.go:64] FLAG: --manifest-url="" May 20 15:32:49.141334 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136600 2557 flags.go:64] FLAG: --manifest-url-header="" May 20 15:32:49.141334 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136607 2557 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 20 15:32:49.141334 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136613 2557 flags.go:64] FLAG: --max-open-files="1000000" May 20 15:32:49.141334 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136620 2557 flags.go:64] FLAG: --max-pods="110" May 20 15:32:49.141334 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136624 2557 flags.go:64] FLAG: --maximum-dead-containers="-1" May 20 15:32:49.141334 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136629 2557 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 20 15:32:49.141334 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136634 2557 flags.go:64] FLAG: --memory-manager-policy="None" May 20 15:32:49.141334 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136638 2557 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 20 15:32:49.141334 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136644 2557 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 20 15:32:49.141334 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136649 2557 flags.go:64] FLAG: --node-ip="0.0.0.0" May 20 15:32:49.141334 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136654 2557 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 20 15:32:49.141334 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136665 2557 flags.go:64] FLAG: --node-status-max-images="50" May 20 15:32:49.141334 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136670 2557 flags.go:64] FLAG: --node-status-update-frequency="10s" May 20 15:32:49.141334 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136675 2557 flags.go:64] FLAG: --oom-score-adj="-999" May 20 15:32:49.141334 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136681 2557 flags.go:64] FLAG: --pod-cidr="" May 20 15:32:49.141334 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136689 2557 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 20 15:32:49.141903 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136698 2557 flags.go:64] FLAG: --pod-manifest-path="" May 20 15:32:49.141903 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136703 2557 flags.go:64] FLAG: --pod-max-pids="-1" May 20 15:32:49.141903 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136708 2557 flags.go:64] FLAG: --pods-per-core="0" May 20 15:32:49.141903 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136712 2557 flags.go:64] FLAG: --port="10250" May 20 15:32:49.141903 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136717 2557 flags.go:64] FLAG: --protect-kernel-defaults="false" May 20 15:32:49.141903 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136722 2557 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0443ef258258bfbf7" May 20 15:32:49.141903 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136727 2557 flags.go:64] FLAG: --qos-reserved="" May 20 15:32:49.141903 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136732 2557 flags.go:64] FLAG: --read-only-port="10255" May 20 15:32:49.141903 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136737 2557 flags.go:64] FLAG: --register-node="true" May 20 15:32:49.141903 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136742 2557 flags.go:64] FLAG: --register-schedulable="true" May 20 15:32:49.141903 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136746 2557 flags.go:64] FLAG: --register-with-taints="" May 20 15:32:49.141903 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136752 2557 flags.go:64] FLAG: --registry-burst="10" May 20 15:32:49.141903 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136756 2557 flags.go:64] FLAG: --registry-qps="5" May 20 15:32:49.141903 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136761 2557 flags.go:64] FLAG: --reserved-cpus="" May 20 15:32:49.141903 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136765 2557 flags.go:64] FLAG: --reserved-memory="" May 20 15:32:49.141903 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136773 2557 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 20 15:32:49.141903 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136778 2557 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 20 15:32:49.141903 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136783 2557 flags.go:64] FLAG: --rotate-certificates="false" May 20 15:32:49.141903 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136788 2557 flags.go:64] FLAG: --rotate-server-certificates="false" May 20 15:32:49.141903 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136792 2557 flags.go:64] FLAG: --runonce="false" May 20 15:32:49.141903 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136796 2557 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 20 15:32:49.141903 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136801 2557 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 20 15:32:49.141903 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136806 2557 flags.go:64] FLAG: --seccomp-default="false" May 20 15:32:49.141903 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136830 2557 flags.go:64] FLAG: --serialize-image-pulls="true" May 20 15:32:49.141903 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136834 2557 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 20 15:32:49.141903 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136839 2557 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 20 15:32:49.142531 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136844 2557 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 20 15:32:49.142531 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136849 2557 flags.go:64] FLAG: --storage-driver-password="root" May 20 15:32:49.142531 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136853 2557 flags.go:64] FLAG: --storage-driver-secure="false" May 20 15:32:49.142531 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136858 2557 flags.go:64] FLAG: --storage-driver-table="stats" May 20 15:32:49.142531 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136862 2557 flags.go:64] FLAG: --storage-driver-user="root" May 20 15:32:49.142531 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136867 2557 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 20 15:32:49.142531 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136875 2557 flags.go:64] FLAG: --sync-frequency="1m0s" May 20 15:32:49.142531 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136880 2557 flags.go:64] FLAG: --system-cgroups="" May 20 15:32:49.142531 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136884 2557 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 20 15:32:49.142531 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136893 2557 flags.go:64] FLAG: --system-reserved-cgroup="" May 20 15:32:49.142531 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136898 2557 flags.go:64] FLAG: --tls-cert-file="" May 20 15:32:49.142531 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136902 2557 flags.go:64] FLAG: --tls-cipher-suites="[]" May 20 15:32:49.142531 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136908 2557 flags.go:64] FLAG: --tls-min-version="" May 20 15:32:49.142531 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136913 2557 flags.go:64] FLAG: --tls-private-key-file="" May 20 15:32:49.142531 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136917 2557 flags.go:64] FLAG: --topology-manager-policy="none" May 20 15:32:49.142531 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136922 2557 flags.go:64] FLAG: --topology-manager-policy-options="" May 20 15:32:49.142531 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136927 2557 flags.go:64] FLAG: --topology-manager-scope="container" May 20 15:32:49.142531 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136931 2557 flags.go:64] FLAG: --v="2" May 20 15:32:49.142531 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136938 2557 flags.go:64] FLAG: --version="false" May 20 15:32:49.142531 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136944 2557 flags.go:64] FLAG: --vmodule="" May 20 15:32:49.142531 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136950 2557 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 20 15:32:49.142531 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.136958 2557 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 20 15:32:49.142531 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137111 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 20 15:32:49.142531 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137118 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 20 15:32:49.143122 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137123 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 20 15:32:49.143122 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137128 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 20 15:32:49.143122 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137132 2557 feature_gate.go:328] unrecognized feature gate: DualReplica May 20 15:32:49.143122 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137136 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 20 15:32:49.143122 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137141 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 20 15:32:49.143122 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137148 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 20 15:32:49.143122 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137154 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 20 15:32:49.143122 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137159 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 20 15:32:49.143122 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137164 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 20 15:32:49.143122 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137168 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 20 15:32:49.143122 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137173 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 20 15:32:49.143122 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137178 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 20 15:32:49.143122 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137182 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 20 15:32:49.143122 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137188 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 20 15:32:49.143122 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137195 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 20 15:32:49.143122 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137200 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 20 15:32:49.143122 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137205 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 20 15:32:49.143122 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137209 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 20 15:32:49.143122 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137213 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 20 15:32:49.143122 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137217 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 20 15:32:49.143625 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137222 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 20 15:32:49.143625 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137226 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 20 15:32:49.143625 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137230 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 20 15:32:49.143625 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137235 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 20 15:32:49.143625 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137239 2557 feature_gate.go:328] unrecognized feature gate: NewOLM May 20 15:32:49.143625 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137244 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 20 15:32:49.143625 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137248 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 20 15:32:49.143625 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137252 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 20 15:32:49.143625 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137256 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 20 15:32:49.143625 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137267 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 20 15:32:49.143625 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137272 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 20 15:32:49.143625 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137276 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 20 15:32:49.143625 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137280 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 20 15:32:49.143625 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137284 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 20 15:32:49.143625 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137288 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 20 15:32:49.143625 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137292 2557 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 20 15:32:49.143625 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137297 2557 feature_gate.go:328] unrecognized feature gate: Example2 May 20 15:32:49.143625 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137301 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 20 15:32:49.143625 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137305 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 20 15:32:49.143625 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137309 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 20 15:32:49.144132 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137313 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 20 15:32:49.144132 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137332 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 20 15:32:49.144132 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137336 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 20 15:32:49.144132 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137340 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 20 15:32:49.144132 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137344 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 20 15:32:49.144132 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137348 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 20 15:32:49.144132 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137355 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 20 15:32:49.144132 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137360 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 20 15:32:49.144132 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137364 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 20 15:32:49.144132 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137371 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 20 15:32:49.144132 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137377 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 20 15:32:49.144132 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137381 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 20 15:32:49.144132 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137385 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 20 15:32:49.144132 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137389 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 20 15:32:49.144132 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137393 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 20 15:32:49.144132 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137398 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 20 15:32:49.144132 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137401 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 20 15:32:49.144132 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137406 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 20 15:32:49.144132 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137410 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 20 15:32:49.144592 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137414 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 20 15:32:49.144592 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137418 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 20 15:32:49.144592 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137423 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 20 15:32:49.144592 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137428 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 20 15:32:49.144592 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137432 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 20 15:32:49.144592 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137436 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 20 15:32:49.144592 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137440 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 20 15:32:49.144592 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137444 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 20 15:32:49.144592 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137449 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 20 15:32:49.144592 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137453 2557 feature_gate.go:328] unrecognized feature gate: Example May 20 15:32:49.144592 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137457 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores May 20 15:32:49.144592 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137461 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 20 15:32:49.144592 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137466 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 20 15:32:49.144592 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137470 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 20 15:32:49.144592 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137474 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability May 20 15:32:49.144592 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137478 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 20 15:32:49.144592 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137482 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages May 20 15:32:49.144592 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137486 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 20 15:32:49.144592 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137490 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 20 15:32:49.144592 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137496 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 20 15:32:49.145107 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137500 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 20 15:32:49.145107 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137505 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 20 15:32:49.145107 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137509 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 20 15:32:49.145107 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137512 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 20 15:32:49.145107 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.137516 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 20 15:32:49.145107 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.138491 2557 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 20 15:32:49.147154 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.147131 2557 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 20 15:32:49.147154 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.147151 2557 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 20 15:32:49.147303 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147218 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 20 15:32:49.147303 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147226 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 20 15:32:49.147303 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147231 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 20 15:32:49.147303 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147235 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 20 15:32:49.147303 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147239 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 20 15:32:49.147303 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147244 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 20 15:32:49.147303 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147248 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 20 15:32:49.147303 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147252 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 20 15:32:49.147303 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147256 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 20 15:32:49.147303 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147260 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 20 15:32:49.147303 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147265 2557 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 20 15:32:49.147303 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147270 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 20 15:32:49.147303 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147274 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 20 15:32:49.147303 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147279 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 20 15:32:49.147303 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147283 2557 feature_gate.go:328] unrecognized feature gate: Example May 20 15:32:49.147303 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147288 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 20 15:32:49.147303 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147294 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 20 15:32:49.147303 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147299 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 20 15:32:49.147303 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147304 2557 feature_gate.go:328] unrecognized feature gate: DualReplica May 20 15:32:49.147303 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147308 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 20 15:32:49.148198 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147312 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 20 15:32:49.148198 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147317 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 20 15:32:49.148198 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147321 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 20 15:32:49.148198 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147325 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 20 15:32:49.148198 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147329 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 20 15:32:49.148198 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147334 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 20 15:32:49.148198 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147338 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 20 15:32:49.148198 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147343 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 20 15:32:49.148198 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147347 2557 feature_gate.go:328] unrecognized feature gate: Example2 May 20 15:32:49.148198 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147351 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 20 15:32:49.148198 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147355 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 20 15:32:49.148198 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147361 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 20 15:32:49.148198 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147365 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 20 15:32:49.148198 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147369 2557 feature_gate.go:328] unrecognized feature gate: NewOLM May 20 15:32:49.148198 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147373 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 20 15:32:49.148198 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147377 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 20 15:32:49.148198 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147382 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 20 15:32:49.148198 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147388 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 20 15:32:49.148198 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147395 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 20 15:32:49.148198 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147400 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 20 15:32:49.148750 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147405 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 20 15:32:49.148750 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147409 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 20 15:32:49.148750 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147413 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 20 15:32:49.148750 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147418 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 20 15:32:49.148750 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147422 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores May 20 15:32:49.148750 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147426 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 20 15:32:49.148750 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147430 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 20 15:32:49.148750 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147434 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 20 15:32:49.148750 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147438 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 20 15:32:49.148750 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147442 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 20 15:32:49.148750 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147446 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 20 15:32:49.148750 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147451 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 20 15:32:49.148750 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147454 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 20 15:32:49.148750 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147459 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 20 15:32:49.148750 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147463 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 20 15:32:49.148750 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147467 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 20 15:32:49.148750 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147472 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 20 15:32:49.148750 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147476 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 20 15:32:49.148750 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147480 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 20 15:32:49.149312 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147484 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 20 15:32:49.149312 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147488 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 20 15:32:49.149312 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147492 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 20 15:32:49.149312 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147496 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 20 15:32:49.149312 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147500 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 20 15:32:49.149312 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147506 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability May 20 15:32:49.149312 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147510 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 20 15:32:49.149312 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147514 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 20 15:32:49.149312 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147518 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 20 15:32:49.149312 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147522 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 20 15:32:49.149312 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147526 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 20 15:32:49.149312 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147531 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 20 15:32:49.149312 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147535 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages May 20 15:32:49.149312 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147539 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 20 15:32:49.149312 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147543 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 20 15:32:49.149312 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147547 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 20 15:32:49.149312 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147551 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 20 15:32:49.149312 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147556 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 20 15:32:49.149312 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147560 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 20 15:32:49.149312 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147564 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 20 15:32:49.150143 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147568 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 20 15:32:49.150143 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147572 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 20 15:32:49.150143 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147576 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 20 15:32:49.150143 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147581 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 20 15:32:49.150143 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147585 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 20 15:32:49.150143 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147589 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 20 15:32:49.150143 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147594 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 20 15:32:49.150143 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.147602 2557 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 20 15:32:49.150143 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147758 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 20 15:32:49.150143 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147765 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 20 15:32:49.150143 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147770 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 20 15:32:49.150143 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147775 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 20 15:32:49.150143 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147780 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 20 15:32:49.150143 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147784 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 20 15:32:49.150143 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147789 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 20 15:32:49.150833 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147793 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 20 15:32:49.150833 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147797 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 20 15:32:49.150833 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147802 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 20 15:32:49.150833 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147834 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 20 15:32:49.150833 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147839 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 20 15:32:49.150833 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147843 2557 feature_gate.go:328] unrecognized feature gate: Example2 May 20 15:32:49.150833 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147848 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 20 15:32:49.150833 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147852 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 20 15:32:49.150833 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147856 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 20 15:32:49.150833 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147859 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 20 15:32:49.150833 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147863 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 20 15:32:49.150833 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147867 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 20 15:32:49.150833 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147871 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 20 15:32:49.150833 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147875 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 20 15:32:49.150833 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147880 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 20 15:32:49.150833 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147884 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages May 20 15:32:49.150833 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147888 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 20 15:32:49.150833 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147892 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 20 15:32:49.150833 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147896 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 20 15:32:49.151450 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147900 2557 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 20 15:32:49.151450 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147904 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 20 15:32:49.151450 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147909 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 20 15:32:49.151450 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147913 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability May 20 15:32:49.151450 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147917 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 20 15:32:49.151450 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147923 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 20 15:32:49.151450 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147930 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 20 15:32:49.151450 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147936 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 20 15:32:49.151450 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147940 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 20 15:32:49.151450 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147944 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 20 15:32:49.151450 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147949 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 20 15:32:49.151450 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147954 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 20 15:32:49.151450 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147958 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 20 15:32:49.151450 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147962 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 20 15:32:49.151450 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147966 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 20 15:32:49.151450 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147971 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 20 15:32:49.151450 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147975 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 20 15:32:49.151450 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147987 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 20 15:32:49.151450 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147992 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 20 15:32:49.151450 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.147996 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 20 15:32:49.152062 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.148000 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 20 15:32:49.152062 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.148004 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 20 15:32:49.152062 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.148009 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 20 15:32:49.152062 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.148013 2557 feature_gate.go:328] unrecognized feature gate: DualReplica May 20 15:32:49.152062 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.148017 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 20 15:32:49.152062 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.148021 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 20 15:32:49.152062 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.148025 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 20 15:32:49.152062 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.148029 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 20 15:32:49.152062 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.148034 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 20 15:32:49.152062 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.148038 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 20 15:32:49.152062 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.148042 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 20 15:32:49.152062 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.148047 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores May 20 15:32:49.152062 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.148051 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 20 15:32:49.152062 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.148055 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 20 15:32:49.152062 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.148060 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 20 15:32:49.152062 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.148064 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 20 15:32:49.152062 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.148068 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 20 15:32:49.152062 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.148072 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 20 15:32:49.152062 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.148076 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 20 15:32:49.152062 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.148080 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 20 15:32:49.152659 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.148084 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 20 15:32:49.152659 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.148088 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 20 15:32:49.152659 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.148092 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 20 15:32:49.152659 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.148096 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 20 15:32:49.152659 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.148100 2557 feature_gate.go:328] unrecognized feature gate: Example May 20 15:32:49.152659 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.148105 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 20 15:32:49.152659 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.148111 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 20 15:32:49.152659 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.148117 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 20 15:32:49.152659 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.148121 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 20 15:32:49.152659 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.148126 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 20 15:32:49.152659 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.148135 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 20 15:32:49.152659 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.148140 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 20 15:32:49.152659 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.148145 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 20 15:32:49.152659 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.148149 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 20 15:32:49.152659 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.148153 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 20 15:32:49.152659 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.148157 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 20 15:32:49.152659 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.148161 2557 feature_gate.go:328] unrecognized feature gate: NewOLM May 20 15:32:49.152659 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.148166 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 20 15:32:49.152659 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.148170 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 20 15:32:49.153149 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:49.148174 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 20 15:32:49.153149 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.148182 2557 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 20 15:32:49.153149 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.148890 2557 server.go:962] "Client rotation is on, will bootstrap in background" May 20 15:32:49.153149 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.151638 2557 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 20 15:32:49.153330 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.153317 2557 server.go:1019] "Starting client certificate rotation" May 20 15:32:49.153440 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.153423 2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 20 15:32:49.153476 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.153460 2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 20 15:32:49.177022 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.176999 2557 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 20 15:32:49.180272 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.180252 2557 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 20 15:32:49.196409 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.196391 2557 log.go:25] "Validated CRI v1 runtime API" May 20 15:32:49.200889 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.200877 2557 log.go:25] "Validated CRI v1 image API" May 20 15:32:49.202882 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.202863 2557 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 20 15:32:49.207396 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.207372 2557 fs.go:135] Filesystem UUIDs: map[57e2fc43-b041-40e6-91e8-06a398a4bc5b:/dev/nvme0n1p3 583b1d05-0106-4a3d-978d-600698b65cc8:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] May 20 15:32:49.207455 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.207395 2557 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 20 15:32:49.211602 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.211497 2557 manager.go:217] Machine: {Timestamp:2026-05-20 15:32:49.211013978 +0000 UTC m=+0.425936762 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099725 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec224e7754df8fd0cb6461b344acb17a SystemUUID:ec224e77-54df-8fd0-cb64-61b344acb17a BootID:f31f0f27-64e9-4ad9-825e-af8ba89acded Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:09:3b:c5:45:17 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:09:3b:c5:45:17 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:76:f2:64:e9:f7:2e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 20 15:32:49.212278 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.212267 2557 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 20 15:32:49.212359 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.212347 2557 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 20 15:32:49.214035 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.214011 2557 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 20 15:32:49.214226 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.214039 2557 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-228.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 20 15:32:49.214309 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.214240 2557 topology_manager.go:138] "Creating topology manager with none policy" May 20 15:32:49.214309 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.214253 2557 container_manager_linux.go:306] "Creating device plugin manager" May 20 15:32:49.214309 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.214264 2557 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 20 15:32:49.215056 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.215044 2557 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 20 15:32:49.216525 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.216513 2557 state_mem.go:36] "Initialized new in-memory state store" May 20 15:32:49.216655 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.216644 2557 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 20 15:32:49.216781 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.216766 2557 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 20 15:32:49.218927 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.218914 2557 kubelet.go:491] "Attempting to sync node with API server" May 20 15:32:49.219042 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.218931 2557 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 20 15:32:49.219042 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.218951 2557 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 20 15:32:49.219042 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.218964 2557 kubelet.go:397] "Adding apiserver pod source" May 20 15:32:49.219042 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.218976 2557 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 20 15:32:49.220132 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.220119 2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 20 15:32:49.220191 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.220143 2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 20 15:32:49.223035 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.223021 2557 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 20 15:32:49.224733 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.224718 2557 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 20 15:32:49.225740 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.225726 2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 20 15:32:49.225806 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.225747 2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 20 15:32:49.225806 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.225756 2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 20 15:32:49.225806 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.225765 2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 20 15:32:49.225806 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.225778 2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 20 15:32:49.225806 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.225790 2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 20 15:32:49.225806 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.225803 2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 20 15:32:49.226030 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.225830 2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 20 15:32:49.226030 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.225845 2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 20 15:32:49.226030 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.225857 2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 20 15:32:49.226030 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.225886 2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 20 15:32:49.226165 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.226076 2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 20 15:32:49.227238 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.227228 2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 20 15:32:49.227294 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.227254 2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 20 15:32:49.230580 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.230563 2557 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 20 15:32:49.230664 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.230604 2557 server.go:1295] "Started kubelet" May 20 15:32:49.230708 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.230657 2557 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 20 15:32:49.230752 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.230679 2557 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 20 15:32:49.230752 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.230741 2557 server_v1.go:47] "podresources" method="list" useActivePods=true May 20 15:32:49.231407 ip-10-0-130-228 systemd[1]: Started Kubernetes Kubelet. May 20 15:32:49.235266 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.235244 2557 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 20 15:32:49.235516 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.235494 2557 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-228.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 20 15:32:49.235735 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:32:49.235711 2557 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-228.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 20 15:32:49.235776 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:32:49.235720 2557 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 20 15:32:49.237892 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.237854 2557 server.go:317] "Adding debug handlers to kubelet server" May 20 15:32:49.240375 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.240353 2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 20 15:32:49.240890 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.240872 2557 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 20 15:32:49.240989 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.240959 2557 volume_manager.go:295] "The desired_state_of_world populator starts" May 20 15:32:49.240989 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.240972 2557 volume_manager.go:297] "Starting Kubelet Volume Manager" May 20 15:32:49.241096 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.241050 2557 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 20 15:32:49.241145 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.241120 2557 reconstruct.go:97] "Volume reconstruction finished" May 20 15:32:49.241145 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.241129 2557 reconciler.go:26] "Reconciler: start to sync state" May 20 15:32:49.242077 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:32:49.242053 2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-228.ec2.internal\" not found" May 20 15:32:49.242353 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.242335 2557 factory.go:55] Registering systemd factory May 20 15:32:49.242353 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.242354 2557 factory.go:223] Registration of the systemd container factory successfully May 20 15:32:49.242472 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:32:49.242410 2557 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 20 15:32:49.242579 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.242566 2557 factory.go:153] Registering CRI-O factory May 20 15:32:49.242579 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.242578 2557 factory.go:223] Registration of the crio container factory successfully May 20 15:32:49.242692 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.242624 2557 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 20 15:32:49.242692 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.242637 2557 factory.go:103] Registering Raw factory May 20 15:32:49.242692 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.242647 2557 manager.go:1196] Started watching for new ooms in manager May 20 15:32:49.242888 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:32:49.241707 2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-228.ec2.internal.18b14fe42dfa58da default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-228.ec2.internal,UID:ip-10-0-130-228.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-228.ec2.internal,},FirstTimestamp:2026-05-20 15:32:49.230575834 +0000 UTC m=+0.445498618,LastTimestamp:2026-05-20 15:32:49.230575834 +0000 UTC m=+0.445498618,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-228.ec2.internal,}" May 20 15:32:49.243298 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.243281 2557 manager.go:319] Starting recovery of all containers May 20 15:32:49.247022 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.247002 2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cbh4j" May 20 15:32:49.249593 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:32:49.249561 2557 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" May 20 15:32:49.249756 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:32:49.249734 2557 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-228.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" May 20 15:32:49.255364 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.255350 2557 manager.go:324] Recovery completed May 20 15:32:49.256074 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.256056 2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cbh4j" May 20 15:32:49.259907 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.259892 2557 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 20 15:32:49.262248 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.262232 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-228.ec2.internal" event="NodeHasSufficientMemory" May 20 15:32:49.262332 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.262264 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-228.ec2.internal" event="NodeHasNoDiskPressure" May 20 15:32:49.262332 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.262279 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-228.ec2.internal" event="NodeHasSufficientPID" May 20 15:32:49.262912 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.262893 2557 cpu_manager.go:222] "Starting CPU manager" policy="none" May 20 15:32:49.262912 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.262913 2557 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 20 15:32:49.263011 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.262930 2557 state_mem.go:36] "Initialized new in-memory state store" May 20 15:32:49.264029 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:32:49.263963 2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-228.ec2.internal.18b14fe42fdda1cc default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-228.ec2.internal,UID:ip-10-0-130-228.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-228.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-228.ec2.internal,},FirstTimestamp:2026-05-20 15:32:49.262248396 +0000 UTC m=+0.477171188,LastTimestamp:2026-05-20 15:32:49.262248396 +0000 UTC m=+0.477171188,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-228.ec2.internal,}" May 20 15:32:49.265327 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.265314 2557 policy_none.go:49] "None policy: Start" May 20 15:32:49.265384 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.265331 2557 memory_manager.go:186] "Starting memorymanager" policy="None" May 20 15:32:49.265384 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.265342 2557 state_mem.go:35] "Initializing new in-memory state store" May 20 15:32:49.303594 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.303577 2557 manager.go:341] "Starting Device Plugin manager" May 20 15:32:49.310257 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:32:49.303635 2557 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 20 15:32:49.310257 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.303652 2557 server.go:85] "Starting device plugin registration server" May 20 15:32:49.310257 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.303933 2557 eviction_manager.go:189] "Eviction manager: starting control loop" May 20 15:32:49.310257 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.303946 2557 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 20 15:32:49.310257 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.304038 2557 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 20 15:32:49.310257 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.304175 2557 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 20 15:32:49.310257 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.304185 2557 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 20 15:32:49.310257 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:32:49.304670 2557 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 20 15:32:49.310257 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:32:49.304704 2557 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-228.ec2.internal\" not found" May 20 15:32:49.377757 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.377688 2557 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 20 15:32:49.379043 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.379029 2557 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 20 15:32:49.379109 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.379053 2557 status_manager.go:230] "Starting to sync pod status with apiserver" May 20 15:32:49.379109 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.379070 2557 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 20 15:32:49.379109 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.379076 2557 kubelet.go:2451] "Starting kubelet main sync loop" May 20 15:32:49.379250 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:32:49.379111 2557 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 20 15:32:49.382419 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.382403 2557 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 20 15:32:49.404449 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.404434 2557 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 20 15:32:49.405285 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.405267 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-228.ec2.internal" event="NodeHasSufficientMemory" May 20 15:32:49.405379 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.405306 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-228.ec2.internal" event="NodeHasNoDiskPressure" May 20 15:32:49.405379 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.405321 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-228.ec2.internal" event="NodeHasSufficientPID" May 20 15:32:49.405379 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.405351 2557 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-228.ec2.internal" May 20 15:32:49.415673 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.415652 2557 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-228.ec2.internal" May 20 15:32:49.415673 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:32:49.415673 2557 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-228.ec2.internal\": node \"ip-10-0-130-228.ec2.internal\" not found" May 20 15:32:49.441232 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:32:49.441209 2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-228.ec2.internal\" not found" May 20 15:32:49.479784 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.479764 2557 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-228.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-228.ec2.internal"] May 20 15:32:49.479881 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.479843 2557 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 20 15:32:49.481261 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.481246 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-228.ec2.internal" event="NodeHasSufficientMemory" May 20 15:32:49.481347 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.481278 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-228.ec2.internal" event="NodeHasNoDiskPressure" May 20 15:32:49.481347 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.481295 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-228.ec2.internal" event="NodeHasSufficientPID" May 20 15:32:49.482472 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.482450 2557 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 20 15:32:49.482617 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.482590 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-228.ec2.internal" May 20 15:32:49.482670 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.482633 2557 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 20 15:32:49.483191 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.483173 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-228.ec2.internal" event="NodeHasSufficientMemory" May 20 15:32:49.483250 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.483176 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-228.ec2.internal" event="NodeHasSufficientMemory" May 20 15:32:49.483250 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.483208 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-228.ec2.internal" event="NodeHasNoDiskPressure" May 20 15:32:49.483250 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.483222 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-228.ec2.internal" event="NodeHasNoDiskPressure" May 20 15:32:49.483250 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.483227 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-228.ec2.internal" event="NodeHasSufficientPID" May 20 15:32:49.483250 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.483237 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-228.ec2.internal" event="NodeHasSufficientPID" May 20 15:32:49.484382 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.484368 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-228.ec2.internal" May 20 15:32:49.484447 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.484391 2557 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 20 15:32:49.484988 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.484973 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-228.ec2.internal" event="NodeHasSufficientMemory" May 20 15:32:49.485054 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.485002 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-228.ec2.internal" event="NodeHasNoDiskPressure" May 20 15:32:49.485054 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.485016 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-228.ec2.internal" event="NodeHasSufficientPID" May 20 15:32:49.509372 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:32:49.509348 2557 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-228.ec2.internal\" not found" node="ip-10-0-130-228.ec2.internal" May 20 15:32:49.513757 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:32:49.513740 2557 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-228.ec2.internal\" not found" node="ip-10-0-130-228.ec2.internal" May 20 15:32:49.541710 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:32:49.541689 2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-228.ec2.internal\" not found" May 20 15:32:49.642359 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:32:49.642284 2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-228.ec2.internal\" not found" May 20 15:32:49.642461 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.642357 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/42e4b468873bacee12c6d864090d2691-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-228.ec2.internal\" (UID: \"42e4b468873bacee12c6d864090d2691\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-228.ec2.internal" May 20 15:32:49.642461 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.642391 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e78fe5c75454ec5097ce49d1da0faa03-config\") pod \"kube-apiserver-proxy-ip-10-0-130-228.ec2.internal\" (UID: \"e78fe5c75454ec5097ce49d1da0faa03\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-228.ec2.internal" May 20 15:32:49.642461 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.642418 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/42e4b468873bacee12c6d864090d2691-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-228.ec2.internal\" (UID: \"42e4b468873bacee12c6d864090d2691\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-228.ec2.internal" May 20 15:32:49.742897 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:32:49.742874 2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-228.ec2.internal\" not found" May 20 15:32:49.742976 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.742903 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e78fe5c75454ec5097ce49d1da0faa03-config\") pod \"kube-apiserver-proxy-ip-10-0-130-228.ec2.internal\" (UID: \"e78fe5c75454ec5097ce49d1da0faa03\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-228.ec2.internal" May 20 15:32:49.742976 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.742933 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/42e4b468873bacee12c6d864090d2691-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-228.ec2.internal\" (UID: \"42e4b468873bacee12c6d864090d2691\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-228.ec2.internal" May 20 15:32:49.742976 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.742956 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/42e4b468873bacee12c6d864090d2691-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-228.ec2.internal\" (UID: \"42e4b468873bacee12c6d864090d2691\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-228.ec2.internal" May 20 15:32:49.743072 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.742992 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e78fe5c75454ec5097ce49d1da0faa03-config\") pod \"kube-apiserver-proxy-ip-10-0-130-228.ec2.internal\" (UID: \"e78fe5c75454ec5097ce49d1da0faa03\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-228.ec2.internal" May 20 15:32:49.743072 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.743001 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/42e4b468873bacee12c6d864090d2691-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-228.ec2.internal\" (UID: \"42e4b468873bacee12c6d864090d2691\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-228.ec2.internal" May 20 15:32:49.743072 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.742993 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/42e4b468873bacee12c6d864090d2691-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-228.ec2.internal\" (UID: \"42e4b468873bacee12c6d864090d2691\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-228.ec2.internal" May 20 15:32:49.813061 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.813033 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-228.ec2.internal" May 20 15:32:49.815735 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:49.815713 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-228.ec2.internal" May 20 15:32:49.843492 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:32:49.843465 2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-228.ec2.internal\" not found" May 20 15:32:49.943936 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:32:49.943875 2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-228.ec2.internal\" not found" May 20 15:32:50.044245 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:32:50.044218 2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-228.ec2.internal\" not found" May 20 15:32:50.046567 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.046547 2557 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 20 15:32:50.141499 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.141477 2557 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-228.ec2.internal" May 20 15:32:50.152839 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.152806 2557 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 20 15:32:50.152975 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:32:50.152952 2557 request.go:1360] "Unexpected error when reading response body" err="read tcp 10.0.130.228:45468->100.30.59.243:6443: use of closed network connection" May 20 15:32:50.153027 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.152997 2557 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 20 15:32:50.153065 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.152997 2557 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 20 15:32:50.153065 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:32:50.153002 2557 kubelet.go:3342] "Failed creating a mirror pod" err="unexpected error when reading response body. Please retry. Original error: read tcp 10.0.130.228:45468->100.30.59.243:6443: use of closed network connection" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-228.ec2.internal" May 20 15:32:50.153065 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.153053 2557 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-228.ec2.internal" May 20 15:32:50.171455 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.171433 2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 20 15:32:50.219860 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.219755 2557 apiserver.go:52] "Watching apiserver" May 20 15:32:50.225712 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.225689 2557 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 20 15:32:50.228076 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.228054 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wsrh","openshift-image-registry/node-ca-wmwps","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-228.ec2.internal","openshift-multus/multus-additional-cni-plugins-tzz5f","openshift-multus/network-metrics-daemon-wszj2","openshift-cluster-node-tuning-operator/tuned-w226m","openshift-dns/node-resolver-r8sqr","openshift-multus/multus-rsmqw","openshift-network-diagnostics/network-check-target-dv77n","openshift-network-operator/iptables-alerter-zfwc4","openshift-ovn-kubernetes/ovnkube-node-gvwgm","kube-system/konnectivity-agent-r9qzn","kube-system/kube-apiserver-proxy-ip-10-0-130-228.ec2.internal"] May 20 15:32:50.230581 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.230558 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-r8sqr" May 20 15:32:50.230684 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.230665 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wmwps" May 20 15:32:50.234601 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.234579 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wszj2" May 20 15:32:50.234725 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.234666 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tzz5f" May 20 15:32:50.234784 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:32:50.234731 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wszj2" podUID="54872a9c-6091-4768-8cd9-e81ab987ba01" May 20 15:32:50.234866 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.234790 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 20 15:32:50.234866 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.234802 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 20 15:32:50.234866 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.234804 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 20 15:32:50.235017 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.234786 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 20 15:32:50.235412 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.235287 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 20 15:32:50.235621 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.235581 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-xv7q2\"" May 20 15:32:50.235725 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.235582 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-pmln2\"" May 20 15:32:50.236365 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.236346 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-w226m" May 20 15:32:50.237432 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.237418 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 20 15:32:50.237556 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.237542 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wsrh" May 20 15:32:50.238190 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.238173 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 20 15:32:50.238267 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.238219 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 20 15:32:50.238267 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.238261 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 20 15:32:50.238408 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.238393 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 20 15:32:50.238497 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.238484 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6th5d\"" May 20 15:32:50.238695 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.238681 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 20 15:32:50.238782 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.238694 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 20 15:32:50.238910 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.238866 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-gkbwl\"" May 20 15:32:50.239103 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.239088 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rsmqw" May 20 15:32:50.239163 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.239116 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 20 15:32:50.239510 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.239470 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 20 15:32:50.239580 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.239527 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-hs8l6\"" May 20 15:32:50.239580 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.239555 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 20 15:32:50.240461 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.240443 2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 20 15:32:50.240555 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.240511 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dv77n" May 20 15:32:50.240617 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:32:50.240574 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dv77n" podUID="ae4048cd-ad5b-4154-8b48-47363ccceda4" May 20 15:32:50.240914 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.240895 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 20 15:32:50.241272 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.241256 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-d8dw7\"" May 20 15:32:50.241723 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.241706 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zfwc4" May 20 15:32:50.243189 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.243173 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gvwgm" May 20 15:32:50.244193 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.244175 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 20 15:32:50.244271 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.244229 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 20 15:32:50.244326 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.244296 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 20 15:32:50.244405 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.244383 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-g64qs\"" May 20 15:32:50.244911 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.244891 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-r9qzn" May 20 15:32:50.245002 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.244911 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d4425adc-866b-4a45-8857-4a90c111f6ff-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tzz5f\" (UID: \"d4425adc-866b-4a45-8857-4a90c111f6ff\") " pod="openshift-multus/multus-additional-cni-plugins-tzz5f" May 20 15:32:50.245002 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.244945 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4-etc-kubernetes\") pod \"tuned-w226m\" (UID: \"81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4\") " pod="openshift-cluster-node-tuning-operator/tuned-w226m" May 20 15:32:50.245002 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.244972 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2ce6e5d4-1424-43c2-9263-ab0463bc8c6c-multus-daemon-config\") pod \"multus-rsmqw\" (UID: \"2ce6e5d4-1424-43c2-9263-ab0463bc8c6c\") " pod="openshift-multus/multus-rsmqw" May 20 15:32:50.245002 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.244996 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zppfc\" (UniqueName: \"kubernetes.io/projected/7b177a52-2efa-4ece-ae5a-52b2386682dd-kube-api-access-zppfc\") pod \"iptables-alerter-zfwc4\" (UID: \"7b177a52-2efa-4ece-ae5a-52b2386682dd\") " pod="openshift-network-operator/iptables-alerter-zfwc4" May 20 15:32:50.245223 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.245037 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckpjq\" (UniqueName: \"kubernetes.io/projected/d4425adc-866b-4a45-8857-4a90c111f6ff-kube-api-access-ckpjq\") pod \"multus-additional-cni-plugins-tzz5f\" (UID: \"d4425adc-866b-4a45-8857-4a90c111f6ff\") " pod="openshift-multus/multus-additional-cni-plugins-tzz5f" May 20 15:32:50.245223 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.245081 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfxsq\" (UniqueName: \"kubernetes.io/projected/54872a9c-6091-4768-8cd9-e81ab987ba01-kube-api-access-vfxsq\") pod \"network-metrics-daemon-wszj2\" (UID: \"54872a9c-6091-4768-8cd9-e81ab987ba01\") " pod="openshift-multus/network-metrics-daemon-wszj2" May 20 15:32:50.245223 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.245093 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 20 15:32:50.245223 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.245105 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7b177a52-2efa-4ece-ae5a-52b2386682dd-iptables-alerter-script\") pod \"iptables-alerter-zfwc4\" (UID: \"7b177a52-2efa-4ece-ae5a-52b2386682dd\") " pod="openshift-network-operator/iptables-alerter-zfwc4" May 20 15:32:50.245223 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.245129 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d4425adc-866b-4a45-8857-4a90c111f6ff-system-cni-dir\") pod \"multus-additional-cni-plugins-tzz5f\" (UID: \"d4425adc-866b-4a45-8857-4a90c111f6ff\") " pod="openshift-multus/multus-additional-cni-plugins-tzz5f" May 20 15:32:50.245223 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.245154 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2ce6e5d4-1424-43c2-9263-ab0463bc8c6c-os-release\") pod \"multus-rsmqw\" (UID: \"2ce6e5d4-1424-43c2-9263-ab0463bc8c6c\") " pod="openshift-multus/multus-rsmqw" May 20 15:32:50.245223 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.245176 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2ce6e5d4-1424-43c2-9263-ab0463bc8c6c-multus-conf-dir\") pod \"multus-rsmqw\" (UID: \"2ce6e5d4-1424-43c2-9263-ab0463bc8c6c\") " pod="openshift-multus/multus-rsmqw" May 20 15:32:50.245562 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.245226 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/30b04f89-de78-49cd-a9f5-45bb9f3be94b-socket-dir\") pod \"aws-ebs-csi-driver-node-9wsrh\" (UID: \"30b04f89-de78-49cd-a9f5-45bb9f3be94b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wsrh" May 20 15:32:50.245562 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.245253 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7b177a52-2efa-4ece-ae5a-52b2386682dd-host-slash\") pod \"iptables-alerter-zfwc4\" (UID: \"7b177a52-2efa-4ece-ae5a-52b2386682dd\") " pod="openshift-network-operator/iptables-alerter-zfwc4" May 20 15:32:50.245562 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.245276 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d4425adc-866b-4a45-8857-4a90c111f6ff-os-release\") pod \"multus-additional-cni-plugins-tzz5f\" (UID: \"d4425adc-866b-4a45-8857-4a90c111f6ff\") " pod="openshift-multus/multus-additional-cni-plugins-tzz5f" May 20 15:32:50.245562 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.245302 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 20 15:32:50.245562 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.245307 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d4425adc-866b-4a45-8857-4a90c111f6ff-cni-binary-copy\") pod \"multus-additional-cni-plugins-tzz5f\" (UID: \"d4425adc-866b-4a45-8857-4a90c111f6ff\") " pod="openshift-multus/multus-additional-cni-plugins-tzz5f" May 20 15:32:50.245562 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.245330 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/30b04f89-de78-49cd-a9f5-45bb9f3be94b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9wsrh\" (UID: \"30b04f89-de78-49cd-a9f5-45bb9f3be94b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wsrh" May 20 15:32:50.245562 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.245355 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/30b04f89-de78-49cd-a9f5-45bb9f3be94b-etc-selinux\") pod \"aws-ebs-csi-driver-node-9wsrh\" (UID: \"30b04f89-de78-49cd-a9f5-45bb9f3be94b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wsrh" May 20 15:32:50.245562 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.245380 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6v2d9\" (UniqueName: \"kubernetes.io/projected/3965fa01-ac56-43aa-b92e-985a0e59fdc6-kube-api-access-6v2d9\") pod \"node-ca-wmwps\" (UID: \"3965fa01-ac56-43aa-b92e-985a0e59fdc6\") " pod="openshift-image-registry/node-ca-wmwps" May 20 15:32:50.245562 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.245405 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2ce6e5d4-1424-43c2-9263-ab0463bc8c6c-host-run-k8s-cni-cncf-io\") pod \"multus-rsmqw\" (UID: \"2ce6e5d4-1424-43c2-9263-ab0463bc8c6c\") " pod="openshift-multus/multus-rsmqw" May 20 15:32:50.245562 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.245453 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d4425adc-866b-4a45-8857-4a90c111f6ff-cnibin\") pod \"multus-additional-cni-plugins-tzz5f\" (UID: \"d4425adc-866b-4a45-8857-4a90c111f6ff\") " pod="openshift-multus/multus-additional-cni-plugins-tzz5f" May 20 15:32:50.245562 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.245512 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 20 15:32:50.245562 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.245522 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 20 15:32:50.246176 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.245644 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 20 15:32:50.246176 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.245666 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 20 15:32:50.246176 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.245458 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-25kvr\"" May 20 15:32:50.246176 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.245511 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d4425adc-866b-4a45-8857-4a90c111f6ff-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tzz5f\" (UID: \"d4425adc-866b-4a45-8857-4a90c111f6ff\") " pod="openshift-multus/multus-additional-cni-plugins-tzz5f" May 20 15:32:50.246176 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.245747 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4-etc-systemd\") pod \"tuned-w226m\" (UID: \"81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4\") " pod="openshift-cluster-node-tuning-operator/tuned-w226m" May 20 15:32:50.246176 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.245769 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4-sys\") pod \"tuned-w226m\" (UID: \"81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4\") " pod="openshift-cluster-node-tuning-operator/tuned-w226m" May 20 15:32:50.246176 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.245793 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4-var-lib-kubelet\") pod \"tuned-w226m\" (UID: \"81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4\") " pod="openshift-cluster-node-tuning-operator/tuned-w226m" May 20 15:32:50.246176 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.245838 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2ce6e5d4-1424-43c2-9263-ab0463bc8c6c-cni-binary-copy\") pod \"multus-rsmqw\" (UID: \"2ce6e5d4-1424-43c2-9263-ab0463bc8c6c\") " pod="openshift-multus/multus-rsmqw" May 20 15:32:50.246176 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.245866 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2ce6e5d4-1424-43c2-9263-ab0463bc8c6c-host-var-lib-cni-multus\") pod \"multus-rsmqw\" (UID: \"2ce6e5d4-1424-43c2-9263-ab0463bc8c6c\") " pod="openshift-multus/multus-rsmqw" May 20 15:32:50.246176 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.245906 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2ce6e5d4-1424-43c2-9263-ab0463bc8c6c-host-run-multus-certs\") pod \"multus-rsmqw\" (UID: \"2ce6e5d4-1424-43c2-9263-ab0463bc8c6c\") " pod="openshift-multus/multus-rsmqw" May 20 15:32:50.246176 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.245942 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4-etc-sysconfig\") pod \"tuned-w226m\" (UID: \"81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4\") " pod="openshift-cluster-node-tuning-operator/tuned-w226m" May 20 15:32:50.246176 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.245961 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2ce6e5d4-1424-43c2-9263-ab0463bc8c6c-host-var-lib-kubelet\") pod \"multus-rsmqw\" (UID: \"2ce6e5d4-1424-43c2-9263-ab0463bc8c6c\") " pod="openshift-multus/multus-rsmqw" May 20 15:32:50.246176 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.245976 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7g8k\" (UniqueName: \"kubernetes.io/projected/f3564822-b89c-4974-8c53-986c6b3fd1e7-kube-api-access-r7g8k\") pod \"node-resolver-r8sqr\" (UID: \"f3564822-b89c-4974-8c53-986c6b3fd1e7\") " pod="openshift-dns/node-resolver-r8sqr" May 20 15:32:50.246176 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.245995 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54872a9c-6091-4768-8cd9-e81ab987ba01-metrics-certs\") pod \"network-metrics-daemon-wszj2\" (UID: \"54872a9c-6091-4768-8cd9-e81ab987ba01\") " pod="openshift-multus/network-metrics-daemon-wszj2" May 20 15:32:50.246176 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.246025 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4-tmp\") pod \"tuned-w226m\" (UID: \"81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4\") " pod="openshift-cluster-node-tuning-operator/tuned-w226m" May 20 15:32:50.246176 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.246039 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2ce6e5d4-1424-43c2-9263-ab0463bc8c6c-cnibin\") pod \"multus-rsmqw\" (UID: \"2ce6e5d4-1424-43c2-9263-ab0463bc8c6c\") " pod="openshift-multus/multus-rsmqw" May 20 15:32:50.246176 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.246053 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2ce6e5d4-1424-43c2-9263-ab0463bc8c6c-host-run-netns\") pod \"multus-rsmqw\" (UID: \"2ce6e5d4-1424-43c2-9263-ab0463bc8c6c\") " pod="openshift-multus/multus-rsmqw" May 20 15:32:50.246176 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.246075 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d4425adc-866b-4a45-8857-4a90c111f6ff-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tzz5f\" (UID: \"d4425adc-866b-4a45-8857-4a90c111f6ff\") " pod="openshift-multus/multus-additional-cni-plugins-tzz5f" May 20 15:32:50.247055 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.246100 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hcbd\" (UniqueName: \"kubernetes.io/projected/30b04f89-de78-49cd-a9f5-45bb9f3be94b-kube-api-access-2hcbd\") pod \"aws-ebs-csi-driver-node-9wsrh\" (UID: \"30b04f89-de78-49cd-a9f5-45bb9f3be94b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wsrh" May 20 15:32:50.247055 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.246122 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4-run\") pod \"tuned-w226m\" (UID: \"81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4\") " pod="openshift-cluster-node-tuning-operator/tuned-w226m" May 20 15:32:50.247055 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.246136 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2ce6e5d4-1424-43c2-9263-ab0463bc8c6c-multus-cni-dir\") pod \"multus-rsmqw\" (UID: \"2ce6e5d4-1424-43c2-9263-ab0463bc8c6c\") " pod="openshift-multus/multus-rsmqw" May 20 15:32:50.247055 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.246153 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbs2p\" (UniqueName: \"kubernetes.io/projected/2ce6e5d4-1424-43c2-9263-ab0463bc8c6c-kube-api-access-rbs2p\") pod \"multus-rsmqw\" (UID: \"2ce6e5d4-1424-43c2-9263-ab0463bc8c6c\") " pod="openshift-multus/multus-rsmqw" May 20 15:32:50.247055 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.246186 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/30b04f89-de78-49cd-a9f5-45bb9f3be94b-sys-fs\") pod \"aws-ebs-csi-driver-node-9wsrh\" (UID: \"30b04f89-de78-49cd-a9f5-45bb9f3be94b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wsrh" May 20 15:32:50.247055 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.246636 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4-etc-modprobe-d\") pod \"tuned-w226m\" (UID: \"81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4\") " pod="openshift-cluster-node-tuning-operator/tuned-w226m" May 20 15:32:50.247055 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.246658 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3564822-b89c-4974-8c53-986c6b3fd1e7-tmp-dir\") pod \"node-resolver-r8sqr\" (UID: \"f3564822-b89c-4974-8c53-986c6b3fd1e7\") " pod="openshift-dns/node-resolver-r8sqr" May 20 15:32:50.247055 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.246673 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/30b04f89-de78-49cd-a9f5-45bb9f3be94b-registration-dir\") pod \"aws-ebs-csi-driver-node-9wsrh\" (UID: \"30b04f89-de78-49cd-a9f5-45bb9f3be94b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wsrh" May 20 15:32:50.247055 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.246689 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3965fa01-ac56-43aa-b92e-985a0e59fdc6-host\") pod \"node-ca-wmwps\" (UID: \"3965fa01-ac56-43aa-b92e-985a0e59fdc6\") " pod="openshift-image-registry/node-ca-wmwps" May 20 15:32:50.247055 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.246713 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4-etc-sysctl-d\") pod \"tuned-w226m\" (UID: \"81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4\") " pod="openshift-cluster-node-tuning-operator/tuned-w226m" May 20 15:32:50.247055 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.246727 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4-etc-tuned\") pod \"tuned-w226m\" (UID: \"81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4\") " pod="openshift-cluster-node-tuning-operator/tuned-w226m" May 20 15:32:50.247055 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.246740 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f3564822-b89c-4974-8c53-986c6b3fd1e7-hosts-file\") pod \"node-resolver-r8sqr\" (UID: \"f3564822-b89c-4974-8c53-986c6b3fd1e7\") " pod="openshift-dns/node-resolver-r8sqr" May 20 15:32:50.247055 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.246753 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4-etc-sysctl-conf\") pod \"tuned-w226m\" (UID: \"81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4\") " pod="openshift-cluster-node-tuning-operator/tuned-w226m" May 20 15:32:50.247055 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.246774 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4-host\") pod \"tuned-w226m\" (UID: \"81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4\") " pod="openshift-cluster-node-tuning-operator/tuned-w226m" May 20 15:32:50.247055 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.246827 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2ce6e5d4-1424-43c2-9263-ab0463bc8c6c-hostroot\") pod \"multus-rsmqw\" (UID: \"2ce6e5d4-1424-43c2-9263-ab0463bc8c6c\") " pod="openshift-multus/multus-rsmqw" May 20 15:32:50.247055 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.246871 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 20 15:32:50.247055 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.246870 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2ce6e5d4-1424-43c2-9263-ab0463bc8c6c-host-var-lib-cni-bin\") pod \"multus-rsmqw\" (UID: \"2ce6e5d4-1424-43c2-9263-ab0463bc8c6c\") " pod="openshift-multus/multus-rsmqw" May 20 15:32:50.247844 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.246927 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2ce6e5d4-1424-43c2-9263-ab0463bc8c6c-etc-kubernetes\") pod \"multus-rsmqw\" (UID: \"2ce6e5d4-1424-43c2-9263-ab0463bc8c6c\") " pod="openshift-multus/multus-rsmqw" May 20 15:32:50.247844 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.246959 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/30b04f89-de78-49cd-a9f5-45bb9f3be94b-device-dir\") pod \"aws-ebs-csi-driver-node-9wsrh\" (UID: \"30b04f89-de78-49cd-a9f5-45bb9f3be94b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wsrh" May 20 15:32:50.247844 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.246986 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 20 15:32:50.247844 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.247046 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-wkl88\"" May 20 15:32:50.247844 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.247047 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ft5ww\" (UniqueName: \"kubernetes.io/projected/ae4048cd-ad5b-4154-8b48-47363ccceda4-kube-api-access-ft5ww\") pod \"network-check-target-dv77n\" (UID: \"ae4048cd-ad5b-4154-8b48-47363ccceda4\") " pod="openshift-network-diagnostics/network-check-target-dv77n" May 20 15:32:50.247844 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.247099 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4-lib-modules\") pod \"tuned-w226m\" (UID: \"81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4\") " pod="openshift-cluster-node-tuning-operator/tuned-w226m" May 20 15:32:50.247844 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.247124 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3965fa01-ac56-43aa-b92e-985a0e59fdc6-serviceca\") pod \"node-ca-wmwps\" (UID: \"3965fa01-ac56-43aa-b92e-985a0e59fdc6\") " pod="openshift-image-registry/node-ca-wmwps" May 20 15:32:50.247844 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.247151 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bq9m\" (UniqueName: \"kubernetes.io/projected/81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4-kube-api-access-4bq9m\") pod \"tuned-w226m\" (UID: \"81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4\") " pod="openshift-cluster-node-tuning-operator/tuned-w226m" May 20 15:32:50.247844 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.247179 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2ce6e5d4-1424-43c2-9263-ab0463bc8c6c-system-cni-dir\") pod \"multus-rsmqw\" (UID: \"2ce6e5d4-1424-43c2-9263-ab0463bc8c6c\") " pod="openshift-multus/multus-rsmqw" May 20 15:32:50.247844 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.247212 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2ce6e5d4-1424-43c2-9263-ab0463bc8c6c-multus-socket-dir-parent\") pod \"multus-rsmqw\" (UID: \"2ce6e5d4-1424-43c2-9263-ab0463bc8c6c\") " pod="openshift-multus/multus-rsmqw" May 20 15:32:50.257959 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.257924 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-19 15:27:49 +0000 UTC" deadline="2027-10-21 12:45:46.489954638 +0000 UTC" May 20 15:32:50.257959 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.257957 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12453h12m56.232000166s" May 20 15:32:50.259674 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.259658 2557 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 20 15:32:50.260892 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:50.260870 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode78fe5c75454ec5097ce49d1da0faa03.slice/crio-6ce1801ea44a8d4e306ca4c61b2a2dbe1a661e82bd5d666d72003b96b3a2c0d3 WatchSource:0}: Error finding container 6ce1801ea44a8d4e306ca4c61b2a2dbe1a661e82bd5d666d72003b96b3a2c0d3: Status 404 returned error can't find the container with id 6ce1801ea44a8d4e306ca4c61b2a2dbe1a661e82bd5d666d72003b96b3a2c0d3 May 20 15:32:50.261898 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:50.261376 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42e4b468873bacee12c6d864090d2691.slice/crio-3749f49c468954a8160d8e34c058e641addd7c983c0aff9f008f909a17a76824 WatchSource:0}: Error finding container 3749f49c468954a8160d8e34c058e641addd7c983c0aff9f008f909a17a76824: Status 404 returned error can't find the container with id 3749f49c468954a8160d8e34c058e641addd7c983c0aff9f008f909a17a76824 May 20 15:32:50.265751 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.265736 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 20 15:32:50.282042 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.282026 2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-4zs7l" May 20 15:32:50.291610 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.291594 2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-4zs7l" May 20 15:32:50.342492 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.342470 2557 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 20 15:32:50.348326 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.348309 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2ce6e5d4-1424-43c2-9263-ab0463bc8c6c-host-var-lib-cni-multus\") pod \"multus-rsmqw\" (UID: \"2ce6e5d4-1424-43c2-9263-ab0463bc8c6c\") " pod="openshift-multus/multus-rsmqw" May 20 15:32:50.348424 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.348333 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2ce6e5d4-1424-43c2-9263-ab0463bc8c6c-host-run-multus-certs\") pod \"multus-rsmqw\" (UID: \"2ce6e5d4-1424-43c2-9263-ab0463bc8c6c\") " pod="openshift-multus/multus-rsmqw" May 20 15:32:50.348424 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.348364 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/271da0d2-8828-4630-8143-39ef6964f7f4-host-kubelet\") pod \"ovnkube-node-gvwgm\" (UID: \"271da0d2-8828-4630-8143-39ef6964f7f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvwgm" May 20 15:32:50.348424 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.348373 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2ce6e5d4-1424-43c2-9263-ab0463bc8c6c-host-var-lib-cni-multus\") pod \"multus-rsmqw\" (UID: \"2ce6e5d4-1424-43c2-9263-ab0463bc8c6c\") " pod="openshift-multus/multus-rsmqw" May 20 15:32:50.348424 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.348382 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/271da0d2-8828-4630-8143-39ef6964f7f4-etc-openvswitch\") pod \"ovnkube-node-gvwgm\" (UID: \"271da0d2-8828-4630-8143-39ef6964f7f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvwgm" May 20 15:32:50.348626 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.348417 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2ce6e5d4-1424-43c2-9263-ab0463bc8c6c-host-run-multus-certs\") pod \"multus-rsmqw\" (UID: \"2ce6e5d4-1424-43c2-9263-ab0463bc8c6c\") " pod="openshift-multus/multus-rsmqw" May 20 15:32:50.348626 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.348425 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4-etc-sysconfig\") pod \"tuned-w226m\" (UID: \"81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4\") " pod="openshift-cluster-node-tuning-operator/tuned-w226m" May 20 15:32:50.348626 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.348453 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2ce6e5d4-1424-43c2-9263-ab0463bc8c6c-host-var-lib-kubelet\") pod \"multus-rsmqw\" (UID: \"2ce6e5d4-1424-43c2-9263-ab0463bc8c6c\") " pod="openshift-multus/multus-rsmqw" May 20 15:32:50.348626 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.348479 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r7g8k\" (UniqueName: \"kubernetes.io/projected/f3564822-b89c-4974-8c53-986c6b3fd1e7-kube-api-access-r7g8k\") pod \"node-resolver-r8sqr\" (UID: \"f3564822-b89c-4974-8c53-986c6b3fd1e7\") " pod="openshift-dns/node-resolver-r8sqr" May 20 15:32:50.348626 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.348507 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/271da0d2-8828-4630-8143-39ef6964f7f4-node-log\") pod \"ovnkube-node-gvwgm\" (UID: \"271da0d2-8828-4630-8143-39ef6964f7f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvwgm" May 20 15:32:50.348626 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.348513 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2ce6e5d4-1424-43c2-9263-ab0463bc8c6c-host-var-lib-kubelet\") pod \"multus-rsmqw\" (UID: \"2ce6e5d4-1424-43c2-9263-ab0463bc8c6c\") " pod="openshift-multus/multus-rsmqw" May 20 15:32:50.348626 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.348523 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4-etc-sysconfig\") pod \"tuned-w226m\" (UID: \"81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4\") " pod="openshift-cluster-node-tuning-operator/tuned-w226m" May 20 15:32:50.348626 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.348547 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/271da0d2-8828-4630-8143-39ef6964f7f4-log-socket\") pod \"ovnkube-node-gvwgm\" (UID: \"271da0d2-8828-4630-8143-39ef6964f7f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvwgm" May 20 15:32:50.348626 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.348576 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/271da0d2-8828-4630-8143-39ef6964f7f4-ovn-node-metrics-cert\") pod \"ovnkube-node-gvwgm\" (UID: \"271da0d2-8828-4630-8143-39ef6964f7f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvwgm" May 20 15:32:50.348626 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.348603 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54872a9c-6091-4768-8cd9-e81ab987ba01-metrics-certs\") pod \"network-metrics-daemon-wszj2\" (UID: \"54872a9c-6091-4768-8cd9-e81ab987ba01\") " pod="openshift-multus/network-metrics-daemon-wszj2" May 20 15:32:50.348626 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.348628 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4-tmp\") pod \"tuned-w226m\" (UID: \"81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4\") " pod="openshift-cluster-node-tuning-operator/tuned-w226m" May 20 15:32:50.349137 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.348655 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2ce6e5d4-1424-43c2-9263-ab0463bc8c6c-cnibin\") pod \"multus-rsmqw\" (UID: \"2ce6e5d4-1424-43c2-9263-ab0463bc8c6c\") " pod="openshift-multus/multus-rsmqw" May 20 15:32:50.349137 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.348682 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2ce6e5d4-1424-43c2-9263-ab0463bc8c6c-host-run-netns\") pod \"multus-rsmqw\" (UID: \"2ce6e5d4-1424-43c2-9263-ab0463bc8c6c\") " pod="openshift-multus/multus-rsmqw" May 20 15:32:50.349137 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:32:50.348706 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 20 15:32:50.349137 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.348707 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d4425adc-866b-4a45-8857-4a90c111f6ff-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tzz5f\" (UID: \"d4425adc-866b-4a45-8857-4a90c111f6ff\") " pod="openshift-multus/multus-additional-cni-plugins-tzz5f" May 20 15:32:50.349137 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.348765 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2ce6e5d4-1424-43c2-9263-ab0463bc8c6c-host-run-netns\") pod \"multus-rsmqw\" (UID: \"2ce6e5d4-1424-43c2-9263-ab0463bc8c6c\") " pod="openshift-multus/multus-rsmqw" May 20 15:32:50.349137 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.348784 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2ce6e5d4-1424-43c2-9263-ab0463bc8c6c-cnibin\") pod \"multus-rsmqw\" (UID: \"2ce6e5d4-1424-43c2-9263-ab0463bc8c6c\") " pod="openshift-multus/multus-rsmqw" May 20 15:32:50.349137 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:32:50.348801 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54872a9c-6091-4768-8cd9-e81ab987ba01-metrics-certs podName:54872a9c-6091-4768-8cd9-e81ab987ba01 nodeName:}" failed. No retries permitted until 2026-05-20 15:32:50.848748738 +0000 UTC m=+2.063671512 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/54872a9c-6091-4768-8cd9-e81ab987ba01-metrics-certs") pod "network-metrics-daemon-wszj2" (UID: "54872a9c-6091-4768-8cd9-e81ab987ba01") : object "openshift-multus"/"metrics-daemon-secret" not registered May 20 15:32:50.349137 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.348852 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2hcbd\" (UniqueName: \"kubernetes.io/projected/30b04f89-de78-49cd-a9f5-45bb9f3be94b-kube-api-access-2hcbd\") pod \"aws-ebs-csi-driver-node-9wsrh\" (UID: \"30b04f89-de78-49cd-a9f5-45bb9f3be94b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wsrh" May 20 15:32:50.349137 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.348881 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/271da0d2-8828-4630-8143-39ef6964f7f4-host-cni-netd\") pod \"ovnkube-node-gvwgm\" (UID: \"271da0d2-8828-4630-8143-39ef6964f7f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvwgm" May 20 15:32:50.349137 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.348907 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a8e3f0da-9b88-4b25-9836-21def71adfe1-konnectivity-ca\") pod \"konnectivity-agent-r9qzn\" (UID: \"a8e3f0da-9b88-4b25-9836-21def71adfe1\") " pod="kube-system/konnectivity-agent-r9qzn" May 20 15:32:50.349137 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.348934 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4-run\") pod \"tuned-w226m\" (UID: \"81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4\") " pod="openshift-cluster-node-tuning-operator/tuned-w226m" May 20 15:32:50.349137 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.348962 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2ce6e5d4-1424-43c2-9263-ab0463bc8c6c-multus-cni-dir\") pod \"multus-rsmqw\" (UID: \"2ce6e5d4-1424-43c2-9263-ab0463bc8c6c\") " pod="openshift-multus/multus-rsmqw" May 20 15:32:50.349137 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.348980 2557 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 20 15:32:50.349137 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.348988 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rbs2p\" (UniqueName: \"kubernetes.io/projected/2ce6e5d4-1424-43c2-9263-ab0463bc8c6c-kube-api-access-rbs2p\") pod \"multus-rsmqw\" (UID: \"2ce6e5d4-1424-43c2-9263-ab0463bc8c6c\") " pod="openshift-multus/multus-rsmqw" May 20 15:32:50.349137 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.349055 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/30b04f89-de78-49cd-a9f5-45bb9f3be94b-sys-fs\") pod \"aws-ebs-csi-driver-node-9wsrh\" (UID: \"30b04f89-de78-49cd-a9f5-45bb9f3be94b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wsrh" May 20 15:32:50.349137 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.349075 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4-etc-modprobe-d\") pod \"tuned-w226m\" (UID: \"81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4\") " pod="openshift-cluster-node-tuning-operator/tuned-w226m" May 20 15:32:50.349137 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.349094 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3564822-b89c-4974-8c53-986c6b3fd1e7-tmp-dir\") pod \"node-resolver-r8sqr\" (UID: \"f3564822-b89c-4974-8c53-986c6b3fd1e7\") " pod="openshift-dns/node-resolver-r8sqr" May 20 15:32:50.349870 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.349133 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/30b04f89-de78-49cd-a9f5-45bb9f3be94b-registration-dir\") pod \"aws-ebs-csi-driver-node-9wsrh\" (UID: \"30b04f89-de78-49cd-a9f5-45bb9f3be94b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wsrh" May 20 15:32:50.349870 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.349135 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2ce6e5d4-1424-43c2-9263-ab0463bc8c6c-multus-cni-dir\") pod \"multus-rsmqw\" (UID: \"2ce6e5d4-1424-43c2-9263-ab0463bc8c6c\") " pod="openshift-multus/multus-rsmqw" May 20 15:32:50.349870 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.349159 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3965fa01-ac56-43aa-b92e-985a0e59fdc6-host\") pod \"node-ca-wmwps\" (UID: \"3965fa01-ac56-43aa-b92e-985a0e59fdc6\") " pod="openshift-image-registry/node-ca-wmwps" May 20 15:32:50.349870 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.349183 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4-run\") pod \"tuned-w226m\" (UID: \"81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4\") " pod="openshift-cluster-node-tuning-operator/tuned-w226m" May 20 15:32:50.349870 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.349224 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/30b04f89-de78-49cd-a9f5-45bb9f3be94b-sys-fs\") pod \"aws-ebs-csi-driver-node-9wsrh\" (UID: \"30b04f89-de78-49cd-a9f5-45bb9f3be94b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wsrh" May 20 15:32:50.349870 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.349255 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d4425adc-866b-4a45-8857-4a90c111f6ff-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tzz5f\" (UID: \"d4425adc-866b-4a45-8857-4a90c111f6ff\") " pod="openshift-multus/multus-additional-cni-plugins-tzz5f" May 20 15:32:50.349870 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.349318 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/30b04f89-de78-49cd-a9f5-45bb9f3be94b-registration-dir\") pod \"aws-ebs-csi-driver-node-9wsrh\" (UID: \"30b04f89-de78-49cd-a9f5-45bb9f3be94b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wsrh" May 20 15:32:50.349870 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.349352 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3965fa01-ac56-43aa-b92e-985a0e59fdc6-host\") pod \"node-ca-wmwps\" (UID: \"3965fa01-ac56-43aa-b92e-985a0e59fdc6\") " pod="openshift-image-registry/node-ca-wmwps" May 20 15:32:50.349870 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.349363 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4-etc-modprobe-d\") pod \"tuned-w226m\" (UID: \"81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4\") " pod="openshift-cluster-node-tuning-operator/tuned-w226m" May 20 15:32:50.349870 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.349375 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4-etc-sysctl-d\") pod \"tuned-w226m\" (UID: \"81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4\") " pod="openshift-cluster-node-tuning-operator/tuned-w226m" May 20 15:32:50.349870 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.349416 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4-etc-tuned\") pod \"tuned-w226m\" (UID: \"81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4\") " pod="openshift-cluster-node-tuning-operator/tuned-w226m" May 20 15:32:50.349870 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.349444 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f3564822-b89c-4974-8c53-986c6b3fd1e7-hosts-file\") pod \"node-resolver-r8sqr\" (UID: \"f3564822-b89c-4974-8c53-986c6b3fd1e7\") " pod="openshift-dns/node-resolver-r8sqr" May 20 15:32:50.349870 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.349451 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4-etc-sysctl-d\") pod \"tuned-w226m\" (UID: \"81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4\") " pod="openshift-cluster-node-tuning-operator/tuned-w226m" May 20 15:32:50.349870 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.349468 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/271da0d2-8828-4630-8143-39ef6964f7f4-host-cni-bin\") pod \"ovnkube-node-gvwgm\" (UID: \"271da0d2-8828-4630-8143-39ef6964f7f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvwgm" May 20 15:32:50.349870 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.349492 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f3564822-b89c-4974-8c53-986c6b3fd1e7-hosts-file\") pod \"node-resolver-r8sqr\" (UID: \"f3564822-b89c-4974-8c53-986c6b3fd1e7\") " pod="openshift-dns/node-resolver-r8sqr" May 20 15:32:50.349870 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.349504 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4-etc-sysctl-conf\") pod \"tuned-w226m\" (UID: \"81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4\") " pod="openshift-cluster-node-tuning-operator/tuned-w226m" May 20 15:32:50.349870 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.349530 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4-host\") pod \"tuned-w226m\" (UID: \"81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4\") " pod="openshift-cluster-node-tuning-operator/tuned-w226m" May 20 15:32:50.349870 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.349551 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2ce6e5d4-1424-43c2-9263-ab0463bc8c6c-hostroot\") pod \"multus-rsmqw\" (UID: \"2ce6e5d4-1424-43c2-9263-ab0463bc8c6c\") " pod="openshift-multus/multus-rsmqw" May 20 15:32:50.350739 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.349574 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2ce6e5d4-1424-43c2-9263-ab0463bc8c6c-host-var-lib-cni-bin\") pod \"multus-rsmqw\" (UID: \"2ce6e5d4-1424-43c2-9263-ab0463bc8c6c\") " pod="openshift-multus/multus-rsmqw" May 20 15:32:50.350739 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.349586 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3564822-b89c-4974-8c53-986c6b3fd1e7-tmp-dir\") pod \"node-resolver-r8sqr\" (UID: \"f3564822-b89c-4974-8c53-986c6b3fd1e7\") " pod="openshift-dns/node-resolver-r8sqr" May 20 15:32:50.350739 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.349603 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2ce6e5d4-1424-43c2-9263-ab0463bc8c6c-etc-kubernetes\") pod \"multus-rsmqw\" (UID: \"2ce6e5d4-1424-43c2-9263-ab0463bc8c6c\") " pod="openshift-multus/multus-rsmqw" May 20 15:32:50.350739 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.349607 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2ce6e5d4-1424-43c2-9263-ab0463bc8c6c-hostroot\") pod \"multus-rsmqw\" (UID: \"2ce6e5d4-1424-43c2-9263-ab0463bc8c6c\") " pod="openshift-multus/multus-rsmqw" May 20 15:32:50.350739 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.349625 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4-etc-sysctl-conf\") pod \"tuned-w226m\" (UID: \"81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4\") " pod="openshift-cluster-node-tuning-operator/tuned-w226m" May 20 15:32:50.350739 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.349632 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/30b04f89-de78-49cd-a9f5-45bb9f3be94b-device-dir\") pod \"aws-ebs-csi-driver-node-9wsrh\" (UID: \"30b04f89-de78-49cd-a9f5-45bb9f3be94b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wsrh" May 20 15:32:50.350739 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.349649 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4-host\") pod \"tuned-w226m\" (UID: \"81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4\") " pod="openshift-cluster-node-tuning-operator/tuned-w226m" May 20 15:32:50.350739 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.349650 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2ce6e5d4-1424-43c2-9263-ab0463bc8c6c-host-var-lib-cni-bin\") pod \"multus-rsmqw\" (UID: \"2ce6e5d4-1424-43c2-9263-ab0463bc8c6c\") " pod="openshift-multus/multus-rsmqw" May 20 15:32:50.350739 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.349661 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ft5ww\" (UniqueName: \"kubernetes.io/projected/ae4048cd-ad5b-4154-8b48-47363ccceda4-kube-api-access-ft5ww\") pod \"network-check-target-dv77n\" (UID: \"ae4048cd-ad5b-4154-8b48-47363ccceda4\") " pod="openshift-network-diagnostics/network-check-target-dv77n" May 20 15:32:50.350739 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.349674 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2ce6e5d4-1424-43c2-9263-ab0463bc8c6c-etc-kubernetes\") pod \"multus-rsmqw\" (UID: \"2ce6e5d4-1424-43c2-9263-ab0463bc8c6c\") " pod="openshift-multus/multus-rsmqw" May 20 15:32:50.350739 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.349687 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/30b04f89-de78-49cd-a9f5-45bb9f3be94b-device-dir\") pod \"aws-ebs-csi-driver-node-9wsrh\" (UID: \"30b04f89-de78-49cd-a9f5-45bb9f3be94b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wsrh" May 20 15:32:50.350739 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.349695 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4-lib-modules\") pod \"tuned-w226m\" (UID: \"81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4\") " pod="openshift-cluster-node-tuning-operator/tuned-w226m" May 20 15:32:50.350739 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.349735 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3965fa01-ac56-43aa-b92e-985a0e59fdc6-serviceca\") pod \"node-ca-wmwps\" (UID: \"3965fa01-ac56-43aa-b92e-985a0e59fdc6\") " pod="openshift-image-registry/node-ca-wmwps" May 20 15:32:50.350739 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.349777 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4bq9m\" (UniqueName: \"kubernetes.io/projected/81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4-kube-api-access-4bq9m\") pod \"tuned-w226m\" (UID: \"81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4\") " pod="openshift-cluster-node-tuning-operator/tuned-w226m" May 20 15:32:50.350739 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.349799 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2ce6e5d4-1424-43c2-9263-ab0463bc8c6c-system-cni-dir\") pod \"multus-rsmqw\" (UID: \"2ce6e5d4-1424-43c2-9263-ab0463bc8c6c\") " pod="openshift-multus/multus-rsmqw" May 20 15:32:50.350739 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.349839 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2ce6e5d4-1424-43c2-9263-ab0463bc8c6c-multus-socket-dir-parent\") pod \"multus-rsmqw\" (UID: \"2ce6e5d4-1424-43c2-9263-ab0463bc8c6c\") " pod="openshift-multus/multus-rsmqw" May 20 15:32:50.350739 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.349855 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4-lib-modules\") pod \"tuned-w226m\" (UID: \"81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4\") " pod="openshift-cluster-node-tuning-operator/tuned-w226m" May 20 15:32:50.350739 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.349866 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d4425adc-866b-4a45-8857-4a90c111f6ff-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tzz5f\" (UID: \"d4425adc-866b-4a45-8857-4a90c111f6ff\") " pod="openshift-multus/multus-additional-cni-plugins-tzz5f" May 20 15:32:50.351447 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.349927 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4-etc-kubernetes\") pod \"tuned-w226m\" (UID: \"81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4\") " pod="openshift-cluster-node-tuning-operator/tuned-w226m" May 20 15:32:50.351447 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.349939 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2ce6e5d4-1424-43c2-9263-ab0463bc8c6c-system-cni-dir\") pod \"multus-rsmqw\" (UID: \"2ce6e5d4-1424-43c2-9263-ab0463bc8c6c\") " pod="openshift-multus/multus-rsmqw" May 20 15:32:50.351447 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.349952 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2ce6e5d4-1424-43c2-9263-ab0463bc8c6c-multus-daemon-config\") pod \"multus-rsmqw\" (UID: \"2ce6e5d4-1424-43c2-9263-ab0463bc8c6c\") " pod="openshift-multus/multus-rsmqw" May 20 15:32:50.351447 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.349986 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zppfc\" (UniqueName: \"kubernetes.io/projected/7b177a52-2efa-4ece-ae5a-52b2386682dd-kube-api-access-zppfc\") pod \"iptables-alerter-zfwc4\" (UID: \"7b177a52-2efa-4ece-ae5a-52b2386682dd\") " pod="openshift-network-operator/iptables-alerter-zfwc4" May 20 15:32:50.351447 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.350012 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ckpjq\" (UniqueName: \"kubernetes.io/projected/d4425adc-866b-4a45-8857-4a90c111f6ff-kube-api-access-ckpjq\") pod \"multus-additional-cni-plugins-tzz5f\" (UID: \"d4425adc-866b-4a45-8857-4a90c111f6ff\") " pod="openshift-multus/multus-additional-cni-plugins-tzz5f" May 20 15:32:50.351447 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.350019 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2ce6e5d4-1424-43c2-9263-ab0463bc8c6c-multus-socket-dir-parent\") pod \"multus-rsmqw\" (UID: \"2ce6e5d4-1424-43c2-9263-ab0463bc8c6c\") " pod="openshift-multus/multus-rsmqw" May 20 15:32:50.351447 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.350041 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/271da0d2-8828-4630-8143-39ef6964f7f4-systemd-units\") pod \"ovnkube-node-gvwgm\" (UID: \"271da0d2-8828-4630-8143-39ef6964f7f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvwgm" May 20 15:32:50.351447 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.350096 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/271da0d2-8828-4630-8143-39ef6964f7f4-run-ovn\") pod \"ovnkube-node-gvwgm\" (UID: \"271da0d2-8828-4630-8143-39ef6964f7f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvwgm" May 20 15:32:50.351447 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.350122 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a8e3f0da-9b88-4b25-9836-21def71adfe1-agent-certs\") pod \"konnectivity-agent-r9qzn\" (UID: \"a8e3f0da-9b88-4b25-9836-21def71adfe1\") " pod="kube-system/konnectivity-agent-r9qzn" May 20 15:32:50.351447 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.350150 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vfxsq\" (UniqueName: \"kubernetes.io/projected/54872a9c-6091-4768-8cd9-e81ab987ba01-kube-api-access-vfxsq\") pod \"network-metrics-daemon-wszj2\" (UID: \"54872a9c-6091-4768-8cd9-e81ab987ba01\") " pod="openshift-multus/network-metrics-daemon-wszj2" May 20 15:32:50.351447 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.350177 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7b177a52-2efa-4ece-ae5a-52b2386682dd-iptables-alerter-script\") pod \"iptables-alerter-zfwc4\" (UID: \"7b177a52-2efa-4ece-ae5a-52b2386682dd\") " pod="openshift-network-operator/iptables-alerter-zfwc4" May 20 15:32:50.351447 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.350203 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d4425adc-866b-4a45-8857-4a90c111f6ff-system-cni-dir\") pod \"multus-additional-cni-plugins-tzz5f\" (UID: \"d4425adc-866b-4a45-8857-4a90c111f6ff\") " pod="openshift-multus/multus-additional-cni-plugins-tzz5f" May 20 15:32:50.351447 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.350238 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d4425adc-866b-4a45-8857-4a90c111f6ff-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tzz5f\" (UID: \"d4425adc-866b-4a45-8857-4a90c111f6ff\") " pod="openshift-multus/multus-additional-cni-plugins-tzz5f" May 20 15:32:50.351447 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.350234 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/271da0d2-8828-4630-8143-39ef6964f7f4-host-run-ovn-kubernetes\") pod \"ovnkube-node-gvwgm\" (UID: \"271da0d2-8828-4630-8143-39ef6964f7f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvwgm" May 20 15:32:50.351447 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.350293 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/271da0d2-8828-4630-8143-39ef6964f7f4-ovnkube-config\") pod \"ovnkube-node-gvwgm\" (UID: \"271da0d2-8828-4630-8143-39ef6964f7f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvwgm" May 20 15:32:50.351447 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.350316 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/271da0d2-8828-4630-8143-39ef6964f7f4-env-overrides\") pod \"ovnkube-node-gvwgm\" (UID: \"271da0d2-8828-4630-8143-39ef6964f7f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvwgm" May 20 15:32:50.351447 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.350340 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2ce6e5d4-1424-43c2-9263-ab0463bc8c6c-os-release\") pod \"multus-rsmqw\" (UID: \"2ce6e5d4-1424-43c2-9263-ab0463bc8c6c\") " pod="openshift-multus/multus-rsmqw" May 20 15:32:50.351928 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.350342 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4-etc-kubernetes\") pod \"tuned-w226m\" (UID: \"81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4\") " pod="openshift-cluster-node-tuning-operator/tuned-w226m" May 20 15:32:50.351928 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.350383 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2ce6e5d4-1424-43c2-9263-ab0463bc8c6c-multus-conf-dir\") pod \"multus-rsmqw\" (UID: \"2ce6e5d4-1424-43c2-9263-ab0463bc8c6c\") " pod="openshift-multus/multus-rsmqw" May 20 15:32:50.351928 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.350397 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2ce6e5d4-1424-43c2-9263-ab0463bc8c6c-os-release\") pod \"multus-rsmqw\" (UID: \"2ce6e5d4-1424-43c2-9263-ab0463bc8c6c\") " pod="openshift-multus/multus-rsmqw" May 20 15:32:50.351928 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.350411 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3965fa01-ac56-43aa-b92e-985a0e59fdc6-serviceca\") pod \"node-ca-wmwps\" (UID: \"3965fa01-ac56-43aa-b92e-985a0e59fdc6\") " pod="openshift-image-registry/node-ca-wmwps" May 20 15:32:50.351928 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.350413 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/30b04f89-de78-49cd-a9f5-45bb9f3be94b-socket-dir\") pod \"aws-ebs-csi-driver-node-9wsrh\" (UID: \"30b04f89-de78-49cd-a9f5-45bb9f3be94b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wsrh" May 20 15:32:50.351928 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.350468 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/271da0d2-8828-4630-8143-39ef6964f7f4-host-run-netns\") pod \"ovnkube-node-gvwgm\" (UID: \"271da0d2-8828-4630-8143-39ef6964f7f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvwgm" May 20 15:32:50.351928 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.350493 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/271da0d2-8828-4630-8143-39ef6964f7f4-var-lib-openvswitch\") pod \"ovnkube-node-gvwgm\" (UID: \"271da0d2-8828-4630-8143-39ef6964f7f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvwgm" May 20 15:32:50.351928 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.350521 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/271da0d2-8828-4630-8143-39ef6964f7f4-run-openvswitch\") pod \"ovnkube-node-gvwgm\" (UID: \"271da0d2-8828-4630-8143-39ef6964f7f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvwgm" May 20 15:32:50.351928 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.350544 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/30b04f89-de78-49cd-a9f5-45bb9f3be94b-socket-dir\") pod \"aws-ebs-csi-driver-node-9wsrh\" (UID: \"30b04f89-de78-49cd-a9f5-45bb9f3be94b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wsrh" May 20 15:32:50.351928 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.350545 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/271da0d2-8828-4630-8143-39ef6964f7f4-ovnkube-script-lib\") pod \"ovnkube-node-gvwgm\" (UID: \"271da0d2-8828-4630-8143-39ef6964f7f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvwgm" May 20 15:32:50.351928 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.350589 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kqvj\" (UniqueName: \"kubernetes.io/projected/271da0d2-8828-4630-8143-39ef6964f7f4-kube-api-access-8kqvj\") pod \"ovnkube-node-gvwgm\" (UID: \"271da0d2-8828-4630-8143-39ef6964f7f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvwgm" May 20 15:32:50.351928 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.350597 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2ce6e5d4-1424-43c2-9263-ab0463bc8c6c-multus-conf-dir\") pod \"multus-rsmqw\" (UID: \"2ce6e5d4-1424-43c2-9263-ab0463bc8c6c\") " pod="openshift-multus/multus-rsmqw" May 20 15:32:50.351928 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.350617 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7b177a52-2efa-4ece-ae5a-52b2386682dd-host-slash\") pod \"iptables-alerter-zfwc4\" (UID: \"7b177a52-2efa-4ece-ae5a-52b2386682dd\") " pod="openshift-network-operator/iptables-alerter-zfwc4" May 20 15:32:50.351928 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.350645 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d4425adc-866b-4a45-8857-4a90c111f6ff-os-release\") pod \"multus-additional-cni-plugins-tzz5f\" (UID: \"d4425adc-866b-4a45-8857-4a90c111f6ff\") " pod="openshift-multus/multus-additional-cni-plugins-tzz5f" May 20 15:32:50.351928 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.350672 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/271da0d2-8828-4630-8143-39ef6964f7f4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gvwgm\" (UID: \"271da0d2-8828-4630-8143-39ef6964f7f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvwgm" May 20 15:32:50.351928 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.350692 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7b177a52-2efa-4ece-ae5a-52b2386682dd-host-slash\") pod \"iptables-alerter-zfwc4\" (UID: \"7b177a52-2efa-4ece-ae5a-52b2386682dd\") " pod="openshift-network-operator/iptables-alerter-zfwc4" May 20 15:32:50.351928 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.350703 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d4425adc-866b-4a45-8857-4a90c111f6ff-cni-binary-copy\") pod \"multus-additional-cni-plugins-tzz5f\" (UID: \"d4425adc-866b-4a45-8857-4a90c111f6ff\") " pod="openshift-multus/multus-additional-cni-plugins-tzz5f" May 20 15:32:50.352373 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.350737 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/30b04f89-de78-49cd-a9f5-45bb9f3be94b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9wsrh\" (UID: \"30b04f89-de78-49cd-a9f5-45bb9f3be94b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wsrh" May 20 15:32:50.352373 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.350730 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d4425adc-866b-4a45-8857-4a90c111f6ff-os-release\") pod \"multus-additional-cni-plugins-tzz5f\" (UID: \"d4425adc-866b-4a45-8857-4a90c111f6ff\") " pod="openshift-multus/multus-additional-cni-plugins-tzz5f" May 20 15:32:50.352373 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.350675 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d4425adc-866b-4a45-8857-4a90c111f6ff-system-cni-dir\") pod \"multus-additional-cni-plugins-tzz5f\" (UID: \"d4425adc-866b-4a45-8857-4a90c111f6ff\") " pod="openshift-multus/multus-additional-cni-plugins-tzz5f" May 20 15:32:50.352373 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.350786 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/30b04f89-de78-49cd-a9f5-45bb9f3be94b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9wsrh\" (UID: \"30b04f89-de78-49cd-a9f5-45bb9f3be94b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wsrh" May 20 15:32:50.352373 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.350828 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/30b04f89-de78-49cd-a9f5-45bb9f3be94b-etc-selinux\") pod \"aws-ebs-csi-driver-node-9wsrh\" (UID: \"30b04f89-de78-49cd-a9f5-45bb9f3be94b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wsrh" May 20 15:32:50.352373 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.350886 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/271da0d2-8828-4630-8143-39ef6964f7f4-host-slash\") pod \"ovnkube-node-gvwgm\" (UID: \"271da0d2-8828-4630-8143-39ef6964f7f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvwgm" May 20 15:32:50.352373 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.350921 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/271da0d2-8828-4630-8143-39ef6964f7f4-run-systemd\") pod \"ovnkube-node-gvwgm\" (UID: \"271da0d2-8828-4630-8143-39ef6964f7f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvwgm" May 20 15:32:50.352373 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.350948 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6v2d9\" (UniqueName: \"kubernetes.io/projected/3965fa01-ac56-43aa-b92e-985a0e59fdc6-kube-api-access-6v2d9\") pod \"node-ca-wmwps\" (UID: \"3965fa01-ac56-43aa-b92e-985a0e59fdc6\") " pod="openshift-image-registry/node-ca-wmwps" May 20 15:32:50.352373 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.350961 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/30b04f89-de78-49cd-a9f5-45bb9f3be94b-etc-selinux\") pod \"aws-ebs-csi-driver-node-9wsrh\" (UID: \"30b04f89-de78-49cd-a9f5-45bb9f3be94b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wsrh" May 20 15:32:50.352373 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.350974 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2ce6e5d4-1424-43c2-9263-ab0463bc8c6c-host-run-k8s-cni-cncf-io\") pod \"multus-rsmqw\" (UID: \"2ce6e5d4-1424-43c2-9263-ab0463bc8c6c\") " pod="openshift-multus/multus-rsmqw" May 20 15:32:50.352373 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.350991 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7b177a52-2efa-4ece-ae5a-52b2386682dd-iptables-alerter-script\") pod \"iptables-alerter-zfwc4\" (UID: \"7b177a52-2efa-4ece-ae5a-52b2386682dd\") " pod="openshift-network-operator/iptables-alerter-zfwc4" May 20 15:32:50.352373 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.351000 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d4425adc-866b-4a45-8857-4a90c111f6ff-cnibin\") pod \"multus-additional-cni-plugins-tzz5f\" (UID: \"d4425adc-866b-4a45-8857-4a90c111f6ff\") " pod="openshift-multus/multus-additional-cni-plugins-tzz5f" May 20 15:32:50.352373 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.351022 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2ce6e5d4-1424-43c2-9263-ab0463bc8c6c-host-run-k8s-cni-cncf-io\") pod \"multus-rsmqw\" (UID: \"2ce6e5d4-1424-43c2-9263-ab0463bc8c6c\") " pod="openshift-multus/multus-rsmqw" May 20 15:32:50.352373 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.351026 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d4425adc-866b-4a45-8857-4a90c111f6ff-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tzz5f\" (UID: \"d4425adc-866b-4a45-8857-4a90c111f6ff\") " pod="openshift-multus/multus-additional-cni-plugins-tzz5f" May 20 15:32:50.352373 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.351054 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d4425adc-866b-4a45-8857-4a90c111f6ff-cnibin\") pod \"multus-additional-cni-plugins-tzz5f\" (UID: \"d4425adc-866b-4a45-8857-4a90c111f6ff\") " pod="openshift-multus/multus-additional-cni-plugins-tzz5f" May 20 15:32:50.352373 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.351052 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4-etc-systemd\") pod \"tuned-w226m\" (UID: \"81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4\") " pod="openshift-cluster-node-tuning-operator/tuned-w226m" May 20 15:32:50.352373 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.351097 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4-sys\") pod \"tuned-w226m\" (UID: \"81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4\") " pod="openshift-cluster-node-tuning-operator/tuned-w226m" May 20 15:32:50.352831 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.351099 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2ce6e5d4-1424-43c2-9263-ab0463bc8c6c-multus-daemon-config\") pod \"multus-rsmqw\" (UID: \"2ce6e5d4-1424-43c2-9263-ab0463bc8c6c\") " pod="openshift-multus/multus-rsmqw" May 20 15:32:50.352831 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.351121 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4-etc-systemd\") pod \"tuned-w226m\" (UID: \"81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4\") " pod="openshift-cluster-node-tuning-operator/tuned-w226m" May 20 15:32:50.352831 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.351148 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4-var-lib-kubelet\") pod \"tuned-w226m\" (UID: \"81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4\") " pod="openshift-cluster-node-tuning-operator/tuned-w226m" May 20 15:32:50.352831 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.351174 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4-sys\") pod \"tuned-w226m\" (UID: \"81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4\") " pod="openshift-cluster-node-tuning-operator/tuned-w226m" May 20 15:32:50.352831 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.351183 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2ce6e5d4-1424-43c2-9263-ab0463bc8c6c-cni-binary-copy\") pod \"multus-rsmqw\" (UID: \"2ce6e5d4-1424-43c2-9263-ab0463bc8c6c\") " pod="openshift-multus/multus-rsmqw" May 20 15:32:50.352831 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.351249 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4-var-lib-kubelet\") pod \"tuned-w226m\" (UID: \"81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4\") " pod="openshift-cluster-node-tuning-operator/tuned-w226m" May 20 15:32:50.352831 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.351515 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d4425adc-866b-4a45-8857-4a90c111f6ff-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tzz5f\" (UID: \"d4425adc-866b-4a45-8857-4a90c111f6ff\") " pod="openshift-multus/multus-additional-cni-plugins-tzz5f" May 20 15:32:50.352831 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.351603 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2ce6e5d4-1424-43c2-9263-ab0463bc8c6c-cni-binary-copy\") pod \"multus-rsmqw\" (UID: \"2ce6e5d4-1424-43c2-9263-ab0463bc8c6c\") " pod="openshift-multus/multus-rsmqw" May 20 15:32:50.352831 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.351654 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d4425adc-866b-4a45-8857-4a90c111f6ff-cni-binary-copy\") pod \"multus-additional-cni-plugins-tzz5f\" (UID: \"d4425adc-866b-4a45-8857-4a90c111f6ff\") " pod="openshift-multus/multus-additional-cni-plugins-tzz5f" May 20 15:32:50.352831 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.352456 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4-etc-tuned\") pod \"tuned-w226m\" (UID: \"81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4\") " pod="openshift-cluster-node-tuning-operator/tuned-w226m" May 20 15:32:50.352831 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.352528 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4-tmp\") pod \"tuned-w226m\" (UID: \"81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4\") " pod="openshift-cluster-node-tuning-operator/tuned-w226m" May 20 15:32:50.357873 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:32:50.357848 2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 20 15:32:50.357873 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:32:50.357871 2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 20 15:32:50.358015 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:32:50.357884 2557 projected.go:194] Error preparing data for projected volume kube-api-access-ft5ww for pod openshift-network-diagnostics/network-check-target-dv77n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 15:32:50.358015 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:32:50.357946 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae4048cd-ad5b-4154-8b48-47363ccceda4-kube-api-access-ft5ww podName:ae4048cd-ad5b-4154-8b48-47363ccceda4 nodeName:}" failed. No retries permitted until 2026-05-20 15:32:50.857928646 +0000 UTC m=+2.072851431 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-ft5ww" (UniqueName: "kubernetes.io/projected/ae4048cd-ad5b-4154-8b48-47363ccceda4-kube-api-access-ft5ww") pod "network-check-target-dv77n" (UID: "ae4048cd-ad5b-4154-8b48-47363ccceda4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 15:32:50.360128 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.360097 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zppfc\" (UniqueName: \"kubernetes.io/projected/7b177a52-2efa-4ece-ae5a-52b2386682dd-kube-api-access-zppfc\") pod \"iptables-alerter-zfwc4\" (UID: \"7b177a52-2efa-4ece-ae5a-52b2386682dd\") " pod="openshift-network-operator/iptables-alerter-zfwc4" May 20 15:32:50.360396 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.360368 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfxsq\" (UniqueName: \"kubernetes.io/projected/54872a9c-6091-4768-8cd9-e81ab987ba01-kube-api-access-vfxsq\") pod \"network-metrics-daemon-wszj2\" (UID: \"54872a9c-6091-4768-8cd9-e81ab987ba01\") " pod="openshift-multus/network-metrics-daemon-wszj2" May 20 15:32:50.360495 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.360455 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7g8k\" (UniqueName: \"kubernetes.io/projected/f3564822-b89c-4974-8c53-986c6b3fd1e7-kube-api-access-r7g8k\") pod \"node-resolver-r8sqr\" (UID: \"f3564822-b89c-4974-8c53-986c6b3fd1e7\") " pod="openshift-dns/node-resolver-r8sqr" May 20 15:32:50.361016 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.360993 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bq9m\" (UniqueName: \"kubernetes.io/projected/81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4-kube-api-access-4bq9m\") pod \"tuned-w226m\" (UID: \"81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4\") " pod="openshift-cluster-node-tuning-operator/tuned-w226m" May 20 15:32:50.361016 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.361004 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckpjq\" (UniqueName: \"kubernetes.io/projected/d4425adc-866b-4a45-8857-4a90c111f6ff-kube-api-access-ckpjq\") pod \"multus-additional-cni-plugins-tzz5f\" (UID: \"d4425adc-866b-4a45-8857-4a90c111f6ff\") " pod="openshift-multus/multus-additional-cni-plugins-tzz5f" May 20 15:32:50.361323 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.361301 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hcbd\" (UniqueName: \"kubernetes.io/projected/30b04f89-de78-49cd-a9f5-45bb9f3be94b-kube-api-access-2hcbd\") pod \"aws-ebs-csi-driver-node-9wsrh\" (UID: \"30b04f89-de78-49cd-a9f5-45bb9f3be94b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wsrh" May 20 15:32:50.361559 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.361543 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6v2d9\" (UniqueName: \"kubernetes.io/projected/3965fa01-ac56-43aa-b92e-985a0e59fdc6-kube-api-access-6v2d9\") pod \"node-ca-wmwps\" (UID: \"3965fa01-ac56-43aa-b92e-985a0e59fdc6\") " pod="openshift-image-registry/node-ca-wmwps" May 20 15:32:50.362344 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.362326 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbs2p\" (UniqueName: \"kubernetes.io/projected/2ce6e5d4-1424-43c2-9263-ab0463bc8c6c-kube-api-access-rbs2p\") pod \"multus-rsmqw\" (UID: \"2ce6e5d4-1424-43c2-9263-ab0463bc8c6c\") " pod="openshift-multus/multus-rsmqw" May 20 15:32:50.381766 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.381728 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-228.ec2.internal" event={"ID":"e78fe5c75454ec5097ce49d1da0faa03","Type":"ContainerStarted","Data":"6ce1801ea44a8d4e306ca4c61b2a2dbe1a661e82bd5d666d72003b96b3a2c0d3"} May 20 15:32:50.382638 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.382610 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-228.ec2.internal" event={"ID":"42e4b468873bacee12c6d864090d2691","Type":"ContainerStarted","Data":"3749f49c468954a8160d8e34c058e641addd7c983c0aff9f008f909a17a76824"} May 20 15:32:50.447827 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.447789 2557 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 20 15:32:50.452270 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.452251 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/271da0d2-8828-4630-8143-39ef6964f7f4-systemd-units\") pod \"ovnkube-node-gvwgm\" (UID: \"271da0d2-8828-4630-8143-39ef6964f7f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvwgm" May 20 15:32:50.452362 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.452281 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/271da0d2-8828-4630-8143-39ef6964f7f4-run-ovn\") pod \"ovnkube-node-gvwgm\" (UID: \"271da0d2-8828-4630-8143-39ef6964f7f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvwgm" May 20 15:32:50.452362 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.452305 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a8e3f0da-9b88-4b25-9836-21def71adfe1-agent-certs\") pod \"konnectivity-agent-r9qzn\" (UID: \"a8e3f0da-9b88-4b25-9836-21def71adfe1\") " pod="kube-system/konnectivity-agent-r9qzn" May 20 15:32:50.452440 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.452361 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/271da0d2-8828-4630-8143-39ef6964f7f4-systemd-units\") pod \"ovnkube-node-gvwgm\" (UID: \"271da0d2-8828-4630-8143-39ef6964f7f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvwgm" May 20 15:32:50.452440 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.452402 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/271da0d2-8828-4630-8143-39ef6964f7f4-run-ovn\") pod \"ovnkube-node-gvwgm\" (UID: \"271da0d2-8828-4630-8143-39ef6964f7f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvwgm" May 20 15:32:50.452560 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.452542 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/271da0d2-8828-4630-8143-39ef6964f7f4-host-run-ovn-kubernetes\") pod \"ovnkube-node-gvwgm\" (UID: \"271da0d2-8828-4630-8143-39ef6964f7f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvwgm" May 20 15:32:50.452603 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.452575 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/271da0d2-8828-4630-8143-39ef6964f7f4-ovnkube-config\") pod \"ovnkube-node-gvwgm\" (UID: \"271da0d2-8828-4630-8143-39ef6964f7f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvwgm" May 20 15:32:50.452603 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.452592 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/271da0d2-8828-4630-8143-39ef6964f7f4-env-overrides\") pod \"ovnkube-node-gvwgm\" (UID: \"271da0d2-8828-4630-8143-39ef6964f7f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvwgm" May 20 15:32:50.452695 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.452609 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/271da0d2-8828-4630-8143-39ef6964f7f4-host-run-netns\") pod \"ovnkube-node-gvwgm\" (UID: \"271da0d2-8828-4630-8143-39ef6964f7f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvwgm" May 20 15:32:50.452695 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.452628 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/271da0d2-8828-4630-8143-39ef6964f7f4-var-lib-openvswitch\") pod \"ovnkube-node-gvwgm\" (UID: \"271da0d2-8828-4630-8143-39ef6964f7f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvwgm" May 20 15:32:50.452695 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.452636 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/271da0d2-8828-4630-8143-39ef6964f7f4-host-run-ovn-kubernetes\") pod \"ovnkube-node-gvwgm\" (UID: \"271da0d2-8828-4630-8143-39ef6964f7f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvwgm" May 20 15:32:50.452854 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.452693 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/271da0d2-8828-4630-8143-39ef6964f7f4-var-lib-openvswitch\") pod \"ovnkube-node-gvwgm\" (UID: \"271da0d2-8828-4630-8143-39ef6964f7f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvwgm" May 20 15:32:50.452854 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.452704 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/271da0d2-8828-4630-8143-39ef6964f7f4-run-openvswitch\") pod \"ovnkube-node-gvwgm\" (UID: \"271da0d2-8828-4630-8143-39ef6964f7f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvwgm" May 20 15:32:50.452854 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.452747 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/271da0d2-8828-4630-8143-39ef6964f7f4-ovnkube-script-lib\") pod \"ovnkube-node-gvwgm\" (UID: \"271da0d2-8828-4630-8143-39ef6964f7f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvwgm" May 20 15:32:50.452854 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.452748 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/271da0d2-8828-4630-8143-39ef6964f7f4-run-openvswitch\") pod \"ovnkube-node-gvwgm\" (UID: \"271da0d2-8828-4630-8143-39ef6964f7f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvwgm" May 20 15:32:50.452854 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.452708 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/271da0d2-8828-4630-8143-39ef6964f7f4-host-run-netns\") pod \"ovnkube-node-gvwgm\" (UID: \"271da0d2-8828-4630-8143-39ef6964f7f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvwgm" May 20 15:32:50.452854 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.452772 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8kqvj\" (UniqueName: \"kubernetes.io/projected/271da0d2-8828-4630-8143-39ef6964f7f4-kube-api-access-8kqvj\") pod \"ovnkube-node-gvwgm\" (UID: \"271da0d2-8828-4630-8143-39ef6964f7f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvwgm" May 20 15:32:50.452854 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.452833 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/271da0d2-8828-4630-8143-39ef6964f7f4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gvwgm\" (UID: \"271da0d2-8828-4630-8143-39ef6964f7f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvwgm" May 20 15:32:50.453181 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.452863 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/271da0d2-8828-4630-8143-39ef6964f7f4-host-slash\") pod \"ovnkube-node-gvwgm\" (UID: \"271da0d2-8828-4630-8143-39ef6964f7f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvwgm" May 20 15:32:50.453181 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.452885 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/271da0d2-8828-4630-8143-39ef6964f7f4-run-systemd\") pod \"ovnkube-node-gvwgm\" (UID: \"271da0d2-8828-4630-8143-39ef6964f7f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvwgm" May 20 15:32:50.453181 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.452913 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/271da0d2-8828-4630-8143-39ef6964f7f4-host-kubelet\") pod \"ovnkube-node-gvwgm\" (UID: \"271da0d2-8828-4630-8143-39ef6964f7f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvwgm" May 20 15:32:50.453181 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.452937 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/271da0d2-8828-4630-8143-39ef6964f7f4-etc-openvswitch\") pod \"ovnkube-node-gvwgm\" (UID: \"271da0d2-8828-4630-8143-39ef6964f7f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvwgm" May 20 15:32:50.453181 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.452962 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/271da0d2-8828-4630-8143-39ef6964f7f4-node-log\") pod \"ovnkube-node-gvwgm\" (UID: \"271da0d2-8828-4630-8143-39ef6964f7f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvwgm" May 20 15:32:50.453181 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.452986 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/271da0d2-8828-4630-8143-39ef6964f7f4-log-socket\") pod \"ovnkube-node-gvwgm\" (UID: \"271da0d2-8828-4630-8143-39ef6964f7f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvwgm" May 20 15:32:50.453181 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.453031 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/271da0d2-8828-4630-8143-39ef6964f7f4-run-systemd\") pod \"ovnkube-node-gvwgm\" (UID: \"271da0d2-8828-4630-8143-39ef6964f7f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvwgm" May 20 15:32:50.453181 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.453070 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/271da0d2-8828-4630-8143-39ef6964f7f4-ovn-node-metrics-cert\") pod \"ovnkube-node-gvwgm\" (UID: \"271da0d2-8828-4630-8143-39ef6964f7f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvwgm" May 20 15:32:50.453181 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.453109 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/271da0d2-8828-4630-8143-39ef6964f7f4-env-overrides\") pod \"ovnkube-node-gvwgm\" (UID: \"271da0d2-8828-4630-8143-39ef6964f7f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvwgm" May 20 15:32:50.453181 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.453115 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/271da0d2-8828-4630-8143-39ef6964f7f4-host-cni-netd\") pod \"ovnkube-node-gvwgm\" (UID: \"271da0d2-8828-4630-8143-39ef6964f7f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvwgm" May 20 15:32:50.453181 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.453144 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/271da0d2-8828-4630-8143-39ef6964f7f4-ovnkube-config\") pod \"ovnkube-node-gvwgm\" (UID: \"271da0d2-8828-4630-8143-39ef6964f7f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvwgm" May 20 15:32:50.453181 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.453147 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/271da0d2-8828-4630-8143-39ef6964f7f4-host-cni-netd\") pod \"ovnkube-node-gvwgm\" (UID: \"271da0d2-8828-4630-8143-39ef6964f7f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvwgm" May 20 15:32:50.453181 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.453169 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a8e3f0da-9b88-4b25-9836-21def71adfe1-konnectivity-ca\") pod \"konnectivity-agent-r9qzn\" (UID: \"a8e3f0da-9b88-4b25-9836-21def71adfe1\") " pod="kube-system/konnectivity-agent-r9qzn" May 20 15:32:50.453181 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.453180 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/271da0d2-8828-4630-8143-39ef6964f7f4-host-slash\") pod \"ovnkube-node-gvwgm\" (UID: \"271da0d2-8828-4630-8143-39ef6964f7f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvwgm" May 20 15:32:50.453691 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.453198 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/271da0d2-8828-4630-8143-39ef6964f7f4-log-socket\") pod \"ovnkube-node-gvwgm\" (UID: \"271da0d2-8828-4630-8143-39ef6964f7f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvwgm" May 20 15:32:50.453691 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.453214 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/271da0d2-8828-4630-8143-39ef6964f7f4-host-cni-bin\") pod \"ovnkube-node-gvwgm\" (UID: \"271da0d2-8828-4630-8143-39ef6964f7f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvwgm" May 20 15:32:50.453691 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.453238 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/271da0d2-8828-4630-8143-39ef6964f7f4-host-kubelet\") pod \"ovnkube-node-gvwgm\" (UID: \"271da0d2-8828-4630-8143-39ef6964f7f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvwgm" May 20 15:32:50.453691 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.453242 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/271da0d2-8828-4630-8143-39ef6964f7f4-ovnkube-script-lib\") pod \"ovnkube-node-gvwgm\" (UID: \"271da0d2-8828-4630-8143-39ef6964f7f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvwgm" May 20 15:32:50.453691 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.453292 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/271da0d2-8828-4630-8143-39ef6964f7f4-host-cni-bin\") pod \"ovnkube-node-gvwgm\" (UID: \"271da0d2-8828-4630-8143-39ef6964f7f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvwgm" May 20 15:32:50.453691 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.453296 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/271da0d2-8828-4630-8143-39ef6964f7f4-etc-openvswitch\") pod \"ovnkube-node-gvwgm\" (UID: \"271da0d2-8828-4630-8143-39ef6964f7f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvwgm" May 20 15:32:50.453691 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.453298 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/271da0d2-8828-4630-8143-39ef6964f7f4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gvwgm\" (UID: \"271da0d2-8828-4630-8143-39ef6964f7f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvwgm" May 20 15:32:50.453691 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.453331 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/271da0d2-8828-4630-8143-39ef6964f7f4-node-log\") pod \"ovnkube-node-gvwgm\" (UID: \"271da0d2-8828-4630-8143-39ef6964f7f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvwgm" May 20 15:32:50.454156 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.454142 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a8e3f0da-9b88-4b25-9836-21def71adfe1-konnectivity-ca\") pod \"konnectivity-agent-r9qzn\" (UID: \"a8e3f0da-9b88-4b25-9836-21def71adfe1\") " pod="kube-system/konnectivity-agent-r9qzn" May 20 15:32:50.454743 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.454721 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a8e3f0da-9b88-4b25-9836-21def71adfe1-agent-certs\") pod \"konnectivity-agent-r9qzn\" (UID: \"a8e3f0da-9b88-4b25-9836-21def71adfe1\") " pod="kube-system/konnectivity-agent-r9qzn" May 20 15:32:50.455357 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.455337 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/271da0d2-8828-4630-8143-39ef6964f7f4-ovn-node-metrics-cert\") pod \"ovnkube-node-gvwgm\" (UID: \"271da0d2-8828-4630-8143-39ef6964f7f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvwgm" May 20 15:32:50.464383 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.464368 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kqvj\" (UniqueName: \"kubernetes.io/projected/271da0d2-8828-4630-8143-39ef6964f7f4-kube-api-access-8kqvj\") pod \"ovnkube-node-gvwgm\" (UID: \"271da0d2-8828-4630-8143-39ef6964f7f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvwgm" May 20 15:32:50.563608 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.563542 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-r8sqr" May 20 15:32:50.567148 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.567124 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wmwps" May 20 15:32:50.570781 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:50.570755 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3564822_b89c_4974_8c53_986c6b3fd1e7.slice/crio-a6c0b489cab569b1814e4428e733b09c13ae5aa798459db299dc55fa1ba3ad36 WatchSource:0}: Error finding container a6c0b489cab569b1814e4428e733b09c13ae5aa798459db299dc55fa1ba3ad36: Status 404 returned error can't find the container with id a6c0b489cab569b1814e4428e733b09c13ae5aa798459db299dc55fa1ba3ad36 May 20 15:32:50.574012 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:50.573991 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3965fa01_ac56_43aa_b92e_985a0e59fdc6.slice/crio-5fdea3fcbb17a36507b3e0eb6c20310890069bf82d9f4af32fc162eb15ab4151 WatchSource:0}: Error finding container 5fdea3fcbb17a36507b3e0eb6c20310890069bf82d9f4af32fc162eb15ab4151: Status 404 returned error can't find the container with id 5fdea3fcbb17a36507b3e0eb6c20310890069bf82d9f4af32fc162eb15ab4151 May 20 15:32:50.578058 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.578044 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tzz5f" May 20 15:32:50.583000 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.582982 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-w226m" May 20 15:32:50.583943 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:50.583889 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4425adc_866b_4a45_8857_4a90c111f6ff.slice/crio-c8415bf5c3fcab954e023ba995248b44bfa38a8710c4253b3c9be1d54f57b559 WatchSource:0}: Error finding container c8415bf5c3fcab954e023ba995248b44bfa38a8710c4253b3c9be1d54f57b559: Status 404 returned error can't find the container with id c8415bf5c3fcab954e023ba995248b44bfa38a8710c4253b3c9be1d54f57b559 May 20 15:32:50.587989 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.587967 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wsrh" May 20 15:32:50.592576 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:50.591137 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81f3d24b_3a44_4ab6_8b9c_d8cfcef12eb4.slice/crio-eaad2f61ff88ce3b198c8b7dfd23b4b3b33a5b1c77c90d628a469cde21365fd9 WatchSource:0}: Error finding container eaad2f61ff88ce3b198c8b7dfd23b4b3b33a5b1c77c90d628a469cde21365fd9: Status 404 returned error can't find the container with id eaad2f61ff88ce3b198c8b7dfd23b4b3b33a5b1c77c90d628a469cde21365fd9 May 20 15:32:50.593971 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.593912 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rsmqw" May 20 15:32:50.599860 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:50.599837 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30b04f89_de78_49cd_a9f5_45bb9f3be94b.slice/crio-7ad88546f3ff50d6f8a8a053ffe54b40a11faf24b4aee9d44c5f8edc49ce4134 WatchSource:0}: Error finding container 7ad88546f3ff50d6f8a8a053ffe54b40a11faf24b4aee9d44c5f8edc49ce4134: Status 404 returned error can't find the container with id 7ad88546f3ff50d6f8a8a053ffe54b40a11faf24b4aee9d44c5f8edc49ce4134 May 20 15:32:50.599971 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.599857 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zfwc4" May 20 15:32:50.604477 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:50.604458 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ce6e5d4_1424_43c2_9263_ab0463bc8c6c.slice/crio-649542a1fefcd8731eac1f6f56ab5ffd185d7e9f8522da9803835ac44f4522e4 WatchSource:0}: Error finding container 649542a1fefcd8731eac1f6f56ab5ffd185d7e9f8522da9803835ac44f4522e4: Status 404 returned error can't find the container with id 649542a1fefcd8731eac1f6f56ab5ffd185d7e9f8522da9803835ac44f4522e4 May 20 15:32:50.605675 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.605302 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gvwgm" May 20 15:32:50.609529 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.609504 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-r9qzn" May 20 15:32:50.609753 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:50.609730 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b177a52_2efa_4ece_ae5a_52b2386682dd.slice/crio-9226afdb20ab09cf748bf052b8dcd62b36ecb06d272c466610ae20133bbc6c4a WatchSource:0}: Error finding container 9226afdb20ab09cf748bf052b8dcd62b36ecb06d272c466610ae20133bbc6c4a: Status 404 returned error can't find the container with id 9226afdb20ab09cf748bf052b8dcd62b36ecb06d272c466610ae20133bbc6c4a May 20 15:32:50.613315 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:50.613278 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod271da0d2_8828_4630_8143_39ef6964f7f4.slice/crio-0705ed62dfa588d1bd26d2a3018c4a30cc8c324ccb2cdb2fc27b99721733940a WatchSource:0}: Error finding container 0705ed62dfa588d1bd26d2a3018c4a30cc8c324ccb2cdb2fc27b99721733940a: Status 404 returned error can't find the container with id 0705ed62dfa588d1bd26d2a3018c4a30cc8c324ccb2cdb2fc27b99721733940a May 20 15:32:50.617672 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:32:50.617647 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8e3f0da_9b88_4b25_9836_21def71adfe1.slice/crio-c9271a54da69952a0aeb8e3325e9329643786879dbfbcfde4becc4b2d0c09349 WatchSource:0}: Error finding container c9271a54da69952a0aeb8e3325e9329643786879dbfbcfde4becc4b2d0c09349: Status 404 returned error can't find the container with id c9271a54da69952a0aeb8e3325e9329643786879dbfbcfde4becc4b2d0c09349 May 20 15:32:50.663954 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.662405 2557 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 20 15:32:50.855182 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.855095 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54872a9c-6091-4768-8cd9-e81ab987ba01-metrics-certs\") pod \"network-metrics-daemon-wszj2\" (UID: \"54872a9c-6091-4768-8cd9-e81ab987ba01\") " pod="openshift-multus/network-metrics-daemon-wszj2" May 20 15:32:50.855335 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:32:50.855294 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 20 15:32:50.855392 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:32:50.855376 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54872a9c-6091-4768-8cd9-e81ab987ba01-metrics-certs podName:54872a9c-6091-4768-8cd9-e81ab987ba01 nodeName:}" failed. No retries permitted until 2026-05-20 15:32:51.855355599 +0000 UTC m=+3.070278371 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/54872a9c-6091-4768-8cd9-e81ab987ba01-metrics-certs") pod "network-metrics-daemon-wszj2" (UID: "54872a9c-6091-4768-8cd9-e81ab987ba01") : object "openshift-multus"/"metrics-daemon-secret" not registered May 20 15:32:50.957046 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:50.956319 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ft5ww\" (UniqueName: \"kubernetes.io/projected/ae4048cd-ad5b-4154-8b48-47363ccceda4-kube-api-access-ft5ww\") pod \"network-check-target-dv77n\" (UID: \"ae4048cd-ad5b-4154-8b48-47363ccceda4\") " pod="openshift-network-diagnostics/network-check-target-dv77n" May 20 15:32:50.957046 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:32:50.956560 2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 20 15:32:50.957046 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:32:50.956580 2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 20 15:32:50.957046 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:32:50.956594 2557 projected.go:194] Error preparing data for projected volume kube-api-access-ft5ww for pod openshift-network-diagnostics/network-check-target-dv77n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 15:32:50.957046 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:32:50.956657 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae4048cd-ad5b-4154-8b48-47363ccceda4-kube-api-access-ft5ww podName:ae4048cd-ad5b-4154-8b48-47363ccceda4 nodeName:}" failed. No retries permitted until 2026-05-20 15:32:51.956638262 +0000 UTC m=+3.171561054 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-ft5ww" (UniqueName: "kubernetes.io/projected/ae4048cd-ad5b-4154-8b48-47363ccceda4-kube-api-access-ft5ww") pod "network-check-target-dv77n" (UID: "ae4048cd-ad5b-4154-8b48-47363ccceda4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 15:32:51.292788 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:51.292660 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-19 15:27:50 +0000 UTC" deadline="2028-02-21 21:49:27.728218108 +0000 UTC" May 20 15:32:51.292788 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:51.292694 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15414h16m36.435528058s" May 20 15:32:51.411778 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:51.411737 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-r8sqr" event={"ID":"f3564822-b89c-4974-8c53-986c6b3fd1e7","Type":"ContainerStarted","Data":"a6c0b489cab569b1814e4428e733b09c13ae5aa798459db299dc55fa1ba3ad36"} May 20 15:32:51.422331 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:51.422269 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gvwgm" event={"ID":"271da0d2-8828-4630-8143-39ef6964f7f4","Type":"ContainerStarted","Data":"0705ed62dfa588d1bd26d2a3018c4a30cc8c324ccb2cdb2fc27b99721733940a"} May 20 15:32:51.429630 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:51.429578 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wsrh" event={"ID":"30b04f89-de78-49cd-a9f5-45bb9f3be94b","Type":"ContainerStarted","Data":"7ad88546f3ff50d6f8a8a053ffe54b40a11faf24b4aee9d44c5f8edc49ce4134"} May 20 15:32:51.436133 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:51.436106 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-w226m" event={"ID":"81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4","Type":"ContainerStarted","Data":"eaad2f61ff88ce3b198c8b7dfd23b4b3b33a5b1c77c90d628a469cde21365fd9"} May 20 15:32:51.458954 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:51.458926 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tzz5f" event={"ID":"d4425adc-866b-4a45-8857-4a90c111f6ff","Type":"ContainerStarted","Data":"c8415bf5c3fcab954e023ba995248b44bfa38a8710c4253b3c9be1d54f57b559"} May 20 15:32:51.472071 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:51.472008 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wmwps" event={"ID":"3965fa01-ac56-43aa-b92e-985a0e59fdc6","Type":"ContainerStarted","Data":"5fdea3fcbb17a36507b3e0eb6c20310890069bf82d9f4af32fc162eb15ab4151"} May 20 15:32:51.479789 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:51.479365 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-r9qzn" event={"ID":"a8e3f0da-9b88-4b25-9836-21def71adfe1","Type":"ContainerStarted","Data":"c9271a54da69952a0aeb8e3325e9329643786879dbfbcfde4becc4b2d0c09349"} May 20 15:32:51.489852 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:51.489827 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zfwc4" event={"ID":"7b177a52-2efa-4ece-ae5a-52b2386682dd","Type":"ContainerStarted","Data":"9226afdb20ab09cf748bf052b8dcd62b36ecb06d272c466610ae20133bbc6c4a"} May 20 15:32:51.498157 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:51.498129 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rsmqw" event={"ID":"2ce6e5d4-1424-43c2-9263-ab0463bc8c6c","Type":"ContainerStarted","Data":"649542a1fefcd8731eac1f6f56ab5ffd185d7e9f8522da9803835ac44f4522e4"} May 20 15:32:51.590160 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:51.590081 2557 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 20 15:32:51.865029 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:51.864423 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54872a9c-6091-4768-8cd9-e81ab987ba01-metrics-certs\") pod \"network-metrics-daemon-wszj2\" (UID: \"54872a9c-6091-4768-8cd9-e81ab987ba01\") " pod="openshift-multus/network-metrics-daemon-wszj2" May 20 15:32:51.865029 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:32:51.864559 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 20 15:32:51.865029 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:32:51.864628 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54872a9c-6091-4768-8cd9-e81ab987ba01-metrics-certs podName:54872a9c-6091-4768-8cd9-e81ab987ba01 nodeName:}" failed. No retries permitted until 2026-05-20 15:32:53.864600664 +0000 UTC m=+5.079523435 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/54872a9c-6091-4768-8cd9-e81ab987ba01-metrics-certs") pod "network-metrics-daemon-wszj2" (UID: "54872a9c-6091-4768-8cd9-e81ab987ba01") : object "openshift-multus"/"metrics-daemon-secret" not registered May 20 15:32:51.923032 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:51.922796 2557 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 20 15:32:51.965502 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:51.965468 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ft5ww\" (UniqueName: \"kubernetes.io/projected/ae4048cd-ad5b-4154-8b48-47363ccceda4-kube-api-access-ft5ww\") pod \"network-check-target-dv77n\" (UID: \"ae4048cd-ad5b-4154-8b48-47363ccceda4\") " pod="openshift-network-diagnostics/network-check-target-dv77n" May 20 15:32:51.965681 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:32:51.965659 2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 20 15:32:51.965681 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:32:51.965677 2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 20 15:32:51.965788 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:32:51.965689 2557 projected.go:194] Error preparing data for projected volume kube-api-access-ft5ww for pod openshift-network-diagnostics/network-check-target-dv77n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 15:32:51.965788 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:32:51.965743 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae4048cd-ad5b-4154-8b48-47363ccceda4-kube-api-access-ft5ww podName:ae4048cd-ad5b-4154-8b48-47363ccceda4 nodeName:}" failed. No retries permitted until 2026-05-20 15:32:53.965725276 +0000 UTC m=+5.180648047 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-ft5ww" (UniqueName: "kubernetes.io/projected/ae4048cd-ad5b-4154-8b48-47363ccceda4-kube-api-access-ft5ww") pod "network-check-target-dv77n" (UID: "ae4048cd-ad5b-4154-8b48-47363ccceda4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 15:32:52.293465 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:52.293357 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-19 15:27:50 +0000 UTC" deadline="2028-02-06 00:38:04.829334422 +0000 UTC" May 20 15:32:52.293465 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:52.293390 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15033h5m12.535948615s" May 20 15:32:52.380950 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:52.380210 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wszj2" May 20 15:32:52.380950 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:32:52.380350 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wszj2" podUID="54872a9c-6091-4768-8cd9-e81ab987ba01" May 20 15:32:52.380950 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:52.380772 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dv77n" May 20 15:32:52.380950 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:32:52.380881 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dv77n" podUID="ae4048cd-ad5b-4154-8b48-47363ccceda4" May 20 15:32:53.881342 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:53.880860 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54872a9c-6091-4768-8cd9-e81ab987ba01-metrics-certs\") pod \"network-metrics-daemon-wszj2\" (UID: \"54872a9c-6091-4768-8cd9-e81ab987ba01\") " pod="openshift-multus/network-metrics-daemon-wszj2" May 20 15:32:53.881342 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:32:53.880981 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 20 15:32:53.881342 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:32:53.881043 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54872a9c-6091-4768-8cd9-e81ab987ba01-metrics-certs podName:54872a9c-6091-4768-8cd9-e81ab987ba01 nodeName:}" failed. No retries permitted until 2026-05-20 15:32:57.881022961 +0000 UTC m=+9.095945737 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/54872a9c-6091-4768-8cd9-e81ab987ba01-metrics-certs") pod "network-metrics-daemon-wszj2" (UID: "54872a9c-6091-4768-8cd9-e81ab987ba01") : object "openshift-multus"/"metrics-daemon-secret" not registered May 20 15:32:53.981842 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:53.981792 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ft5ww\" (UniqueName: \"kubernetes.io/projected/ae4048cd-ad5b-4154-8b48-47363ccceda4-kube-api-access-ft5ww\") pod \"network-check-target-dv77n\" (UID: \"ae4048cd-ad5b-4154-8b48-47363ccceda4\") " pod="openshift-network-diagnostics/network-check-target-dv77n" May 20 15:32:53.982052 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:32:53.982033 2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 20 15:32:53.982121 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:32:53.982061 2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 20 15:32:53.982121 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:32:53.982074 2557 projected.go:194] Error preparing data for projected volume kube-api-access-ft5ww for pod openshift-network-diagnostics/network-check-target-dv77n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 15:32:53.982213 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:32:53.982138 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae4048cd-ad5b-4154-8b48-47363ccceda4-kube-api-access-ft5ww podName:ae4048cd-ad5b-4154-8b48-47363ccceda4 nodeName:}" failed. No retries permitted until 2026-05-20 15:32:57.982117438 +0000 UTC m=+9.197040221 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-ft5ww" (UniqueName: "kubernetes.io/projected/ae4048cd-ad5b-4154-8b48-47363ccceda4-kube-api-access-ft5ww") pod "network-check-target-dv77n" (UID: "ae4048cd-ad5b-4154-8b48-47363ccceda4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 15:32:54.380664 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:54.379969 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dv77n" May 20 15:32:54.380664 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:32:54.380100 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dv77n" podUID="ae4048cd-ad5b-4154-8b48-47363ccceda4" May 20 15:32:54.380664 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:54.380450 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wszj2" May 20 15:32:54.380664 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:32:54.380537 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wszj2" podUID="54872a9c-6091-4768-8cd9-e81ab987ba01" May 20 15:32:56.380654 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:56.380153 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wszj2" May 20 15:32:56.380654 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:56.380171 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dv77n" May 20 15:32:56.380654 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:32:56.380283 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wszj2" podUID="54872a9c-6091-4768-8cd9-e81ab987ba01" May 20 15:32:56.380654 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:32:56.380345 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dv77n" podUID="ae4048cd-ad5b-4154-8b48-47363ccceda4" May 20 15:32:57.917109 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:57.917071 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54872a9c-6091-4768-8cd9-e81ab987ba01-metrics-certs\") pod \"network-metrics-daemon-wszj2\" (UID: \"54872a9c-6091-4768-8cd9-e81ab987ba01\") " pod="openshift-multus/network-metrics-daemon-wszj2" May 20 15:32:57.917539 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:32:57.917266 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 20 15:32:57.917539 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:32:57.917323 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54872a9c-6091-4768-8cd9-e81ab987ba01-metrics-certs podName:54872a9c-6091-4768-8cd9-e81ab987ba01 nodeName:}" failed. No retries permitted until 2026-05-20 15:33:05.917310257 +0000 UTC m=+17.132233033 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/54872a9c-6091-4768-8cd9-e81ab987ba01-metrics-certs") pod "network-metrics-daemon-wszj2" (UID: "54872a9c-6091-4768-8cd9-e81ab987ba01") : object "openshift-multus"/"metrics-daemon-secret" not registered May 20 15:32:58.018143 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:58.018088 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ft5ww\" (UniqueName: \"kubernetes.io/projected/ae4048cd-ad5b-4154-8b48-47363ccceda4-kube-api-access-ft5ww\") pod \"network-check-target-dv77n\" (UID: \"ae4048cd-ad5b-4154-8b48-47363ccceda4\") " pod="openshift-network-diagnostics/network-check-target-dv77n" May 20 15:32:58.018301 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:32:58.018223 2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 20 15:32:58.018301 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:32:58.018238 2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 20 15:32:58.018301 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:32:58.018249 2557 projected.go:194] Error preparing data for projected volume kube-api-access-ft5ww for pod openshift-network-diagnostics/network-check-target-dv77n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 15:32:58.018415 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:32:58.018309 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae4048cd-ad5b-4154-8b48-47363ccceda4-kube-api-access-ft5ww podName:ae4048cd-ad5b-4154-8b48-47363ccceda4 nodeName:}" failed. No retries permitted until 2026-05-20 15:33:06.018295339 +0000 UTC m=+17.233218110 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-ft5ww" (UniqueName: "kubernetes.io/projected/ae4048cd-ad5b-4154-8b48-47363ccceda4-kube-api-access-ft5ww") pod "network-check-target-dv77n" (UID: "ae4048cd-ad5b-4154-8b48-47363ccceda4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 15:32:58.380193 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:58.380117 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wszj2" May 20 15:32:58.380331 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:32:58.380258 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wszj2" podUID="54872a9c-6091-4768-8cd9-e81ab987ba01" May 20 15:32:58.380591 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:32:58.380117 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dv77n" May 20 15:32:58.380740 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:32:58.380670 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dv77n" podUID="ae4048cd-ad5b-4154-8b48-47363ccceda4" May 20 15:33:00.380350 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:00.380302 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wszj2" May 20 15:33:00.380350 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:00.380336 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dv77n" May 20 15:33:00.380954 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:33:00.380440 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wszj2" podUID="54872a9c-6091-4768-8cd9-e81ab987ba01" May 20 15:33:00.380954 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:33:00.380526 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dv77n" podUID="ae4048cd-ad5b-4154-8b48-47363ccceda4" May 20 15:33:02.379877 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:02.379840 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wszj2" May 20 15:33:02.380311 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:02.379894 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dv77n" May 20 15:33:02.380311 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:33:02.380010 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wszj2" podUID="54872a9c-6091-4768-8cd9-e81ab987ba01" May 20 15:33:02.380311 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:33:02.380127 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dv77n" podUID="ae4048cd-ad5b-4154-8b48-47363ccceda4" May 20 15:33:04.380047 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:04.379996 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wszj2" May 20 15:33:04.380484 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:04.379996 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dv77n" May 20 15:33:04.380484 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:33:04.380128 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wszj2" podUID="54872a9c-6091-4768-8cd9-e81ab987ba01" May 20 15:33:04.380484 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:33:04.380225 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dv77n" podUID="ae4048cd-ad5b-4154-8b48-47363ccceda4" May 20 15:33:05.974566 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:05.974491 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54872a9c-6091-4768-8cd9-e81ab987ba01-metrics-certs\") pod \"network-metrics-daemon-wszj2\" (UID: \"54872a9c-6091-4768-8cd9-e81ab987ba01\") " pod="openshift-multus/network-metrics-daemon-wszj2" May 20 15:33:05.975068 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:33:05.974609 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 20 15:33:05.975068 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:33:05.974687 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54872a9c-6091-4768-8cd9-e81ab987ba01-metrics-certs podName:54872a9c-6091-4768-8cd9-e81ab987ba01 nodeName:}" failed. No retries permitted until 2026-05-20 15:33:21.974671412 +0000 UTC m=+33.189594188 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/54872a9c-6091-4768-8cd9-e81ab987ba01-metrics-certs") pod "network-metrics-daemon-wszj2" (UID: "54872a9c-6091-4768-8cd9-e81ab987ba01") : object "openshift-multus"/"metrics-daemon-secret" not registered May 20 15:33:06.075748 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:06.075711 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ft5ww\" (UniqueName: \"kubernetes.io/projected/ae4048cd-ad5b-4154-8b48-47363ccceda4-kube-api-access-ft5ww\") pod \"network-check-target-dv77n\" (UID: \"ae4048cd-ad5b-4154-8b48-47363ccceda4\") " pod="openshift-network-diagnostics/network-check-target-dv77n" May 20 15:33:06.075923 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:33:06.075875 2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 20 15:33:06.075923 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:33:06.075903 2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 20 15:33:06.075923 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:33:06.075915 2557 projected.go:194] Error preparing data for projected volume kube-api-access-ft5ww for pod openshift-network-diagnostics/network-check-target-dv77n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 15:33:06.076095 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:33:06.075967 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae4048cd-ad5b-4154-8b48-47363ccceda4-kube-api-access-ft5ww podName:ae4048cd-ad5b-4154-8b48-47363ccceda4 nodeName:}" failed. No retries permitted until 2026-05-20 15:33:22.075953557 +0000 UTC m=+33.290876328 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-ft5ww" (UniqueName: "kubernetes.io/projected/ae4048cd-ad5b-4154-8b48-47363ccceda4-kube-api-access-ft5ww") pod "network-check-target-dv77n" (UID: "ae4048cd-ad5b-4154-8b48-47363ccceda4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 15:33:06.379503 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:06.379417 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wszj2" May 20 15:33:06.379503 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:06.379450 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dv77n" May 20 15:33:06.379714 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:33:06.379571 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wszj2" podUID="54872a9c-6091-4768-8cd9-e81ab987ba01" May 20 15:33:06.379781 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:33:06.379720 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dv77n" podUID="ae4048cd-ad5b-4154-8b48-47363ccceda4" May 20 15:33:08.380557 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:08.380308 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wszj2" May 20 15:33:08.380992 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:08.380394 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dv77n" May 20 15:33:08.380992 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:33:08.380730 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dv77n" podUID="ae4048cd-ad5b-4154-8b48-47363ccceda4" May 20 15:33:08.380992 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:33:08.380744 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wszj2" podUID="54872a9c-6091-4768-8cd9-e81ab987ba01" May 20 15:33:10.379326 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:10.379296 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dv77n" May 20 15:33:10.379864 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:33:10.379431 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dv77n" podUID="ae4048cd-ad5b-4154-8b48-47363ccceda4" May 20 15:33:10.379921 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:10.379905 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wszj2" May 20 15:33:10.380041 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:33:10.380017 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wszj2" podUID="54872a9c-6091-4768-8cd9-e81ab987ba01" May 20 15:33:10.532400 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:10.532372 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wsrh" event={"ID":"30b04f89-de78-49cd-a9f5-45bb9f3be94b","Type":"ContainerStarted","Data":"d06057a28babb1bb4f73b59fb897a6a0410d6a61a7b7abc51dc33ca35a62f331"} May 20 15:33:10.533570 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:10.533548 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-w226m" event={"ID":"81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4","Type":"ContainerStarted","Data":"056c3aa8be2ba0721cc658eef4168cbc94a27b933e1d2cae0142c73daab83e66"} May 20 15:33:10.534968 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:10.534945 2557 generic.go:358] "Generic (PLEG): container finished" podID="d4425adc-866b-4a45-8857-4a90c111f6ff" containerID="0aef9c2d22429942951bfb390bbe6d753cf6ae457beb7e135272784f093c30c7" exitCode=0 May 20 15:33:10.535078 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:10.535019 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tzz5f" event={"ID":"d4425adc-866b-4a45-8857-4a90c111f6ff","Type":"ContainerDied","Data":"0aef9c2d22429942951bfb390bbe6d753cf6ae457beb7e135272784f093c30c7"} May 20 15:33:10.536424 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:10.536403 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wmwps" event={"ID":"3965fa01-ac56-43aa-b92e-985a0e59fdc6","Type":"ContainerStarted","Data":"279b46bf57f520e1a13e63163bb1643c5eed6b4098a70cf957a5dce39ba6e5a2"} May 20 15:33:10.537619 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:10.537596 2557 generic.go:358] "Generic (PLEG): container finished" podID="42e4b468873bacee12c6d864090d2691" containerID="3e3fe58855b9c2e14ce4b8fcfa6ea6791a5b9a30ce22cb2a42098d5a4ab605ac" exitCode=0 May 20 15:33:10.537740 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:10.537652 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-228.ec2.internal" event={"ID":"42e4b468873bacee12c6d864090d2691","Type":"ContainerDied","Data":"3e3fe58855b9c2e14ce4b8fcfa6ea6791a5b9a30ce22cb2a42098d5a4ab605ac"} May 20 15:33:10.538717 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:10.538698 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-r9qzn" event={"ID":"a8e3f0da-9b88-4b25-9836-21def71adfe1","Type":"ContainerStarted","Data":"f6319abdaaf50a7ef05c966975ddff4263e450eaf2b98a3e381227dcdb8447f0"} May 20 15:33:10.540086 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:10.540063 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rsmqw" event={"ID":"2ce6e5d4-1424-43c2-9263-ab0463bc8c6c","Type":"ContainerStarted","Data":"c72a02c62957cf011c19fcde3dcb5ba8da5ce300e3a818ba7ee7069929d8bd04"} May 20 15:33:10.541411 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:10.541391 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-r8sqr" event={"ID":"f3564822-b89c-4974-8c53-986c6b3fd1e7","Type":"ContainerStarted","Data":"443325bd320d3d3259b01d613936aba4588e9e83fd2f1dafa422c5785f893710"} May 20 15:33:10.542804 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:10.542785 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-228.ec2.internal" event={"ID":"e78fe5c75454ec5097ce49d1da0faa03","Type":"ContainerStarted","Data":"2fa376d0159651d6330cb35937614d0e1b0a0d260481e41e207ae15461112a3c"} May 20 15:33:10.544785 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:10.544767 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gvwgm" event={"ID":"271da0d2-8828-4630-8143-39ef6964f7f4","Type":"ContainerStarted","Data":"6ffc9fa81840e011d38884963b8f6a7aba948ec74011de7afb5d62ca31f58b41"} May 20 15:33:10.544896 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:10.544793 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gvwgm" event={"ID":"271da0d2-8828-4630-8143-39ef6964f7f4","Type":"ContainerStarted","Data":"c7e2a4e47941942e271c467cb40adb259a602234432c734100cee40401e9979f"} May 20 15:33:10.544896 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:10.544824 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gvwgm" event={"ID":"271da0d2-8828-4630-8143-39ef6964f7f4","Type":"ContainerStarted","Data":"4ae109c519fe50baad9e640302b9d4b016c556c0c6c69aed4775bcf5087ef1ac"} May 20 15:33:10.544896 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:10.544838 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gvwgm" event={"ID":"271da0d2-8828-4630-8143-39ef6964f7f4","Type":"ContainerStarted","Data":"fbdadf84412946b0e5539e38ca11f01c6a057d8461884f740cac2c86b5807d42"} May 20 15:33:10.562419 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:10.562273 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-w226m" podStartSLOduration=2.383343978 podStartE2EDuration="21.562262196s" podCreationTimestamp="2026-05-20 15:32:49 +0000 UTC" firstStartedPulling="2026-05-20 15:32:50.595864727 +0000 UTC m=+1.810787501" lastFinishedPulling="2026-05-20 15:33:09.774782937 +0000 UTC m=+20.989705719" observedRunningTime="2026-05-20 15:33:10.562097319 +0000 UTC m=+21.777020111" watchObservedRunningTime="2026-05-20 15:33:10.562262196 +0000 UTC m=+21.777184988" May 20 15:33:10.600403 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:10.600365 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-228.ec2.internal" podStartSLOduration=20.60035497 podStartE2EDuration="20.60035497s" podCreationTimestamp="2026-05-20 15:32:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 15:33:10.59975289 +0000 UTC m=+21.814675725" watchObservedRunningTime="2026-05-20 15:33:10.60035497 +0000 UTC m=+21.815277764" May 20 15:33:10.625224 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:10.625180 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-r8sqr" podStartSLOduration=2.41627994 podStartE2EDuration="21.625164063s" podCreationTimestamp="2026-05-20 15:32:49 +0000 UTC" firstStartedPulling="2026-05-20 15:32:50.572259982 +0000 UTC m=+1.787182755" lastFinishedPulling="2026-05-20 15:33:09.781144092 +0000 UTC m=+20.996066878" observedRunningTime="2026-05-20 15:33:10.625021036 +0000 UTC m=+21.839943829" watchObservedRunningTime="2026-05-20 15:33:10.625164063 +0000 UTC m=+21.840086857" May 20 15:33:10.672959 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:10.672647 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-rsmqw" podStartSLOduration=2.147903604 podStartE2EDuration="21.672629691s" podCreationTimestamp="2026-05-20 15:32:49 +0000 UTC" firstStartedPulling="2026-05-20 15:32:50.608544696 +0000 UTC m=+1.823467481" lastFinishedPulling="2026-05-20 15:33:10.133270783 +0000 UTC m=+21.348193568" observedRunningTime="2026-05-20 15:33:10.672195964 +0000 UTC m=+21.887118753" watchObservedRunningTime="2026-05-20 15:33:10.672629691 +0000 UTC m=+21.887552487" May 20 15:33:10.689825 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:10.689756 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wmwps" podStartSLOduration=6.938397034 podStartE2EDuration="21.689743546s" podCreationTimestamp="2026-05-20 15:32:49 +0000 UTC" firstStartedPulling="2026-05-20 15:32:50.575549094 +0000 UTC m=+1.790471865" lastFinishedPulling="2026-05-20 15:33:05.326895589 +0000 UTC m=+16.541818377" observedRunningTime="2026-05-20 15:33:10.689666534 +0000 UTC m=+21.904589326" watchObservedRunningTime="2026-05-20 15:33:10.689743546 +0000 UTC m=+21.904666338" May 20 15:33:10.709056 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:10.709017 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-r9qzn" podStartSLOduration=2.576645965 podStartE2EDuration="21.709003909s" podCreationTimestamp="2026-05-20 15:32:49 +0000 UTC" firstStartedPulling="2026-05-20 15:32:50.619532881 +0000 UTC m=+1.834455653" lastFinishedPulling="2026-05-20 15:33:09.751890827 +0000 UTC m=+20.966813597" observedRunningTime="2026-05-20 15:33:10.708745505 +0000 UTC m=+21.923668300" watchObservedRunningTime="2026-05-20 15:33:10.709003909 +0000 UTC m=+21.923926701" May 20 15:33:11.309985 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:11.309962 2557 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 20 15:33:11.314010 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:11.313930 2557 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-20T15:33:11.309981729Z","UUID":"e9bb7c1a-a1db-490f-ad46-0ab688f08b20","Handler":null,"Name":"","Endpoint":""} May 20 15:33:11.316806 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:11.316781 2557 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 20 15:33:11.316806 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:11.316805 2557 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 20 15:33:11.551778 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:11.551677 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gvwgm" event={"ID":"271da0d2-8828-4630-8143-39ef6964f7f4","Type":"ContainerStarted","Data":"d3e71a75bb170b27f5c19717f3f7c084e2ae5428ceeb436a3cfd01fa8bf61a1f"} May 20 15:33:11.551778 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:11.551715 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gvwgm" event={"ID":"271da0d2-8828-4630-8143-39ef6964f7f4","Type":"ContainerStarted","Data":"4f964bc9e22d81d736ee4c69bd8c03068b0449526541bbbe17b26534ec6c9263"} May 20 15:33:11.553706 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:11.553671 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wsrh" event={"ID":"30b04f89-de78-49cd-a9f5-45bb9f3be94b","Type":"ContainerStarted","Data":"241ff2280686d11c6c4eeef5763b5be2ea275b727e184054a905cafffc2d1309"} May 20 15:33:11.555379 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:11.555352 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-228.ec2.internal" event={"ID":"42e4b468873bacee12c6d864090d2691","Type":"ContainerStarted","Data":"861ff3c7a246a1345c46a5db973e457c51bf2d4f636d97e74dccfad3040adc27"} May 20 15:33:11.556955 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:11.556870 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zfwc4" event={"ID":"7b177a52-2efa-4ece-ae5a-52b2386682dd","Type":"ContainerStarted","Data":"d83da3482e275f7f52a3a5010d42eaf8d6bc37fa50cdec3593e08a1c4f7b4606"} May 20 15:33:11.581395 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:11.581341 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-228.ec2.internal" podStartSLOduration=21.581325341 podStartE2EDuration="21.581325341s" podCreationTimestamp="2026-05-20 15:32:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 15:33:11.580997539 +0000 UTC m=+22.795920333" watchObservedRunningTime="2026-05-20 15:33:11.581325341 +0000 UTC m=+22.796248137" May 20 15:33:11.613349 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:11.613308 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-zfwc4" podStartSLOduration=3.473189729 podStartE2EDuration="22.613294429s" podCreationTimestamp="2026-05-20 15:32:49 +0000 UTC" firstStartedPulling="2026-05-20 15:32:50.611970132 +0000 UTC m=+1.826892909" lastFinishedPulling="2026-05-20 15:33:09.752074824 +0000 UTC m=+20.966997609" observedRunningTime="2026-05-20 15:33:11.612718067 +0000 UTC m=+22.827640861" watchObservedRunningTime="2026-05-20 15:33:11.613294429 +0000 UTC m=+22.828217224" May 20 15:33:12.379949 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:12.379863 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wszj2" May 20 15:33:12.380106 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:12.379863 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dv77n" May 20 15:33:12.380106 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:33:12.380008 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wszj2" podUID="54872a9c-6091-4768-8cd9-e81ab987ba01" May 20 15:33:12.380106 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:33:12.380058 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dv77n" podUID="ae4048cd-ad5b-4154-8b48-47363ccceda4" May 20 15:33:12.561362 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:12.561298 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wsrh" event={"ID":"30b04f89-de78-49cd-a9f5-45bb9f3be94b","Type":"ContainerStarted","Data":"6e74158bb55c7ac198e36f3a26a4fd43ac7129d52fd9d34f2d2b12d2159f4e07"} May 20 15:33:12.594867 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:12.594797 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wsrh" podStartSLOduration=2.077685823 podStartE2EDuration="23.59478444s" podCreationTimestamp="2026-05-20 15:32:49 +0000 UTC" firstStartedPulling="2026-05-20 15:32:50.601466199 +0000 UTC m=+1.816388970" lastFinishedPulling="2026-05-20 15:33:12.118564809 +0000 UTC m=+23.333487587" observedRunningTime="2026-05-20 15:33:12.594663477 +0000 UTC m=+23.809586270" watchObservedRunningTime="2026-05-20 15:33:12.59478444 +0000 UTC m=+23.809707230" May 20 15:33:13.566632 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:13.566588 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gvwgm" event={"ID":"271da0d2-8828-4630-8143-39ef6964f7f4","Type":"ContainerStarted","Data":"0aa3fdc0d70c271339bfa2145b953097c38fb51304c42ad582b98cdfaac1088a"} May 20 15:33:14.380087 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:14.379942 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wszj2" May 20 15:33:14.380087 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:14.379942 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dv77n" May 20 15:33:14.380330 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:33:14.380094 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wszj2" podUID="54872a9c-6091-4768-8cd9-e81ab987ba01" May 20 15:33:14.380330 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:33:14.380172 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dv77n" podUID="ae4048cd-ad5b-4154-8b48-47363ccceda4" May 20 15:33:14.890608 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:14.890576 2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-r9qzn" May 20 15:33:14.891272 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:14.891249 2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-r9qzn" May 20 15:33:15.570827 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:15.570793 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-r9qzn" May 20 15:33:15.571329 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:15.571308 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-r9qzn" May 20 15:33:16.379729 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:16.379707 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dv77n" May 20 15:33:16.380427 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:16.379707 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wszj2" May 20 15:33:16.380427 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:33:16.379893 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wszj2" podUID="54872a9c-6091-4768-8cd9-e81ab987ba01" May 20 15:33:16.380427 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:33:16.379807 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dv77n" podUID="ae4048cd-ad5b-4154-8b48-47363ccceda4" May 20 15:33:16.578613 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:16.575999 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gvwgm" event={"ID":"271da0d2-8828-4630-8143-39ef6964f7f4","Type":"ContainerStarted","Data":"28430df14f5d7a5ea1c65d8e7069ce369b644e35fa3f77dc6e9de4d69b7d267a"} May 20 15:33:16.578613 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:16.578309 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gvwgm" May 20 15:33:16.578613 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:16.578337 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gvwgm" May 20 15:33:16.578613 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:16.578360 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gvwgm" May 20 15:33:16.580179 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:16.580153 2557 generic.go:358] "Generic (PLEG): container finished" podID="d4425adc-866b-4a45-8857-4a90c111f6ff" containerID="b2d6ca4a3f2931fcfc395ffced799eec6e67c23e240cbc868732a89a13e5cd14" exitCode=0 May 20 15:33:16.580307 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:16.580243 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tzz5f" event={"ID":"d4425adc-866b-4a45-8857-4a90c111f6ff","Type":"ContainerDied","Data":"b2d6ca4a3f2931fcfc395ffced799eec6e67c23e240cbc868732a89a13e5cd14"} May 20 15:33:16.594773 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:16.594754 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gvwgm" May 20 15:33:16.594886 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:16.594833 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gvwgm" May 20 15:33:16.609193 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:16.609158 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-gvwgm" podStartSLOduration=8.137792389 podStartE2EDuration="27.609147425s" podCreationTimestamp="2026-05-20 15:32:49 +0000 UTC" firstStartedPulling="2026-05-20 15:32:50.614990335 +0000 UTC m=+1.829913120" lastFinishedPulling="2026-05-20 15:33:10.086345385 +0000 UTC m=+21.301268156" observedRunningTime="2026-05-20 15:33:16.608689989 +0000 UTC m=+27.823612802" watchObservedRunningTime="2026-05-20 15:33:16.609147425 +0000 UTC m=+27.824070239" May 20 15:33:17.583464 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:17.583247 2557 generic.go:358] "Generic (PLEG): container finished" podID="d4425adc-866b-4a45-8857-4a90c111f6ff" containerID="f96238fe8a75d88778aa4437394108a65ed6e6b61ddf0d2b0422b66db219d162" exitCode=0 May 20 15:33:17.583464 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:17.583324 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tzz5f" event={"ID":"d4425adc-866b-4a45-8857-4a90c111f6ff","Type":"ContainerDied","Data":"f96238fe8a75d88778aa4437394108a65ed6e6b61ddf0d2b0422b66db219d162"} May 20 15:33:17.649219 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:17.649171 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dv77n"] May 20 15:33:17.649386 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:17.649313 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dv77n" May 20 15:33:17.649453 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:33:17.649418 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dv77n" podUID="ae4048cd-ad5b-4154-8b48-47363ccceda4" May 20 15:33:17.650206 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:17.650181 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wszj2"] May 20 15:33:17.650334 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:17.650282 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wszj2" May 20 15:33:17.650401 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:33:17.650377 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wszj2" podUID="54872a9c-6091-4768-8cd9-e81ab987ba01" May 20 15:33:18.587784 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:18.587747 2557 generic.go:358] "Generic (PLEG): container finished" podID="d4425adc-866b-4a45-8857-4a90c111f6ff" containerID="e86a20fff58b7f4837a2e50df890538aa3733af81249f7385c34634135db638f" exitCode=0 May 20 15:33:18.588249 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:18.587829 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tzz5f" event={"ID":"d4425adc-866b-4a45-8857-4a90c111f6ff","Type":"ContainerDied","Data":"e86a20fff58b7f4837a2e50df890538aa3733af81249f7385c34634135db638f"} May 20 15:33:19.380793 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:19.380762 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wszj2" May 20 15:33:19.380989 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:33:19.380901 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wszj2" podUID="54872a9c-6091-4768-8cd9-e81ab987ba01" May 20 15:33:19.380989 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:19.380936 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dv77n" May 20 15:33:19.381070 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:33:19.381018 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dv77n" podUID="ae4048cd-ad5b-4154-8b48-47363ccceda4" May 20 15:33:21.379753 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:21.379718 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wszj2" May 20 15:33:21.380184 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:21.379717 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dv77n" May 20 15:33:21.380184 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:33:21.379852 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wszj2" podUID="54872a9c-6091-4768-8cd9-e81ab987ba01" May 20 15:33:21.380184 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:33:21.379926 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dv77n" podUID="ae4048cd-ad5b-4154-8b48-47363ccceda4" May 20 15:33:21.990676 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:21.990644 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54872a9c-6091-4768-8cd9-e81ab987ba01-metrics-certs\") pod \"network-metrics-daemon-wszj2\" (UID: \"54872a9c-6091-4768-8cd9-e81ab987ba01\") " pod="openshift-multus/network-metrics-daemon-wszj2" May 20 15:33:21.990855 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:33:21.990800 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 20 15:33:21.990900 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:33:21.990882 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54872a9c-6091-4768-8cd9-e81ab987ba01-metrics-certs podName:54872a9c-6091-4768-8cd9-e81ab987ba01 nodeName:}" failed. No retries permitted until 2026-05-20 15:33:53.990866558 +0000 UTC m=+65.205789329 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/54872a9c-6091-4768-8cd9-e81ab987ba01-metrics-certs") pod "network-metrics-daemon-wszj2" (UID: "54872a9c-6091-4768-8cd9-e81ab987ba01") : object "openshift-multus"/"metrics-daemon-secret" not registered May 20 15:33:22.091147 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:22.091102 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ft5ww\" (UniqueName: \"kubernetes.io/projected/ae4048cd-ad5b-4154-8b48-47363ccceda4-kube-api-access-ft5ww\") pod \"network-check-target-dv77n\" (UID: \"ae4048cd-ad5b-4154-8b48-47363ccceda4\") " pod="openshift-network-diagnostics/network-check-target-dv77n" May 20 15:33:22.091306 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:33:22.091229 2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 20 15:33:22.091306 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:33:22.091245 2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 20 15:33:22.091306 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:33:22.091255 2557 projected.go:194] Error preparing data for projected volume kube-api-access-ft5ww for pod openshift-network-diagnostics/network-check-target-dv77n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 15:33:22.091306 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:33:22.091301 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae4048cd-ad5b-4154-8b48-47363ccceda4-kube-api-access-ft5ww podName:ae4048cd-ad5b-4154-8b48-47363ccceda4 nodeName:}" failed. No retries permitted until 2026-05-20 15:33:54.091288922 +0000 UTC m=+65.306211693 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-ft5ww" (UniqueName: "kubernetes.io/projected/ae4048cd-ad5b-4154-8b48-47363ccceda4-kube-api-access-ft5ww") pod "network-check-target-dv77n" (UID: "ae4048cd-ad5b-4154-8b48-47363ccceda4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 15:33:23.072037 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:23.072004 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-228.ec2.internal" event="NodeReady" May 20 15:33:23.072465 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:23.072161 2557 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 20 15:33:23.117187 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:23.117137 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-hxl9x"] May 20 15:33:23.135540 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:23.135502 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-fvbkd"] May 20 15:33:23.135700 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:23.135653 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hxl9x" May 20 15:33:23.137946 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:23.137924 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 20 15:33:23.138073 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:23.138002 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-j6j2b\"" May 20 15:33:23.138178 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:23.138162 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 20 15:33:23.149346 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:23.149324 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hxl9x"] May 20 15:33:23.149460 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:23.149354 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fvbkd"] May 20 15:33:23.149460 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:23.149447 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fvbkd" May 20 15:33:23.151868 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:23.151845 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 20 15:33:23.151996 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:23.151975 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-94zvt\"" May 20 15:33:23.152060 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:23.152050 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 20 15:33:23.152322 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:23.152155 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 20 15:33:23.201788 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:23.198496 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fcbc1cf6-64e2-42ce-b29d-2c21b26668ce-config-volume\") pod \"dns-default-hxl9x\" (UID: \"fcbc1cf6-64e2-42ce-b29d-2c21b26668ce\") " pod="openshift-dns/dns-default-hxl9x" May 20 15:33:23.201788 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:23.198598 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fcbc1cf6-64e2-42ce-b29d-2c21b26668ce-tmp-dir\") pod \"dns-default-hxl9x\" (UID: \"fcbc1cf6-64e2-42ce-b29d-2c21b26668ce\") " pod="openshift-dns/dns-default-hxl9x" May 20 15:33:23.201788 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:23.198651 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mv6nw\" (UniqueName: \"kubernetes.io/projected/fcbc1cf6-64e2-42ce-b29d-2c21b26668ce-kube-api-access-mv6nw\") pod \"dns-default-hxl9x\" (UID: \"fcbc1cf6-64e2-42ce-b29d-2c21b26668ce\") " pod="openshift-dns/dns-default-hxl9x" May 20 15:33:23.201788 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:23.198693 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fcbc1cf6-64e2-42ce-b29d-2c21b26668ce-metrics-tls\") pod \"dns-default-hxl9x\" (UID: \"fcbc1cf6-64e2-42ce-b29d-2c21b26668ce\") " pod="openshift-dns/dns-default-hxl9x" May 20 15:33:23.299635 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:23.299582 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fcbc1cf6-64e2-42ce-b29d-2c21b26668ce-config-volume\") pod \"dns-default-hxl9x\" (UID: \"fcbc1cf6-64e2-42ce-b29d-2c21b26668ce\") " pod="openshift-dns/dns-default-hxl9x" May 20 15:33:23.299635 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:23.299632 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fcbc1cf6-64e2-42ce-b29d-2c21b26668ce-tmp-dir\") pod \"dns-default-hxl9x\" (UID: \"fcbc1cf6-64e2-42ce-b29d-2c21b26668ce\") " pod="openshift-dns/dns-default-hxl9x" May 20 15:33:23.300463 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:23.299657 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mv6nw\" (UniqueName: \"kubernetes.io/projected/fcbc1cf6-64e2-42ce-b29d-2c21b26668ce-kube-api-access-mv6nw\") pod \"dns-default-hxl9x\" (UID: \"fcbc1cf6-64e2-42ce-b29d-2c21b26668ce\") " pod="openshift-dns/dns-default-hxl9x" May 20 15:33:23.300463 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:23.299685 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fcbc1cf6-64e2-42ce-b29d-2c21b26668ce-metrics-tls\") pod \"dns-default-hxl9x\" (UID: \"fcbc1cf6-64e2-42ce-b29d-2c21b26668ce\") " pod="openshift-dns/dns-default-hxl9x" May 20 15:33:23.300463 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:23.299716 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6qcf\" (UniqueName: \"kubernetes.io/projected/9f13da06-401d-412b-a532-a02a3a620761-kube-api-access-k6qcf\") pod \"ingress-canary-fvbkd\" (UID: \"9f13da06-401d-412b-a532-a02a3a620761\") " pod="openshift-ingress-canary/ingress-canary-fvbkd" May 20 15:33:23.300463 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:23.299779 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9f13da06-401d-412b-a532-a02a3a620761-cert\") pod \"ingress-canary-fvbkd\" (UID: \"9f13da06-401d-412b-a532-a02a3a620761\") " pod="openshift-ingress-canary/ingress-canary-fvbkd" May 20 15:33:23.300463 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:33:23.299949 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 20 15:33:23.300463 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:23.300002 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fcbc1cf6-64e2-42ce-b29d-2c21b26668ce-tmp-dir\") pod \"dns-default-hxl9x\" (UID: \"fcbc1cf6-64e2-42ce-b29d-2c21b26668ce\") " pod="openshift-dns/dns-default-hxl9x" May 20 15:33:23.300463 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:33:23.300051 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcbc1cf6-64e2-42ce-b29d-2c21b26668ce-metrics-tls podName:fcbc1cf6-64e2-42ce-b29d-2c21b26668ce nodeName:}" failed. No retries permitted until 2026-05-20 15:33:23.800024599 +0000 UTC m=+35.014947372 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fcbc1cf6-64e2-42ce-b29d-2c21b26668ce-metrics-tls") pod "dns-default-hxl9x" (UID: "fcbc1cf6-64e2-42ce-b29d-2c21b26668ce") : secret "dns-default-metrics-tls" not found May 20 15:33:23.300463 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:23.300274 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fcbc1cf6-64e2-42ce-b29d-2c21b26668ce-config-volume\") pod \"dns-default-hxl9x\" (UID: \"fcbc1cf6-64e2-42ce-b29d-2c21b26668ce\") " pod="openshift-dns/dns-default-hxl9x" May 20 15:33:23.311230 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:23.311207 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mv6nw\" (UniqueName: \"kubernetes.io/projected/fcbc1cf6-64e2-42ce-b29d-2c21b26668ce-kube-api-access-mv6nw\") pod \"dns-default-hxl9x\" (UID: \"fcbc1cf6-64e2-42ce-b29d-2c21b26668ce\") " pod="openshift-dns/dns-default-hxl9x" May 20 15:33:23.379804 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:23.379731 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dv77n" May 20 15:33:23.379804 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:23.379757 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wszj2" May 20 15:33:23.382675 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:23.382377 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 20 15:33:23.382675 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:23.382434 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xw7hl\"" May 20 15:33:23.382675 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:23.382482 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 20 15:33:23.382675 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:23.382438 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-79qfs\"" May 20 15:33:23.382675 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:23.382377 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 20 15:33:23.400509 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:23.400490 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k6qcf\" (UniqueName: \"kubernetes.io/projected/9f13da06-401d-412b-a532-a02a3a620761-kube-api-access-k6qcf\") pod \"ingress-canary-fvbkd\" (UID: \"9f13da06-401d-412b-a532-a02a3a620761\") " pod="openshift-ingress-canary/ingress-canary-fvbkd" May 20 15:33:23.400608 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:23.400576 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9f13da06-401d-412b-a532-a02a3a620761-cert\") pod \"ingress-canary-fvbkd\" (UID: \"9f13da06-401d-412b-a532-a02a3a620761\") " pod="openshift-ingress-canary/ingress-canary-fvbkd" May 20 15:33:23.400683 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:33:23.400670 2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 20 15:33:23.400752 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:33:23.400740 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f13da06-401d-412b-a532-a02a3a620761-cert podName:9f13da06-401d-412b-a532-a02a3a620761 nodeName:}" failed. No retries permitted until 2026-05-20 15:33:23.900721432 +0000 UTC m=+35.115644206 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9f13da06-401d-412b-a532-a02a3a620761-cert") pod "ingress-canary-fvbkd" (UID: "9f13da06-401d-412b-a532-a02a3a620761") : secret "canary-serving-cert" not found May 20 15:33:23.411549 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:23.411526 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6qcf\" (UniqueName: \"kubernetes.io/projected/9f13da06-401d-412b-a532-a02a3a620761-kube-api-access-k6qcf\") pod \"ingress-canary-fvbkd\" (UID: \"9f13da06-401d-412b-a532-a02a3a620761\") " pod="openshift-ingress-canary/ingress-canary-fvbkd" May 20 15:33:23.804649 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:23.804608 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fcbc1cf6-64e2-42ce-b29d-2c21b26668ce-metrics-tls\") pod \"dns-default-hxl9x\" (UID: \"fcbc1cf6-64e2-42ce-b29d-2c21b26668ce\") " pod="openshift-dns/dns-default-hxl9x" May 20 15:33:23.804907 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:33:23.804760 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 20 15:33:23.804907 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:33:23.804858 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcbc1cf6-64e2-42ce-b29d-2c21b26668ce-metrics-tls podName:fcbc1cf6-64e2-42ce-b29d-2c21b26668ce nodeName:}" failed. No retries permitted until 2026-05-20 15:33:24.804836694 +0000 UTC m=+36.019759469 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fcbc1cf6-64e2-42ce-b29d-2c21b26668ce-metrics-tls") pod "dns-default-hxl9x" (UID: "fcbc1cf6-64e2-42ce-b29d-2c21b26668ce") : secret "dns-default-metrics-tls" not found May 20 15:33:23.905829 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:23.905783 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9f13da06-401d-412b-a532-a02a3a620761-cert\") pod \"ingress-canary-fvbkd\" (UID: \"9f13da06-401d-412b-a532-a02a3a620761\") " pod="openshift-ingress-canary/ingress-canary-fvbkd" May 20 15:33:23.906014 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:33:23.905946 2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 20 15:33:23.906014 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:33:23.906009 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f13da06-401d-412b-a532-a02a3a620761-cert podName:9f13da06-401d-412b-a532-a02a3a620761 nodeName:}" failed. No retries permitted until 2026-05-20 15:33:24.905995074 +0000 UTC m=+36.120917853 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9f13da06-401d-412b-a532-a02a3a620761-cert") pod "ingress-canary-fvbkd" (UID: "9f13da06-401d-412b-a532-a02a3a620761") : secret "canary-serving-cert" not found May 20 15:33:24.812449 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:24.812425 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fcbc1cf6-64e2-42ce-b29d-2c21b26668ce-metrics-tls\") pod \"dns-default-hxl9x\" (UID: \"fcbc1cf6-64e2-42ce-b29d-2c21b26668ce\") " pod="openshift-dns/dns-default-hxl9x" May 20 15:33:24.812838 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:33:24.812561 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 20 15:33:24.812838 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:33:24.812607 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcbc1cf6-64e2-42ce-b29d-2c21b26668ce-metrics-tls podName:fcbc1cf6-64e2-42ce-b29d-2c21b26668ce nodeName:}" failed. No retries permitted until 2026-05-20 15:33:26.812594276 +0000 UTC m=+38.027517048 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fcbc1cf6-64e2-42ce-b29d-2c21b26668ce-metrics-tls") pod "dns-default-hxl9x" (UID: "fcbc1cf6-64e2-42ce-b29d-2c21b26668ce") : secret "dns-default-metrics-tls" not found May 20 15:33:24.912802 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:24.912778 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9f13da06-401d-412b-a532-a02a3a620761-cert\") pod \"ingress-canary-fvbkd\" (UID: \"9f13da06-401d-412b-a532-a02a3a620761\") " pod="openshift-ingress-canary/ingress-canary-fvbkd" May 20 15:33:24.912945 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:33:24.912926 2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 20 15:33:24.913017 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:33:24.913007 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f13da06-401d-412b-a532-a02a3a620761-cert podName:9f13da06-401d-412b-a532-a02a3a620761 nodeName:}" failed. No retries permitted until 2026-05-20 15:33:26.91298743 +0000 UTC m=+38.127910204 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9f13da06-401d-412b-a532-a02a3a620761-cert") pod "ingress-canary-fvbkd" (UID: "9f13da06-401d-412b-a532-a02a3a620761") : secret "canary-serving-cert" not found May 20 15:33:25.603579 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:25.603542 2557 generic.go:358] "Generic (PLEG): container finished" podID="d4425adc-866b-4a45-8857-4a90c111f6ff" containerID="c31cc4e0246c00e86a9b756f2eea9b2d9a61e2ec357609066c7b102fc263119f" exitCode=0 May 20 15:33:25.603750 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:25.603607 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tzz5f" event={"ID":"d4425adc-866b-4a45-8857-4a90c111f6ff","Type":"ContainerDied","Data":"c31cc4e0246c00e86a9b756f2eea9b2d9a61e2ec357609066c7b102fc263119f"} May 20 15:33:26.608079 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:26.608049 2557 generic.go:358] "Generic (PLEG): container finished" podID="d4425adc-866b-4a45-8857-4a90c111f6ff" containerID="647c0e6a74d059f75082f4af84ba1c5cbe4d4dc1481eff194b44478ca7ca99fe" exitCode=0 May 20 15:33:26.608609 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:26.608085 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tzz5f" event={"ID":"d4425adc-866b-4a45-8857-4a90c111f6ff","Type":"ContainerDied","Data":"647c0e6a74d059f75082f4af84ba1c5cbe4d4dc1481eff194b44478ca7ca99fe"} May 20 15:33:26.828084 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:26.828051 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fcbc1cf6-64e2-42ce-b29d-2c21b26668ce-metrics-tls\") pod \"dns-default-hxl9x\" (UID: \"fcbc1cf6-64e2-42ce-b29d-2c21b26668ce\") " pod="openshift-dns/dns-default-hxl9x" May 20 15:33:26.828210 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:33:26.828192 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 20 15:33:26.828266 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:33:26.828256 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcbc1cf6-64e2-42ce-b29d-2c21b26668ce-metrics-tls podName:fcbc1cf6-64e2-42ce-b29d-2c21b26668ce nodeName:}" failed. No retries permitted until 2026-05-20 15:33:30.82823635 +0000 UTC m=+42.043159124 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fcbc1cf6-64e2-42ce-b29d-2c21b26668ce-metrics-tls") pod "dns-default-hxl9x" (UID: "fcbc1cf6-64e2-42ce-b29d-2c21b26668ce") : secret "dns-default-metrics-tls" not found May 20 15:33:26.928636 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:26.928567 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9f13da06-401d-412b-a532-a02a3a620761-cert\") pod \"ingress-canary-fvbkd\" (UID: \"9f13da06-401d-412b-a532-a02a3a620761\") " pod="openshift-ingress-canary/ingress-canary-fvbkd" May 20 15:33:26.928755 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:33:26.928686 2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 20 15:33:26.928755 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:33:26.928736 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f13da06-401d-412b-a532-a02a3a620761-cert podName:9f13da06-401d-412b-a532-a02a3a620761 nodeName:}" failed. No retries permitted until 2026-05-20 15:33:30.928722292 +0000 UTC m=+42.143645063 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9f13da06-401d-412b-a532-a02a3a620761-cert") pod "ingress-canary-fvbkd" (UID: "9f13da06-401d-412b-a532-a02a3a620761") : secret "canary-serving-cert" not found May 20 15:33:27.612737 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:27.612703 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tzz5f" event={"ID":"d4425adc-866b-4a45-8857-4a90c111f6ff","Type":"ContainerStarted","Data":"334ce1a2af80239fcc3156c2d0e16a1224aa1edc54efc1ca99c7ee1f4c54e4eb"} May 20 15:33:27.643325 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:27.643278 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-tzz5f" podStartSLOduration=4.584017616 podStartE2EDuration="38.643266682s" podCreationTimestamp="2026-05-20 15:32:49 +0000 UTC" firstStartedPulling="2026-05-20 15:32:50.586312393 +0000 UTC m=+1.801235187" lastFinishedPulling="2026-05-20 15:33:24.645561483 +0000 UTC m=+35.860484253" observedRunningTime="2026-05-20 15:33:27.641776443 +0000 UTC m=+38.856699236" watchObservedRunningTime="2026-05-20 15:33:27.643266682 +0000 UTC m=+38.858189475" May 20 15:33:30.856564 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:30.856525 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fcbc1cf6-64e2-42ce-b29d-2c21b26668ce-metrics-tls\") pod \"dns-default-hxl9x\" (UID: \"fcbc1cf6-64e2-42ce-b29d-2c21b26668ce\") " pod="openshift-dns/dns-default-hxl9x" May 20 15:33:30.857219 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:33:30.856688 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 20 15:33:30.857219 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:33:30.856772 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcbc1cf6-64e2-42ce-b29d-2c21b26668ce-metrics-tls podName:fcbc1cf6-64e2-42ce-b29d-2c21b26668ce nodeName:}" failed. No retries permitted until 2026-05-20 15:33:38.856751227 +0000 UTC m=+50.071674012 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fcbc1cf6-64e2-42ce-b29d-2c21b26668ce-metrics-tls") pod "dns-default-hxl9x" (UID: "fcbc1cf6-64e2-42ce-b29d-2c21b26668ce") : secret "dns-default-metrics-tls" not found May 20 15:33:30.957502 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:30.957467 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9f13da06-401d-412b-a532-a02a3a620761-cert\") pod \"ingress-canary-fvbkd\" (UID: \"9f13da06-401d-412b-a532-a02a3a620761\") " pod="openshift-ingress-canary/ingress-canary-fvbkd" May 20 15:33:30.957643 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:33:30.957574 2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 20 15:33:30.957643 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:33:30.957628 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f13da06-401d-412b-a532-a02a3a620761-cert podName:9f13da06-401d-412b-a532-a02a3a620761 nodeName:}" failed. No retries permitted until 2026-05-20 15:33:38.957612065 +0000 UTC m=+50.172534841 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9f13da06-401d-412b-a532-a02a3a620761-cert") pod "ingress-canary-fvbkd" (UID: "9f13da06-401d-412b-a532-a02a3a620761") : secret "canary-serving-cert" not found May 20 15:33:38.912782 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:38.912745 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fcbc1cf6-64e2-42ce-b29d-2c21b26668ce-metrics-tls\") pod \"dns-default-hxl9x\" (UID: \"fcbc1cf6-64e2-42ce-b29d-2c21b26668ce\") " pod="openshift-dns/dns-default-hxl9x" May 20 15:33:38.913160 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:33:38.912869 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 20 15:33:38.913160 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:33:38.912925 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcbc1cf6-64e2-42ce-b29d-2c21b26668ce-metrics-tls podName:fcbc1cf6-64e2-42ce-b29d-2c21b26668ce nodeName:}" failed. No retries permitted until 2026-05-20 15:33:54.912910049 +0000 UTC m=+66.127832820 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fcbc1cf6-64e2-42ce-b29d-2c21b26668ce-metrics-tls") pod "dns-default-hxl9x" (UID: "fcbc1cf6-64e2-42ce-b29d-2c21b26668ce") : secret "dns-default-metrics-tls" not found May 20 15:33:39.012980 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:39.012950 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9f13da06-401d-412b-a532-a02a3a620761-cert\") pod \"ingress-canary-fvbkd\" (UID: \"9f13da06-401d-412b-a532-a02a3a620761\") " pod="openshift-ingress-canary/ingress-canary-fvbkd" May 20 15:33:39.013126 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:33:39.013103 2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 20 15:33:39.013181 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:33:39.013170 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f13da06-401d-412b-a532-a02a3a620761-cert podName:9f13da06-401d-412b-a532-a02a3a620761 nodeName:}" failed. No retries permitted until 2026-05-20 15:33:55.013155428 +0000 UTC m=+66.228078203 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9f13da06-401d-412b-a532-a02a3a620761-cert") pod "ingress-canary-fvbkd" (UID: "9f13da06-401d-412b-a532-a02a3a620761") : secret "canary-serving-cert" not found May 20 15:33:48.598791 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:48.598759 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gvwgm" May 20 15:33:54.018780 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:54.018744 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54872a9c-6091-4768-8cd9-e81ab987ba01-metrics-certs\") pod \"network-metrics-daemon-wszj2\" (UID: \"54872a9c-6091-4768-8cd9-e81ab987ba01\") " pod="openshift-multus/network-metrics-daemon-wszj2" May 20 15:33:54.021507 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:54.021488 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 20 15:33:54.029314 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:33:54.029299 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 20 15:33:54.029367 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:33:54.029356 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54872a9c-6091-4768-8cd9-e81ab987ba01-metrics-certs podName:54872a9c-6091-4768-8cd9-e81ab987ba01 nodeName:}" failed. No retries permitted until 2026-05-20 15:34:58.029339837 +0000 UTC m=+129.244262608 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/54872a9c-6091-4768-8cd9-e81ab987ba01-metrics-certs") pod "network-metrics-daemon-wszj2" (UID: "54872a9c-6091-4768-8cd9-e81ab987ba01") : secret "metrics-daemon-secret" not found May 20 15:33:54.120078 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:54.120047 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ft5ww\" (UniqueName: \"kubernetes.io/projected/ae4048cd-ad5b-4154-8b48-47363ccceda4-kube-api-access-ft5ww\") pod \"network-check-target-dv77n\" (UID: \"ae4048cd-ad5b-4154-8b48-47363ccceda4\") " pod="openshift-network-diagnostics/network-check-target-dv77n" May 20 15:33:54.122889 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:54.122870 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 20 15:33:54.133006 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:54.132987 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 20 15:33:54.143549 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:54.143522 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ft5ww\" (UniqueName: \"kubernetes.io/projected/ae4048cd-ad5b-4154-8b48-47363ccceda4-kube-api-access-ft5ww\") pod \"network-check-target-dv77n\" (UID: \"ae4048cd-ad5b-4154-8b48-47363ccceda4\") " pod="openshift-network-diagnostics/network-check-target-dv77n" May 20 15:33:54.295416 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:54.295334 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xw7hl\"" May 20 15:33:54.303201 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:54.303180 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dv77n" May 20 15:33:54.477920 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:54.477869 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dv77n"] May 20 15:33:54.481896 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:33:54.481833 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae4048cd_ad5b_4154_8b48_47363ccceda4.slice/crio-4c42a238ae437d2b59cc8a05e2b7983f1787e9397543987ed207057efbada37a WatchSource:0}: Error finding container 4c42a238ae437d2b59cc8a05e2b7983f1787e9397543987ed207057efbada37a: Status 404 returned error can't find the container with id 4c42a238ae437d2b59cc8a05e2b7983f1787e9397543987ed207057efbada37a May 20 15:33:54.666683 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:54.666602 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dv77n" event={"ID":"ae4048cd-ad5b-4154-8b48-47363ccceda4","Type":"ContainerStarted","Data":"4c42a238ae437d2b59cc8a05e2b7983f1787e9397543987ed207057efbada37a"} May 20 15:33:54.925141 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:54.925063 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fcbc1cf6-64e2-42ce-b29d-2c21b26668ce-metrics-tls\") pod \"dns-default-hxl9x\" (UID: \"fcbc1cf6-64e2-42ce-b29d-2c21b26668ce\") " pod="openshift-dns/dns-default-hxl9x" May 20 15:33:54.925298 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:33:54.925232 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 20 15:33:54.925358 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:33:54.925314 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcbc1cf6-64e2-42ce-b29d-2c21b26668ce-metrics-tls podName:fcbc1cf6-64e2-42ce-b29d-2c21b26668ce nodeName:}" failed. No retries permitted until 2026-05-20 15:34:26.925291501 +0000 UTC m=+98.140214272 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fcbc1cf6-64e2-42ce-b29d-2c21b26668ce-metrics-tls") pod "dns-default-hxl9x" (UID: "fcbc1cf6-64e2-42ce-b29d-2c21b26668ce") : secret "dns-default-metrics-tls" not found May 20 15:33:55.026140 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:55.026101 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9f13da06-401d-412b-a532-a02a3a620761-cert\") pod \"ingress-canary-fvbkd\" (UID: \"9f13da06-401d-412b-a532-a02a3a620761\") " pod="openshift-ingress-canary/ingress-canary-fvbkd" May 20 15:33:55.026569 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:33:55.026236 2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 20 15:33:55.026569 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:33:55.026298 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f13da06-401d-412b-a532-a02a3a620761-cert podName:9f13da06-401d-412b-a532-a02a3a620761 nodeName:}" failed. No retries permitted until 2026-05-20 15:34:27.02627854 +0000 UTC m=+98.241201315 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9f13da06-401d-412b-a532-a02a3a620761-cert") pod "ingress-canary-fvbkd" (UID: "9f13da06-401d-412b-a532-a02a3a620761") : secret "canary-serving-cert" not found May 20 15:33:57.674626 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:57.674545 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dv77n" event={"ID":"ae4048cd-ad5b-4154-8b48-47363ccceda4","Type":"ContainerStarted","Data":"5294f0778defe8f126bda3cea640bc019576f2df59489dcda5459d8647f88c6b"} May 20 15:33:57.675024 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:57.674690 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-dv77n" May 20 15:33:57.696912 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:33:57.696867 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-dv77n" podStartSLOduration=65.956858383 podStartE2EDuration="1m8.696854153s" podCreationTimestamp="2026-05-20 15:32:49 +0000 UTC" firstStartedPulling="2026-05-20 15:33:54.483784005 +0000 UTC m=+65.698706776" lastFinishedPulling="2026-05-20 15:33:57.223779773 +0000 UTC m=+68.438702546" observedRunningTime="2026-05-20 15:33:57.696425512 +0000 UTC m=+68.911348307" watchObservedRunningTime="2026-05-20 15:33:57.696854153 +0000 UTC m=+68.911776945" May 20 15:34:26.947063 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:26.947016 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fcbc1cf6-64e2-42ce-b29d-2c21b26668ce-metrics-tls\") pod \"dns-default-hxl9x\" (UID: \"fcbc1cf6-64e2-42ce-b29d-2c21b26668ce\") " pod="openshift-dns/dns-default-hxl9x" May 20 15:34:26.947604 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:34:26.947161 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 20 15:34:26.947604 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:34:26.947227 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcbc1cf6-64e2-42ce-b29d-2c21b26668ce-metrics-tls podName:fcbc1cf6-64e2-42ce-b29d-2c21b26668ce nodeName:}" failed. No retries permitted until 2026-05-20 15:35:30.94720995 +0000 UTC m=+162.162132721 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fcbc1cf6-64e2-42ce-b29d-2c21b26668ce-metrics-tls") pod "dns-default-hxl9x" (UID: "fcbc1cf6-64e2-42ce-b29d-2c21b26668ce") : secret "dns-default-metrics-tls" not found May 20 15:34:27.047984 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:27.047956 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9f13da06-401d-412b-a532-a02a3a620761-cert\") pod \"ingress-canary-fvbkd\" (UID: \"9f13da06-401d-412b-a532-a02a3a620761\") " pod="openshift-ingress-canary/ingress-canary-fvbkd" May 20 15:34:27.048086 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:34:27.048073 2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 20 15:34:27.048148 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:34:27.048138 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f13da06-401d-412b-a532-a02a3a620761-cert podName:9f13da06-401d-412b-a532-a02a3a620761 nodeName:}" failed. No retries permitted until 2026-05-20 15:35:31.048124968 +0000 UTC m=+162.263047740 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9f13da06-401d-412b-a532-a02a3a620761-cert") pod "ingress-canary-fvbkd" (UID: "9f13da06-401d-412b-a532-a02a3a620761") : secret "canary-serving-cert" not found May 20 15:34:28.679386 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:28.679348 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-dv77n" May 20 15:34:52.495003 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.494971 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-gwx4j"] May 20 15:34:52.498255 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.498233 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-cst47"] May 20 15:34:52.498390 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.498376 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-gwx4j" May 20 15:34:52.500425 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.500408 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-cst47" May 20 15:34:52.502595 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.502578 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-f5x47\"" May 20 15:34:52.503102 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.503084 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" May 20 15:34:52.503197 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.503114 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" May 20 15:34:52.503197 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.503124 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" May 20 15:34:52.503314 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.503252 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" May 20 15:34:52.503408 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.503372 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-7vgjd\"" May 20 15:34:52.507637 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.507602 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" May 20 15:34:52.513090 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.513070 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-gwx4j"] May 20 15:34:52.513868 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.513848 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-cst47"] May 20 15:34:52.607141 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.607107 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-qrbth"] May 20 15:34:52.609031 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.609016 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-qrbth" May 20 15:34:52.611405 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.611380 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" May 20 15:34:52.611512 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.611383 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-smlfl\"" May 20 15:34:52.611569 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.611430 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" May 20 15:34:52.618739 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.618716 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/574489b4-f926-4667-be55-8e4e4d4f98e4-serving-cert\") pod \"console-operator-76dff48d59-gwx4j\" (UID: \"574489b4-f926-4667-be55-8e4e4d4f98e4\") " pod="openshift-console-operator/console-operator-76dff48d59-gwx4j" May 20 15:34:52.618855 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.618771 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24trp\" (UniqueName: \"kubernetes.io/projected/251edcb6-4345-4fe1-8388-5c973498cbc4-kube-api-access-24trp\") pod \"network-check-source-7f44b6dd87-cst47\" (UID: \"251edcb6-4345-4fe1-8388-5c973498cbc4\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-cst47" May 20 15:34:52.618855 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.618790 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfs4s\" (UniqueName: \"kubernetes.io/projected/574489b4-f926-4667-be55-8e4e4d4f98e4-kube-api-access-sfs4s\") pod \"console-operator-76dff48d59-gwx4j\" (UID: \"574489b4-f926-4667-be55-8e4e4d4f98e4\") " pod="openshift-console-operator/console-operator-76dff48d59-gwx4j" May 20 15:34:52.618975 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.618951 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/574489b4-f926-4667-be55-8e4e4d4f98e4-config\") pod \"console-operator-76dff48d59-gwx4j\" (UID: \"574489b4-f926-4667-be55-8e4e4d4f98e4\") " pod="openshift-console-operator/console-operator-76dff48d59-gwx4j" May 20 15:34:52.619019 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.618996 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/574489b4-f926-4667-be55-8e4e4d4f98e4-trusted-ca\") pod \"console-operator-76dff48d59-gwx4j\" (UID: \"574489b4-f926-4667-be55-8e4e4d4f98e4\") " pod="openshift-console-operator/console-operator-76dff48d59-gwx4j" May 20 15:34:52.623737 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.623715 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-qrbth"] May 20 15:34:52.627513 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.627492 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-65694f9b86-s6z2z"] May 20 15:34:52.629377 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.629361 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-65f96ddd4b-pqgdt"] May 20 15:34:52.629529 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.629513 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-65694f9b86-s6z2z" May 20 15:34:52.631509 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.631490 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65f96ddd4b-pqgdt" May 20 15:34:52.636206 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.636186 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" May 20 15:34:52.636902 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.636880 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 20 15:34:52.637007 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.636914 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 20 15:34:52.637152 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.637136 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-2gccf\"" May 20 15:34:52.637213 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.637195 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 20 15:34:52.637213 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.637200 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-szqzx\"" May 20 15:34:52.637312 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.637244 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 20 15:34:52.637312 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.637273 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" May 20 15:34:52.637410 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.637316 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" May 20 15:34:52.637410 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.637216 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 20 15:34:52.637410 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.637322 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" May 20 15:34:52.645982 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.645965 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 20 15:34:52.649635 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.649607 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-65694f9b86-s6z2z"] May 20 15:34:52.669487 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.669458 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-65f96ddd4b-pqgdt"] May 20 15:34:52.719428 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.719400 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/574489b4-f926-4667-be55-8e4e4d4f98e4-config\") pod \"console-operator-76dff48d59-gwx4j\" (UID: \"574489b4-f926-4667-be55-8e4e4d4f98e4\") " pod="openshift-console-operator/console-operator-76dff48d59-gwx4j" May 20 15:34:52.719569 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.719437 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7b5ce08f-f82d-4226-b1b0-9dddccec11cd-registry-tls\") pod \"image-registry-65f96ddd4b-pqgdt\" (UID: \"7b5ce08f-f82d-4226-b1b0-9dddccec11cd\") " pod="openshift-image-registry/image-registry-65f96ddd4b-pqgdt" May 20 15:34:52.719569 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.719465 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/574489b4-f926-4667-be55-8e4e4d4f98e4-trusted-ca\") pod \"console-operator-76dff48d59-gwx4j\" (UID: \"574489b4-f926-4667-be55-8e4e4d4f98e4\") " pod="openshift-console-operator/console-operator-76dff48d59-gwx4j" May 20 15:34:52.719569 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.719512 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7b5ce08f-f82d-4226-b1b0-9dddccec11cd-image-registry-private-configuration\") pod \"image-registry-65f96ddd4b-pqgdt\" (UID: \"7b5ce08f-f82d-4226-b1b0-9dddccec11cd\") " pod="openshift-image-registry/image-registry-65f96ddd4b-pqgdt" May 20 15:34:52.719730 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.719633 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsg2j\" (UniqueName: \"kubernetes.io/projected/5b574a1a-8a5f-486e-94f7-8f388c7cf6b9-kube-api-access-gsg2j\") pod \"volume-data-source-validator-5cf8c89d64-qrbth\" (UID: \"5b574a1a-8a5f-486e-94f7-8f388c7cf6b9\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-qrbth" May 20 15:34:52.719730 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.719655 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/dd197f83-6962-416f-9520-6532a33ae2c1-default-certificate\") pod \"router-default-65694f9b86-s6z2z\" (UID: \"dd197f83-6962-416f-9520-6532a33ae2c1\") " pod="openshift-ingress/router-default-65694f9b86-s6z2z" May 20 15:34:52.719730 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.719692 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/574489b4-f926-4667-be55-8e4e4d4f98e4-serving-cert\") pod \"console-operator-76dff48d59-gwx4j\" (UID: \"574489b4-f926-4667-be55-8e4e4d4f98e4\") " pod="openshift-console-operator/console-operator-76dff48d59-gwx4j" May 20 15:34:52.719908 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.719753 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvbrn\" (UniqueName: \"kubernetes.io/projected/dd197f83-6962-416f-9520-6532a33ae2c1-kube-api-access-bvbrn\") pod \"router-default-65694f9b86-s6z2z\" (UID: \"dd197f83-6962-416f-9520-6532a33ae2c1\") " pod="openshift-ingress/router-default-65694f9b86-s6z2z" May 20 15:34:52.719908 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.719786 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-24trp\" (UniqueName: \"kubernetes.io/projected/251edcb6-4345-4fe1-8388-5c973498cbc4-kube-api-access-24trp\") pod \"network-check-source-7f44b6dd87-cst47\" (UID: \"251edcb6-4345-4fe1-8388-5c973498cbc4\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-cst47" May 20 15:34:52.719908 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.719834 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sfs4s\" (UniqueName: \"kubernetes.io/projected/574489b4-f926-4667-be55-8e4e4d4f98e4-kube-api-access-sfs4s\") pod \"console-operator-76dff48d59-gwx4j\" (UID: \"574489b4-f926-4667-be55-8e4e4d4f98e4\") " pod="openshift-console-operator/console-operator-76dff48d59-gwx4j" May 20 15:34:52.719908 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.719862 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7b5ce08f-f82d-4226-b1b0-9dddccec11cd-registry-certificates\") pod \"image-registry-65f96ddd4b-pqgdt\" (UID: \"7b5ce08f-f82d-4226-b1b0-9dddccec11cd\") " pod="openshift-image-registry/image-registry-65f96ddd4b-pqgdt" May 20 15:34:52.719908 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.719898 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7b5ce08f-f82d-4226-b1b0-9dddccec11cd-trusted-ca\") pod \"image-registry-65f96ddd4b-pqgdt\" (UID: \"7b5ce08f-f82d-4226-b1b0-9dddccec11cd\") " pod="openshift-image-registry/image-registry-65f96ddd4b-pqgdt" May 20 15:34:52.720144 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.719925 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd197f83-6962-416f-9520-6532a33ae2c1-metrics-certs\") pod \"router-default-65694f9b86-s6z2z\" (UID: \"dd197f83-6962-416f-9520-6532a33ae2c1\") " pod="openshift-ingress/router-default-65694f9b86-s6z2z" May 20 15:34:52.720144 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.719979 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7b5ce08f-f82d-4226-b1b0-9dddccec11cd-ca-trust-extracted\") pod \"image-registry-65f96ddd4b-pqgdt\" (UID: \"7b5ce08f-f82d-4226-b1b0-9dddccec11cd\") " pod="openshift-image-registry/image-registry-65f96ddd4b-pqgdt" May 20 15:34:52.720144 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.720003 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd197f83-6962-416f-9520-6532a33ae2c1-service-ca-bundle\") pod \"router-default-65694f9b86-s6z2z\" (UID: \"dd197f83-6962-416f-9520-6532a33ae2c1\") " pod="openshift-ingress/router-default-65694f9b86-s6z2z" May 20 15:34:52.720144 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.720037 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8s7ml\" (UniqueName: \"kubernetes.io/projected/7b5ce08f-f82d-4226-b1b0-9dddccec11cd-kube-api-access-8s7ml\") pod \"image-registry-65f96ddd4b-pqgdt\" (UID: \"7b5ce08f-f82d-4226-b1b0-9dddccec11cd\") " pod="openshift-image-registry/image-registry-65f96ddd4b-pqgdt" May 20 15:34:52.720144 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.720079 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7b5ce08f-f82d-4226-b1b0-9dddccec11cd-bound-sa-token\") pod \"image-registry-65f96ddd4b-pqgdt\" (UID: \"7b5ce08f-f82d-4226-b1b0-9dddccec11cd\") " pod="openshift-image-registry/image-registry-65f96ddd4b-pqgdt" May 20 15:34:52.720144 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.720104 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/dd197f83-6962-416f-9520-6532a33ae2c1-stats-auth\") pod \"router-default-65694f9b86-s6z2z\" (UID: \"dd197f83-6962-416f-9520-6532a33ae2c1\") " pod="openshift-ingress/router-default-65694f9b86-s6z2z" May 20 15:34:52.720144 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.720123 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7b5ce08f-f82d-4226-b1b0-9dddccec11cd-installation-pull-secrets\") pod \"image-registry-65f96ddd4b-pqgdt\" (UID: \"7b5ce08f-f82d-4226-b1b0-9dddccec11cd\") " pod="openshift-image-registry/image-registry-65f96ddd4b-pqgdt" May 20 15:34:52.720478 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.720244 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/574489b4-f926-4667-be55-8e4e4d4f98e4-config\") pod \"console-operator-76dff48d59-gwx4j\" (UID: \"574489b4-f926-4667-be55-8e4e4d4f98e4\") " pod="openshift-console-operator/console-operator-76dff48d59-gwx4j" May 20 15:34:52.720478 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.720463 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/574489b4-f926-4667-be55-8e4e4d4f98e4-trusted-ca\") pod \"console-operator-76dff48d59-gwx4j\" (UID: \"574489b4-f926-4667-be55-8e4e4d4f98e4\") " pod="openshift-console-operator/console-operator-76dff48d59-gwx4j" May 20 15:34:52.722160 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.722145 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/574489b4-f926-4667-be55-8e4e4d4f98e4-serving-cert\") pod \"console-operator-76dff48d59-gwx4j\" (UID: \"574489b4-f926-4667-be55-8e4e4d4f98e4\") " pod="openshift-console-operator/console-operator-76dff48d59-gwx4j" May 20 15:34:52.742880 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.742852 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfs4s\" (UniqueName: \"kubernetes.io/projected/574489b4-f926-4667-be55-8e4e4d4f98e4-kube-api-access-sfs4s\") pod \"console-operator-76dff48d59-gwx4j\" (UID: \"574489b4-f926-4667-be55-8e4e4d4f98e4\") " pod="openshift-console-operator/console-operator-76dff48d59-gwx4j" May 20 15:34:52.750151 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.750108 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-sltsl"] May 20 15:34:52.752069 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.752051 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-sltsl" May 20 15:34:52.754726 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:34:52.754704 2557 reflector.go:200] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-130-228.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-kube-storage-version-migrator-operator\": no relationship found between node 'ip-10-0-130-228.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" May 20 15:34:52.754845 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.754757 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-24trp\" (UniqueName: \"kubernetes.io/projected/251edcb6-4345-4fe1-8388-5c973498cbc4-kube-api-access-24trp\") pod \"network-check-source-7f44b6dd87-cst47\" (UID: \"251edcb6-4345-4fe1-8388-5c973498cbc4\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-cst47" May 20 15:34:52.754845 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:34:52.754798 2557 reflector.go:200] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"config\" is forbidden: User \"system:node:ip-10-0-130-228.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-kube-storage-version-migrator-operator\": no relationship found between node 'ip-10-0-130-228.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" type="*v1.ConfigMap" May 20 15:34:52.754978 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:34:52.754878 2557 reflector.go:200] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-130-228.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-kube-storage-version-migrator-operator\": no relationship found between node 'ip-10-0-130-228.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" May 20 15:34:52.755051 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:34:52.755026 2557 reflector.go:200] "Failed to watch" err="failed to list *v1.Secret: secrets \"kube-storage-version-migrator-operator-dockercfg-8mthc\" is forbidden: User \"system:node:ip-10-0-130-228.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-kube-storage-version-migrator-operator\": no relationship found between node 'ip-10-0-130-228.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-8mthc\"" type="*v1.Secret" May 20 15:34:52.755096 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:34:52.755049 2557 reflector.go:200] "Failed to watch" err="failed to list *v1.Secret: secrets \"serving-cert\" is forbidden: User \"system:node:ip-10-0-130-228.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-kube-storage-version-migrator-operator\": no relationship found between node 'ip-10-0-130-228.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" type="*v1.Secret" May 20 15:34:52.778626 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.778607 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-sltsl"] May 20 15:34:52.807746 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.807714 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-gwx4j" May 20 15:34:52.813343 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.813323 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-cst47" May 20 15:34:52.821136 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.821114 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7b5ce08f-f82d-4226-b1b0-9dddccec11cd-ca-trust-extracted\") pod \"image-registry-65f96ddd4b-pqgdt\" (UID: \"7b5ce08f-f82d-4226-b1b0-9dddccec11cd\") " pod="openshift-image-registry/image-registry-65f96ddd4b-pqgdt" May 20 15:34:52.821217 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.821144 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd197f83-6962-416f-9520-6532a33ae2c1-service-ca-bundle\") pod \"router-default-65694f9b86-s6z2z\" (UID: \"dd197f83-6962-416f-9520-6532a33ae2c1\") " pod="openshift-ingress/router-default-65694f9b86-s6z2z" May 20 15:34:52.821217 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.821198 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3fa0f676-1933-48b3-b1ed-65853b963ff0-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-sltsl\" (UID: \"3fa0f676-1933-48b3-b1ed-65853b963ff0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-sltsl" May 20 15:34:52.821311 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.821231 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3fa0f676-1933-48b3-b1ed-65853b963ff0-config\") pod \"kube-storage-version-migrator-operator-565644f49-sltsl\" (UID: \"3fa0f676-1933-48b3-b1ed-65853b963ff0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-sltsl" May 20 15:34:52.821363 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.821303 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8s7ml\" (UniqueName: \"kubernetes.io/projected/7b5ce08f-f82d-4226-b1b0-9dddccec11cd-kube-api-access-8s7ml\") pod \"image-registry-65f96ddd4b-pqgdt\" (UID: \"7b5ce08f-f82d-4226-b1b0-9dddccec11cd\") " pod="openshift-image-registry/image-registry-65f96ddd4b-pqgdt" May 20 15:34:52.821363 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.821346 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7b5ce08f-f82d-4226-b1b0-9dddccec11cd-bound-sa-token\") pod \"image-registry-65f96ddd4b-pqgdt\" (UID: \"7b5ce08f-f82d-4226-b1b0-9dddccec11cd\") " pod="openshift-image-registry/image-registry-65f96ddd4b-pqgdt" May 20 15:34:52.821457 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.821373 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/dd197f83-6962-416f-9520-6532a33ae2c1-stats-auth\") pod \"router-default-65694f9b86-s6z2z\" (UID: \"dd197f83-6962-416f-9520-6532a33ae2c1\") " pod="openshift-ingress/router-default-65694f9b86-s6z2z" May 20 15:34:52.821457 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.821404 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7b5ce08f-f82d-4226-b1b0-9dddccec11cd-installation-pull-secrets\") pod \"image-registry-65f96ddd4b-pqgdt\" (UID: \"7b5ce08f-f82d-4226-b1b0-9dddccec11cd\") " pod="openshift-image-registry/image-registry-65f96ddd4b-pqgdt" May 20 15:34:52.821457 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.821435 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22rz5\" (UniqueName: \"kubernetes.io/projected/3fa0f676-1933-48b3-b1ed-65853b963ff0-kube-api-access-22rz5\") pod \"kube-storage-version-migrator-operator-565644f49-sltsl\" (UID: \"3fa0f676-1933-48b3-b1ed-65853b963ff0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-sltsl" May 20 15:34:52.821590 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.821467 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7b5ce08f-f82d-4226-b1b0-9dddccec11cd-registry-tls\") pod \"image-registry-65f96ddd4b-pqgdt\" (UID: \"7b5ce08f-f82d-4226-b1b0-9dddccec11cd\") " pod="openshift-image-registry/image-registry-65f96ddd4b-pqgdt" May 20 15:34:52.821590 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.821505 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7b5ce08f-f82d-4226-b1b0-9dddccec11cd-image-registry-private-configuration\") pod \"image-registry-65f96ddd4b-pqgdt\" (UID: \"7b5ce08f-f82d-4226-b1b0-9dddccec11cd\") " pod="openshift-image-registry/image-registry-65f96ddd4b-pqgdt" May 20 15:34:52.821590 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.821537 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gsg2j\" (UniqueName: \"kubernetes.io/projected/5b574a1a-8a5f-486e-94f7-8f388c7cf6b9-kube-api-access-gsg2j\") pod \"volume-data-source-validator-5cf8c89d64-qrbth\" (UID: \"5b574a1a-8a5f-486e-94f7-8f388c7cf6b9\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-qrbth" May 20 15:34:52.821590 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.821561 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7b5ce08f-f82d-4226-b1b0-9dddccec11cd-ca-trust-extracted\") pod \"image-registry-65f96ddd4b-pqgdt\" (UID: \"7b5ce08f-f82d-4226-b1b0-9dddccec11cd\") " pod="openshift-image-registry/image-registry-65f96ddd4b-pqgdt" May 20 15:34:52.821590 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.821563 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/dd197f83-6962-416f-9520-6532a33ae2c1-default-certificate\") pod \"router-default-65694f9b86-s6z2z\" (UID: \"dd197f83-6962-416f-9520-6532a33ae2c1\") " pod="openshift-ingress/router-default-65694f9b86-s6z2z" May 20 15:34:52.821905 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.821650 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bvbrn\" (UniqueName: \"kubernetes.io/projected/dd197f83-6962-416f-9520-6532a33ae2c1-kube-api-access-bvbrn\") pod \"router-default-65694f9b86-s6z2z\" (UID: \"dd197f83-6962-416f-9520-6532a33ae2c1\") " pod="openshift-ingress/router-default-65694f9b86-s6z2z" May 20 15:34:52.821905 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:34:52.821697 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dd197f83-6962-416f-9520-6532a33ae2c1-service-ca-bundle podName:dd197f83-6962-416f-9520-6532a33ae2c1 nodeName:}" failed. No retries permitted until 2026-05-20 15:34:53.32167722 +0000 UTC m=+124.536599997 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/dd197f83-6962-416f-9520-6532a33ae2c1-service-ca-bundle") pod "router-default-65694f9b86-s6z2z" (UID: "dd197f83-6962-416f-9520-6532a33ae2c1") : configmap references non-existent config key: service-ca.crt May 20 15:34:52.821905 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.821720 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7b5ce08f-f82d-4226-b1b0-9dddccec11cd-registry-certificates\") pod \"image-registry-65f96ddd4b-pqgdt\" (UID: \"7b5ce08f-f82d-4226-b1b0-9dddccec11cd\") " pod="openshift-image-registry/image-registry-65f96ddd4b-pqgdt" May 20 15:34:52.821905 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.821761 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7b5ce08f-f82d-4226-b1b0-9dddccec11cd-trusted-ca\") pod \"image-registry-65f96ddd4b-pqgdt\" (UID: \"7b5ce08f-f82d-4226-b1b0-9dddccec11cd\") " pod="openshift-image-registry/image-registry-65f96ddd4b-pqgdt" May 20 15:34:52.821905 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.821788 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd197f83-6962-416f-9520-6532a33ae2c1-metrics-certs\") pod \"router-default-65694f9b86-s6z2z\" (UID: \"dd197f83-6962-416f-9520-6532a33ae2c1\") " pod="openshift-ingress/router-default-65694f9b86-s6z2z" May 20 15:34:52.822234 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:34:52.821930 2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 20 15:34:52.822234 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:34:52.821964 2557 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 20 15:34:52.822234 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:34:52.821980 2557 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65f96ddd4b-pqgdt: secret "image-registry-tls" not found May 20 15:34:52.822234 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:34:52.821994 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd197f83-6962-416f-9520-6532a33ae2c1-metrics-certs podName:dd197f83-6962-416f-9520-6532a33ae2c1 nodeName:}" failed. No retries permitted until 2026-05-20 15:34:53.321979283 +0000 UTC m=+124.536902055 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dd197f83-6962-416f-9520-6532a33ae2c1-metrics-certs") pod "router-default-65694f9b86-s6z2z" (UID: "dd197f83-6962-416f-9520-6532a33ae2c1") : secret "router-metrics-certs-default" not found May 20 15:34:52.822234 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:34:52.822052 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7b5ce08f-f82d-4226-b1b0-9dddccec11cd-registry-tls podName:7b5ce08f-f82d-4226-b1b0-9dddccec11cd nodeName:}" failed. No retries permitted until 2026-05-20 15:34:53.322031942 +0000 UTC m=+124.536954718 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7b5ce08f-f82d-4226-b1b0-9dddccec11cd-registry-tls") pod "image-registry-65f96ddd4b-pqgdt" (UID: "7b5ce08f-f82d-4226-b1b0-9dddccec11cd") : secret "image-registry-tls" not found May 20 15:34:52.822592 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.822486 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7b5ce08f-f82d-4226-b1b0-9dddccec11cd-registry-certificates\") pod \"image-registry-65f96ddd4b-pqgdt\" (UID: \"7b5ce08f-f82d-4226-b1b0-9dddccec11cd\") " pod="openshift-image-registry/image-registry-65f96ddd4b-pqgdt" May 20 15:34:52.823220 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.823197 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7b5ce08f-f82d-4226-b1b0-9dddccec11cd-trusted-ca\") pod \"image-registry-65f96ddd4b-pqgdt\" (UID: \"7b5ce08f-f82d-4226-b1b0-9dddccec11cd\") " pod="openshift-image-registry/image-registry-65f96ddd4b-pqgdt" May 20 15:34:52.824680 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.824656 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/dd197f83-6962-416f-9520-6532a33ae2c1-default-certificate\") pod \"router-default-65694f9b86-s6z2z\" (UID: \"dd197f83-6962-416f-9520-6532a33ae2c1\") " pod="openshift-ingress/router-default-65694f9b86-s6z2z" May 20 15:34:52.824974 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.824955 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7b5ce08f-f82d-4226-b1b0-9dddccec11cd-installation-pull-secrets\") pod \"image-registry-65f96ddd4b-pqgdt\" (UID: \"7b5ce08f-f82d-4226-b1b0-9dddccec11cd\") " pod="openshift-image-registry/image-registry-65f96ddd4b-pqgdt" May 20 15:34:52.825044 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.825005 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/dd197f83-6962-416f-9520-6532a33ae2c1-stats-auth\") pod \"router-default-65694f9b86-s6z2z\" (UID: \"dd197f83-6962-416f-9520-6532a33ae2c1\") " pod="openshift-ingress/router-default-65694f9b86-s6z2z" May 20 15:34:52.825497 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.825475 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7b5ce08f-f82d-4226-b1b0-9dddccec11cd-image-registry-private-configuration\") pod \"image-registry-65f96ddd4b-pqgdt\" (UID: \"7b5ce08f-f82d-4226-b1b0-9dddccec11cd\") " pod="openshift-image-registry/image-registry-65f96ddd4b-pqgdt" May 20 15:34:52.837613 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.837586 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvbrn\" (UniqueName: \"kubernetes.io/projected/dd197f83-6962-416f-9520-6532a33ae2c1-kube-api-access-bvbrn\") pod \"router-default-65694f9b86-s6z2z\" (UID: \"dd197f83-6962-416f-9520-6532a33ae2c1\") " pod="openshift-ingress/router-default-65694f9b86-s6z2z" May 20 15:34:52.838307 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.837976 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8s7ml\" (UniqueName: \"kubernetes.io/projected/7b5ce08f-f82d-4226-b1b0-9dddccec11cd-kube-api-access-8s7ml\") pod \"image-registry-65f96ddd4b-pqgdt\" (UID: \"7b5ce08f-f82d-4226-b1b0-9dddccec11cd\") " pod="openshift-image-registry/image-registry-65f96ddd4b-pqgdt" May 20 15:34:52.838568 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.838545 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7b5ce08f-f82d-4226-b1b0-9dddccec11cd-bound-sa-token\") pod \"image-registry-65f96ddd4b-pqgdt\" (UID: \"7b5ce08f-f82d-4226-b1b0-9dddccec11cd\") " pod="openshift-image-registry/image-registry-65f96ddd4b-pqgdt" May 20 15:34:52.842959 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.842938 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsg2j\" (UniqueName: \"kubernetes.io/projected/5b574a1a-8a5f-486e-94f7-8f388c7cf6b9-kube-api-access-gsg2j\") pod \"volume-data-source-validator-5cf8c89d64-qrbth\" (UID: \"5b574a1a-8a5f-486e-94f7-8f388c7cf6b9\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-qrbth" May 20 15:34:52.920589 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.920561 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-qrbth" May 20 15:34:52.922608 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.922585 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3fa0f676-1933-48b3-b1ed-65853b963ff0-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-sltsl\" (UID: \"3fa0f676-1933-48b3-b1ed-65853b963ff0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-sltsl" May 20 15:34:52.922724 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.922623 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3fa0f676-1933-48b3-b1ed-65853b963ff0-config\") pod \"kube-storage-version-migrator-operator-565644f49-sltsl\" (UID: \"3fa0f676-1933-48b3-b1ed-65853b963ff0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-sltsl" May 20 15:34:52.922724 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.922650 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-22rz5\" (UniqueName: \"kubernetes.io/projected/3fa0f676-1933-48b3-b1ed-65853b963ff0-kube-api-access-22rz5\") pod \"kube-storage-version-migrator-operator-565644f49-sltsl\" (UID: \"3fa0f676-1933-48b3-b1ed-65853b963ff0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-sltsl" May 20 15:34:52.948284 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.948251 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-gwx4j"] May 20 15:34:52.952069 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:34:52.952038 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod574489b4_f926_4667_be55_8e4e4d4f98e4.slice/crio-b925f2e5fc7152cea74deb39145f458dea32d220fda97e5c23e936a360d8b48a WatchSource:0}: Error finding container b925f2e5fc7152cea74deb39145f458dea32d220fda97e5c23e936a360d8b48a: Status 404 returned error can't find the container with id b925f2e5fc7152cea74deb39145f458dea32d220fda97e5c23e936a360d8b48a May 20 15:34:52.964859 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:52.964832 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-cst47"] May 20 15:34:52.967979 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:34:52.967945 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod251edcb6_4345_4fe1_8388_5c973498cbc4.slice/crio-2f76759865c146562c646e41bf5a9dcbb0369b3fbcfa378d4a3442741d4bf957 WatchSource:0}: Error finding container 2f76759865c146562c646e41bf5a9dcbb0369b3fbcfa378d4a3442741d4bf957: Status 404 returned error can't find the container with id 2f76759865c146562c646e41bf5a9dcbb0369b3fbcfa378d4a3442741d4bf957 May 20 15:34:53.049387 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:53.049356 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-qrbth"] May 20 15:34:53.052794 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:34:53.052764 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b574a1a_8a5f_486e_94f7_8f388c7cf6b9.slice/crio-5cef05ffd13542e7fb5cfc36ccd515547797ee3ec443180bb018b9eafd7c42ae WatchSource:0}: Error finding container 5cef05ffd13542e7fb5cfc36ccd515547797ee3ec443180bb018b9eafd7c42ae: Status 404 returned error can't find the container with id 5cef05ffd13542e7fb5cfc36ccd515547797ee3ec443180bb018b9eafd7c42ae May 20 15:34:53.326066 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:53.325975 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7b5ce08f-f82d-4226-b1b0-9dddccec11cd-registry-tls\") pod \"image-registry-65f96ddd4b-pqgdt\" (UID: \"7b5ce08f-f82d-4226-b1b0-9dddccec11cd\") " pod="openshift-image-registry/image-registry-65f96ddd4b-pqgdt" May 20 15:34:53.326223 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:53.326084 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd197f83-6962-416f-9520-6532a33ae2c1-metrics-certs\") pod \"router-default-65694f9b86-s6z2z\" (UID: \"dd197f83-6962-416f-9520-6532a33ae2c1\") " pod="openshift-ingress/router-default-65694f9b86-s6z2z" May 20 15:34:53.326223 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:53.326142 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd197f83-6962-416f-9520-6532a33ae2c1-service-ca-bundle\") pod \"router-default-65694f9b86-s6z2z\" (UID: \"dd197f83-6962-416f-9520-6532a33ae2c1\") " pod="openshift-ingress/router-default-65694f9b86-s6z2z" May 20 15:34:53.326223 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:34:53.326142 2557 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 20 15:34:53.326223 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:34:53.326197 2557 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65f96ddd4b-pqgdt: secret "image-registry-tls" not found May 20 15:34:53.326380 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:34:53.326240 2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 20 15:34:53.326380 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:34:53.326251 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dd197f83-6962-416f-9520-6532a33ae2c1-service-ca-bundle podName:dd197f83-6962-416f-9520-6532a33ae2c1 nodeName:}" failed. No retries permitted until 2026-05-20 15:34:54.326231658 +0000 UTC m=+125.541154445 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/dd197f83-6962-416f-9520-6532a33ae2c1-service-ca-bundle") pod "router-default-65694f9b86-s6z2z" (UID: "dd197f83-6962-416f-9520-6532a33ae2c1") : configmap references non-existent config key: service-ca.crt May 20 15:34:53.326380 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:34:53.326306 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7b5ce08f-f82d-4226-b1b0-9dddccec11cd-registry-tls podName:7b5ce08f-f82d-4226-b1b0-9dddccec11cd nodeName:}" failed. No retries permitted until 2026-05-20 15:34:54.326293177 +0000 UTC m=+125.541215949 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7b5ce08f-f82d-4226-b1b0-9dddccec11cd-registry-tls") pod "image-registry-65f96ddd4b-pqgdt" (UID: "7b5ce08f-f82d-4226-b1b0-9dddccec11cd") : secret "image-registry-tls" not found May 20 15:34:53.326380 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:34:53.326322 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd197f83-6962-416f-9520-6532a33ae2c1-metrics-certs podName:dd197f83-6962-416f-9520-6532a33ae2c1 nodeName:}" failed. No retries permitted until 2026-05-20 15:34:54.3263163 +0000 UTC m=+125.541239070 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dd197f83-6962-416f-9520-6532a33ae2c1-metrics-certs") pod "router-default-65694f9b86-s6z2z" (UID: "dd197f83-6962-416f-9520-6532a33ae2c1") : secret "router-metrics-certs-default" not found May 20 15:34:53.717542 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:53.717460 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" May 20 15:34:53.724314 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:53.724280 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3fa0f676-1933-48b3-b1ed-65853b963ff0-config\") pod \"kube-storage-version-migrator-operator-565644f49-sltsl\" (UID: \"3fa0f676-1933-48b3-b1ed-65853b963ff0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-sltsl" May 20 15:34:53.782139 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:53.782088 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-cst47" event={"ID":"251edcb6-4345-4fe1-8388-5c973498cbc4","Type":"ContainerStarted","Data":"24cb39f44a0f96eed4a6de7a755297089521920e4ed025e2920f351613a367a7"} May 20 15:34:53.782139 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:53.782142 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-cst47" event={"ID":"251edcb6-4345-4fe1-8388-5c973498cbc4","Type":"ContainerStarted","Data":"2f76759865c146562c646e41bf5a9dcbb0369b3fbcfa378d4a3442741d4bf957"} May 20 15:34:53.784029 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:53.783804 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-qrbth" event={"ID":"5b574a1a-8a5f-486e-94f7-8f388c7cf6b9","Type":"ContainerStarted","Data":"5cef05ffd13542e7fb5cfc36ccd515547797ee3ec443180bb018b9eafd7c42ae"} May 20 15:34:53.786152 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:53.785579 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-gwx4j" event={"ID":"574489b4-f926-4667-be55-8e4e4d4f98e4","Type":"ContainerStarted","Data":"b925f2e5fc7152cea74deb39145f458dea32d220fda97e5c23e936a360d8b48a"} May 20 15:34:53.786152 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:53.785704 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" May 20 15:34:53.806520 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:53.806452 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-cst47" podStartSLOduration=1.806436053 podStartE2EDuration="1.806436053s" podCreationTimestamp="2026-05-20 15:34:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 15:34:53.804527714 +0000 UTC m=+125.019450498" watchObservedRunningTime="2026-05-20 15:34:53.806436053 +0000 UTC m=+125.021358827" May 20 15:34:53.923934 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:34:53.923892 2557 secret.go:189] Couldn't get secret openshift-kube-storage-version-migrator-operator/serving-cert: failed to sync secret cache: timed out waiting for the condition May 20 15:34:53.924115 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:34:53.924022 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fa0f676-1933-48b3-b1ed-65853b963ff0-serving-cert podName:3fa0f676-1933-48b3-b1ed-65853b963ff0 nodeName:}" failed. No retries permitted until 2026-05-20 15:34:54.423990861 +0000 UTC m=+125.638913639 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "serving-cert" (UniqueName: "kubernetes.io/secret/3fa0f676-1933-48b3-b1ed-65853b963ff0-serving-cert") pod "kube-storage-version-migrator-operator-565644f49-sltsl" (UID: "3fa0f676-1933-48b3-b1ed-65853b963ff0") : failed to sync secret cache: timed out waiting for the condition May 20 15:34:53.927469 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:53.927432 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" May 20 15:34:53.934546 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:53.934522 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-22rz5\" (UniqueName: \"kubernetes.io/projected/3fa0f676-1933-48b3-b1ed-65853b963ff0-kube-api-access-22rz5\") pod \"kube-storage-version-migrator-operator-565644f49-sltsl\" (UID: \"3fa0f676-1933-48b3-b1ed-65853b963ff0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-sltsl" May 20 15:34:53.997712 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:53.997676 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" May 20 15:34:54.181418 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:54.181388 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-8mthc\"" May 20 15:34:54.335643 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:54.335610 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd197f83-6962-416f-9520-6532a33ae2c1-service-ca-bundle\") pod \"router-default-65694f9b86-s6z2z\" (UID: \"dd197f83-6962-416f-9520-6532a33ae2c1\") " pod="openshift-ingress/router-default-65694f9b86-s6z2z" May 20 15:34:54.335855 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:54.335672 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7b5ce08f-f82d-4226-b1b0-9dddccec11cd-registry-tls\") pod \"image-registry-65f96ddd4b-pqgdt\" (UID: \"7b5ce08f-f82d-4226-b1b0-9dddccec11cd\") " pod="openshift-image-registry/image-registry-65f96ddd4b-pqgdt" May 20 15:34:54.335855 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:54.335753 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd197f83-6962-416f-9520-6532a33ae2c1-metrics-certs\") pod \"router-default-65694f9b86-s6z2z\" (UID: \"dd197f83-6962-416f-9520-6532a33ae2c1\") " pod="openshift-ingress/router-default-65694f9b86-s6z2z" May 20 15:34:54.335855 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:34:54.335773 2557 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 20 15:34:54.335855 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:34:54.335791 2557 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65f96ddd4b-pqgdt: secret "image-registry-tls" not found May 20 15:34:54.335855 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:34:54.335774 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dd197f83-6962-416f-9520-6532a33ae2c1-service-ca-bundle podName:dd197f83-6962-416f-9520-6532a33ae2c1 nodeName:}" failed. No retries permitted until 2026-05-20 15:34:56.335756087 +0000 UTC m=+127.550678858 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/dd197f83-6962-416f-9520-6532a33ae2c1-service-ca-bundle") pod "router-default-65694f9b86-s6z2z" (UID: "dd197f83-6962-416f-9520-6532a33ae2c1") : configmap references non-existent config key: service-ca.crt May 20 15:34:54.335855 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:34:54.335852 2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 20 15:34:54.336076 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:34:54.335865 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7b5ce08f-f82d-4226-b1b0-9dddccec11cd-registry-tls podName:7b5ce08f-f82d-4226-b1b0-9dddccec11cd nodeName:}" failed. No retries permitted until 2026-05-20 15:34:56.335852866 +0000 UTC m=+127.550775637 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7b5ce08f-f82d-4226-b1b0-9dddccec11cd-registry-tls") pod "image-registry-65f96ddd4b-pqgdt" (UID: "7b5ce08f-f82d-4226-b1b0-9dddccec11cd") : secret "image-registry-tls" not found May 20 15:34:54.336076 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:34:54.335895 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd197f83-6962-416f-9520-6532a33ae2c1-metrics-certs podName:dd197f83-6962-416f-9520-6532a33ae2c1 nodeName:}" failed. No retries permitted until 2026-05-20 15:34:56.335881616 +0000 UTC m=+127.550804387 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dd197f83-6962-416f-9520-6532a33ae2c1-metrics-certs") pod "router-default-65694f9b86-s6z2z" (UID: "dd197f83-6962-416f-9520-6532a33ae2c1") : secret "router-metrics-certs-default" not found May 20 15:34:54.436604 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:54.436571 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3fa0f676-1933-48b3-b1ed-65853b963ff0-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-sltsl\" (UID: \"3fa0f676-1933-48b3-b1ed-65853b963ff0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-sltsl" May 20 15:34:54.438793 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:54.438766 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3fa0f676-1933-48b3-b1ed-65853b963ff0-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-sltsl\" (UID: \"3fa0f676-1933-48b3-b1ed-65853b963ff0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-sltsl" May 20 15:34:54.564270 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:54.564183 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-sltsl" May 20 15:34:54.789551 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:54.789504 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-qrbth" event={"ID":"5b574a1a-8a5f-486e-94f7-8f388c7cf6b9","Type":"ContainerStarted","Data":"cec824a616fdaed88378fe33c43676e1e67e5e18e3c254ecc1f44a74eb55c919"} May 20 15:34:54.812206 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:54.812154 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-qrbth" podStartSLOduration=1.643447052 podStartE2EDuration="2.812140705s" podCreationTimestamp="2026-05-20 15:34:52 +0000 UTC" firstStartedPulling="2026-05-20 15:34:53.054923401 +0000 UTC m=+124.269846186" lastFinishedPulling="2026-05-20 15:34:54.223617046 +0000 UTC m=+125.438539839" observedRunningTime="2026-05-20 15:34:54.811354197 +0000 UTC m=+126.026276991" watchObservedRunningTime="2026-05-20 15:34:54.812140705 +0000 UTC m=+126.027063497" May 20 15:34:55.047940 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:55.047910 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-sltsl"] May 20 15:34:55.050993 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:34:55.050962 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fa0f676_1933_48b3_b1ed_65853b963ff0.slice/crio-915182d34ce618037ec9abd6926a15f9a836af353173dc2e19676789a1dc2069 WatchSource:0}: Error finding container 915182d34ce618037ec9abd6926a15f9a836af353173dc2e19676789a1dc2069: Status 404 returned error can't find the container with id 915182d34ce618037ec9abd6926a15f9a836af353173dc2e19676789a1dc2069 May 20 15:34:55.792703 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:55.792656 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-sltsl" event={"ID":"3fa0f676-1933-48b3-b1ed-65853b963ff0","Type":"ContainerStarted","Data":"915182d34ce618037ec9abd6926a15f9a836af353173dc2e19676789a1dc2069"} May 20 15:34:55.794205 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:55.794178 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-gwx4j_574489b4-f926-4667-be55-8e4e4d4f98e4/console-operator/0.log" May 20 15:34:55.794338 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:55.794224 2557 generic.go:358] "Generic (PLEG): container finished" podID="574489b4-f926-4667-be55-8e4e4d4f98e4" containerID="9939683669be093d0d0789d3d380b6514cb668b44d76ac360c2eb4e017835026" exitCode=255 May 20 15:34:55.794338 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:55.794321 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-gwx4j" event={"ID":"574489b4-f926-4667-be55-8e4e4d4f98e4","Type":"ContainerDied","Data":"9939683669be093d0d0789d3d380b6514cb668b44d76ac360c2eb4e017835026"} May 20 15:34:55.794578 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:55.794562 2557 scope.go:117] "RemoveContainer" containerID="9939683669be093d0d0789d3d380b6514cb668b44d76ac360c2eb4e017835026" May 20 15:34:56.354553 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:56.354519 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd197f83-6962-416f-9520-6532a33ae2c1-metrics-certs\") pod \"router-default-65694f9b86-s6z2z\" (UID: \"dd197f83-6962-416f-9520-6532a33ae2c1\") " pod="openshift-ingress/router-default-65694f9b86-s6z2z" May 20 15:34:56.354749 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:56.354574 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd197f83-6962-416f-9520-6532a33ae2c1-service-ca-bundle\") pod \"router-default-65694f9b86-s6z2z\" (UID: \"dd197f83-6962-416f-9520-6532a33ae2c1\") " pod="openshift-ingress/router-default-65694f9b86-s6z2z" May 20 15:34:56.354749 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:56.354606 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7b5ce08f-f82d-4226-b1b0-9dddccec11cd-registry-tls\") pod \"image-registry-65f96ddd4b-pqgdt\" (UID: \"7b5ce08f-f82d-4226-b1b0-9dddccec11cd\") " pod="openshift-image-registry/image-registry-65f96ddd4b-pqgdt" May 20 15:34:56.354749 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:34:56.354666 2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 20 15:34:56.354749 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:34:56.354719 2557 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 20 15:34:56.354749 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:34:56.354730 2557 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65f96ddd4b-pqgdt: secret "image-registry-tls" not found May 20 15:34:56.354749 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:34:56.354734 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd197f83-6962-416f-9520-6532a33ae2c1-metrics-certs podName:dd197f83-6962-416f-9520-6532a33ae2c1 nodeName:}" failed. No retries permitted until 2026-05-20 15:35:00.354718694 +0000 UTC m=+131.569641466 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dd197f83-6962-416f-9520-6532a33ae2c1-metrics-certs") pod "router-default-65694f9b86-s6z2z" (UID: "dd197f83-6962-416f-9520-6532a33ae2c1") : secret "router-metrics-certs-default" not found May 20 15:34:56.354749 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:34:56.354750 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dd197f83-6962-416f-9520-6532a33ae2c1-service-ca-bundle podName:dd197f83-6962-416f-9520-6532a33ae2c1 nodeName:}" failed. No retries permitted until 2026-05-20 15:35:00.354743913 +0000 UTC m=+131.569666683 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/dd197f83-6962-416f-9520-6532a33ae2c1-service-ca-bundle") pod "router-default-65694f9b86-s6z2z" (UID: "dd197f83-6962-416f-9520-6532a33ae2c1") : configmap references non-existent config key: service-ca.crt May 20 15:34:56.354990 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:34:56.354767 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7b5ce08f-f82d-4226-b1b0-9dddccec11cd-registry-tls podName:7b5ce08f-f82d-4226-b1b0-9dddccec11cd nodeName:}" failed. No retries permitted until 2026-05-20 15:35:00.35475609 +0000 UTC m=+131.569678879 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7b5ce08f-f82d-4226-b1b0-9dddccec11cd-registry-tls") pod "image-registry-65f96ddd4b-pqgdt" (UID: "7b5ce08f-f82d-4226-b1b0-9dddccec11cd") : secret "image-registry-tls" not found May 20 15:34:56.798694 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:56.798660 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-gwx4j_574489b4-f926-4667-be55-8e4e4d4f98e4/console-operator/1.log" May 20 15:34:56.799135 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:56.799118 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-gwx4j_574489b4-f926-4667-be55-8e4e4d4f98e4/console-operator/0.log" May 20 15:34:56.799205 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:56.799163 2557 generic.go:358] "Generic (PLEG): container finished" podID="574489b4-f926-4667-be55-8e4e4d4f98e4" containerID="d089d681c65aa5a839688660b10fc18add066603b105a3e74306ee1b89ae1718" exitCode=255 May 20 15:34:56.799246 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:56.799220 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-gwx4j" event={"ID":"574489b4-f926-4667-be55-8e4e4d4f98e4","Type":"ContainerDied","Data":"d089d681c65aa5a839688660b10fc18add066603b105a3e74306ee1b89ae1718"} May 20 15:34:56.799277 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:56.799262 2557 scope.go:117] "RemoveContainer" containerID="9939683669be093d0d0789d3d380b6514cb668b44d76ac360c2eb4e017835026" May 20 15:34:56.799550 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:56.799521 2557 scope.go:117] "RemoveContainer" containerID="d089d681c65aa5a839688660b10fc18add066603b105a3e74306ee1b89ae1718" May 20 15:34:56.799831 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:34:56.799766 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-gwx4j_openshift-console-operator(574489b4-f926-4667-be55-8e4e4d4f98e4)\"" pod="openshift-console-operator/console-operator-76dff48d59-gwx4j" podUID="574489b4-f926-4667-be55-8e4e4d4f98e4" May 20 15:34:57.802736 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:57.802691 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-sltsl" event={"ID":"3fa0f676-1933-48b3-b1ed-65853b963ff0","Type":"ContainerStarted","Data":"508649c9af7d2ee16204b1f4789cd7573725524321dfc5749358f6f39345c6b7"} May 20 15:34:57.804038 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:57.804022 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-gwx4j_574489b4-f926-4667-be55-8e4e4d4f98e4/console-operator/1.log" May 20 15:34:57.804421 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:57.804405 2557 scope.go:117] "RemoveContainer" containerID="d089d681c65aa5a839688660b10fc18add066603b105a3e74306ee1b89ae1718" May 20 15:34:57.804615 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:34:57.804596 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-gwx4j_openshift-console-operator(574489b4-f926-4667-be55-8e4e4d4f98e4)\"" pod="openshift-console-operator/console-operator-76dff48d59-gwx4j" podUID="574489b4-f926-4667-be55-8e4e4d4f98e4" May 20 15:34:57.819870 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:57.819827 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-sltsl" podStartSLOduration=3.944407624 podStartE2EDuration="5.819795788s" podCreationTimestamp="2026-05-20 15:34:52 +0000 UTC" firstStartedPulling="2026-05-20 15:34:55.053242233 +0000 UTC m=+126.268165018" lastFinishedPulling="2026-05-20 15:34:56.928630408 +0000 UTC m=+128.143553182" observedRunningTime="2026-05-20 15:34:57.819517964 +0000 UTC m=+129.034440759" watchObservedRunningTime="2026-05-20 15:34:57.819795788 +0000 UTC m=+129.034718581" May 20 15:34:58.068467 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:58.068380 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54872a9c-6091-4768-8cd9-e81ab987ba01-metrics-certs\") pod \"network-metrics-daemon-wszj2\" (UID: \"54872a9c-6091-4768-8cd9-e81ab987ba01\") " pod="openshift-multus/network-metrics-daemon-wszj2" May 20 15:34:58.068613 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:34:58.068497 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 20 15:34:58.068613 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:34:58.068552 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54872a9c-6091-4768-8cd9-e81ab987ba01-metrics-certs podName:54872a9c-6091-4768-8cd9-e81ab987ba01 nodeName:}" failed. No retries permitted until 2026-05-20 15:37:00.068537631 +0000 UTC m=+251.283460402 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/54872a9c-6091-4768-8cd9-e81ab987ba01-metrics-certs") pod "network-metrics-daemon-wszj2" (UID: "54872a9c-6091-4768-8cd9-e81ab987ba01") : secret "metrics-daemon-secret" not found May 20 15:34:58.223319 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:58.223282 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-bbbs8"] May 20 15:34:58.226648 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:58.226628 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-bbbs8" May 20 15:34:58.228803 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:58.228775 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" May 20 15:34:58.229066 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:58.229047 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-jv5wb\"" May 20 15:34:58.229120 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:58.229076 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" May 20 15:34:58.241009 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:58.240979 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-bbbs8"] May 20 15:34:58.371165 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:58.371074 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmjg2\" (UniqueName: \"kubernetes.io/projected/795c8587-73ca-4c0c-8f1f-dd2eedb6323a-kube-api-access-wmjg2\") pod \"migrator-b985f5d89-bbbs8\" (UID: \"795c8587-73ca-4c0c-8f1f-dd2eedb6323a\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-bbbs8" May 20 15:34:58.471660 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:58.471632 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wmjg2\" (UniqueName: \"kubernetes.io/projected/795c8587-73ca-4c0c-8f1f-dd2eedb6323a-kube-api-access-wmjg2\") pod \"migrator-b985f5d89-bbbs8\" (UID: \"795c8587-73ca-4c0c-8f1f-dd2eedb6323a\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-bbbs8" May 20 15:34:58.484867 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:58.484845 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmjg2\" (UniqueName: \"kubernetes.io/projected/795c8587-73ca-4c0c-8f1f-dd2eedb6323a-kube-api-access-wmjg2\") pod \"migrator-b985f5d89-bbbs8\" (UID: \"795c8587-73ca-4c0c-8f1f-dd2eedb6323a\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-bbbs8" May 20 15:34:58.534992 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:58.534949 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-bbbs8" May 20 15:34:58.656081 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:58.656001 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-bbbs8"] May 20 15:34:58.658947 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:34:58.658920 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod795c8587_73ca_4c0c_8f1f_dd2eedb6323a.slice/crio-1e80f5d202bcfd1d721ef764a755156f13891615f644b40b308857556ff4c793 WatchSource:0}: Error finding container 1e80f5d202bcfd1d721ef764a755156f13891615f644b40b308857556ff4c793: Status 404 returned error can't find the container with id 1e80f5d202bcfd1d721ef764a755156f13891615f644b40b308857556ff4c793 May 20 15:34:58.806702 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:58.806672 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-bbbs8" event={"ID":"795c8587-73ca-4c0c-8f1f-dd2eedb6323a","Type":"ContainerStarted","Data":"1e80f5d202bcfd1d721ef764a755156f13891615f644b40b308857556ff4c793"} May 20 15:34:59.225959 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:59.225916 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-lpvhc"] May 20 15:34:59.228980 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:59.228950 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-lpvhc" May 20 15:34:59.231178 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:59.231156 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" May 20 15:34:59.231788 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:59.231769 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" May 20 15:34:59.231788 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:59.231776 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-fk6hn\"" May 20 15:34:59.232010 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:59.231776 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" May 20 15:34:59.232010 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:59.231830 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" May 20 15:34:59.236517 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:59.236473 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-lpvhc"] May 20 15:34:59.379409 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:59.379342 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b39e94ef-30bc-44dd-9b70-fc4a346fac62-signing-cabundle\") pod \"service-ca-67d667c7d-lpvhc\" (UID: \"b39e94ef-30bc-44dd-9b70-fc4a346fac62\") " pod="openshift-service-ca/service-ca-67d667c7d-lpvhc" May 20 15:34:59.379409 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:59.379385 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wltq6\" (UniqueName: \"kubernetes.io/projected/b39e94ef-30bc-44dd-9b70-fc4a346fac62-kube-api-access-wltq6\") pod \"service-ca-67d667c7d-lpvhc\" (UID: \"b39e94ef-30bc-44dd-9b70-fc4a346fac62\") " pod="openshift-service-ca/service-ca-67d667c7d-lpvhc" May 20 15:34:59.379655 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:59.379497 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b39e94ef-30bc-44dd-9b70-fc4a346fac62-signing-key\") pod \"service-ca-67d667c7d-lpvhc\" (UID: \"b39e94ef-30bc-44dd-9b70-fc4a346fac62\") " pod="openshift-service-ca/service-ca-67d667c7d-lpvhc" May 20 15:34:59.480030 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:59.479932 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b39e94ef-30bc-44dd-9b70-fc4a346fac62-signing-cabundle\") pod \"service-ca-67d667c7d-lpvhc\" (UID: \"b39e94ef-30bc-44dd-9b70-fc4a346fac62\") " pod="openshift-service-ca/service-ca-67d667c7d-lpvhc" May 20 15:34:59.480030 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:59.479984 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wltq6\" (UniqueName: \"kubernetes.io/projected/b39e94ef-30bc-44dd-9b70-fc4a346fac62-kube-api-access-wltq6\") pod \"service-ca-67d667c7d-lpvhc\" (UID: \"b39e94ef-30bc-44dd-9b70-fc4a346fac62\") " pod="openshift-service-ca/service-ca-67d667c7d-lpvhc" May 20 15:34:59.480253 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:59.480069 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b39e94ef-30bc-44dd-9b70-fc4a346fac62-signing-key\") pod \"service-ca-67d667c7d-lpvhc\" (UID: \"b39e94ef-30bc-44dd-9b70-fc4a346fac62\") " pod="openshift-service-ca/service-ca-67d667c7d-lpvhc" May 20 15:34:59.480595 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:59.480573 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b39e94ef-30bc-44dd-9b70-fc4a346fac62-signing-cabundle\") pod \"service-ca-67d667c7d-lpvhc\" (UID: \"b39e94ef-30bc-44dd-9b70-fc4a346fac62\") " pod="openshift-service-ca/service-ca-67d667c7d-lpvhc" May 20 15:34:59.482558 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:59.482541 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b39e94ef-30bc-44dd-9b70-fc4a346fac62-signing-key\") pod \"service-ca-67d667c7d-lpvhc\" (UID: \"b39e94ef-30bc-44dd-9b70-fc4a346fac62\") " pod="openshift-service-ca/service-ca-67d667c7d-lpvhc" May 20 15:34:59.488878 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:59.488858 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wltq6\" (UniqueName: \"kubernetes.io/projected/b39e94ef-30bc-44dd-9b70-fc4a346fac62-kube-api-access-wltq6\") pod \"service-ca-67d667c7d-lpvhc\" (UID: \"b39e94ef-30bc-44dd-9b70-fc4a346fac62\") " pod="openshift-service-ca/service-ca-67d667c7d-lpvhc" May 20 15:34:59.540148 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:59.540112 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-lpvhc" May 20 15:34:59.642784 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:59.642751 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-r8sqr_f3564822-b89c-4974-8c53-986c6b3fd1e7/dns-node-resolver/0.log" May 20 15:34:59.885038 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:34:59.885013 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-lpvhc"] May 20 15:34:59.888672 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:34:59.888641 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb39e94ef_30bc_44dd_9b70_fc4a346fac62.slice/crio-bce3c9d5b13d75b442e9d253d2e34269e6145c3412fb1ab1f342073641eced13 WatchSource:0}: Error finding container bce3c9d5b13d75b442e9d253d2e34269e6145c3412fb1ab1f342073641eced13: Status 404 returned error can't find the container with id bce3c9d5b13d75b442e9d253d2e34269e6145c3412fb1ab1f342073641eced13 May 20 15:35:00.387608 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:00.387563 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd197f83-6962-416f-9520-6532a33ae2c1-metrics-certs\") pod \"router-default-65694f9b86-s6z2z\" (UID: \"dd197f83-6962-416f-9520-6532a33ae2c1\") " pod="openshift-ingress/router-default-65694f9b86-s6z2z" May 20 15:35:00.387783 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:00.387622 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd197f83-6962-416f-9520-6532a33ae2c1-service-ca-bundle\") pod \"router-default-65694f9b86-s6z2z\" (UID: \"dd197f83-6962-416f-9520-6532a33ae2c1\") " pod="openshift-ingress/router-default-65694f9b86-s6z2z" May 20 15:35:00.387783 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:00.387719 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7b5ce08f-f82d-4226-b1b0-9dddccec11cd-registry-tls\") pod \"image-registry-65f96ddd4b-pqgdt\" (UID: \"7b5ce08f-f82d-4226-b1b0-9dddccec11cd\") " pod="openshift-image-registry/image-registry-65f96ddd4b-pqgdt" May 20 15:35:00.387783 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:35:00.387731 2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 20 15:35:00.387973 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:35:00.387831 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd197f83-6962-416f-9520-6532a33ae2c1-metrics-certs podName:dd197f83-6962-416f-9520-6532a33ae2c1 nodeName:}" failed. No retries permitted until 2026-05-20 15:35:08.387789635 +0000 UTC m=+139.602712419 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dd197f83-6962-416f-9520-6532a33ae2c1-metrics-certs") pod "router-default-65694f9b86-s6z2z" (UID: "dd197f83-6962-416f-9520-6532a33ae2c1") : secret "router-metrics-certs-default" not found May 20 15:35:00.387973 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:35:00.387851 2557 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 20 15:35:00.387973 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:35:00.387869 2557 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65f96ddd4b-pqgdt: secret "image-registry-tls" not found May 20 15:35:00.387973 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:35:00.387852 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dd197f83-6962-416f-9520-6532a33ae2c1-service-ca-bundle podName:dd197f83-6962-416f-9520-6532a33ae2c1 nodeName:}" failed. No retries permitted until 2026-05-20 15:35:08.387842109 +0000 UTC m=+139.602764885 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/dd197f83-6962-416f-9520-6532a33ae2c1-service-ca-bundle") pod "router-default-65694f9b86-s6z2z" (UID: "dd197f83-6962-416f-9520-6532a33ae2c1") : configmap references non-existent config key: service-ca.crt May 20 15:35:00.387973 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:35:00.387914 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7b5ce08f-f82d-4226-b1b0-9dddccec11cd-registry-tls podName:7b5ce08f-f82d-4226-b1b0-9dddccec11cd nodeName:}" failed. No retries permitted until 2026-05-20 15:35:08.38789808 +0000 UTC m=+139.602820870 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7b5ce08f-f82d-4226-b1b0-9dddccec11cd-registry-tls") pod "image-registry-65f96ddd4b-pqgdt" (UID: "7b5ce08f-f82d-4226-b1b0-9dddccec11cd") : secret "image-registry-tls" not found May 20 15:35:00.812962 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:00.812921 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-lpvhc" event={"ID":"b39e94ef-30bc-44dd-9b70-fc4a346fac62","Type":"ContainerStarted","Data":"bce3c9d5b13d75b442e9d253d2e34269e6145c3412fb1ab1f342073641eced13"} May 20 15:35:00.817623 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:00.817584 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-bbbs8" event={"ID":"795c8587-73ca-4c0c-8f1f-dd2eedb6323a","Type":"ContainerStarted","Data":"02be6f4399be55c17bd7058d2cb2b956c5679ac62407e291a7c5cf9b61ed32e6"} May 20 15:35:00.817623 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:00.817626 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-bbbs8" event={"ID":"795c8587-73ca-4c0c-8f1f-dd2eedb6323a","Type":"ContainerStarted","Data":"c0b82ee4f12d5266ea515e69fcf06cbb8f8897928bdce962165c6d4c3e73a6d1"} May 20 15:35:00.835053 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:00.835001 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-bbbs8" podStartSLOduration=1.689887242 podStartE2EDuration="2.834984258s" podCreationTimestamp="2026-05-20 15:34:58 +0000 UTC" firstStartedPulling="2026-05-20 15:34:58.660703689 +0000 UTC m=+129.875626464" lastFinishedPulling="2026-05-20 15:34:59.805800706 +0000 UTC m=+131.020723480" observedRunningTime="2026-05-20 15:35:00.834159697 +0000 UTC m=+132.049082492" watchObservedRunningTime="2026-05-20 15:35:00.834984258 +0000 UTC m=+132.049907051" May 20 15:35:00.842653 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:00.842632 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wmwps_3965fa01-ac56-43aa-b92e-985a0e59fdc6/node-ca/0.log" May 20 15:35:02.807806 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:02.807774 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-gwx4j" May 20 15:35:02.807806 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:02.807824 2557 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-gwx4j" May 20 15:35:02.808215 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:02.808158 2557 scope.go:117] "RemoveContainer" containerID="d089d681c65aa5a839688660b10fc18add066603b105a3e74306ee1b89ae1718" May 20 15:35:02.808334 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:35:02.808315 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-gwx4j_openshift-console-operator(574489b4-f926-4667-be55-8e4e4d4f98e4)\"" pod="openshift-console-operator/console-operator-76dff48d59-gwx4j" podUID="574489b4-f926-4667-be55-8e4e4d4f98e4" May 20 15:35:02.824830 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:02.824786 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-lpvhc" event={"ID":"b39e94ef-30bc-44dd-9b70-fc4a346fac62","Type":"ContainerStarted","Data":"8661acbf4dd132d7817b687477e693627ad84d79d69492a3ec88b41a653e8703"} May 20 15:35:08.450142 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:08.450102 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd197f83-6962-416f-9520-6532a33ae2c1-metrics-certs\") pod \"router-default-65694f9b86-s6z2z\" (UID: \"dd197f83-6962-416f-9520-6532a33ae2c1\") " pod="openshift-ingress/router-default-65694f9b86-s6z2z" May 20 15:35:08.450142 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:08.450146 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd197f83-6962-416f-9520-6532a33ae2c1-service-ca-bundle\") pod \"router-default-65694f9b86-s6z2z\" (UID: \"dd197f83-6962-416f-9520-6532a33ae2c1\") " pod="openshift-ingress/router-default-65694f9b86-s6z2z" May 20 15:35:08.450553 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:08.450288 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7b5ce08f-f82d-4226-b1b0-9dddccec11cd-registry-tls\") pod \"image-registry-65f96ddd4b-pqgdt\" (UID: \"7b5ce08f-f82d-4226-b1b0-9dddccec11cd\") " pod="openshift-image-registry/image-registry-65f96ddd4b-pqgdt" May 20 15:35:08.450553 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:35:08.450300 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dd197f83-6962-416f-9520-6532a33ae2c1-service-ca-bundle podName:dd197f83-6962-416f-9520-6532a33ae2c1 nodeName:}" failed. No retries permitted until 2026-05-20 15:35:24.450280644 +0000 UTC m=+155.665203435 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/dd197f83-6962-416f-9520-6532a33ae2c1-service-ca-bundle") pod "router-default-65694f9b86-s6z2z" (UID: "dd197f83-6962-416f-9520-6532a33ae2c1") : configmap references non-existent config key: service-ca.crt May 20 15:35:08.452657 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:08.452628 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd197f83-6962-416f-9520-6532a33ae2c1-metrics-certs\") pod \"router-default-65694f9b86-s6z2z\" (UID: \"dd197f83-6962-416f-9520-6532a33ae2c1\") " pod="openshift-ingress/router-default-65694f9b86-s6z2z" May 20 15:35:08.452767 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:08.452631 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7b5ce08f-f82d-4226-b1b0-9dddccec11cd-registry-tls\") pod \"image-registry-65f96ddd4b-pqgdt\" (UID: \"7b5ce08f-f82d-4226-b1b0-9dddccec11cd\") " pod="openshift-image-registry/image-registry-65f96ddd4b-pqgdt" May 20 15:35:08.544577 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:08.544550 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65f96ddd4b-pqgdt" May 20 15:35:08.668235 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:08.668187 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-67d667c7d-lpvhc" podStartSLOduration=7.743300142 podStartE2EDuration="9.668169242s" podCreationTimestamp="2026-05-20 15:34:59 +0000 UTC" firstStartedPulling="2026-05-20 15:34:59.890964779 +0000 UTC m=+131.105887551" lastFinishedPulling="2026-05-20 15:35:01.815833875 +0000 UTC m=+133.030756651" observedRunningTime="2026-05-20 15:35:02.840259941 +0000 UTC m=+134.055182733" watchObservedRunningTime="2026-05-20 15:35:08.668169242 +0000 UTC m=+139.883092232" May 20 15:35:08.669062 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:08.668968 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-65f96ddd4b-pqgdt"] May 20 15:35:08.672281 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:35:08.672254 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b5ce08f_f82d_4226_b1b0_9dddccec11cd.slice/crio-6c71ff546cc8080a8ff45e1304555c53e7689df32c6f217967e027fd4228addc WatchSource:0}: Error finding container 6c71ff546cc8080a8ff45e1304555c53e7689df32c6f217967e027fd4228addc: Status 404 returned error can't find the container with id 6c71ff546cc8080a8ff45e1304555c53e7689df32c6f217967e027fd4228addc May 20 15:35:08.840734 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:08.840702 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65f96ddd4b-pqgdt" event={"ID":"7b5ce08f-f82d-4226-b1b0-9dddccec11cd","Type":"ContainerStarted","Data":"183d8c880ef578fa7d4993c3c574d707b2abb9a8e3837047c556a6f9341793c8"} May 20 15:35:08.840734 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:08.840739 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65f96ddd4b-pqgdt" event={"ID":"7b5ce08f-f82d-4226-b1b0-9dddccec11cd","Type":"ContainerStarted","Data":"6c71ff546cc8080a8ff45e1304555c53e7689df32c6f217967e027fd4228addc"} May 20 15:35:08.840989 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:08.840837 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-65f96ddd4b-pqgdt" May 20 15:35:08.859306 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:08.859236 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-65f96ddd4b-pqgdt" podStartSLOduration=16.859218403 podStartE2EDuration="16.859218403s" podCreationTimestamp="2026-05-20 15:34:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 15:35:08.858636884 +0000 UTC m=+140.073559678" watchObservedRunningTime="2026-05-20 15:35:08.859218403 +0000 UTC m=+140.074141196" May 20 15:35:13.380234 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:13.380206 2557 scope.go:117] "RemoveContainer" containerID="d089d681c65aa5a839688660b10fc18add066603b105a3e74306ee1b89ae1718" May 20 15:35:13.854235 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:13.854209 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-gwx4j_574489b4-f926-4667-be55-8e4e4d4f98e4/console-operator/2.log" May 20 15:35:13.854592 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:13.854574 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-gwx4j_574489b4-f926-4667-be55-8e4e4d4f98e4/console-operator/1.log" May 20 15:35:13.854644 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:13.854614 2557 generic.go:358] "Generic (PLEG): container finished" podID="574489b4-f926-4667-be55-8e4e4d4f98e4" containerID="c3c6e13d6eefcfb7bf34a9ef2a8ad333cbc38998a80f4fcff5fae855ff9561c3" exitCode=255 May 20 15:35:13.854693 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:13.854678 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-gwx4j" event={"ID":"574489b4-f926-4667-be55-8e4e4d4f98e4","Type":"ContainerDied","Data":"c3c6e13d6eefcfb7bf34a9ef2a8ad333cbc38998a80f4fcff5fae855ff9561c3"} May 20 15:35:13.854728 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:13.854712 2557 scope.go:117] "RemoveContainer" containerID="d089d681c65aa5a839688660b10fc18add066603b105a3e74306ee1b89ae1718" May 20 15:35:13.855067 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:13.855046 2557 scope.go:117] "RemoveContainer" containerID="c3c6e13d6eefcfb7bf34a9ef2a8ad333cbc38998a80f4fcff5fae855ff9561c3" May 20 15:35:13.855303 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:35:13.855282 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-gwx4j_openshift-console-operator(574489b4-f926-4667-be55-8e4e4d4f98e4)\"" pod="openshift-console-operator/console-operator-76dff48d59-gwx4j" podUID="574489b4-f926-4667-be55-8e4e4d4f98e4" May 20 15:35:14.861376 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:14.861344 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-gwx4j_574489b4-f926-4667-be55-8e4e4d4f98e4/console-operator/2.log" May 20 15:35:22.808681 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:22.808638 2557 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-gwx4j" May 20 15:35:22.808681 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:22.808687 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-gwx4j" May 20 15:35:22.809202 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:22.809009 2557 scope.go:117] "RemoveContainer" containerID="c3c6e13d6eefcfb7bf34a9ef2a8ad333cbc38998a80f4fcff5fae855ff9561c3" May 20 15:35:22.809202 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:35:22.809175 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-gwx4j_openshift-console-operator(574489b4-f926-4667-be55-8e4e4d4f98e4)\"" pod="openshift-console-operator/console-operator-76dff48d59-gwx4j" podUID="574489b4-f926-4667-be55-8e4e4d4f98e4" May 20 15:35:23.063406 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:23.063315 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-6bzm6"] May 20 15:35:23.066601 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:23.066577 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6bzm6" May 20 15:35:23.068775 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:23.068753 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 20 15:35:23.068914 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:23.068792 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 20 15:35:23.069405 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:23.069378 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 20 15:35:23.069516 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:23.069413 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 20 15:35:23.069516 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:23.069443 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6wcqs\"" May 20 15:35:23.077142 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:23.077124 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6bzm6"] May 20 15:35:23.109337 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:23.109316 2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-65f96ddd4b-pqgdt"] May 20 15:35:23.113400 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:23.113366 2557 patch_prober.go:28] interesting pod/image-registry-65f96ddd4b-pqgdt container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 20 15:35:23.113505 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:23.113437 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-65f96ddd4b-pqgdt" podUID="7b5ce08f-f82d-4226-b1b0-9dddccec11cd" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 20 15:35:23.163218 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:23.163192 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0ee12c56-05a4-4013-8297-a9d329afc1a4-crio-socket\") pod \"insights-runtime-extractor-6bzm6\" (UID: \"0ee12c56-05a4-4013-8297-a9d329afc1a4\") " pod="openshift-insights/insights-runtime-extractor-6bzm6" May 20 15:35:23.163354 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:23.163224 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0ee12c56-05a4-4013-8297-a9d329afc1a4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6bzm6\" (UID: \"0ee12c56-05a4-4013-8297-a9d329afc1a4\") " pod="openshift-insights/insights-runtime-extractor-6bzm6" May 20 15:35:23.163354 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:23.163259 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7d4m\" (UniqueName: \"kubernetes.io/projected/0ee12c56-05a4-4013-8297-a9d329afc1a4-kube-api-access-p7d4m\") pod \"insights-runtime-extractor-6bzm6\" (UID: \"0ee12c56-05a4-4013-8297-a9d329afc1a4\") " pod="openshift-insights/insights-runtime-extractor-6bzm6" May 20 15:35:23.163354 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:23.163310 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0ee12c56-05a4-4013-8297-a9d329afc1a4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6bzm6\" (UID: \"0ee12c56-05a4-4013-8297-a9d329afc1a4\") " pod="openshift-insights/insights-runtime-extractor-6bzm6" May 20 15:35:23.163354 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:23.163347 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0ee12c56-05a4-4013-8297-a9d329afc1a4-data-volume\") pod \"insights-runtime-extractor-6bzm6\" (UID: \"0ee12c56-05a4-4013-8297-a9d329afc1a4\") " pod="openshift-insights/insights-runtime-extractor-6bzm6" May 20 15:35:23.264637 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:23.264606 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0ee12c56-05a4-4013-8297-a9d329afc1a4-data-volume\") pod \"insights-runtime-extractor-6bzm6\" (UID: \"0ee12c56-05a4-4013-8297-a9d329afc1a4\") " pod="openshift-insights/insights-runtime-extractor-6bzm6" May 20 15:35:23.264802 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:23.264656 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0ee12c56-05a4-4013-8297-a9d329afc1a4-crio-socket\") pod \"insights-runtime-extractor-6bzm6\" (UID: \"0ee12c56-05a4-4013-8297-a9d329afc1a4\") " pod="openshift-insights/insights-runtime-extractor-6bzm6" May 20 15:35:23.264802 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:23.264680 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0ee12c56-05a4-4013-8297-a9d329afc1a4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6bzm6\" (UID: \"0ee12c56-05a4-4013-8297-a9d329afc1a4\") " pod="openshift-insights/insights-runtime-extractor-6bzm6" May 20 15:35:23.264802 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:23.264726 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p7d4m\" (UniqueName: \"kubernetes.io/projected/0ee12c56-05a4-4013-8297-a9d329afc1a4-kube-api-access-p7d4m\") pod \"insights-runtime-extractor-6bzm6\" (UID: \"0ee12c56-05a4-4013-8297-a9d329afc1a4\") " pod="openshift-insights/insights-runtime-extractor-6bzm6" May 20 15:35:23.264802 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:23.264750 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0ee12c56-05a4-4013-8297-a9d329afc1a4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6bzm6\" (UID: \"0ee12c56-05a4-4013-8297-a9d329afc1a4\") " pod="openshift-insights/insights-runtime-extractor-6bzm6" May 20 15:35:23.264802 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:23.264746 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0ee12c56-05a4-4013-8297-a9d329afc1a4-crio-socket\") pod \"insights-runtime-extractor-6bzm6\" (UID: \"0ee12c56-05a4-4013-8297-a9d329afc1a4\") " pod="openshift-insights/insights-runtime-extractor-6bzm6" May 20 15:35:23.265093 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:23.265062 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0ee12c56-05a4-4013-8297-a9d329afc1a4-data-volume\") pod \"insights-runtime-extractor-6bzm6\" (UID: \"0ee12c56-05a4-4013-8297-a9d329afc1a4\") " pod="openshift-insights/insights-runtime-extractor-6bzm6" May 20 15:35:23.265252 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:23.265236 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0ee12c56-05a4-4013-8297-a9d329afc1a4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6bzm6\" (UID: \"0ee12c56-05a4-4013-8297-a9d329afc1a4\") " pod="openshift-insights/insights-runtime-extractor-6bzm6" May 20 15:35:23.267245 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:23.267229 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0ee12c56-05a4-4013-8297-a9d329afc1a4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6bzm6\" (UID: \"0ee12c56-05a4-4013-8297-a9d329afc1a4\") " pod="openshift-insights/insights-runtime-extractor-6bzm6" May 20 15:35:23.273154 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:23.273133 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7d4m\" (UniqueName: \"kubernetes.io/projected/0ee12c56-05a4-4013-8297-a9d329afc1a4-kube-api-access-p7d4m\") pod \"insights-runtime-extractor-6bzm6\" (UID: \"0ee12c56-05a4-4013-8297-a9d329afc1a4\") " pod="openshift-insights/insights-runtime-extractor-6bzm6" May 20 15:35:23.375598 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:23.375528 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6bzm6" May 20 15:35:23.503344 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:23.503313 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6bzm6"] May 20 15:35:23.507540 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:35:23.507500 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ee12c56_05a4_4013_8297_a9d329afc1a4.slice/crio-384cdd6e8c01ece25eb1f1d35030722eaa00707961046f2c6ae90f6d8c3c21b6 WatchSource:0}: Error finding container 384cdd6e8c01ece25eb1f1d35030722eaa00707961046f2c6ae90f6d8c3c21b6: Status 404 returned error can't find the container with id 384cdd6e8c01ece25eb1f1d35030722eaa00707961046f2c6ae90f6d8c3c21b6 May 20 15:35:23.884720 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:23.884684 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6bzm6" event={"ID":"0ee12c56-05a4-4013-8297-a9d329afc1a4","Type":"ContainerStarted","Data":"84d216cc4de095e1ddc71fea33452baa5abb6d9724b5d08da2d1da125007f442"} May 20 15:35:23.884720 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:23.884722 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6bzm6" event={"ID":"0ee12c56-05a4-4013-8297-a9d329afc1a4","Type":"ContainerStarted","Data":"384cdd6e8c01ece25eb1f1d35030722eaa00707961046f2c6ae90f6d8c3c21b6"} May 20 15:35:24.474319 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:24.474297 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd197f83-6962-416f-9520-6532a33ae2c1-service-ca-bundle\") pod \"router-default-65694f9b86-s6z2z\" (UID: \"dd197f83-6962-416f-9520-6532a33ae2c1\") " pod="openshift-ingress/router-default-65694f9b86-s6z2z" May 20 15:35:24.474873 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:24.474854 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd197f83-6962-416f-9520-6532a33ae2c1-service-ca-bundle\") pod \"router-default-65694f9b86-s6z2z\" (UID: \"dd197f83-6962-416f-9520-6532a33ae2c1\") " pod="openshift-ingress/router-default-65694f9b86-s6z2z" May 20 15:35:24.740207 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:24.740119 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-65694f9b86-s6z2z" May 20 15:35:24.886609 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:24.886518 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-65694f9b86-s6z2z"] May 20 15:35:24.889135 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:24.889104 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6bzm6" event={"ID":"0ee12c56-05a4-4013-8297-a9d329afc1a4","Type":"ContainerStarted","Data":"843d4df66dee7ed502081a090ba17fc92d0827dcd20ab2afb1c34ae9957b0a28"} May 20 15:35:24.889588 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:35:24.889566 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd197f83_6962_416f_9520_6532a33ae2c1.slice/crio-d29a854f5a6e0ff1200b0d9801ec4027128336ea11499fca220fa1ccc154263a WatchSource:0}: Error finding container d29a854f5a6e0ff1200b0d9801ec4027128336ea11499fca220fa1ccc154263a: Status 404 returned error can't find the container with id d29a854f5a6e0ff1200b0d9801ec4027128336ea11499fca220fa1ccc154263a May 20 15:35:25.893007 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:25.892964 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6bzm6" event={"ID":"0ee12c56-05a4-4013-8297-a9d329afc1a4","Type":"ContainerStarted","Data":"535d4b4eca619ee934e9411cdcfd41a481c5ac7674766f2219a9b030c8e18e37"} May 20 15:35:25.894324 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:25.894298 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-65694f9b86-s6z2z" event={"ID":"dd197f83-6962-416f-9520-6532a33ae2c1","Type":"ContainerStarted","Data":"6f45abb732892a7045cd0c9bd1d36ef16a9b3953f889fc6bccf6eff10e53ba3e"} May 20 15:35:25.894324 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:25.894324 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-65694f9b86-s6z2z" event={"ID":"dd197f83-6962-416f-9520-6532a33ae2c1","Type":"ContainerStarted","Data":"d29a854f5a6e0ff1200b0d9801ec4027128336ea11499fca220fa1ccc154263a"} May 20 15:35:25.914789 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:25.912420 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-6bzm6" podStartSLOduration=1.038824117 podStartE2EDuration="2.912401578s" podCreationTimestamp="2026-05-20 15:35:23 +0000 UTC" firstStartedPulling="2026-05-20 15:35:23.565906608 +0000 UTC m=+154.780829392" lastFinishedPulling="2026-05-20 15:35:25.439484082 +0000 UTC m=+156.654406853" observedRunningTime="2026-05-20 15:35:25.910156299 +0000 UTC m=+157.125079093" watchObservedRunningTime="2026-05-20 15:35:25.912401578 +0000 UTC m=+157.127324372" May 20 15:35:25.933911 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:25.933870 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-65694f9b86-s6z2z" podStartSLOduration=33.933849223 podStartE2EDuration="33.933849223s" podCreationTimestamp="2026-05-20 15:34:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 15:35:25.933069064 +0000 UTC m=+157.147991869" watchObservedRunningTime="2026-05-20 15:35:25.933849223 +0000 UTC m=+157.148772016" May 20 15:35:26.147040 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:35:26.146962 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-hxl9x" podUID="fcbc1cf6-64e2-42ce-b29d-2c21b26668ce" May 20 15:35:26.160133 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:35:26.160101 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-fvbkd" podUID="9f13da06-401d-412b-a532-a02a3a620761" May 20 15:35:26.398477 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:35:26.398378 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-wszj2" podUID="54872a9c-6091-4768-8cd9-e81ab987ba01" May 20 15:35:26.740735 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:26.740700 2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-65694f9b86-s6z2z" May 20 15:35:26.743181 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:26.743160 2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-65694f9b86-s6z2z" May 20 15:35:26.898796 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:26.898762 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hxl9x" May 20 15:35:26.899175 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:26.899026 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-65694f9b86-s6z2z" May 20 15:35:26.900200 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:26.900179 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-65694f9b86-s6z2z" May 20 15:35:31.023113 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:31.023017 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fcbc1cf6-64e2-42ce-b29d-2c21b26668ce-metrics-tls\") pod \"dns-default-hxl9x\" (UID: \"fcbc1cf6-64e2-42ce-b29d-2c21b26668ce\") " pod="openshift-dns/dns-default-hxl9x" May 20 15:35:31.025589 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:31.025558 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fcbc1cf6-64e2-42ce-b29d-2c21b26668ce-metrics-tls\") pod \"dns-default-hxl9x\" (UID: \"fcbc1cf6-64e2-42ce-b29d-2c21b26668ce\") " pod="openshift-dns/dns-default-hxl9x" May 20 15:35:31.041486 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:31.041451 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-68267"] May 20 15:35:31.044100 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:31.044074 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-68267" May 20 15:35:31.047361 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:31.047333 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 20 15:35:31.047521 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:31.047379 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 20 15:35:31.047521 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:31.047413 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" May 20 15:35:31.047521 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:31.047435 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-62sr2\"" May 20 15:35:31.047521 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:31.047454 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" May 20 15:35:31.047742 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:31.047730 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 20 15:35:31.052864 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:31.052842 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-68267"] May 20 15:35:31.102743 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:31.102710 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-j6j2b\"" May 20 15:35:31.110584 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:31.110559 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hxl9x" May 20 15:35:31.123535 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:31.123500 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6g8sb\" (UniqueName: \"kubernetes.io/projected/f9ba6193-844a-482e-9b55-198cc419d021-kube-api-access-6g8sb\") pod \"prometheus-operator-7779bbdd78-68267\" (UID: \"f9ba6193-844a-482e-9b55-198cc419d021\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-68267" May 20 15:35:31.123710 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:31.123551 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f9ba6193-844a-482e-9b55-198cc419d021-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-68267\" (UID: \"f9ba6193-844a-482e-9b55-198cc419d021\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-68267" May 20 15:35:31.123710 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:31.123664 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9f13da06-401d-412b-a532-a02a3a620761-cert\") pod \"ingress-canary-fvbkd\" (UID: \"9f13da06-401d-412b-a532-a02a3a620761\") " pod="openshift-ingress-canary/ingress-canary-fvbkd" May 20 15:35:31.123868 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:31.123705 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f9ba6193-844a-482e-9b55-198cc419d021-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-68267\" (UID: \"f9ba6193-844a-482e-9b55-198cc419d021\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-68267" May 20 15:35:31.123868 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:31.123770 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f9ba6193-844a-482e-9b55-198cc419d021-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-68267\" (UID: \"f9ba6193-844a-482e-9b55-198cc419d021\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-68267" May 20 15:35:31.126588 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:31.126558 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9f13da06-401d-412b-a532-a02a3a620761-cert\") pod \"ingress-canary-fvbkd\" (UID: \"9f13da06-401d-412b-a532-a02a3a620761\") " pod="openshift-ingress-canary/ingress-canary-fvbkd" May 20 15:35:31.224622 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:31.224575 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f9ba6193-844a-482e-9b55-198cc419d021-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-68267\" (UID: \"f9ba6193-844a-482e-9b55-198cc419d021\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-68267" May 20 15:35:31.224800 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:31.224653 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6g8sb\" (UniqueName: \"kubernetes.io/projected/f9ba6193-844a-482e-9b55-198cc419d021-kube-api-access-6g8sb\") pod \"prometheus-operator-7779bbdd78-68267\" (UID: \"f9ba6193-844a-482e-9b55-198cc419d021\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-68267" May 20 15:35:31.224800 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:31.224688 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f9ba6193-844a-482e-9b55-198cc419d021-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-68267\" (UID: \"f9ba6193-844a-482e-9b55-198cc419d021\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-68267" May 20 15:35:31.224800 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:31.224752 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f9ba6193-844a-482e-9b55-198cc419d021-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-68267\" (UID: \"f9ba6193-844a-482e-9b55-198cc419d021\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-68267" May 20 15:35:31.224997 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:35:31.224890 2557 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found May 20 15:35:31.224997 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:35:31.224981 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9ba6193-844a-482e-9b55-198cc419d021-prometheus-operator-tls podName:f9ba6193-844a-482e-9b55-198cc419d021 nodeName:}" failed. No retries permitted until 2026-05-20 15:35:31.724962359 +0000 UTC m=+162.939885132 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/f9ba6193-844a-482e-9b55-198cc419d021-prometheus-operator-tls") pod "prometheus-operator-7779bbdd78-68267" (UID: "f9ba6193-844a-482e-9b55-198cc419d021") : secret "prometheus-operator-tls" not found May 20 15:35:31.225386 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:31.225355 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f9ba6193-844a-482e-9b55-198cc419d021-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-68267\" (UID: \"f9ba6193-844a-482e-9b55-198cc419d021\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-68267" May 20 15:35:31.227393 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:31.227355 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f9ba6193-844a-482e-9b55-198cc419d021-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-68267\" (UID: \"f9ba6193-844a-482e-9b55-198cc419d021\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-68267" May 20 15:35:31.235419 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:31.235389 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6g8sb\" (UniqueName: \"kubernetes.io/projected/f9ba6193-844a-482e-9b55-198cc419d021-kube-api-access-6g8sb\") pod \"prometheus-operator-7779bbdd78-68267\" (UID: \"f9ba6193-844a-482e-9b55-198cc419d021\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-68267" May 20 15:35:31.253215 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:31.253150 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hxl9x"] May 20 15:35:31.257040 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:35:31.257010 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcbc1cf6_64e2_42ce_b29d_2c21b26668ce.slice/crio-436e1e2f348343ce4e5078ae7006f379fc7abab61dd9163ee087f018da24d826 WatchSource:0}: Error finding container 436e1e2f348343ce4e5078ae7006f379fc7abab61dd9163ee087f018da24d826: Status 404 returned error can't find the container with id 436e1e2f348343ce4e5078ae7006f379fc7abab61dd9163ee087f018da24d826 May 20 15:35:31.729083 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:31.729045 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f9ba6193-844a-482e-9b55-198cc419d021-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-68267\" (UID: \"f9ba6193-844a-482e-9b55-198cc419d021\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-68267" May 20 15:35:31.731725 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:31.731697 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f9ba6193-844a-482e-9b55-198cc419d021-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-68267\" (UID: \"f9ba6193-844a-482e-9b55-198cc419d021\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-68267" May 20 15:35:31.912661 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:31.912619 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hxl9x" event={"ID":"fcbc1cf6-64e2-42ce-b29d-2c21b26668ce","Type":"ContainerStarted","Data":"436e1e2f348343ce4e5078ae7006f379fc7abab61dd9163ee087f018da24d826"} May 20 15:35:31.954807 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:31.954769 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-68267" May 20 15:35:32.099940 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:32.099905 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-68267"] May 20 15:35:32.103518 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:35:32.103482 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9ba6193_844a_482e_9b55_198cc419d021.slice/crio-aa839fcd99c5757abd018a3d6d57e25495611fc5d2e2f543f695e86e317ccf63 WatchSource:0}: Error finding container aa839fcd99c5757abd018a3d6d57e25495611fc5d2e2f543f695e86e317ccf63: Status 404 returned error can't find the container with id aa839fcd99c5757abd018a3d6d57e25495611fc5d2e2f543f695e86e317ccf63 May 20 15:35:32.917782 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:32.917650 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hxl9x" event={"ID":"fcbc1cf6-64e2-42ce-b29d-2c21b26668ce","Type":"ContainerStarted","Data":"33cba144f31404a21f98d9717d4bd3ab13b3dbdfd41c2a8e77ef29dcb8cecab1"} May 20 15:35:32.917782 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:32.917696 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hxl9x" event={"ID":"fcbc1cf6-64e2-42ce-b29d-2c21b26668ce","Type":"ContainerStarted","Data":"d9c34de7c6e166545498a3a971b1ebea8f2965275ae8521edd403eb94722f1f4"} May 20 15:35:32.918019 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:32.917798 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-hxl9x" May 20 15:35:32.918899 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:32.918865 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-68267" event={"ID":"f9ba6193-844a-482e-9b55-198cc419d021","Type":"ContainerStarted","Data":"aa839fcd99c5757abd018a3d6d57e25495611fc5d2e2f543f695e86e317ccf63"} May 20 15:35:32.936604 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:32.936551 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-hxl9x" podStartSLOduration=128.554566763 podStartE2EDuration="2m9.936535197s" podCreationTimestamp="2026-05-20 15:33:23 +0000 UTC" firstStartedPulling="2026-05-20 15:35:31.258930605 +0000 UTC m=+162.473853376" lastFinishedPulling="2026-05-20 15:35:32.640899024 +0000 UTC m=+163.855821810" observedRunningTime="2026-05-20 15:35:32.935027194 +0000 UTC m=+164.149949986" watchObservedRunningTime="2026-05-20 15:35:32.936535197 +0000 UTC m=+164.151457991" May 20 15:35:33.115585 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:33.115561 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-65f96ddd4b-pqgdt" May 20 15:35:33.927135 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:33.927103 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-68267" event={"ID":"f9ba6193-844a-482e-9b55-198cc419d021","Type":"ContainerStarted","Data":"7df81160ef8a835c01886d60ade20a6bff3e4f8c9b9ba13c82b5c474e92b9ab7"} May 20 15:35:33.927135 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:33.927140 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-68267" event={"ID":"f9ba6193-844a-482e-9b55-198cc419d021","Type":"ContainerStarted","Data":"6122772afc24118363144f1dbad2ffc7fd5ffb7d4fb831b519e25415752f26b3"} May 20 15:35:33.946747 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:33.946699 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7779bbdd78-68267" podStartSLOduration=1.6446351049999999 podStartE2EDuration="2.946685791s" podCreationTimestamp="2026-05-20 15:35:31 +0000 UTC" firstStartedPulling="2026-05-20 15:35:32.106062982 +0000 UTC m=+163.320985753" lastFinishedPulling="2026-05-20 15:35:33.408113666 +0000 UTC m=+164.623036439" observedRunningTime="2026-05-20 15:35:33.945691632 +0000 UTC m=+165.160614452" watchObservedRunningTime="2026-05-20 15:35:33.946685791 +0000 UTC m=+165.161608584" May 20 15:35:35.535748 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:35.535699 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-p9426"] May 20 15:35:35.538966 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:35.538940 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-p9426" May 20 15:35:35.541182 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:35.541160 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 20 15:35:35.541545 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:35.541523 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-ttrgj\"" May 20 15:35:35.541750 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:35.541733 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 20 15:35:35.541996 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:35.541977 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 20 15:35:35.560514 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:35.560484 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c83885b8-12f2-434f-9349-f811f5507c19-sys\") pod \"node-exporter-p9426\" (UID: \"c83885b8-12f2-434f-9349-f811f5507c19\") " pod="openshift-monitoring/node-exporter-p9426" May 20 15:35:35.560682 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:35.560515 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c83885b8-12f2-434f-9349-f811f5507c19-node-exporter-tls\") pod \"node-exporter-p9426\" (UID: \"c83885b8-12f2-434f-9349-f811f5507c19\") " pod="openshift-monitoring/node-exporter-p9426" May 20 15:35:35.560682 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:35.560560 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c83885b8-12f2-434f-9349-f811f5507c19-node-exporter-textfile\") pod \"node-exporter-p9426\" (UID: \"c83885b8-12f2-434f-9349-f811f5507c19\") " pod="openshift-monitoring/node-exporter-p9426" May 20 15:35:35.560682 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:35.560598 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c83885b8-12f2-434f-9349-f811f5507c19-metrics-client-ca\") pod \"node-exporter-p9426\" (UID: \"c83885b8-12f2-434f-9349-f811f5507c19\") " pod="openshift-monitoring/node-exporter-p9426" May 20 15:35:35.560682 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:35.560622 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c83885b8-12f2-434f-9349-f811f5507c19-node-exporter-accelerators-collector-config\") pod \"node-exporter-p9426\" (UID: \"c83885b8-12f2-434f-9349-f811f5507c19\") " pod="openshift-monitoring/node-exporter-p9426" May 20 15:35:35.560682 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:35.560648 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbzth\" (UniqueName: \"kubernetes.io/projected/c83885b8-12f2-434f-9349-f811f5507c19-kube-api-access-fbzth\") pod \"node-exporter-p9426\" (UID: \"c83885b8-12f2-434f-9349-f811f5507c19\") " pod="openshift-monitoring/node-exporter-p9426" May 20 15:35:35.560682 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:35.560669 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c83885b8-12f2-434f-9349-f811f5507c19-node-exporter-wtmp\") pod \"node-exporter-p9426\" (UID: \"c83885b8-12f2-434f-9349-f811f5507c19\") " pod="openshift-monitoring/node-exporter-p9426" May 20 15:35:35.561008 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:35.560709 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c83885b8-12f2-434f-9349-f811f5507c19-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p9426\" (UID: \"c83885b8-12f2-434f-9349-f811f5507c19\") " pod="openshift-monitoring/node-exporter-p9426" May 20 15:35:35.561008 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:35.560733 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c83885b8-12f2-434f-9349-f811f5507c19-root\") pod \"node-exporter-p9426\" (UID: \"c83885b8-12f2-434f-9349-f811f5507c19\") " pod="openshift-monitoring/node-exporter-p9426" May 20 15:35:35.662073 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:35.662042 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c83885b8-12f2-434f-9349-f811f5507c19-root\") pod \"node-exporter-p9426\" (UID: \"c83885b8-12f2-434f-9349-f811f5507c19\") " pod="openshift-monitoring/node-exporter-p9426" May 20 15:35:35.662220 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:35.662087 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c83885b8-12f2-434f-9349-f811f5507c19-sys\") pod \"node-exporter-p9426\" (UID: \"c83885b8-12f2-434f-9349-f811f5507c19\") " pod="openshift-monitoring/node-exporter-p9426" May 20 15:35:35.662220 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:35.662117 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c83885b8-12f2-434f-9349-f811f5507c19-node-exporter-tls\") pod \"node-exporter-p9426\" (UID: \"c83885b8-12f2-434f-9349-f811f5507c19\") " pod="openshift-monitoring/node-exporter-p9426" May 20 15:35:35.662220 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:35.662164 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c83885b8-12f2-434f-9349-f811f5507c19-node-exporter-textfile\") pod \"node-exporter-p9426\" (UID: \"c83885b8-12f2-434f-9349-f811f5507c19\") " pod="openshift-monitoring/node-exporter-p9426" May 20 15:35:35.662220 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:35.662165 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c83885b8-12f2-434f-9349-f811f5507c19-root\") pod \"node-exporter-p9426\" (UID: \"c83885b8-12f2-434f-9349-f811f5507c19\") " pod="openshift-monitoring/node-exporter-p9426" May 20 15:35:35.662220 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:35.662184 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c83885b8-12f2-434f-9349-f811f5507c19-sys\") pod \"node-exporter-p9426\" (UID: \"c83885b8-12f2-434f-9349-f811f5507c19\") " pod="openshift-monitoring/node-exporter-p9426" May 20 15:35:35.662220 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:35.662190 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c83885b8-12f2-434f-9349-f811f5507c19-metrics-client-ca\") pod \"node-exporter-p9426\" (UID: \"c83885b8-12f2-434f-9349-f811f5507c19\") " pod="openshift-monitoring/node-exporter-p9426" May 20 15:35:35.662505 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:35.662261 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c83885b8-12f2-434f-9349-f811f5507c19-node-exporter-accelerators-collector-config\") pod \"node-exporter-p9426\" (UID: \"c83885b8-12f2-434f-9349-f811f5507c19\") " pod="openshift-monitoring/node-exporter-p9426" May 20 15:35:35.662505 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:35.662323 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fbzth\" (UniqueName: \"kubernetes.io/projected/c83885b8-12f2-434f-9349-f811f5507c19-kube-api-access-fbzth\") pod \"node-exporter-p9426\" (UID: \"c83885b8-12f2-434f-9349-f811f5507c19\") " pod="openshift-monitoring/node-exporter-p9426" May 20 15:35:35.662505 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:35.662361 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c83885b8-12f2-434f-9349-f811f5507c19-node-exporter-wtmp\") pod \"node-exporter-p9426\" (UID: \"c83885b8-12f2-434f-9349-f811f5507c19\") " pod="openshift-monitoring/node-exporter-p9426" May 20 15:35:35.662505 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:35.662412 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c83885b8-12f2-434f-9349-f811f5507c19-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p9426\" (UID: \"c83885b8-12f2-434f-9349-f811f5507c19\") " pod="openshift-monitoring/node-exporter-p9426" May 20 15:35:35.662695 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:35.662559 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c83885b8-12f2-434f-9349-f811f5507c19-node-exporter-textfile\") pod \"node-exporter-p9426\" (UID: \"c83885b8-12f2-434f-9349-f811f5507c19\") " pod="openshift-monitoring/node-exporter-p9426" May 20 15:35:35.662801 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:35.662777 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c83885b8-12f2-434f-9349-f811f5507c19-metrics-client-ca\") pod \"node-exporter-p9426\" (UID: \"c83885b8-12f2-434f-9349-f811f5507c19\") " pod="openshift-monitoring/node-exporter-p9426" May 20 15:35:35.663061 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:35.663023 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c83885b8-12f2-434f-9349-f811f5507c19-node-exporter-wtmp\") pod \"node-exporter-p9426\" (UID: \"c83885b8-12f2-434f-9349-f811f5507c19\") " pod="openshift-monitoring/node-exporter-p9426" May 20 15:35:35.663061 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:35.663048 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c83885b8-12f2-434f-9349-f811f5507c19-node-exporter-accelerators-collector-config\") pod \"node-exporter-p9426\" (UID: \"c83885b8-12f2-434f-9349-f811f5507c19\") " pod="openshift-monitoring/node-exporter-p9426" May 20 15:35:35.665275 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:35.665255 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c83885b8-12f2-434f-9349-f811f5507c19-node-exporter-tls\") pod \"node-exporter-p9426\" (UID: \"c83885b8-12f2-434f-9349-f811f5507c19\") " pod="openshift-monitoring/node-exporter-p9426" May 20 15:35:35.665432 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:35.665410 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c83885b8-12f2-434f-9349-f811f5507c19-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p9426\" (UID: \"c83885b8-12f2-434f-9349-f811f5507c19\") " pod="openshift-monitoring/node-exporter-p9426" May 20 15:35:35.673799 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:35.673750 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbzth\" (UniqueName: \"kubernetes.io/projected/c83885b8-12f2-434f-9349-f811f5507c19-kube-api-access-fbzth\") pod \"node-exporter-p9426\" (UID: \"c83885b8-12f2-434f-9349-f811f5507c19\") " pod="openshift-monitoring/node-exporter-p9426" May 20 15:35:35.850854 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:35.850755 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-p9426" May 20 15:35:35.859210 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:35:35.859185 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc83885b8_12f2_434f_9349_f811f5507c19.slice/crio-1ee2a3c68b58494c105cec77954719d642ff84df68d8d4572866b5cc9aee5bf5 WatchSource:0}: Error finding container 1ee2a3c68b58494c105cec77954719d642ff84df68d8d4572866b5cc9aee5bf5: Status 404 returned error can't find the container with id 1ee2a3c68b58494c105cec77954719d642ff84df68d8d4572866b5cc9aee5bf5 May 20 15:35:35.933288 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:35.933260 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p9426" event={"ID":"c83885b8-12f2-434f-9349-f811f5507c19","Type":"ContainerStarted","Data":"1ee2a3c68b58494c105cec77954719d642ff84df68d8d4572866b5cc9aee5bf5"} May 20 15:35:36.379776 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:36.379744 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fvbkd" May 20 15:35:36.382201 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:36.382178 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-94zvt\"" May 20 15:35:36.390391 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:36.390362 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fvbkd" May 20 15:35:36.543499 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:36.543469 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 20 15:35:36.546807 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:36.546782 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 20 15:35:36.549382 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:36.549351 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" May 20 15:35:36.549946 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:36.549699 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-l8lwb\"" May 20 15:35:36.549946 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:36.549703 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" May 20 15:35:36.550107 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:36.549924 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" May 20 15:35:36.550107 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:36.550080 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" May 20 15:35:36.550638 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:36.550236 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" May 20 15:35:36.550638 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:36.550383 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" May 20 15:35:36.550638 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:36.550402 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" May 20 15:35:36.550638 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:36.550405 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" May 20 15:35:36.552961 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:36.552942 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" May 20 15:35:36.555058 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:36.555037 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fvbkd"] May 20 15:35:36.560151 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:35:36.560113 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f13da06_401d_412b_a532_a02a3a620761.slice/crio-54560491dc87c0aa14f156499b6bdad1c7dd20e6c1fbd437ed98f85d1e7a5ad6 WatchSource:0}: Error finding container 54560491dc87c0aa14f156499b6bdad1c7dd20e6c1fbd437ed98f85d1e7a5ad6: Status 404 returned error can't find the container with id 54560491dc87c0aa14f156499b6bdad1c7dd20e6c1fbd437ed98f85d1e7a5ad6 May 20 15:35:36.560567 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:36.560530 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 20 15:35:36.568736 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:36.568711 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8eef42cd-6f2d-4f5c-84a4-62e29aeca82c-web-config\") pod \"alertmanager-main-0\" (UID: \"8eef42cd-6f2d-4f5c-84a4-62e29aeca82c\") " pod="openshift-monitoring/alertmanager-main-0" May 20 15:35:36.568860 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:36.568777 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8eef42cd-6f2d-4f5c-84a4-62e29aeca82c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8eef42cd-6f2d-4f5c-84a4-62e29aeca82c\") " pod="openshift-monitoring/alertmanager-main-0" May 20 15:35:36.568860 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:36.568805 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8eef42cd-6f2d-4f5c-84a4-62e29aeca82c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8eef42cd-6f2d-4f5c-84a4-62e29aeca82c\") " pod="openshift-monitoring/alertmanager-main-0" May 20 15:35:36.568860 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:36.568850 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8eef42cd-6f2d-4f5c-84a4-62e29aeca82c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8eef42cd-6f2d-4f5c-84a4-62e29aeca82c\") " pod="openshift-monitoring/alertmanager-main-0" May 20 15:35:36.569013 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:36.568883 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8eef42cd-6f2d-4f5c-84a4-62e29aeca82c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8eef42cd-6f2d-4f5c-84a4-62e29aeca82c\") " pod="openshift-monitoring/alertmanager-main-0" May 20 15:35:36.569013 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:36.568907 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8eef42cd-6f2d-4f5c-84a4-62e29aeca82c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8eef42cd-6f2d-4f5c-84a4-62e29aeca82c\") " pod="openshift-monitoring/alertmanager-main-0" May 20 15:35:36.569013 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:36.568924 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8eef42cd-6f2d-4f5c-84a4-62e29aeca82c-config-out\") pod \"alertmanager-main-0\" (UID: \"8eef42cd-6f2d-4f5c-84a4-62e29aeca82c\") " pod="openshift-monitoring/alertmanager-main-0" May 20 15:35:36.569013 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:36.568943 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wm4v8\" (UniqueName: \"kubernetes.io/projected/8eef42cd-6f2d-4f5c-84a4-62e29aeca82c-kube-api-access-wm4v8\") pod \"alertmanager-main-0\" (UID: \"8eef42cd-6f2d-4f5c-84a4-62e29aeca82c\") " pod="openshift-monitoring/alertmanager-main-0" May 20 15:35:36.569212 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:36.569072 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8eef42cd-6f2d-4f5c-84a4-62e29aeca82c-config-volume\") pod \"alertmanager-main-0\" (UID: \"8eef42cd-6f2d-4f5c-84a4-62e29aeca82c\") " pod="openshift-monitoring/alertmanager-main-0" May 20 15:35:36.569212 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:36.569110 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8eef42cd-6f2d-4f5c-84a4-62e29aeca82c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8eef42cd-6f2d-4f5c-84a4-62e29aeca82c\") " pod="openshift-monitoring/alertmanager-main-0" May 20 15:35:36.569212 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:36.569158 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8eef42cd-6f2d-4f5c-84a4-62e29aeca82c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8eef42cd-6f2d-4f5c-84a4-62e29aeca82c\") " pod="openshift-monitoring/alertmanager-main-0" May 20 15:35:36.569212 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:36.569186 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8eef42cd-6f2d-4f5c-84a4-62e29aeca82c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8eef42cd-6f2d-4f5c-84a4-62e29aeca82c\") " pod="openshift-monitoring/alertmanager-main-0" May 20 15:35:36.569366 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:36.569237 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8eef42cd-6f2d-4f5c-84a4-62e29aeca82c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8eef42cd-6f2d-4f5c-84a4-62e29aeca82c\") " pod="openshift-monitoring/alertmanager-main-0" May 20 15:35:36.670095 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:36.670019 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8eef42cd-6f2d-4f5c-84a4-62e29aeca82c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8eef42cd-6f2d-4f5c-84a4-62e29aeca82c\") " pod="openshift-monitoring/alertmanager-main-0" May 20 15:35:36.670095 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:36.670064 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8eef42cd-6f2d-4f5c-84a4-62e29aeca82c-web-config\") pod \"alertmanager-main-0\" (UID: \"8eef42cd-6f2d-4f5c-84a4-62e29aeca82c\") " pod="openshift-monitoring/alertmanager-main-0" May 20 15:35:36.670283 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:36.670113 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8eef42cd-6f2d-4f5c-84a4-62e29aeca82c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8eef42cd-6f2d-4f5c-84a4-62e29aeca82c\") " pod="openshift-monitoring/alertmanager-main-0" May 20 15:35:36.670283 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:36.670136 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8eef42cd-6f2d-4f5c-84a4-62e29aeca82c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8eef42cd-6f2d-4f5c-84a4-62e29aeca82c\") " pod="openshift-monitoring/alertmanager-main-0" May 20 15:35:36.670283 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:36.670164 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8eef42cd-6f2d-4f5c-84a4-62e29aeca82c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8eef42cd-6f2d-4f5c-84a4-62e29aeca82c\") " pod="openshift-monitoring/alertmanager-main-0" May 20 15:35:36.670283 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:36.670205 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8eef42cd-6f2d-4f5c-84a4-62e29aeca82c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8eef42cd-6f2d-4f5c-84a4-62e29aeca82c\") " pod="openshift-monitoring/alertmanager-main-0" May 20 15:35:36.670283 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:36.670239 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8eef42cd-6f2d-4f5c-84a4-62e29aeca82c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8eef42cd-6f2d-4f5c-84a4-62e29aeca82c\") " pod="openshift-monitoring/alertmanager-main-0" May 20 15:35:36.670283 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:36.670262 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8eef42cd-6f2d-4f5c-84a4-62e29aeca82c-config-out\") pod \"alertmanager-main-0\" (UID: \"8eef42cd-6f2d-4f5c-84a4-62e29aeca82c\") " pod="openshift-monitoring/alertmanager-main-0" May 20 15:35:36.670549 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:36.670285 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wm4v8\" (UniqueName: \"kubernetes.io/projected/8eef42cd-6f2d-4f5c-84a4-62e29aeca82c-kube-api-access-wm4v8\") pod \"alertmanager-main-0\" (UID: \"8eef42cd-6f2d-4f5c-84a4-62e29aeca82c\") " pod="openshift-monitoring/alertmanager-main-0" May 20 15:35:36.670549 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:36.670319 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8eef42cd-6f2d-4f5c-84a4-62e29aeca82c-config-volume\") pod \"alertmanager-main-0\" (UID: \"8eef42cd-6f2d-4f5c-84a4-62e29aeca82c\") " pod="openshift-monitoring/alertmanager-main-0" May 20 15:35:36.670549 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:36.670343 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8eef42cd-6f2d-4f5c-84a4-62e29aeca82c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8eef42cd-6f2d-4f5c-84a4-62e29aeca82c\") " pod="openshift-monitoring/alertmanager-main-0" May 20 15:35:36.670549 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:36.670390 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8eef42cd-6f2d-4f5c-84a4-62e29aeca82c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8eef42cd-6f2d-4f5c-84a4-62e29aeca82c\") " pod="openshift-monitoring/alertmanager-main-0" May 20 15:35:36.670549 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:36.670415 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8eef42cd-6f2d-4f5c-84a4-62e29aeca82c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8eef42cd-6f2d-4f5c-84a4-62e29aeca82c\") " pod="openshift-monitoring/alertmanager-main-0" May 20 15:35:36.671373 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:35:36.670933 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8eef42cd-6f2d-4f5c-84a4-62e29aeca82c-alertmanager-trusted-ca-bundle podName:8eef42cd-6f2d-4f5c-84a4-62e29aeca82c nodeName:}" failed. No retries permitted until 2026-05-20 15:35:37.170915444 +0000 UTC m=+168.385838216 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/8eef42cd-6f2d-4f5c-84a4-62e29aeca82c-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "8eef42cd-6f2d-4f5c-84a4-62e29aeca82c") : configmap references non-existent config key: ca-bundle.crt May 20 15:35:36.671373 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:36.671215 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8eef42cd-6f2d-4f5c-84a4-62e29aeca82c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8eef42cd-6f2d-4f5c-84a4-62e29aeca82c\") " pod="openshift-monitoring/alertmanager-main-0" May 20 15:35:36.671587 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:36.671487 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8eef42cd-6f2d-4f5c-84a4-62e29aeca82c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8eef42cd-6f2d-4f5c-84a4-62e29aeca82c\") " pod="openshift-monitoring/alertmanager-main-0" May 20 15:35:36.673982 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:36.673950 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8eef42cd-6f2d-4f5c-84a4-62e29aeca82c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8eef42cd-6f2d-4f5c-84a4-62e29aeca82c\") " pod="openshift-monitoring/alertmanager-main-0" May 20 15:35:36.675365 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:36.675067 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8eef42cd-6f2d-4f5c-84a4-62e29aeca82c-config-volume\") pod \"alertmanager-main-0\" (UID: \"8eef42cd-6f2d-4f5c-84a4-62e29aeca82c\") " pod="openshift-monitoring/alertmanager-main-0" May 20 15:35:36.675365 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:36.675295 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8eef42cd-6f2d-4f5c-84a4-62e29aeca82c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8eef42cd-6f2d-4f5c-84a4-62e29aeca82c\") " pod="openshift-monitoring/alertmanager-main-0" May 20 15:35:36.676205 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:36.675926 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8eef42cd-6f2d-4f5c-84a4-62e29aeca82c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8eef42cd-6f2d-4f5c-84a4-62e29aeca82c\") " pod="openshift-monitoring/alertmanager-main-0" May 20 15:35:36.676205 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:36.676168 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8eef42cd-6f2d-4f5c-84a4-62e29aeca82c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8eef42cd-6f2d-4f5c-84a4-62e29aeca82c\") " pod="openshift-monitoring/alertmanager-main-0" May 20 15:35:36.676610 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:36.676589 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8eef42cd-6f2d-4f5c-84a4-62e29aeca82c-config-out\") pod \"alertmanager-main-0\" (UID: \"8eef42cd-6f2d-4f5c-84a4-62e29aeca82c\") " pod="openshift-monitoring/alertmanager-main-0" May 20 15:35:36.676768 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:36.676739 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8eef42cd-6f2d-4f5c-84a4-62e29aeca82c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8eef42cd-6f2d-4f5c-84a4-62e29aeca82c\") " pod="openshift-monitoring/alertmanager-main-0" May 20 15:35:36.677366 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:36.677346 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8eef42cd-6f2d-4f5c-84a4-62e29aeca82c-web-config\") pod \"alertmanager-main-0\" (UID: \"8eef42cd-6f2d-4f5c-84a4-62e29aeca82c\") " pod="openshift-monitoring/alertmanager-main-0" May 20 15:35:36.677648 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:36.677626 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8eef42cd-6f2d-4f5c-84a4-62e29aeca82c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8eef42cd-6f2d-4f5c-84a4-62e29aeca82c\") " pod="openshift-monitoring/alertmanager-main-0" May 20 15:35:36.683387 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:36.683368 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wm4v8\" (UniqueName: \"kubernetes.io/projected/8eef42cd-6f2d-4f5c-84a4-62e29aeca82c-kube-api-access-wm4v8\") pod \"alertmanager-main-0\" (UID: \"8eef42cd-6f2d-4f5c-84a4-62e29aeca82c\") " pod="openshift-monitoring/alertmanager-main-0" May 20 15:35:36.938374 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:36.938123 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p9426" event={"ID":"c83885b8-12f2-434f-9349-f811f5507c19","Type":"ContainerStarted","Data":"36066d9bba1b0e57a7f0bb39ded7c918d1071a6870bea375b6eacf178cdc8906"} May 20 15:35:36.939502 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:36.939470 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fvbkd" event={"ID":"9f13da06-401d-412b-a532-a02a3a620761","Type":"ContainerStarted","Data":"54560491dc87c0aa14f156499b6bdad1c7dd20e6c1fbd437ed98f85d1e7a5ad6"} May 20 15:35:37.175378 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:37.175344 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8eef42cd-6f2d-4f5c-84a4-62e29aeca82c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8eef42cd-6f2d-4f5c-84a4-62e29aeca82c\") " pod="openshift-monitoring/alertmanager-main-0" May 20 15:35:37.176105 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:37.176083 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8eef42cd-6f2d-4f5c-84a4-62e29aeca82c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8eef42cd-6f2d-4f5c-84a4-62e29aeca82c\") " pod="openshift-monitoring/alertmanager-main-0" May 20 15:35:37.380062 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:37.380027 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wszj2" May 20 15:35:37.461178 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:37.461148 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 20 15:35:37.615692 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:37.615669 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 20 15:35:37.617439 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:35:37.617411 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8eef42cd_6f2d_4f5c_84a4_62e29aeca82c.slice/crio-af62e4d8db13b0ddbae1cdcb85f526fc1574516f3355ae58d77d2b696e015c8e WatchSource:0}: Error finding container af62e4d8db13b0ddbae1cdcb85f526fc1574516f3355ae58d77d2b696e015c8e: Status 404 returned error can't find the container with id af62e4d8db13b0ddbae1cdcb85f526fc1574516f3355ae58d77d2b696e015c8e May 20 15:35:37.943465 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:37.943425 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8eef42cd-6f2d-4f5c-84a4-62e29aeca82c","Type":"ContainerStarted","Data":"af62e4d8db13b0ddbae1cdcb85f526fc1574516f3355ae58d77d2b696e015c8e"} May 20 15:35:37.945083 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:37.945051 2557 generic.go:358] "Generic (PLEG): container finished" podID="c83885b8-12f2-434f-9349-f811f5507c19" containerID="36066d9bba1b0e57a7f0bb39ded7c918d1071a6870bea375b6eacf178cdc8906" exitCode=0 May 20 15:35:37.945223 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:37.945107 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p9426" event={"ID":"c83885b8-12f2-434f-9349-f811f5507c19","Type":"ContainerDied","Data":"36066d9bba1b0e57a7f0bb39ded7c918d1071a6870bea375b6eacf178cdc8906"} May 20 15:35:38.380105 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:38.380081 2557 scope.go:117] "RemoveContainer" containerID="c3c6e13d6eefcfb7bf34a9ef2a8ad333cbc38998a80f4fcff5fae855ff9561c3" May 20 15:35:38.950574 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:38.950549 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-gwx4j_574489b4-f926-4667-be55-8e4e4d4f98e4/console-operator/2.log" May 20 15:35:38.951031 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:38.950640 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-gwx4j" event={"ID":"574489b4-f926-4667-be55-8e4e4d4f98e4","Type":"ContainerStarted","Data":"24e31df8c738668999391b8f6b859aef4d7a72aed875c732cf8ca13d723feacb"} May 20 15:35:38.951159 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:38.951137 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-gwx4j" May 20 15:35:38.953317 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:38.953288 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p9426" event={"ID":"c83885b8-12f2-434f-9349-f811f5507c19","Type":"ContainerStarted","Data":"8ca4af49186a63d4d67afcfd34642dec627a1347ea58b56ebe72c823f8e401a7"} May 20 15:35:38.953436 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:38.953323 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p9426" event={"ID":"c83885b8-12f2-434f-9349-f811f5507c19","Type":"ContainerStarted","Data":"5183d73ffce040851777b0ce6702d3d75e7b1eeb98c105c673549372f4d11288"} May 20 15:35:38.954874 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:38.954847 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fvbkd" event={"ID":"9f13da06-401d-412b-a532-a02a3a620761","Type":"ContainerStarted","Data":"348349610f418bd6b7a251034bde31bf1bcd44527ea8cde44765c58a8aa7970b"} May 20 15:35:38.969039 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:38.968991 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-76dff48d59-gwx4j" podStartSLOduration=44.941376748 podStartE2EDuration="46.968979467s" podCreationTimestamp="2026-05-20 15:34:52 +0000 UTC" firstStartedPulling="2026-05-20 15:34:52.9537941 +0000 UTC m=+124.168716871" lastFinishedPulling="2026-05-20 15:34:54.981396798 +0000 UTC m=+126.196319590" observedRunningTime="2026-05-20 15:35:38.96863747 +0000 UTC m=+170.183560265" watchObservedRunningTime="2026-05-20 15:35:38.968979467 +0000 UTC m=+170.183902259" May 20 15:35:38.986091 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:38.986052 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-fvbkd" podStartSLOduration=134.261261038 podStartE2EDuration="2m15.986040781s" podCreationTimestamp="2026-05-20 15:33:23 +0000 UTC" firstStartedPulling="2026-05-20 15:35:36.561745135 +0000 UTC m=+167.776667908" lastFinishedPulling="2026-05-20 15:35:38.28652488 +0000 UTC m=+169.501447651" observedRunningTime="2026-05-20 15:35:38.985036043 +0000 UTC m=+170.199958848" watchObservedRunningTime="2026-05-20 15:35:38.986040781 +0000 UTC m=+170.200963574" May 20 15:35:39.003366 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:39.003329 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-p9426" podStartSLOduration=3.0599553840000002 podStartE2EDuration="4.003316676s" podCreationTimestamp="2026-05-20 15:35:35 +0000 UTC" firstStartedPulling="2026-05-20 15:35:35.861221596 +0000 UTC m=+167.076144370" lastFinishedPulling="2026-05-20 15:35:36.804582891 +0000 UTC m=+168.019505662" observedRunningTime="2026-05-20 15:35:39.002929359 +0000 UTC m=+170.217852152" watchObservedRunningTime="2026-05-20 15:35:39.003316676 +0000 UTC m=+170.218239469" May 20 15:35:39.075554 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:39.075532 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-76dff48d59-gwx4j" May 20 15:35:39.959273 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:39.959230 2557 generic.go:358] "Generic (PLEG): container finished" podID="8eef42cd-6f2d-4f5c-84a4-62e29aeca82c" containerID="06e1bbf768a1a05f6d567d4c5537b7858085e53a781ee95a079e6bd205fc0685" exitCode=0 May 20 15:35:39.959776 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:39.959366 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8eef42cd-6f2d-4f5c-84a4-62e29aeca82c","Type":"ContainerDied","Data":"06e1bbf768a1a05f6d567d4c5537b7858085e53a781ee95a079e6bd205fc0685"} May 20 15:35:40.685670 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:40.685628 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-64776754bd-b48h7"] May 20 15:35:40.688376 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:40.688355 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-64776754bd-b48h7" May 20 15:35:40.690655 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:40.690622 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" May 20 15:35:40.690655 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:40.690643 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" May 20 15:35:40.691150 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:40.691123 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-md87q\"" May 20 15:35:40.691150 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:40.691137 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" May 20 15:35:40.691304 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:40.691251 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" May 20 15:35:40.691411 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:40.691394 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" May 20 15:35:40.695961 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:40.695938 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" May 20 15:35:40.703222 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:40.703182 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-64776754bd-b48h7"] May 20 15:35:40.808185 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:40.808152 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/603977fd-0596-4003-8d30-d44493503248-metrics-client-ca\") pod \"telemeter-client-64776754bd-b48h7\" (UID: \"603977fd-0596-4003-8d30-d44493503248\") " pod="openshift-monitoring/telemeter-client-64776754bd-b48h7" May 20 15:35:40.808366 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:40.808209 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/603977fd-0596-4003-8d30-d44493503248-telemeter-client-tls\") pod \"telemeter-client-64776754bd-b48h7\" (UID: \"603977fd-0596-4003-8d30-d44493503248\") " pod="openshift-monitoring/telemeter-client-64776754bd-b48h7" May 20 15:35:40.808366 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:40.808248 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/603977fd-0596-4003-8d30-d44493503248-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-64776754bd-b48h7\" (UID: \"603977fd-0596-4003-8d30-d44493503248\") " pod="openshift-monitoring/telemeter-client-64776754bd-b48h7" May 20 15:35:40.808366 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:40.808339 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/603977fd-0596-4003-8d30-d44493503248-secret-telemeter-client\") pod \"telemeter-client-64776754bd-b48h7\" (UID: \"603977fd-0596-4003-8d30-d44493503248\") " pod="openshift-monitoring/telemeter-client-64776754bd-b48h7" May 20 15:35:40.808495 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:40.808373 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/603977fd-0596-4003-8d30-d44493503248-federate-client-tls\") pod \"telemeter-client-64776754bd-b48h7\" (UID: \"603977fd-0596-4003-8d30-d44493503248\") " pod="openshift-monitoring/telemeter-client-64776754bd-b48h7" May 20 15:35:40.808495 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:40.808397 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwl2t\" (UniqueName: \"kubernetes.io/projected/603977fd-0596-4003-8d30-d44493503248-kube-api-access-gwl2t\") pod \"telemeter-client-64776754bd-b48h7\" (UID: \"603977fd-0596-4003-8d30-d44493503248\") " pod="openshift-monitoring/telemeter-client-64776754bd-b48h7" May 20 15:35:40.808495 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:40.808467 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/603977fd-0596-4003-8d30-d44493503248-telemeter-trusted-ca-bundle\") pod \"telemeter-client-64776754bd-b48h7\" (UID: \"603977fd-0596-4003-8d30-d44493503248\") " pod="openshift-monitoring/telemeter-client-64776754bd-b48h7" May 20 15:35:40.808495 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:40.808492 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/603977fd-0596-4003-8d30-d44493503248-serving-certs-ca-bundle\") pod \"telemeter-client-64776754bd-b48h7\" (UID: \"603977fd-0596-4003-8d30-d44493503248\") " pod="openshift-monitoring/telemeter-client-64776754bd-b48h7" May 20 15:35:40.909623 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:40.909567 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/603977fd-0596-4003-8d30-d44493503248-telemeter-trusted-ca-bundle\") pod \"telemeter-client-64776754bd-b48h7\" (UID: \"603977fd-0596-4003-8d30-d44493503248\") " pod="openshift-monitoring/telemeter-client-64776754bd-b48h7" May 20 15:35:40.909623 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:40.909630 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/603977fd-0596-4003-8d30-d44493503248-serving-certs-ca-bundle\") pod \"telemeter-client-64776754bd-b48h7\" (UID: \"603977fd-0596-4003-8d30-d44493503248\") " pod="openshift-monitoring/telemeter-client-64776754bd-b48h7" May 20 15:35:40.909905 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:40.909678 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/603977fd-0596-4003-8d30-d44493503248-metrics-client-ca\") pod \"telemeter-client-64776754bd-b48h7\" (UID: \"603977fd-0596-4003-8d30-d44493503248\") " pod="openshift-monitoring/telemeter-client-64776754bd-b48h7" May 20 15:35:40.909905 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:40.909716 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/603977fd-0596-4003-8d30-d44493503248-telemeter-client-tls\") pod \"telemeter-client-64776754bd-b48h7\" (UID: \"603977fd-0596-4003-8d30-d44493503248\") " pod="openshift-monitoring/telemeter-client-64776754bd-b48h7" May 20 15:35:40.909905 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:40.909747 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/603977fd-0596-4003-8d30-d44493503248-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-64776754bd-b48h7\" (UID: \"603977fd-0596-4003-8d30-d44493503248\") " pod="openshift-monitoring/telemeter-client-64776754bd-b48h7" May 20 15:35:40.909905 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:40.909835 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/603977fd-0596-4003-8d30-d44493503248-secret-telemeter-client\") pod \"telemeter-client-64776754bd-b48h7\" (UID: \"603977fd-0596-4003-8d30-d44493503248\") " pod="openshift-monitoring/telemeter-client-64776754bd-b48h7" May 20 15:35:40.909905 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:40.909860 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/603977fd-0596-4003-8d30-d44493503248-federate-client-tls\") pod \"telemeter-client-64776754bd-b48h7\" (UID: \"603977fd-0596-4003-8d30-d44493503248\") " pod="openshift-monitoring/telemeter-client-64776754bd-b48h7" May 20 15:35:40.909905 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:40.909888 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gwl2t\" (UniqueName: \"kubernetes.io/projected/603977fd-0596-4003-8d30-d44493503248-kube-api-access-gwl2t\") pod \"telemeter-client-64776754bd-b48h7\" (UID: \"603977fd-0596-4003-8d30-d44493503248\") " pod="openshift-monitoring/telemeter-client-64776754bd-b48h7" May 20 15:35:40.910512 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:40.910413 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/603977fd-0596-4003-8d30-d44493503248-serving-certs-ca-bundle\") pod \"telemeter-client-64776754bd-b48h7\" (UID: \"603977fd-0596-4003-8d30-d44493503248\") " pod="openshift-monitoring/telemeter-client-64776754bd-b48h7" May 20 15:35:40.910628 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:40.910528 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/603977fd-0596-4003-8d30-d44493503248-metrics-client-ca\") pod \"telemeter-client-64776754bd-b48h7\" (UID: \"603977fd-0596-4003-8d30-d44493503248\") " pod="openshift-monitoring/telemeter-client-64776754bd-b48h7" May 20 15:35:40.910783 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:40.910675 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/603977fd-0596-4003-8d30-d44493503248-telemeter-trusted-ca-bundle\") pod \"telemeter-client-64776754bd-b48h7\" (UID: \"603977fd-0596-4003-8d30-d44493503248\") " pod="openshift-monitoring/telemeter-client-64776754bd-b48h7" May 20 15:35:40.912928 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:40.912900 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/603977fd-0596-4003-8d30-d44493503248-secret-telemeter-client\") pod \"telemeter-client-64776754bd-b48h7\" (UID: \"603977fd-0596-4003-8d30-d44493503248\") " pod="openshift-monitoring/telemeter-client-64776754bd-b48h7" May 20 15:35:40.913149 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:40.913127 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/603977fd-0596-4003-8d30-d44493503248-federate-client-tls\") pod \"telemeter-client-64776754bd-b48h7\" (UID: \"603977fd-0596-4003-8d30-d44493503248\") " pod="openshift-monitoring/telemeter-client-64776754bd-b48h7" May 20 15:35:40.913238 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:40.913137 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/603977fd-0596-4003-8d30-d44493503248-telemeter-client-tls\") pod \"telemeter-client-64776754bd-b48h7\" (UID: \"603977fd-0596-4003-8d30-d44493503248\") " pod="openshift-monitoring/telemeter-client-64776754bd-b48h7" May 20 15:35:40.913238 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:40.913189 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/603977fd-0596-4003-8d30-d44493503248-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-64776754bd-b48h7\" (UID: \"603977fd-0596-4003-8d30-d44493503248\") " pod="openshift-monitoring/telemeter-client-64776754bd-b48h7" May 20 15:35:40.922170 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:40.922144 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwl2t\" (UniqueName: \"kubernetes.io/projected/603977fd-0596-4003-8d30-d44493503248-kube-api-access-gwl2t\") pod \"telemeter-client-64776754bd-b48h7\" (UID: \"603977fd-0596-4003-8d30-d44493503248\") " pod="openshift-monitoring/telemeter-client-64776754bd-b48h7" May 20 15:35:41.002681 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:41.002653 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-64776754bd-b48h7" May 20 15:35:41.306132 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:41.306095 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-64776754bd-b48h7"] May 20 15:35:41.310000 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:35:41.309969 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod603977fd_0596_4003_8d30_d44493503248.slice/crio-a96f75b1439a0d806f39d43ed4d7eaacec65de5339f9ef277733069dd2b7ec1e WatchSource:0}: Error finding container a96f75b1439a0d806f39d43ed4d7eaacec65de5339f9ef277733069dd2b7ec1e: Status 404 returned error can't find the container with id a96f75b1439a0d806f39d43ed4d7eaacec65de5339f9ef277733069dd2b7ec1e May 20 15:35:41.812898 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:41.812868 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 20 15:35:41.816036 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:41.816009 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 20 15:35:41.818989 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:41.818965 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 20 15:35:41.819115 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:41.819028 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 20 15:35:41.820951 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:41.819839 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 20 15:35:41.820951 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:41.820128 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 20 15:35:41.820951 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:41.820849 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 20 15:35:41.821264 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:41.821241 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 20 15:35:41.822496 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:41.821241 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-5c6b7\"" May 20 15:35:41.822496 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:41.821956 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 20 15:35:41.822746 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:41.822667 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-ak78t0k1gr017\"" May 20 15:35:41.825589 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:41.823089 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 20 15:35:41.825589 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:41.823399 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 20 15:35:41.825589 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:41.824409 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" May 20 15:35:41.826137 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:41.826118 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 20 15:35:41.828171 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:41.828149 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 20 15:35:41.829995 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:41.829973 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 20 15:35:41.842562 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:41.842537 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 20 15:35:41.918697 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:41.918662 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7db58356-2c8a-447c-85fb-28a24f10d285-config-out\") pod \"prometheus-k8s-0\" (UID: \"7db58356-2c8a-447c-85fb-28a24f10d285\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:35:41.918898 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:41.918701 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7db58356-2c8a-447c-85fb-28a24f10d285-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7db58356-2c8a-447c-85fb-28a24f10d285\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:35:41.918898 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:41.918733 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7db58356-2c8a-447c-85fb-28a24f10d285-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7db58356-2c8a-447c-85fb-28a24f10d285\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:35:41.918898 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:41.918831 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7db58356-2c8a-447c-85fb-28a24f10d285-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7db58356-2c8a-447c-85fb-28a24f10d285\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:35:41.919071 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:41.918898 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7db58356-2c8a-447c-85fb-28a24f10d285-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7db58356-2c8a-447c-85fb-28a24f10d285\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:35:41.919071 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:41.918937 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7db58356-2c8a-447c-85fb-28a24f10d285-config\") pod \"prometheus-k8s-0\" (UID: \"7db58356-2c8a-447c-85fb-28a24f10d285\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:35:41.919071 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:41.918964 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7db58356-2c8a-447c-85fb-28a24f10d285-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7db58356-2c8a-447c-85fb-28a24f10d285\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:35:41.919071 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:41.918998 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7db58356-2c8a-447c-85fb-28a24f10d285-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7db58356-2c8a-447c-85fb-28a24f10d285\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:35:41.919071 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:41.919049 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7db58356-2c8a-447c-85fb-28a24f10d285-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7db58356-2c8a-447c-85fb-28a24f10d285\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:35:41.919216 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:41.919074 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7db58356-2c8a-447c-85fb-28a24f10d285-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7db58356-2c8a-447c-85fb-28a24f10d285\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:35:41.919216 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:41.919096 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7hlq\" (UniqueName: \"kubernetes.io/projected/7db58356-2c8a-447c-85fb-28a24f10d285-kube-api-access-r7hlq\") pod \"prometheus-k8s-0\" (UID: \"7db58356-2c8a-447c-85fb-28a24f10d285\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:35:41.919216 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:41.919154 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7db58356-2c8a-447c-85fb-28a24f10d285-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7db58356-2c8a-447c-85fb-28a24f10d285\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:35:41.919216 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:41.919192 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7db58356-2c8a-447c-85fb-28a24f10d285-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7db58356-2c8a-447c-85fb-28a24f10d285\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:35:41.919331 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:41.919235 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7db58356-2c8a-447c-85fb-28a24f10d285-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7db58356-2c8a-447c-85fb-28a24f10d285\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:35:41.919331 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:41.919262 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7db58356-2c8a-447c-85fb-28a24f10d285-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7db58356-2c8a-447c-85fb-28a24f10d285\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:35:41.919331 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:41.919278 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7db58356-2c8a-447c-85fb-28a24f10d285-web-config\") pod \"prometheus-k8s-0\" (UID: \"7db58356-2c8a-447c-85fb-28a24f10d285\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:35:41.919331 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:41.919300 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7db58356-2c8a-447c-85fb-28a24f10d285-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7db58356-2c8a-447c-85fb-28a24f10d285\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:35:41.919440 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:41.919344 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7db58356-2c8a-447c-85fb-28a24f10d285-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7db58356-2c8a-447c-85fb-28a24f10d285\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:35:41.968873 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:41.968715 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8eef42cd-6f2d-4f5c-84a4-62e29aeca82c","Type":"ContainerStarted","Data":"275abb712b240402c5114d56d3d2e263a1f81d9a1509713e60f31b3778c688c6"} May 20 15:35:41.968873 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:41.968763 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8eef42cd-6f2d-4f5c-84a4-62e29aeca82c","Type":"ContainerStarted","Data":"31c591f501adb9310bd52500ace3638b5435701d5d24e1726081fd4c06c8d734"} May 20 15:35:41.968873 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:41.968777 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8eef42cd-6f2d-4f5c-84a4-62e29aeca82c","Type":"ContainerStarted","Data":"ab7349de1f0d8799fbd36c0af66c03c7407a01c04376b3fb2ea5abf2ccc9a308"} May 20 15:35:41.968873 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:41.968790 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8eef42cd-6f2d-4f5c-84a4-62e29aeca82c","Type":"ContainerStarted","Data":"3e8a78532c6d819d4c140a24f4786e71e4bf1eff03ff4b3c947cdb02acd93bb1"} May 20 15:35:41.968873 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:41.968849 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8eef42cd-6f2d-4f5c-84a4-62e29aeca82c","Type":"ContainerStarted","Data":"e609c9d1df0f85766521522001fe83926f511cc057f2a5471569f5ab780d2d55"} May 20 15:35:41.970561 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:41.970522 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-64776754bd-b48h7" event={"ID":"603977fd-0596-4003-8d30-d44493503248","Type":"ContainerStarted","Data":"a96f75b1439a0d806f39d43ed4d7eaacec65de5339f9ef277733069dd2b7ec1e"} May 20 15:35:42.020848 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:42.019838 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r7hlq\" (UniqueName: \"kubernetes.io/projected/7db58356-2c8a-447c-85fb-28a24f10d285-kube-api-access-r7hlq\") pod \"prometheus-k8s-0\" (UID: \"7db58356-2c8a-447c-85fb-28a24f10d285\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:35:42.020848 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:42.019897 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7db58356-2c8a-447c-85fb-28a24f10d285-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7db58356-2c8a-447c-85fb-28a24f10d285\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:35:42.020848 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:42.019943 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7db58356-2c8a-447c-85fb-28a24f10d285-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7db58356-2c8a-447c-85fb-28a24f10d285\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:35:42.020848 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:42.019975 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7db58356-2c8a-447c-85fb-28a24f10d285-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7db58356-2c8a-447c-85fb-28a24f10d285\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:35:42.020848 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:42.020012 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7db58356-2c8a-447c-85fb-28a24f10d285-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7db58356-2c8a-447c-85fb-28a24f10d285\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:35:42.020848 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:42.020038 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7db58356-2c8a-447c-85fb-28a24f10d285-web-config\") pod \"prometheus-k8s-0\" (UID: \"7db58356-2c8a-447c-85fb-28a24f10d285\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:35:42.020848 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:42.020065 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7db58356-2c8a-447c-85fb-28a24f10d285-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7db58356-2c8a-447c-85fb-28a24f10d285\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:35:42.020848 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:42.020095 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7db58356-2c8a-447c-85fb-28a24f10d285-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7db58356-2c8a-447c-85fb-28a24f10d285\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:35:42.020848 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:42.020123 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7db58356-2c8a-447c-85fb-28a24f10d285-config-out\") pod \"prometheus-k8s-0\" (UID: \"7db58356-2c8a-447c-85fb-28a24f10d285\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:35:42.020848 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:42.020157 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7db58356-2c8a-447c-85fb-28a24f10d285-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7db58356-2c8a-447c-85fb-28a24f10d285\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:35:42.020848 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:42.020184 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7db58356-2c8a-447c-85fb-28a24f10d285-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7db58356-2c8a-447c-85fb-28a24f10d285\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:35:42.020848 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:42.020214 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7db58356-2c8a-447c-85fb-28a24f10d285-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7db58356-2c8a-447c-85fb-28a24f10d285\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:35:42.020848 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:42.020241 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7db58356-2c8a-447c-85fb-28a24f10d285-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7db58356-2c8a-447c-85fb-28a24f10d285\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:35:42.020848 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:42.020267 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7db58356-2c8a-447c-85fb-28a24f10d285-config\") pod \"prometheus-k8s-0\" (UID: \"7db58356-2c8a-447c-85fb-28a24f10d285\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:35:42.020848 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:42.020290 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7db58356-2c8a-447c-85fb-28a24f10d285-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7db58356-2c8a-447c-85fb-28a24f10d285\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:35:42.020848 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:42.020319 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7db58356-2c8a-447c-85fb-28a24f10d285-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7db58356-2c8a-447c-85fb-28a24f10d285\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:35:42.020848 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:42.020364 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7db58356-2c8a-447c-85fb-28a24f10d285-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7db58356-2c8a-447c-85fb-28a24f10d285\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:35:42.022060 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:42.020386 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7db58356-2c8a-447c-85fb-28a24f10d285-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7db58356-2c8a-447c-85fb-28a24f10d285\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:35:42.022060 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:42.021938 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7db58356-2c8a-447c-85fb-28a24f10d285-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7db58356-2c8a-447c-85fb-28a24f10d285\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:35:42.022870 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:42.022530 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7db58356-2c8a-447c-85fb-28a24f10d285-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7db58356-2c8a-447c-85fb-28a24f10d285\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:35:42.022972 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:42.022870 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7db58356-2c8a-447c-85fb-28a24f10d285-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7db58356-2c8a-447c-85fb-28a24f10d285\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:35:42.023584 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:42.023557 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7db58356-2c8a-447c-85fb-28a24f10d285-config-out\") pod \"prometheus-k8s-0\" (UID: \"7db58356-2c8a-447c-85fb-28a24f10d285\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:35:42.024176 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:42.024152 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7db58356-2c8a-447c-85fb-28a24f10d285-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7db58356-2c8a-447c-85fb-28a24f10d285\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:35:42.026671 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:42.026487 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7db58356-2c8a-447c-85fb-28a24f10d285-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7db58356-2c8a-447c-85fb-28a24f10d285\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:35:42.029171 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:42.028501 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7db58356-2c8a-447c-85fb-28a24f10d285-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7db58356-2c8a-447c-85fb-28a24f10d285\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:35:42.029171 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:42.028880 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7db58356-2c8a-447c-85fb-28a24f10d285-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7db58356-2c8a-447c-85fb-28a24f10d285\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:35:42.029484 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:42.029432 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/7db58356-2c8a-447c-85fb-28a24f10d285-config\") pod \"prometheus-k8s-0\" (UID: \"7db58356-2c8a-447c-85fb-28a24f10d285\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:35:42.029683 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:42.029653 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7db58356-2c8a-447c-85fb-28a24f10d285-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7db58356-2c8a-447c-85fb-28a24f10d285\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:35:42.031043 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:42.031003 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7db58356-2c8a-447c-85fb-28a24f10d285-web-config\") pod \"prometheus-k8s-0\" (UID: \"7db58356-2c8a-447c-85fb-28a24f10d285\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:35:42.032688 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:42.032646 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7db58356-2c8a-447c-85fb-28a24f10d285-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7db58356-2c8a-447c-85fb-28a24f10d285\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:35:42.034036 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:42.032889 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7db58356-2c8a-447c-85fb-28a24f10d285-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7db58356-2c8a-447c-85fb-28a24f10d285\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:35:42.034036 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:42.033296 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7db58356-2c8a-447c-85fb-28a24f10d285-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7db58356-2c8a-447c-85fb-28a24f10d285\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:35:42.034036 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:42.033878 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7db58356-2c8a-447c-85fb-28a24f10d285-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7db58356-2c8a-447c-85fb-28a24f10d285\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:35:42.034281 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:42.034234 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7db58356-2c8a-447c-85fb-28a24f10d285-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7db58356-2c8a-447c-85fb-28a24f10d285\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:35:42.036634 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:42.036594 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7db58356-2c8a-447c-85fb-28a24f10d285-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7db58356-2c8a-447c-85fb-28a24f10d285\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:35:42.048300 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:42.048275 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7hlq\" (UniqueName: \"kubernetes.io/projected/7db58356-2c8a-447c-85fb-28a24f10d285-kube-api-access-r7hlq\") pod \"prometheus-k8s-0\" (UID: \"7db58356-2c8a-447c-85fb-28a24f10d285\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:35:42.132294 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:42.132214 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 20 15:35:42.414403 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:42.414333 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 20 15:35:42.417178 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:35:42.417150 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7db58356_2c8a_447c_85fb_28a24f10d285.slice/crio-de73cb4e66aa77fcbc309b1820e6135893060920848ca2b0eb105699ed5aa815 WatchSource:0}: Error finding container de73cb4e66aa77fcbc309b1820e6135893060920848ca2b0eb105699ed5aa815: Status 404 returned error can't find the container with id de73cb4e66aa77fcbc309b1820e6135893060920848ca2b0eb105699ed5aa815 May 20 15:35:42.929695 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:42.929663 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-hxl9x" May 20 15:35:42.978935 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:42.978703 2557 generic.go:358] "Generic (PLEG): container finished" podID="7db58356-2c8a-447c-85fb-28a24f10d285" containerID="3fab75b344502b651bd95d7323ec1d8964a753fa1c914b0ef81cfea4bc8b3d3e" exitCode=0 May 20 15:35:42.978935 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:42.978868 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7db58356-2c8a-447c-85fb-28a24f10d285","Type":"ContainerDied","Data":"3fab75b344502b651bd95d7323ec1d8964a753fa1c914b0ef81cfea4bc8b3d3e"} May 20 15:35:42.978935 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:42.978901 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7db58356-2c8a-447c-85fb-28a24f10d285","Type":"ContainerStarted","Data":"de73cb4e66aa77fcbc309b1820e6135893060920848ca2b0eb105699ed5aa815"} May 20 15:35:42.983241 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:42.983212 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8eef42cd-6f2d-4f5c-84a4-62e29aeca82c","Type":"ContainerStarted","Data":"1ab0f89a713094b3a322ff97e6fd6a233e1bf9ebf50cad11f93a28d73e950b76"} May 20 15:35:43.042149 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:43.042092 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.384739072 podStartE2EDuration="7.04207511s" podCreationTimestamp="2026-05-20 15:35:36 +0000 UTC" firstStartedPulling="2026-05-20 15:35:37.619244204 +0000 UTC m=+168.834166974" lastFinishedPulling="2026-05-20 15:35:42.276580231 +0000 UTC m=+173.491503012" observedRunningTime="2026-05-20 15:35:43.039434681 +0000 UTC m=+174.254357501" watchObservedRunningTime="2026-05-20 15:35:43.04207511 +0000 UTC m=+174.256997905" May 20 15:35:43.989338 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:43.989248 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-64776754bd-b48h7" event={"ID":"603977fd-0596-4003-8d30-d44493503248","Type":"ContainerStarted","Data":"25cae5dcb7f962438921283e744d883acc75ef1bcb3f5d6ad8fb1866e859f7e9"} May 20 15:35:43.989338 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:43.989297 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-64776754bd-b48h7" event={"ID":"603977fd-0596-4003-8d30-d44493503248","Type":"ContainerStarted","Data":"fec7d589b6468964d56a106e00c7b74309b2d007d50c444f69137f973a508c87"} May 20 15:35:43.989338 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:43.989312 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-64776754bd-b48h7" event={"ID":"603977fd-0596-4003-8d30-d44493503248","Type":"ContainerStarted","Data":"b2abccad6c2b0b1deb646299fc6a02d5b3493d8c3bfefbcf1c3ef0baa3350956"} May 20 15:35:44.013410 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:44.013365 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-64776754bd-b48h7" podStartSLOduration=2.025932871 podStartE2EDuration="4.013350135s" podCreationTimestamp="2026-05-20 15:35:40 +0000 UTC" firstStartedPulling="2026-05-20 15:35:41.312326398 +0000 UTC m=+172.527249176" lastFinishedPulling="2026-05-20 15:35:43.299743667 +0000 UTC m=+174.514666440" observedRunningTime="2026-05-20 15:35:44.012742507 +0000 UTC m=+175.227665299" watchObservedRunningTime="2026-05-20 15:35:44.013350135 +0000 UTC m=+175.228272925" May 20 15:35:45.996562 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:45.996522 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7db58356-2c8a-447c-85fb-28a24f10d285","Type":"ContainerStarted","Data":"59851b6c310fe208ee6ea7c0f8d851f494262118ba79206725488d566c77d3b2"} May 20 15:35:45.996562 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:45.996565 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7db58356-2c8a-447c-85fb-28a24f10d285","Type":"ContainerStarted","Data":"03c6fe9a43183f6e1da4ca69204090466c5b7f1af15d6bd4ae5a37692e1ca8f1"} May 20 15:35:48.005856 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:48.005781 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7db58356-2c8a-447c-85fb-28a24f10d285","Type":"ContainerStarted","Data":"5edc328e3af87ae8f5428c3520b91aa9bfd74b5ef5253b200c25cfb94b2aa03c"} May 20 15:35:48.006199 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:48.005860 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7db58356-2c8a-447c-85fb-28a24f10d285","Type":"ContainerStarted","Data":"5ddf8aba83b1bcf706ea6fdce514984e5a99950cfae99fd900e492bf2f799342"} May 20 15:35:48.006199 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:48.005875 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7db58356-2c8a-447c-85fb-28a24f10d285","Type":"ContainerStarted","Data":"6248bab6aa5dd9a44db401478bf3ea133c6d8abd83cd36aff5a102f4e990304b"} May 20 15:35:48.006199 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:48.005886 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7db58356-2c8a-447c-85fb-28a24f10d285","Type":"ContainerStarted","Data":"afc9f693f078a682b2570209435d6b5af179daf2b1f8c35e8fbcfa8ae47d5124"} May 20 15:35:48.040848 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:48.040767 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.694542842 podStartE2EDuration="7.040749282s" podCreationTimestamp="2026-05-20 15:35:41 +0000 UTC" firstStartedPulling="2026-05-20 15:35:42.980367396 +0000 UTC m=+174.195290174" lastFinishedPulling="2026-05-20 15:35:47.326573834 +0000 UTC m=+178.541496614" observedRunningTime="2026-05-20 15:35:48.039218867 +0000 UTC m=+179.254141660" watchObservedRunningTime="2026-05-20 15:35:48.040749282 +0000 UTC m=+179.255672090" May 20 15:35:48.128572 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:48.128520 2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-65f96ddd4b-pqgdt" podUID="7b5ce08f-f82d-4226-b1b0-9dddccec11cd" containerName="registry" containerID="cri-o://183d8c880ef578fa7d4993c3c574d707b2abb9a8e3837047c556a6f9341793c8" gracePeriod=30 May 20 15:35:48.371602 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:48.371581 2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65f96ddd4b-pqgdt" May 20 15:35:48.481755 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:48.481729 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7b5ce08f-f82d-4226-b1b0-9dddccec11cd-image-registry-private-configuration\") pod \"7b5ce08f-f82d-4226-b1b0-9dddccec11cd\" (UID: \"7b5ce08f-f82d-4226-b1b0-9dddccec11cd\") " May 20 15:35:48.481908 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:48.481763 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7b5ce08f-f82d-4226-b1b0-9dddccec11cd-ca-trust-extracted\") pod \"7b5ce08f-f82d-4226-b1b0-9dddccec11cd\" (UID: \"7b5ce08f-f82d-4226-b1b0-9dddccec11cd\") " May 20 15:35:48.481908 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:48.481781 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7b5ce08f-f82d-4226-b1b0-9dddccec11cd-bound-sa-token\") pod \"7b5ce08f-f82d-4226-b1b0-9dddccec11cd\" (UID: \"7b5ce08f-f82d-4226-b1b0-9dddccec11cd\") " May 20 15:35:48.481908 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:48.481837 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7b5ce08f-f82d-4226-b1b0-9dddccec11cd-trusted-ca\") pod \"7b5ce08f-f82d-4226-b1b0-9dddccec11cd\" (UID: \"7b5ce08f-f82d-4226-b1b0-9dddccec11cd\") " May 20 15:35:48.481908 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:48.481886 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8s7ml\" (UniqueName: \"kubernetes.io/projected/7b5ce08f-f82d-4226-b1b0-9dddccec11cd-kube-api-access-8s7ml\") pod \"7b5ce08f-f82d-4226-b1b0-9dddccec11cd\" (UID: \"7b5ce08f-f82d-4226-b1b0-9dddccec11cd\") " May 20 15:35:48.482055 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:48.481960 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7b5ce08f-f82d-4226-b1b0-9dddccec11cd-registry-tls\") pod \"7b5ce08f-f82d-4226-b1b0-9dddccec11cd\" (UID: \"7b5ce08f-f82d-4226-b1b0-9dddccec11cd\") " May 20 15:35:48.482055 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:48.481989 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7b5ce08f-f82d-4226-b1b0-9dddccec11cd-registry-certificates\") pod \"7b5ce08f-f82d-4226-b1b0-9dddccec11cd\" (UID: \"7b5ce08f-f82d-4226-b1b0-9dddccec11cd\") " May 20 15:35:48.482055 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:48.482012 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7b5ce08f-f82d-4226-b1b0-9dddccec11cd-installation-pull-secrets\") pod \"7b5ce08f-f82d-4226-b1b0-9dddccec11cd\" (UID: \"7b5ce08f-f82d-4226-b1b0-9dddccec11cd\") " May 20 15:35:48.482390 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:48.482337 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b5ce08f-f82d-4226-b1b0-9dddccec11cd-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "7b5ce08f-f82d-4226-b1b0-9dddccec11cd" (UID: "7b5ce08f-f82d-4226-b1b0-9dddccec11cd"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 20 15:35:48.482855 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:48.482804 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b5ce08f-f82d-4226-b1b0-9dddccec11cd-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "7b5ce08f-f82d-4226-b1b0-9dddccec11cd" (UID: "7b5ce08f-f82d-4226-b1b0-9dddccec11cd"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 20 15:35:48.484492 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:48.484458 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b5ce08f-f82d-4226-b1b0-9dddccec11cd-kube-api-access-8s7ml" (OuterVolumeSpecName: "kube-api-access-8s7ml") pod "7b5ce08f-f82d-4226-b1b0-9dddccec11cd" (UID: "7b5ce08f-f82d-4226-b1b0-9dddccec11cd"). InnerVolumeSpecName "kube-api-access-8s7ml". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 15:35:48.484762 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:48.484693 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b5ce08f-f82d-4226-b1b0-9dddccec11cd-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "7b5ce08f-f82d-4226-b1b0-9dddccec11cd" (UID: "7b5ce08f-f82d-4226-b1b0-9dddccec11cd"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 15:35:48.484861 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:48.484804 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b5ce08f-f82d-4226-b1b0-9dddccec11cd-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "7b5ce08f-f82d-4226-b1b0-9dddccec11cd" (UID: "7b5ce08f-f82d-4226-b1b0-9dddccec11cd"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 15:35:48.484861 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:48.484799 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b5ce08f-f82d-4226-b1b0-9dddccec11cd-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "7b5ce08f-f82d-4226-b1b0-9dddccec11cd" (UID: "7b5ce08f-f82d-4226-b1b0-9dddccec11cd"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 15:35:48.484951 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:48.484885 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b5ce08f-f82d-4226-b1b0-9dddccec11cd-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "7b5ce08f-f82d-4226-b1b0-9dddccec11cd" (UID: "7b5ce08f-f82d-4226-b1b0-9dddccec11cd"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 15:35:48.489859 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:48.489804 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b5ce08f-f82d-4226-b1b0-9dddccec11cd-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "7b5ce08f-f82d-4226-b1b0-9dddccec11cd" (UID: "7b5ce08f-f82d-4226-b1b0-9dddccec11cd"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 20 15:35:48.583535 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:48.583478 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8s7ml\" (UniqueName: \"kubernetes.io/projected/7b5ce08f-f82d-4226-b1b0-9dddccec11cd-kube-api-access-8s7ml\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" May 20 15:35:48.583535 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:48.583500 2557 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7b5ce08f-f82d-4226-b1b0-9dddccec11cd-registry-tls\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" May 20 15:35:48.583535 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:48.583509 2557 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7b5ce08f-f82d-4226-b1b0-9dddccec11cd-registry-certificates\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" May 20 15:35:48.583535 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:48.583519 2557 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7b5ce08f-f82d-4226-b1b0-9dddccec11cd-installation-pull-secrets\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" May 20 15:35:48.583535 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:48.583529 2557 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7b5ce08f-f82d-4226-b1b0-9dddccec11cd-image-registry-private-configuration\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" May 20 15:35:48.583535 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:48.583537 2557 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7b5ce08f-f82d-4226-b1b0-9dddccec11cd-ca-trust-extracted\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" May 20 15:35:48.583767 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:48.583547 2557 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7b5ce08f-f82d-4226-b1b0-9dddccec11cd-bound-sa-token\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" May 20 15:35:48.583767 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:48.583556 2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7b5ce08f-f82d-4226-b1b0-9dddccec11cd-trusted-ca\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" May 20 15:35:49.010064 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:49.010032 2557 generic.go:358] "Generic (PLEG): container finished" podID="7b5ce08f-f82d-4226-b1b0-9dddccec11cd" containerID="183d8c880ef578fa7d4993c3c574d707b2abb9a8e3837047c556a6f9341793c8" exitCode=0 May 20 15:35:49.010483 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:49.010088 2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65f96ddd4b-pqgdt" May 20 15:35:49.010483 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:49.010117 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65f96ddd4b-pqgdt" event={"ID":"7b5ce08f-f82d-4226-b1b0-9dddccec11cd","Type":"ContainerDied","Data":"183d8c880ef578fa7d4993c3c574d707b2abb9a8e3837047c556a6f9341793c8"} May 20 15:35:49.010483 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:49.010159 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65f96ddd4b-pqgdt" event={"ID":"7b5ce08f-f82d-4226-b1b0-9dddccec11cd","Type":"ContainerDied","Data":"6c71ff546cc8080a8ff45e1304555c53e7689df32c6f217967e027fd4228addc"} May 20 15:35:49.010483 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:49.010178 2557 scope.go:117] "RemoveContainer" containerID="183d8c880ef578fa7d4993c3c574d707b2abb9a8e3837047c556a6f9341793c8" May 20 15:35:49.024306 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:49.024286 2557 scope.go:117] "RemoveContainer" containerID="183d8c880ef578fa7d4993c3c574d707b2abb9a8e3837047c556a6f9341793c8" May 20 15:35:49.024585 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:35:49.024563 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"183d8c880ef578fa7d4993c3c574d707b2abb9a8e3837047c556a6f9341793c8\": container with ID starting with 183d8c880ef578fa7d4993c3c574d707b2abb9a8e3837047c556a6f9341793c8 not found: ID does not exist" containerID="183d8c880ef578fa7d4993c3c574d707b2abb9a8e3837047c556a6f9341793c8" May 20 15:35:49.024627 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:49.024593 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"183d8c880ef578fa7d4993c3c574d707b2abb9a8e3837047c556a6f9341793c8"} err="failed to get container status \"183d8c880ef578fa7d4993c3c574d707b2abb9a8e3837047c556a6f9341793c8\": rpc error: code = NotFound desc = could not find container \"183d8c880ef578fa7d4993c3c574d707b2abb9a8e3837047c556a6f9341793c8\": container with ID starting with 183d8c880ef578fa7d4993c3c574d707b2abb9a8e3837047c556a6f9341793c8 not found: ID does not exist" May 20 15:35:49.041865 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:49.041837 2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-65f96ddd4b-pqgdt"] May 20 15:35:49.047770 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:49.047738 2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-65f96ddd4b-pqgdt"] May 20 15:35:49.383706 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:49.383636 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b5ce08f-f82d-4226-b1b0-9dddccec11cd" path="/var/lib/kubelet/pods/7b5ce08f-f82d-4226-b1b0-9dddccec11cd/volumes" May 20 15:35:52.132602 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:35:52.132570 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 20 15:36:03.053643 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:03.053609 2557 generic.go:358] "Generic (PLEG): container finished" podID="3fa0f676-1933-48b3-b1ed-65853b963ff0" containerID="508649c9af7d2ee16204b1f4789cd7573725524321dfc5749358f6f39345c6b7" exitCode=0 May 20 15:36:03.054156 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:03.053684 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-sltsl" event={"ID":"3fa0f676-1933-48b3-b1ed-65853b963ff0","Type":"ContainerDied","Data":"508649c9af7d2ee16204b1f4789cd7573725524321dfc5749358f6f39345c6b7"} May 20 15:36:03.054156 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:03.054047 2557 scope.go:117] "RemoveContainer" containerID="508649c9af7d2ee16204b1f4789cd7573725524321dfc5749358f6f39345c6b7" May 20 15:36:04.058524 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:04.058484 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-sltsl" event={"ID":"3fa0f676-1933-48b3-b1ed-65853b963ff0","Type":"ContainerStarted","Data":"7a2aece4b2780dbbb97f4f9487cce4e7c000a627267680054fe6eabe71009f3a"} May 20 15:36:42.132992 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:42.132956 2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 20 15:36:42.149143 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:42.149120 2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 20 15:36:42.185190 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:42.185160 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 20 15:36:55.962116 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:55.962081 2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 20 15:36:55.962510 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:55.962483 2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8eef42cd-6f2d-4f5c-84a4-62e29aeca82c" containerName="alertmanager" containerID="cri-o://e609c9d1df0f85766521522001fe83926f511cc057f2a5471569f5ab780d2d55" gracePeriod=120 May 20 15:36:55.962599 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:55.962563 2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8eef42cd-6f2d-4f5c-84a4-62e29aeca82c" containerName="kube-rbac-proxy-web" containerID="cri-o://ab7349de1f0d8799fbd36c0af66c03c7407a01c04376b3fb2ea5abf2ccc9a308" gracePeriod=120 May 20 15:36:55.962666 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:55.962563 2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8eef42cd-6f2d-4f5c-84a4-62e29aeca82c" containerName="kube-rbac-proxy-metric" containerID="cri-o://275abb712b240402c5114d56d3d2e263a1f81d9a1509713e60f31b3778c688c6" gracePeriod=120 May 20 15:36:55.962666 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:55.962626 2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8eef42cd-6f2d-4f5c-84a4-62e29aeca82c" containerName="kube-rbac-proxy" containerID="cri-o://31c591f501adb9310bd52500ace3638b5435701d5d24e1726081fd4c06c8d734" gracePeriod=120 May 20 15:36:55.962666 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:55.962600 2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8eef42cd-6f2d-4f5c-84a4-62e29aeca82c" containerName="config-reloader" containerID="cri-o://3e8a78532c6d819d4c140a24f4786e71e4bf1eff03ff4b3c947cdb02acd93bb1" gracePeriod=120 May 20 15:36:55.962844 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:55.962645 2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8eef42cd-6f2d-4f5c-84a4-62e29aeca82c" containerName="prom-label-proxy" containerID="cri-o://1ab0f89a713094b3a322ff97e6fd6a233e1bf9ebf50cad11f93a28d73e950b76" gracePeriod=120 May 20 15:36:56.222212 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:56.222169 2557 generic.go:358] "Generic (PLEG): container finished" podID="8eef42cd-6f2d-4f5c-84a4-62e29aeca82c" containerID="1ab0f89a713094b3a322ff97e6fd6a233e1bf9ebf50cad11f93a28d73e950b76" exitCode=0 May 20 15:36:56.222212 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:56.222208 2557 generic.go:358] "Generic (PLEG): container finished" podID="8eef42cd-6f2d-4f5c-84a4-62e29aeca82c" containerID="31c591f501adb9310bd52500ace3638b5435701d5d24e1726081fd4c06c8d734" exitCode=0 May 20 15:36:56.222388 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:56.222218 2557 generic.go:358] "Generic (PLEG): container finished" podID="8eef42cd-6f2d-4f5c-84a4-62e29aeca82c" containerID="3e8a78532c6d819d4c140a24f4786e71e4bf1eff03ff4b3c947cdb02acd93bb1" exitCode=0 May 20 15:36:56.222388 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:56.222229 2557 generic.go:358] "Generic (PLEG): container finished" podID="8eef42cd-6f2d-4f5c-84a4-62e29aeca82c" containerID="e609c9d1df0f85766521522001fe83926f511cc057f2a5471569f5ab780d2d55" exitCode=0 May 20 15:36:56.222388 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:56.222237 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8eef42cd-6f2d-4f5c-84a4-62e29aeca82c","Type":"ContainerDied","Data":"1ab0f89a713094b3a322ff97e6fd6a233e1bf9ebf50cad11f93a28d73e950b76"} May 20 15:36:56.222388 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:56.222272 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8eef42cd-6f2d-4f5c-84a4-62e29aeca82c","Type":"ContainerDied","Data":"31c591f501adb9310bd52500ace3638b5435701d5d24e1726081fd4c06c8d734"} May 20 15:36:56.222388 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:56.222282 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8eef42cd-6f2d-4f5c-84a4-62e29aeca82c","Type":"ContainerDied","Data":"3e8a78532c6d819d4c140a24f4786e71e4bf1eff03ff4b3c947cdb02acd93bb1"} May 20 15:36:56.222388 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:56.222291 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8eef42cd-6f2d-4f5c-84a4-62e29aeca82c","Type":"ContainerDied","Data":"e609c9d1df0f85766521522001fe83926f511cc057f2a5471569f5ab780d2d55"} May 20 15:36:57.205656 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.205632 2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 20 15:36:57.227210 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.227182 2557 generic.go:358] "Generic (PLEG): container finished" podID="8eef42cd-6f2d-4f5c-84a4-62e29aeca82c" containerID="275abb712b240402c5114d56d3d2e263a1f81d9a1509713e60f31b3778c688c6" exitCode=0 May 20 15:36:57.227210 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.227208 2557 generic.go:358] "Generic (PLEG): container finished" podID="8eef42cd-6f2d-4f5c-84a4-62e29aeca82c" containerID="ab7349de1f0d8799fbd36c0af66c03c7407a01c04376b3fb2ea5abf2ccc9a308" exitCode=0 May 20 15:36:57.227411 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.227267 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8eef42cd-6f2d-4f5c-84a4-62e29aeca82c","Type":"ContainerDied","Data":"275abb712b240402c5114d56d3d2e263a1f81d9a1509713e60f31b3778c688c6"} May 20 15:36:57.227411 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.227307 2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 20 15:36:57.227411 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.227312 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8eef42cd-6f2d-4f5c-84a4-62e29aeca82c","Type":"ContainerDied","Data":"ab7349de1f0d8799fbd36c0af66c03c7407a01c04376b3fb2ea5abf2ccc9a308"} May 20 15:36:57.227411 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.227331 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8eef42cd-6f2d-4f5c-84a4-62e29aeca82c","Type":"ContainerDied","Data":"af62e4d8db13b0ddbae1cdcb85f526fc1574516f3355ae58d77d2b696e015c8e"} May 20 15:36:57.227411 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.227350 2557 scope.go:117] "RemoveContainer" containerID="1ab0f89a713094b3a322ff97e6fd6a233e1bf9ebf50cad11f93a28d73e950b76" May 20 15:36:57.235719 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.235701 2557 scope.go:117] "RemoveContainer" containerID="275abb712b240402c5114d56d3d2e263a1f81d9a1509713e60f31b3778c688c6" May 20 15:36:57.243695 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.243673 2557 scope.go:117] "RemoveContainer" containerID="31c591f501adb9310bd52500ace3638b5435701d5d24e1726081fd4c06c8d734" May 20 15:36:57.253478 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.253458 2557 scope.go:117] "RemoveContainer" containerID="ab7349de1f0d8799fbd36c0af66c03c7407a01c04376b3fb2ea5abf2ccc9a308" May 20 15:36:57.260203 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.260188 2557 scope.go:117] "RemoveContainer" containerID="3e8a78532c6d819d4c140a24f4786e71e4bf1eff03ff4b3c947cdb02acd93bb1" May 20 15:36:57.266897 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.266877 2557 scope.go:117] "RemoveContainer" containerID="e609c9d1df0f85766521522001fe83926f511cc057f2a5471569f5ab780d2d55" May 20 15:36:57.273638 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.273619 2557 scope.go:117] "RemoveContainer" containerID="06e1bbf768a1a05f6d567d4c5537b7858085e53a781ee95a079e6bd205fc0685" May 20 15:36:57.280164 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.280124 2557 scope.go:117] "RemoveContainer" containerID="1ab0f89a713094b3a322ff97e6fd6a233e1bf9ebf50cad11f93a28d73e950b76" May 20 15:36:57.280536 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:36:57.280516 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ab0f89a713094b3a322ff97e6fd6a233e1bf9ebf50cad11f93a28d73e950b76\": container with ID starting with 1ab0f89a713094b3a322ff97e6fd6a233e1bf9ebf50cad11f93a28d73e950b76 not found: ID does not exist" containerID="1ab0f89a713094b3a322ff97e6fd6a233e1bf9ebf50cad11f93a28d73e950b76" May 20 15:36:57.280636 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.280545 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ab0f89a713094b3a322ff97e6fd6a233e1bf9ebf50cad11f93a28d73e950b76"} err="failed to get container status \"1ab0f89a713094b3a322ff97e6fd6a233e1bf9ebf50cad11f93a28d73e950b76\": rpc error: code = NotFound desc = could not find container \"1ab0f89a713094b3a322ff97e6fd6a233e1bf9ebf50cad11f93a28d73e950b76\": container with ID starting with 1ab0f89a713094b3a322ff97e6fd6a233e1bf9ebf50cad11f93a28d73e950b76 not found: ID does not exist" May 20 15:36:57.280636 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.280569 2557 scope.go:117] "RemoveContainer" containerID="275abb712b240402c5114d56d3d2e263a1f81d9a1509713e60f31b3778c688c6" May 20 15:36:57.280929 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:36:57.280800 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"275abb712b240402c5114d56d3d2e263a1f81d9a1509713e60f31b3778c688c6\": container with ID starting with 275abb712b240402c5114d56d3d2e263a1f81d9a1509713e60f31b3778c688c6 not found: ID does not exist" containerID="275abb712b240402c5114d56d3d2e263a1f81d9a1509713e60f31b3778c688c6" May 20 15:36:57.280929 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.280844 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"275abb712b240402c5114d56d3d2e263a1f81d9a1509713e60f31b3778c688c6"} err="failed to get container status \"275abb712b240402c5114d56d3d2e263a1f81d9a1509713e60f31b3778c688c6\": rpc error: code = NotFound desc = could not find container \"275abb712b240402c5114d56d3d2e263a1f81d9a1509713e60f31b3778c688c6\": container with ID starting with 275abb712b240402c5114d56d3d2e263a1f81d9a1509713e60f31b3778c688c6 not found: ID does not exist" May 20 15:36:57.280929 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.280860 2557 scope.go:117] "RemoveContainer" containerID="31c591f501adb9310bd52500ace3638b5435701d5d24e1726081fd4c06c8d734" May 20 15:36:57.281118 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:36:57.281104 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31c591f501adb9310bd52500ace3638b5435701d5d24e1726081fd4c06c8d734\": container with ID starting with 31c591f501adb9310bd52500ace3638b5435701d5d24e1726081fd4c06c8d734 not found: ID does not exist" containerID="31c591f501adb9310bd52500ace3638b5435701d5d24e1726081fd4c06c8d734" May 20 15:36:57.281170 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.281121 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31c591f501adb9310bd52500ace3638b5435701d5d24e1726081fd4c06c8d734"} err="failed to get container status \"31c591f501adb9310bd52500ace3638b5435701d5d24e1726081fd4c06c8d734\": rpc error: code = NotFound desc = could not find container \"31c591f501adb9310bd52500ace3638b5435701d5d24e1726081fd4c06c8d734\": container with ID starting with 31c591f501adb9310bd52500ace3638b5435701d5d24e1726081fd4c06c8d734 not found: ID does not exist" May 20 15:36:57.281170 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.281135 2557 scope.go:117] "RemoveContainer" containerID="ab7349de1f0d8799fbd36c0af66c03c7407a01c04376b3fb2ea5abf2ccc9a308" May 20 15:36:57.281405 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:36:57.281386 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab7349de1f0d8799fbd36c0af66c03c7407a01c04376b3fb2ea5abf2ccc9a308\": container with ID starting with ab7349de1f0d8799fbd36c0af66c03c7407a01c04376b3fb2ea5abf2ccc9a308 not found: ID does not exist" containerID="ab7349de1f0d8799fbd36c0af66c03c7407a01c04376b3fb2ea5abf2ccc9a308" May 20 15:36:57.281461 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.281410 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab7349de1f0d8799fbd36c0af66c03c7407a01c04376b3fb2ea5abf2ccc9a308"} err="failed to get container status \"ab7349de1f0d8799fbd36c0af66c03c7407a01c04376b3fb2ea5abf2ccc9a308\": rpc error: code = NotFound desc = could not find container \"ab7349de1f0d8799fbd36c0af66c03c7407a01c04376b3fb2ea5abf2ccc9a308\": container with ID starting with ab7349de1f0d8799fbd36c0af66c03c7407a01c04376b3fb2ea5abf2ccc9a308 not found: ID does not exist" May 20 15:36:57.281461 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.281428 2557 scope.go:117] "RemoveContainer" containerID="3e8a78532c6d819d4c140a24f4786e71e4bf1eff03ff4b3c947cdb02acd93bb1" May 20 15:36:57.281689 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:36:57.281672 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e8a78532c6d819d4c140a24f4786e71e4bf1eff03ff4b3c947cdb02acd93bb1\": container with ID starting with 3e8a78532c6d819d4c140a24f4786e71e4bf1eff03ff4b3c947cdb02acd93bb1 not found: ID does not exist" containerID="3e8a78532c6d819d4c140a24f4786e71e4bf1eff03ff4b3c947cdb02acd93bb1" May 20 15:36:57.281753 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.281691 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e8a78532c6d819d4c140a24f4786e71e4bf1eff03ff4b3c947cdb02acd93bb1"} err="failed to get container status \"3e8a78532c6d819d4c140a24f4786e71e4bf1eff03ff4b3c947cdb02acd93bb1\": rpc error: code = NotFound desc = could not find container \"3e8a78532c6d819d4c140a24f4786e71e4bf1eff03ff4b3c947cdb02acd93bb1\": container with ID starting with 3e8a78532c6d819d4c140a24f4786e71e4bf1eff03ff4b3c947cdb02acd93bb1 not found: ID does not exist" May 20 15:36:57.281753 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.281706 2557 scope.go:117] "RemoveContainer" containerID="e609c9d1df0f85766521522001fe83926f511cc057f2a5471569f5ab780d2d55" May 20 15:36:57.281982 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:36:57.281959 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e609c9d1df0f85766521522001fe83926f511cc057f2a5471569f5ab780d2d55\": container with ID starting with e609c9d1df0f85766521522001fe83926f511cc057f2a5471569f5ab780d2d55 not found: ID does not exist" containerID="e609c9d1df0f85766521522001fe83926f511cc057f2a5471569f5ab780d2d55" May 20 15:36:57.282031 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.281988 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e609c9d1df0f85766521522001fe83926f511cc057f2a5471569f5ab780d2d55"} err="failed to get container status \"e609c9d1df0f85766521522001fe83926f511cc057f2a5471569f5ab780d2d55\": rpc error: code = NotFound desc = could not find container \"e609c9d1df0f85766521522001fe83926f511cc057f2a5471569f5ab780d2d55\": container with ID starting with e609c9d1df0f85766521522001fe83926f511cc057f2a5471569f5ab780d2d55 not found: ID does not exist" May 20 15:36:57.282031 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.282000 2557 scope.go:117] "RemoveContainer" containerID="06e1bbf768a1a05f6d567d4c5537b7858085e53a781ee95a079e6bd205fc0685" May 20 15:36:57.282213 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:36:57.282196 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06e1bbf768a1a05f6d567d4c5537b7858085e53a781ee95a079e6bd205fc0685\": container with ID starting with 06e1bbf768a1a05f6d567d4c5537b7858085e53a781ee95a079e6bd205fc0685 not found: ID does not exist" containerID="06e1bbf768a1a05f6d567d4c5537b7858085e53a781ee95a079e6bd205fc0685" May 20 15:36:57.282255 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.282218 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06e1bbf768a1a05f6d567d4c5537b7858085e53a781ee95a079e6bd205fc0685"} err="failed to get container status \"06e1bbf768a1a05f6d567d4c5537b7858085e53a781ee95a079e6bd205fc0685\": rpc error: code = NotFound desc = could not find container \"06e1bbf768a1a05f6d567d4c5537b7858085e53a781ee95a079e6bd205fc0685\": container with ID starting with 06e1bbf768a1a05f6d567d4c5537b7858085e53a781ee95a079e6bd205fc0685 not found: ID does not exist" May 20 15:36:57.282255 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.282230 2557 scope.go:117] "RemoveContainer" containerID="1ab0f89a713094b3a322ff97e6fd6a233e1bf9ebf50cad11f93a28d73e950b76" May 20 15:36:57.282459 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.282441 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ab0f89a713094b3a322ff97e6fd6a233e1bf9ebf50cad11f93a28d73e950b76"} err="failed to get container status \"1ab0f89a713094b3a322ff97e6fd6a233e1bf9ebf50cad11f93a28d73e950b76\": rpc error: code = NotFound desc = could not find container \"1ab0f89a713094b3a322ff97e6fd6a233e1bf9ebf50cad11f93a28d73e950b76\": container with ID starting with 1ab0f89a713094b3a322ff97e6fd6a233e1bf9ebf50cad11f93a28d73e950b76 not found: ID does not exist" May 20 15:36:57.282504 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.282461 2557 scope.go:117] "RemoveContainer" containerID="275abb712b240402c5114d56d3d2e263a1f81d9a1509713e60f31b3778c688c6" May 20 15:36:57.282684 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.282652 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"275abb712b240402c5114d56d3d2e263a1f81d9a1509713e60f31b3778c688c6"} err="failed to get container status \"275abb712b240402c5114d56d3d2e263a1f81d9a1509713e60f31b3778c688c6\": rpc error: code = NotFound desc = could not find container \"275abb712b240402c5114d56d3d2e263a1f81d9a1509713e60f31b3778c688c6\": container with ID starting with 275abb712b240402c5114d56d3d2e263a1f81d9a1509713e60f31b3778c688c6 not found: ID does not exist" May 20 15:36:57.282758 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.282687 2557 scope.go:117] "RemoveContainer" containerID="31c591f501adb9310bd52500ace3638b5435701d5d24e1726081fd4c06c8d734" May 20 15:36:57.282962 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.282939 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31c591f501adb9310bd52500ace3638b5435701d5d24e1726081fd4c06c8d734"} err="failed to get container status \"31c591f501adb9310bd52500ace3638b5435701d5d24e1726081fd4c06c8d734\": rpc error: code = NotFound desc = could not find container \"31c591f501adb9310bd52500ace3638b5435701d5d24e1726081fd4c06c8d734\": container with ID starting with 31c591f501adb9310bd52500ace3638b5435701d5d24e1726081fd4c06c8d734 not found: ID does not exist" May 20 15:36:57.283003 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.282966 2557 scope.go:117] "RemoveContainer" containerID="ab7349de1f0d8799fbd36c0af66c03c7407a01c04376b3fb2ea5abf2ccc9a308" May 20 15:36:57.283200 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.283179 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab7349de1f0d8799fbd36c0af66c03c7407a01c04376b3fb2ea5abf2ccc9a308"} err="failed to get container status \"ab7349de1f0d8799fbd36c0af66c03c7407a01c04376b3fb2ea5abf2ccc9a308\": rpc error: code = NotFound desc = could not find container \"ab7349de1f0d8799fbd36c0af66c03c7407a01c04376b3fb2ea5abf2ccc9a308\": container with ID starting with ab7349de1f0d8799fbd36c0af66c03c7407a01c04376b3fb2ea5abf2ccc9a308 not found: ID does not exist" May 20 15:36:57.283250 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.283202 2557 scope.go:117] "RemoveContainer" containerID="3e8a78532c6d819d4c140a24f4786e71e4bf1eff03ff4b3c947cdb02acd93bb1" May 20 15:36:57.283437 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.283418 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e8a78532c6d819d4c140a24f4786e71e4bf1eff03ff4b3c947cdb02acd93bb1"} err="failed to get container status \"3e8a78532c6d819d4c140a24f4786e71e4bf1eff03ff4b3c947cdb02acd93bb1\": rpc error: code = NotFound desc = could not find container \"3e8a78532c6d819d4c140a24f4786e71e4bf1eff03ff4b3c947cdb02acd93bb1\": container with ID starting with 3e8a78532c6d819d4c140a24f4786e71e4bf1eff03ff4b3c947cdb02acd93bb1 not found: ID does not exist" May 20 15:36:57.283510 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.283439 2557 scope.go:117] "RemoveContainer" containerID="e609c9d1df0f85766521522001fe83926f511cc057f2a5471569f5ab780d2d55" May 20 15:36:57.283667 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.283651 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e609c9d1df0f85766521522001fe83926f511cc057f2a5471569f5ab780d2d55"} err="failed to get container status \"e609c9d1df0f85766521522001fe83926f511cc057f2a5471569f5ab780d2d55\": rpc error: code = NotFound desc = could not find container \"e609c9d1df0f85766521522001fe83926f511cc057f2a5471569f5ab780d2d55\": container with ID starting with e609c9d1df0f85766521522001fe83926f511cc057f2a5471569f5ab780d2d55 not found: ID does not exist" May 20 15:36:57.283667 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.283666 2557 scope.go:117] "RemoveContainer" containerID="06e1bbf768a1a05f6d567d4c5537b7858085e53a781ee95a079e6bd205fc0685" May 20 15:36:57.283868 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.283848 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06e1bbf768a1a05f6d567d4c5537b7858085e53a781ee95a079e6bd205fc0685"} err="failed to get container status \"06e1bbf768a1a05f6d567d4c5537b7858085e53a781ee95a079e6bd205fc0685\": rpc error: code = NotFound desc = could not find container \"06e1bbf768a1a05f6d567d4c5537b7858085e53a781ee95a079e6bd205fc0685\": container with ID starting with 06e1bbf768a1a05f6d567d4c5537b7858085e53a781ee95a079e6bd205fc0685 not found: ID does not exist" May 20 15:36:57.355973 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.355950 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8eef42cd-6f2d-4f5c-84a4-62e29aeca82c-web-config\") pod \"8eef42cd-6f2d-4f5c-84a4-62e29aeca82c\" (UID: \"8eef42cd-6f2d-4f5c-84a4-62e29aeca82c\") " May 20 15:36:57.356118 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.355990 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8eef42cd-6f2d-4f5c-84a4-62e29aeca82c-metrics-client-ca\") pod \"8eef42cd-6f2d-4f5c-84a4-62e29aeca82c\" (UID: \"8eef42cd-6f2d-4f5c-84a4-62e29aeca82c\") " May 20 15:36:57.356118 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.356009 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8eef42cd-6f2d-4f5c-84a4-62e29aeca82c-alertmanager-trusted-ca-bundle\") pod \"8eef42cd-6f2d-4f5c-84a4-62e29aeca82c\" (UID: \"8eef42cd-6f2d-4f5c-84a4-62e29aeca82c\") " May 20 15:36:57.356118 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.356036 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8eef42cd-6f2d-4f5c-84a4-62e29aeca82c-tls-assets\") pod \"8eef42cd-6f2d-4f5c-84a4-62e29aeca82c\" (UID: \"8eef42cd-6f2d-4f5c-84a4-62e29aeca82c\") " May 20 15:36:57.356118 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.356065 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8eef42cd-6f2d-4f5c-84a4-62e29aeca82c-config-out\") pod \"8eef42cd-6f2d-4f5c-84a4-62e29aeca82c\" (UID: \"8eef42cd-6f2d-4f5c-84a4-62e29aeca82c\") " May 20 15:36:57.356118 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.356107 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8eef42cd-6f2d-4f5c-84a4-62e29aeca82c-secret-alertmanager-kube-rbac-proxy-web\") pod \"8eef42cd-6f2d-4f5c-84a4-62e29aeca82c\" (UID: \"8eef42cd-6f2d-4f5c-84a4-62e29aeca82c\") " May 20 15:36:57.356386 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.356135 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8eef42cd-6f2d-4f5c-84a4-62e29aeca82c-config-volume\") pod \"8eef42cd-6f2d-4f5c-84a4-62e29aeca82c\" (UID: \"8eef42cd-6f2d-4f5c-84a4-62e29aeca82c\") " May 20 15:36:57.356386 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.356165 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wm4v8\" (UniqueName: \"kubernetes.io/projected/8eef42cd-6f2d-4f5c-84a4-62e29aeca82c-kube-api-access-wm4v8\") pod \"8eef42cd-6f2d-4f5c-84a4-62e29aeca82c\" (UID: \"8eef42cd-6f2d-4f5c-84a4-62e29aeca82c\") " May 20 15:36:57.356386 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.356190 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8eef42cd-6f2d-4f5c-84a4-62e29aeca82c-secret-alertmanager-main-tls\") pod \"8eef42cd-6f2d-4f5c-84a4-62e29aeca82c\" (UID: \"8eef42cd-6f2d-4f5c-84a4-62e29aeca82c\") " May 20 15:36:57.356386 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.356222 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8eef42cd-6f2d-4f5c-84a4-62e29aeca82c-alertmanager-main-db\") pod \"8eef42cd-6f2d-4f5c-84a4-62e29aeca82c\" (UID: \"8eef42cd-6f2d-4f5c-84a4-62e29aeca82c\") " May 20 15:36:57.356386 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.356252 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8eef42cd-6f2d-4f5c-84a4-62e29aeca82c-secret-alertmanager-kube-rbac-proxy\") pod \"8eef42cd-6f2d-4f5c-84a4-62e29aeca82c\" (UID: \"8eef42cd-6f2d-4f5c-84a4-62e29aeca82c\") " May 20 15:36:57.356386 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.356276 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8eef42cd-6f2d-4f5c-84a4-62e29aeca82c-cluster-tls-config\") pod \"8eef42cd-6f2d-4f5c-84a4-62e29aeca82c\" (UID: \"8eef42cd-6f2d-4f5c-84a4-62e29aeca82c\") " May 20 15:36:57.356386 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.356305 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8eef42cd-6f2d-4f5c-84a4-62e29aeca82c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"8eef42cd-6f2d-4f5c-84a4-62e29aeca82c\" (UID: \"8eef42cd-6f2d-4f5c-84a4-62e29aeca82c\") " May 20 15:36:57.356771 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.356377 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8eef42cd-6f2d-4f5c-84a4-62e29aeca82c-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "8eef42cd-6f2d-4f5c-84a4-62e29aeca82c" (UID: "8eef42cd-6f2d-4f5c-84a4-62e29aeca82c"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 20 15:36:57.356771 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.356386 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8eef42cd-6f2d-4f5c-84a4-62e29aeca82c-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "8eef42cd-6f2d-4f5c-84a4-62e29aeca82c" (UID: "8eef42cd-6f2d-4f5c-84a4-62e29aeca82c"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 20 15:36:57.356771 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.356639 2557 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8eef42cd-6f2d-4f5c-84a4-62e29aeca82c-metrics-client-ca\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" May 20 15:36:57.356975 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.356790 2557 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8eef42cd-6f2d-4f5c-84a4-62e29aeca82c-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" May 20 15:36:57.359195 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.359156 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8eef42cd-6f2d-4f5c-84a4-62e29aeca82c-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "8eef42cd-6f2d-4f5c-84a4-62e29aeca82c" (UID: "8eef42cd-6f2d-4f5c-84a4-62e29aeca82c"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 15:36:57.359545 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.359520 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8eef42cd-6f2d-4f5c-84a4-62e29aeca82c-config-volume" (OuterVolumeSpecName: "config-volume") pod "8eef42cd-6f2d-4f5c-84a4-62e29aeca82c" (UID: "8eef42cd-6f2d-4f5c-84a4-62e29aeca82c"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 15:36:57.359633 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.359583 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8eef42cd-6f2d-4f5c-84a4-62e29aeca82c-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "8eef42cd-6f2d-4f5c-84a4-62e29aeca82c" (UID: "8eef42cd-6f2d-4f5c-84a4-62e29aeca82c"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 15:36:57.359633 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.359617 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8eef42cd-6f2d-4f5c-84a4-62e29aeca82c-config-out" (OuterVolumeSpecName: "config-out") pod "8eef42cd-6f2d-4f5c-84a4-62e29aeca82c" (UID: "8eef42cd-6f2d-4f5c-84a4-62e29aeca82c"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 20 15:36:57.359972 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.359913 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8eef42cd-6f2d-4f5c-84a4-62e29aeca82c-kube-api-access-wm4v8" (OuterVolumeSpecName: "kube-api-access-wm4v8") pod "8eef42cd-6f2d-4f5c-84a4-62e29aeca82c" (UID: "8eef42cd-6f2d-4f5c-84a4-62e29aeca82c"). InnerVolumeSpecName "kube-api-access-wm4v8". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 15:36:57.359972 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.359919 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8eef42cd-6f2d-4f5c-84a4-62e29aeca82c-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "8eef42cd-6f2d-4f5c-84a4-62e29aeca82c" (UID: "8eef42cd-6f2d-4f5c-84a4-62e29aeca82c"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 20 15:36:57.359972 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.359965 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8eef42cd-6f2d-4f5c-84a4-62e29aeca82c-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "8eef42cd-6f2d-4f5c-84a4-62e29aeca82c" (UID: "8eef42cd-6f2d-4f5c-84a4-62e29aeca82c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 15:36:57.361514 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.361490 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8eef42cd-6f2d-4f5c-84a4-62e29aeca82c-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "8eef42cd-6f2d-4f5c-84a4-62e29aeca82c" (UID: "8eef42cd-6f2d-4f5c-84a4-62e29aeca82c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 15:36:57.362324 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.362301 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8eef42cd-6f2d-4f5c-84a4-62e29aeca82c-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "8eef42cd-6f2d-4f5c-84a4-62e29aeca82c" (UID: "8eef42cd-6f2d-4f5c-84a4-62e29aeca82c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 15:36:57.366745 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.366716 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8eef42cd-6f2d-4f5c-84a4-62e29aeca82c-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "8eef42cd-6f2d-4f5c-84a4-62e29aeca82c" (UID: "8eef42cd-6f2d-4f5c-84a4-62e29aeca82c"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 15:36:57.370846 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.370807 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8eef42cd-6f2d-4f5c-84a4-62e29aeca82c-web-config" (OuterVolumeSpecName: "web-config") pod "8eef42cd-6f2d-4f5c-84a4-62e29aeca82c" (UID: "8eef42cd-6f2d-4f5c-84a4-62e29aeca82c"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 15:36:57.457314 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.457280 2557 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8eef42cd-6f2d-4f5c-84a4-62e29aeca82c-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" May 20 15:36:57.457314 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.457309 2557 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8eef42cd-6f2d-4f5c-84a4-62e29aeca82c-config-volume\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" May 20 15:36:57.457479 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.457326 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wm4v8\" (UniqueName: \"kubernetes.io/projected/8eef42cd-6f2d-4f5c-84a4-62e29aeca82c-kube-api-access-wm4v8\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" May 20 15:36:57.457479 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.457339 2557 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8eef42cd-6f2d-4f5c-84a4-62e29aeca82c-secret-alertmanager-main-tls\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" May 20 15:36:57.457479 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.457352 2557 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8eef42cd-6f2d-4f5c-84a4-62e29aeca82c-alertmanager-main-db\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" May 20 15:36:57.457479 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.457365 2557 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8eef42cd-6f2d-4f5c-84a4-62e29aeca82c-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" May 20 15:36:57.457479 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.457378 2557 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8eef42cd-6f2d-4f5c-84a4-62e29aeca82c-cluster-tls-config\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" May 20 15:36:57.457479 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.457391 2557 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8eef42cd-6f2d-4f5c-84a4-62e29aeca82c-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" May 20 15:36:57.457479 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.457407 2557 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8eef42cd-6f2d-4f5c-84a4-62e29aeca82c-web-config\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" May 20 15:36:57.457479 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.457419 2557 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8eef42cd-6f2d-4f5c-84a4-62e29aeca82c-tls-assets\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" May 20 15:36:57.457479 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.457430 2557 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8eef42cd-6f2d-4f5c-84a4-62e29aeca82c-config-out\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" May 20 15:36:57.548137 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.548064 2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 20 15:36:57.554446 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.554423 2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 20 15:36:57.586362 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.586339 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 20 15:36:57.586609 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.586597 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8eef42cd-6f2d-4f5c-84a4-62e29aeca82c" containerName="init-config-reloader" May 20 15:36:57.586651 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.586611 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="8eef42cd-6f2d-4f5c-84a4-62e29aeca82c" containerName="init-config-reloader" May 20 15:36:57.586651 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.586624 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8eef42cd-6f2d-4f5c-84a4-62e29aeca82c" containerName="kube-rbac-proxy-metric" May 20 15:36:57.586651 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.586630 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="8eef42cd-6f2d-4f5c-84a4-62e29aeca82c" containerName="kube-rbac-proxy-metric" May 20 15:36:57.586651 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.586639 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8eef42cd-6f2d-4f5c-84a4-62e29aeca82c" containerName="kube-rbac-proxy" May 20 15:36:57.586651 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.586645 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="8eef42cd-6f2d-4f5c-84a4-62e29aeca82c" containerName="kube-rbac-proxy" May 20 15:36:57.586782 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.586653 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b5ce08f-f82d-4226-b1b0-9dddccec11cd" containerName="registry" May 20 15:36:57.586782 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.586658 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b5ce08f-f82d-4226-b1b0-9dddccec11cd" containerName="registry" May 20 15:36:57.586782 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.586665 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8eef42cd-6f2d-4f5c-84a4-62e29aeca82c" containerName="kube-rbac-proxy-web" May 20 15:36:57.586782 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.586671 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="8eef42cd-6f2d-4f5c-84a4-62e29aeca82c" containerName="kube-rbac-proxy-web" May 20 15:36:57.586782 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.586681 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8eef42cd-6f2d-4f5c-84a4-62e29aeca82c" containerName="prom-label-proxy" May 20 15:36:57.586782 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.586686 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="8eef42cd-6f2d-4f5c-84a4-62e29aeca82c" containerName="prom-label-proxy" May 20 15:36:57.586782 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.586694 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8eef42cd-6f2d-4f5c-84a4-62e29aeca82c" containerName="alertmanager" May 20 15:36:57.586782 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.586698 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="8eef42cd-6f2d-4f5c-84a4-62e29aeca82c" containerName="alertmanager" May 20 15:36:57.586782 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.586704 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8eef42cd-6f2d-4f5c-84a4-62e29aeca82c" containerName="config-reloader" May 20 15:36:57.586782 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.586711 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="8eef42cd-6f2d-4f5c-84a4-62e29aeca82c" containerName="config-reloader" May 20 15:36:57.586782 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.586756 2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="8eef42cd-6f2d-4f5c-84a4-62e29aeca82c" containerName="config-reloader" May 20 15:36:57.586782 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.586763 2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="8eef42cd-6f2d-4f5c-84a4-62e29aeca82c" containerName="kube-rbac-proxy" May 20 15:36:57.586782 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.586771 2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="8eef42cd-6f2d-4f5c-84a4-62e29aeca82c" containerName="prom-label-proxy" May 20 15:36:57.586782 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.586778 2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="7b5ce08f-f82d-4226-b1b0-9dddccec11cd" containerName="registry" May 20 15:36:57.586782 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.586785 2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="8eef42cd-6f2d-4f5c-84a4-62e29aeca82c" containerName="kube-rbac-proxy-metric" May 20 15:36:57.587222 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.586792 2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="8eef42cd-6f2d-4f5c-84a4-62e29aeca82c" containerName="alertmanager" May 20 15:36:57.587222 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.586798 2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="8eef42cd-6f2d-4f5c-84a4-62e29aeca82c" containerName="kube-rbac-proxy-web" May 20 15:36:57.589747 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.589731 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 20 15:36:57.592269 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.592065 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" May 20 15:36:57.592269 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.592087 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" May 20 15:36:57.592269 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.592109 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" May 20 15:36:57.592269 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.592143 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" May 20 15:36:57.592269 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.592166 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-l8lwb\"" May 20 15:36:57.592269 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.592189 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" May 20 15:36:57.592593 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.592278 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" May 20 15:36:57.592593 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.592395 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" May 20 15:36:57.592593 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.592440 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" May 20 15:36:57.597850 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.597804 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" May 20 15:36:57.614348 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.614311 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 20 15:36:57.659470 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.659440 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3793ed15-f7e2-464a-86ec-3318c5d4f4ee-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3793ed15-f7e2-464a-86ec-3318c5d4f4ee\") " pod="openshift-monitoring/alertmanager-main-0" May 20 15:36:57.659585 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.659476 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3793ed15-f7e2-464a-86ec-3318c5d4f4ee-config-volume\") pod \"alertmanager-main-0\" (UID: \"3793ed15-f7e2-464a-86ec-3318c5d4f4ee\") " pod="openshift-monitoring/alertmanager-main-0" May 20 15:36:57.659585 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.659497 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3793ed15-f7e2-464a-86ec-3318c5d4f4ee-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3793ed15-f7e2-464a-86ec-3318c5d4f4ee\") " pod="openshift-monitoring/alertmanager-main-0" May 20 15:36:57.659585 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.659552 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3793ed15-f7e2-464a-86ec-3318c5d4f4ee-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3793ed15-f7e2-464a-86ec-3318c5d4f4ee\") " pod="openshift-monitoring/alertmanager-main-0" May 20 15:36:57.659695 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.659596 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3793ed15-f7e2-464a-86ec-3318c5d4f4ee-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3793ed15-f7e2-464a-86ec-3318c5d4f4ee\") " pod="openshift-monitoring/alertmanager-main-0" May 20 15:36:57.659695 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.659644 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3793ed15-f7e2-464a-86ec-3318c5d4f4ee-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3793ed15-f7e2-464a-86ec-3318c5d4f4ee\") " pod="openshift-monitoring/alertmanager-main-0" May 20 15:36:57.659695 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.659670 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3793ed15-f7e2-464a-86ec-3318c5d4f4ee-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3793ed15-f7e2-464a-86ec-3318c5d4f4ee\") " pod="openshift-monitoring/alertmanager-main-0" May 20 15:36:57.659695 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.659688 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3793ed15-f7e2-464a-86ec-3318c5d4f4ee-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3793ed15-f7e2-464a-86ec-3318c5d4f4ee\") " pod="openshift-monitoring/alertmanager-main-0" May 20 15:36:57.659836 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.659714 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3793ed15-f7e2-464a-86ec-3318c5d4f4ee-config-out\") pod \"alertmanager-main-0\" (UID: \"3793ed15-f7e2-464a-86ec-3318c5d4f4ee\") " pod="openshift-monitoring/alertmanager-main-0" May 20 15:36:57.659836 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.659742 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3793ed15-f7e2-464a-86ec-3318c5d4f4ee-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3793ed15-f7e2-464a-86ec-3318c5d4f4ee\") " pod="openshift-monitoring/alertmanager-main-0" May 20 15:36:57.659836 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.659769 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3793ed15-f7e2-464a-86ec-3318c5d4f4ee-web-config\") pod \"alertmanager-main-0\" (UID: \"3793ed15-f7e2-464a-86ec-3318c5d4f4ee\") " pod="openshift-monitoring/alertmanager-main-0" May 20 15:36:57.659927 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.659841 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3793ed15-f7e2-464a-86ec-3318c5d4f4ee-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3793ed15-f7e2-464a-86ec-3318c5d4f4ee\") " pod="openshift-monitoring/alertmanager-main-0" May 20 15:36:57.659927 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.659879 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pp6fw\" (UniqueName: \"kubernetes.io/projected/3793ed15-f7e2-464a-86ec-3318c5d4f4ee-kube-api-access-pp6fw\") pod \"alertmanager-main-0\" (UID: \"3793ed15-f7e2-464a-86ec-3318c5d4f4ee\") " pod="openshift-monitoring/alertmanager-main-0" May 20 15:36:57.760630 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.760605 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3793ed15-f7e2-464a-86ec-3318c5d4f4ee-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3793ed15-f7e2-464a-86ec-3318c5d4f4ee\") " pod="openshift-monitoring/alertmanager-main-0" May 20 15:36:57.760770 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.760639 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3793ed15-f7e2-464a-86ec-3318c5d4f4ee-config-volume\") pod \"alertmanager-main-0\" (UID: \"3793ed15-f7e2-464a-86ec-3318c5d4f4ee\") " pod="openshift-monitoring/alertmanager-main-0" May 20 15:36:57.760770 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.760658 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3793ed15-f7e2-464a-86ec-3318c5d4f4ee-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3793ed15-f7e2-464a-86ec-3318c5d4f4ee\") " pod="openshift-monitoring/alertmanager-main-0" May 20 15:36:57.760770 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.760677 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3793ed15-f7e2-464a-86ec-3318c5d4f4ee-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3793ed15-f7e2-464a-86ec-3318c5d4f4ee\") " pod="openshift-monitoring/alertmanager-main-0" May 20 15:36:57.760770 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.760728 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3793ed15-f7e2-464a-86ec-3318c5d4f4ee-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3793ed15-f7e2-464a-86ec-3318c5d4f4ee\") " pod="openshift-monitoring/alertmanager-main-0" May 20 15:36:57.760770 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.760760 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3793ed15-f7e2-464a-86ec-3318c5d4f4ee-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3793ed15-f7e2-464a-86ec-3318c5d4f4ee\") " pod="openshift-monitoring/alertmanager-main-0" May 20 15:36:57.761016 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.760777 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3793ed15-f7e2-464a-86ec-3318c5d4f4ee-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3793ed15-f7e2-464a-86ec-3318c5d4f4ee\") " pod="openshift-monitoring/alertmanager-main-0" May 20 15:36:57.761016 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.760795 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3793ed15-f7e2-464a-86ec-3318c5d4f4ee-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3793ed15-f7e2-464a-86ec-3318c5d4f4ee\") " pod="openshift-monitoring/alertmanager-main-0" May 20 15:36:57.761016 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.760852 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3793ed15-f7e2-464a-86ec-3318c5d4f4ee-config-out\") pod \"alertmanager-main-0\" (UID: \"3793ed15-f7e2-464a-86ec-3318c5d4f4ee\") " pod="openshift-monitoring/alertmanager-main-0" May 20 15:36:57.761016 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.760899 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3793ed15-f7e2-464a-86ec-3318c5d4f4ee-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3793ed15-f7e2-464a-86ec-3318c5d4f4ee\") " pod="openshift-monitoring/alertmanager-main-0" May 20 15:36:57.761016 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.760928 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3793ed15-f7e2-464a-86ec-3318c5d4f4ee-web-config\") pod \"alertmanager-main-0\" (UID: \"3793ed15-f7e2-464a-86ec-3318c5d4f4ee\") " pod="openshift-monitoring/alertmanager-main-0" May 20 15:36:57.761016 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.760949 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3793ed15-f7e2-464a-86ec-3318c5d4f4ee-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3793ed15-f7e2-464a-86ec-3318c5d4f4ee\") " pod="openshift-monitoring/alertmanager-main-0" May 20 15:36:57.761016 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.760980 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pp6fw\" (UniqueName: \"kubernetes.io/projected/3793ed15-f7e2-464a-86ec-3318c5d4f4ee-kube-api-access-pp6fw\") pod \"alertmanager-main-0\" (UID: \"3793ed15-f7e2-464a-86ec-3318c5d4f4ee\") " pod="openshift-monitoring/alertmanager-main-0" May 20 15:36:57.761244 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.761070 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3793ed15-f7e2-464a-86ec-3318c5d4f4ee-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3793ed15-f7e2-464a-86ec-3318c5d4f4ee\") " pod="openshift-monitoring/alertmanager-main-0" May 20 15:36:57.762101 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.762069 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3793ed15-f7e2-464a-86ec-3318c5d4f4ee-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3793ed15-f7e2-464a-86ec-3318c5d4f4ee\") " pod="openshift-monitoring/alertmanager-main-0" May 20 15:36:57.762203 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.762128 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3793ed15-f7e2-464a-86ec-3318c5d4f4ee-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3793ed15-f7e2-464a-86ec-3318c5d4f4ee\") " pod="openshift-monitoring/alertmanager-main-0" May 20 15:36:57.764046 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.764015 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3793ed15-f7e2-464a-86ec-3318c5d4f4ee-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3793ed15-f7e2-464a-86ec-3318c5d4f4ee\") " pod="openshift-monitoring/alertmanager-main-0" May 20 15:36:57.764157 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.764087 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3793ed15-f7e2-464a-86ec-3318c5d4f4ee-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3793ed15-f7e2-464a-86ec-3318c5d4f4ee\") " pod="openshift-monitoring/alertmanager-main-0" May 20 15:36:57.764221 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.764156 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3793ed15-f7e2-464a-86ec-3318c5d4f4ee-config-volume\") pod \"alertmanager-main-0\" (UID: \"3793ed15-f7e2-464a-86ec-3318c5d4f4ee\") " pod="openshift-monitoring/alertmanager-main-0" May 20 15:36:57.764221 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.764199 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3793ed15-f7e2-464a-86ec-3318c5d4f4ee-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3793ed15-f7e2-464a-86ec-3318c5d4f4ee\") " pod="openshift-monitoring/alertmanager-main-0" May 20 15:36:57.764221 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.764209 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3793ed15-f7e2-464a-86ec-3318c5d4f4ee-web-config\") pod \"alertmanager-main-0\" (UID: \"3793ed15-f7e2-464a-86ec-3318c5d4f4ee\") " pod="openshift-monitoring/alertmanager-main-0" May 20 15:36:57.764874 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.764852 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3793ed15-f7e2-464a-86ec-3318c5d4f4ee-config-out\") pod \"alertmanager-main-0\" (UID: \"3793ed15-f7e2-464a-86ec-3318c5d4f4ee\") " pod="openshift-monitoring/alertmanager-main-0" May 20 15:36:57.764984 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.764966 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3793ed15-f7e2-464a-86ec-3318c5d4f4ee-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3793ed15-f7e2-464a-86ec-3318c5d4f4ee\") " pod="openshift-monitoring/alertmanager-main-0" May 20 15:36:57.765110 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.765091 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3793ed15-f7e2-464a-86ec-3318c5d4f4ee-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3793ed15-f7e2-464a-86ec-3318c5d4f4ee\") " pod="openshift-monitoring/alertmanager-main-0" May 20 15:36:57.766165 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.766146 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3793ed15-f7e2-464a-86ec-3318c5d4f4ee-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3793ed15-f7e2-464a-86ec-3318c5d4f4ee\") " pod="openshift-monitoring/alertmanager-main-0" May 20 15:36:57.769940 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.769923 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pp6fw\" (UniqueName: \"kubernetes.io/projected/3793ed15-f7e2-464a-86ec-3318c5d4f4ee-kube-api-access-pp6fw\") pod \"alertmanager-main-0\" (UID: \"3793ed15-f7e2-464a-86ec-3318c5d4f4ee\") " pod="openshift-monitoring/alertmanager-main-0" May 20 15:36:57.901268 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:57.901203 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 20 15:36:58.032256 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:58.032231 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 20 15:36:58.034731 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:36:58.034695 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3793ed15_f7e2_464a_86ec_3318c5d4f4ee.slice/crio-3a1ae34fddda4aa7fc58f1e39fa129dd3693ef9ddf1aff36762d0db51f085a28 WatchSource:0}: Error finding container 3a1ae34fddda4aa7fc58f1e39fa129dd3693ef9ddf1aff36762d0db51f085a28: Status 404 returned error can't find the container with id 3a1ae34fddda4aa7fc58f1e39fa129dd3693ef9ddf1aff36762d0db51f085a28 May 20 15:36:58.232188 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:58.232155 2557 generic.go:358] "Generic (PLEG): container finished" podID="3793ed15-f7e2-464a-86ec-3318c5d4f4ee" containerID="d83db31050cc069e05692ceeaf401475c009e2a8f3b1750299ca437c30dbbb49" exitCode=0 May 20 15:36:58.232536 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:58.232202 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3793ed15-f7e2-464a-86ec-3318c5d4f4ee","Type":"ContainerDied","Data":"d83db31050cc069e05692ceeaf401475c009e2a8f3b1750299ca437c30dbbb49"} May 20 15:36:58.232536 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:58.232224 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3793ed15-f7e2-464a-86ec-3318c5d4f4ee","Type":"ContainerStarted","Data":"3a1ae34fddda4aa7fc58f1e39fa129dd3693ef9ddf1aff36762d0db51f085a28"} May 20 15:36:59.238059 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:59.238026 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3793ed15-f7e2-464a-86ec-3318c5d4f4ee","Type":"ContainerStarted","Data":"0241c4af606b34beeb5ee238cdf646802b41f8f449c7c78061ee0e18a93e2a9f"} May 20 15:36:59.238059 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:59.238065 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3793ed15-f7e2-464a-86ec-3318c5d4f4ee","Type":"ContainerStarted","Data":"1c1e63a54dc66d5e487b0a1e8abe7340c2d01b0388beac94ca15ddb9e871b16b"} May 20 15:36:59.238433 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:59.238078 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3793ed15-f7e2-464a-86ec-3318c5d4f4ee","Type":"ContainerStarted","Data":"b35c2cc62dc102a10f7fee0acc0b45a5317466fbe8f5a2a35cdf9045a9dab5c9"} May 20 15:36:59.238433 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:59.238086 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3793ed15-f7e2-464a-86ec-3318c5d4f4ee","Type":"ContainerStarted","Data":"e6fd94c712ff21fc3ed0702932de85a84bbe4e5be8123069b4c3ab47e94f1a64"} May 20 15:36:59.238433 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:59.238095 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3793ed15-f7e2-464a-86ec-3318c5d4f4ee","Type":"ContainerStarted","Data":"e33d5b775da05263f43afc135d538666d409556b952f484438f810c72f7467dd"} May 20 15:36:59.238433 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:59.238102 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3793ed15-f7e2-464a-86ec-3318c5d4f4ee","Type":"ContainerStarted","Data":"6e3c0bc12c2bcc8641c2635a5cb579fbdf6852f2c4944d8e3c9de0ae273bb1d2"} May 20 15:36:59.271062 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:59.271014 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.270999928 podStartE2EDuration="2.270999928s" podCreationTimestamp="2026-05-20 15:36:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 15:36:59.269377859 +0000 UTC m=+250.484300651" watchObservedRunningTime="2026-05-20 15:36:59.270999928 +0000 UTC m=+250.485922699" May 20 15:36:59.384616 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:36:59.384574 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8eef42cd-6f2d-4f5c-84a4-62e29aeca82c" path="/var/lib/kubelet/pods/8eef42cd-6f2d-4f5c-84a4-62e29aeca82c/volumes" May 20 15:37:00.084424 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:00.084382 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54872a9c-6091-4768-8cd9-e81ab987ba01-metrics-certs\") pod \"network-metrics-daemon-wszj2\" (UID: \"54872a9c-6091-4768-8cd9-e81ab987ba01\") " pod="openshift-multus/network-metrics-daemon-wszj2" May 20 15:37:00.087436 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:00.087407 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54872a9c-6091-4768-8cd9-e81ab987ba01-metrics-certs\") pod \"network-metrics-daemon-wszj2\" (UID: \"54872a9c-6091-4768-8cd9-e81ab987ba01\") " pod="openshift-multus/network-metrics-daemon-wszj2" May 20 15:37:00.182571 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:00.182538 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-79qfs\"" May 20 15:37:00.191381 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:00.191352 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wszj2" May 20 15:37:00.239635 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:00.239601 2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 20 15:37:00.240483 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:00.240283 2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7db58356-2c8a-447c-85fb-28a24f10d285" containerName="prometheus" containerID="cri-o://03c6fe9a43183f6e1da4ca69204090466c5b7f1af15d6bd4ae5a37692e1ca8f1" gracePeriod=600 May 20 15:37:00.240483 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:00.240321 2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7db58356-2c8a-447c-85fb-28a24f10d285" containerName="thanos-sidecar" containerID="cri-o://afc9f693f078a682b2570209435d6b5af179daf2b1f8c35e8fbcfa8ae47d5124" gracePeriod=600 May 20 15:37:00.240483 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:00.240347 2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7db58356-2c8a-447c-85fb-28a24f10d285" containerName="kube-rbac-proxy-thanos" containerID="cri-o://5edc328e3af87ae8f5428c3520b91aa9bfd74b5ef5253b200c25cfb94b2aa03c" gracePeriod=600 May 20 15:37:00.240483 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:00.240353 2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7db58356-2c8a-447c-85fb-28a24f10d285" containerName="kube-rbac-proxy-web" containerID="cri-o://6248bab6aa5dd9a44db401478bf3ea133c6d8abd83cd36aff5a102f4e990304b" gracePeriod=600 May 20 15:37:00.240483 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:00.240414 2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7db58356-2c8a-447c-85fb-28a24f10d285" containerName="config-reloader" containerID="cri-o://59851b6c310fe208ee6ea7c0f8d851f494262118ba79206725488d566c77d3b2" gracePeriod=600 May 20 15:37:00.240831 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:00.240514 2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7db58356-2c8a-447c-85fb-28a24f10d285" containerName="kube-rbac-proxy" containerID="cri-o://5ddf8aba83b1bcf706ea6fdce514984e5a99950cfae99fd900e492bf2f799342" gracePeriod=600 May 20 15:37:00.356040 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:00.356010 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wszj2"] May 20 15:37:00.361551 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:37:00.361470 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54872a9c_6091_4768_8cd9_e81ab987ba01.slice/crio-1959499dc78082a2e8de909b79ff794108f1f9079cc4f510344e1fef0d74024c WatchSource:0}: Error finding container 1959499dc78082a2e8de909b79ff794108f1f9079cc4f510344e1fef0d74024c: Status 404 returned error can't find the container with id 1959499dc78082a2e8de909b79ff794108f1f9079cc4f510344e1fef0d74024c May 20 15:37:01.248399 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:01.248364 2557 generic.go:358] "Generic (PLEG): container finished" podID="7db58356-2c8a-447c-85fb-28a24f10d285" containerID="5edc328e3af87ae8f5428c3520b91aa9bfd74b5ef5253b200c25cfb94b2aa03c" exitCode=0 May 20 15:37:01.248399 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:01.248390 2557 generic.go:358] "Generic (PLEG): container finished" podID="7db58356-2c8a-447c-85fb-28a24f10d285" containerID="5ddf8aba83b1bcf706ea6fdce514984e5a99950cfae99fd900e492bf2f799342" exitCode=0 May 20 15:37:01.248399 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:01.248397 2557 generic.go:358] "Generic (PLEG): container finished" podID="7db58356-2c8a-447c-85fb-28a24f10d285" containerID="afc9f693f078a682b2570209435d6b5af179daf2b1f8c35e8fbcfa8ae47d5124" exitCode=0 May 20 15:37:01.248399 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:01.248405 2557 generic.go:358] "Generic (PLEG): container finished" podID="7db58356-2c8a-447c-85fb-28a24f10d285" containerID="59851b6c310fe208ee6ea7c0f8d851f494262118ba79206725488d566c77d3b2" exitCode=0 May 20 15:37:01.248399 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:01.248410 2557 generic.go:358] "Generic (PLEG): container finished" podID="7db58356-2c8a-447c-85fb-28a24f10d285" containerID="03c6fe9a43183f6e1da4ca69204090466c5b7f1af15d6bd4ae5a37692e1ca8f1" exitCode=0 May 20 15:37:01.248959 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:01.248433 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7db58356-2c8a-447c-85fb-28a24f10d285","Type":"ContainerDied","Data":"5edc328e3af87ae8f5428c3520b91aa9bfd74b5ef5253b200c25cfb94b2aa03c"} May 20 15:37:01.248959 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:01.248466 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7db58356-2c8a-447c-85fb-28a24f10d285","Type":"ContainerDied","Data":"5ddf8aba83b1bcf706ea6fdce514984e5a99950cfae99fd900e492bf2f799342"} May 20 15:37:01.248959 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:01.248476 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7db58356-2c8a-447c-85fb-28a24f10d285","Type":"ContainerDied","Data":"afc9f693f078a682b2570209435d6b5af179daf2b1f8c35e8fbcfa8ae47d5124"} May 20 15:37:01.248959 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:01.248484 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7db58356-2c8a-447c-85fb-28a24f10d285","Type":"ContainerDied","Data":"59851b6c310fe208ee6ea7c0f8d851f494262118ba79206725488d566c77d3b2"} May 20 15:37:01.248959 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:01.248494 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7db58356-2c8a-447c-85fb-28a24f10d285","Type":"ContainerDied","Data":"03c6fe9a43183f6e1da4ca69204090466c5b7f1af15d6bd4ae5a37692e1ca8f1"} May 20 15:37:01.249613 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:01.249588 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wszj2" event={"ID":"54872a9c-6091-4768-8cd9-e81ab987ba01","Type":"ContainerStarted","Data":"1959499dc78082a2e8de909b79ff794108f1f9079cc4f510344e1fef0d74024c"} May 20 15:37:01.653264 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:01.653243 2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 20 15:37:01.801178 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:01.801101 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7db58356-2c8a-447c-85fb-28a24f10d285-configmap-serving-certs-ca-bundle\") pod \"7db58356-2c8a-447c-85fb-28a24f10d285\" (UID: \"7db58356-2c8a-447c-85fb-28a24f10d285\") " May 20 15:37:01.801178 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:01.801143 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7db58356-2c8a-447c-85fb-28a24f10d285-secret-metrics-client-certs\") pod \"7db58356-2c8a-447c-85fb-28a24f10d285\" (UID: \"7db58356-2c8a-447c-85fb-28a24f10d285\") " May 20 15:37:01.801178 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:01.801172 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7db58356-2c8a-447c-85fb-28a24f10d285-config-out\") pod \"7db58356-2c8a-447c-85fb-28a24f10d285\" (UID: \"7db58356-2c8a-447c-85fb-28a24f10d285\") " May 20 15:37:01.801417 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:01.801198 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7db58356-2c8a-447c-85fb-28a24f10d285-thanos-prometheus-http-client-file\") pod \"7db58356-2c8a-447c-85fb-28a24f10d285\" (UID: \"7db58356-2c8a-447c-85fb-28a24f10d285\") " May 20 15:37:01.801417 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:01.801225 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7db58356-2c8a-447c-85fb-28a24f10d285-prometheus-k8s-db\") pod \"7db58356-2c8a-447c-85fb-28a24f10d285\" (UID: \"7db58356-2c8a-447c-85fb-28a24f10d285\") " May 20 15:37:01.801417 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:01.801259 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7db58356-2c8a-447c-85fb-28a24f10d285-configmap-kubelet-serving-ca-bundle\") pod \"7db58356-2c8a-447c-85fb-28a24f10d285\" (UID: \"7db58356-2c8a-447c-85fb-28a24f10d285\") " May 20 15:37:01.801417 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:01.801293 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7db58356-2c8a-447c-85fb-28a24f10d285-configmap-metrics-client-ca\") pod \"7db58356-2c8a-447c-85fb-28a24f10d285\" (UID: \"7db58356-2c8a-447c-85fb-28a24f10d285\") " May 20 15:37:01.801610 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:01.801528 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7db58356-2c8a-447c-85fb-28a24f10d285-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "7db58356-2c8a-447c-85fb-28a24f10d285" (UID: "7db58356-2c8a-447c-85fb-28a24f10d285"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 20 15:37:01.801710 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:01.801684 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7db58356-2c8a-447c-85fb-28a24f10d285-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "7db58356-2c8a-447c-85fb-28a24f10d285" (UID: "7db58356-2c8a-447c-85fb-28a24f10d285"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 20 15:37:01.801768 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:01.801699 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7db58356-2c8a-447c-85fb-28a24f10d285-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "7db58356-2c8a-447c-85fb-28a24f10d285" (UID: "7db58356-2c8a-447c-85fb-28a24f10d285"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 20 15:37:01.801964 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:01.801866 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7db58356-2c8a-447c-85fb-28a24f10d285-config\") pod \"7db58356-2c8a-447c-85fb-28a24f10d285\" (UID: \"7db58356-2c8a-447c-85fb-28a24f10d285\") " May 20 15:37:01.802023 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:01.802001 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7db58356-2c8a-447c-85fb-28a24f10d285-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"7db58356-2c8a-447c-85fb-28a24f10d285\" (UID: \"7db58356-2c8a-447c-85fb-28a24f10d285\") " May 20 15:37:01.802078 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:01.802032 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7db58356-2c8a-447c-85fb-28a24f10d285-web-config\") pod \"7db58356-2c8a-447c-85fb-28a24f10d285\" (UID: \"7db58356-2c8a-447c-85fb-28a24f10d285\") " May 20 15:37:01.802078 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:01.802062 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7db58356-2c8a-447c-85fb-28a24f10d285-prometheus-trusted-ca-bundle\") pod \"7db58356-2c8a-447c-85fb-28a24f10d285\" (UID: \"7db58356-2c8a-447c-85fb-28a24f10d285\") " May 20 15:37:01.802175 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:01.802091 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7db58356-2c8a-447c-85fb-28a24f10d285-prometheus-k8s-rulefiles-0\") pod \"7db58356-2c8a-447c-85fb-28a24f10d285\" (UID: \"7db58356-2c8a-447c-85fb-28a24f10d285\") " May 20 15:37:01.802175 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:01.802125 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7db58356-2c8a-447c-85fb-28a24f10d285-tls-assets\") pod \"7db58356-2c8a-447c-85fb-28a24f10d285\" (UID: \"7db58356-2c8a-447c-85fb-28a24f10d285\") " May 20 15:37:01.802175 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:01.802157 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7db58356-2c8a-447c-85fb-28a24f10d285-secret-prometheus-k8s-tls\") pod \"7db58356-2c8a-447c-85fb-28a24f10d285\" (UID: \"7db58356-2c8a-447c-85fb-28a24f10d285\") " May 20 15:37:01.802318 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:01.802188 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7db58356-2c8a-447c-85fb-28a24f10d285-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"7db58356-2c8a-447c-85fb-28a24f10d285\" (UID: \"7db58356-2c8a-447c-85fb-28a24f10d285\") " May 20 15:37:01.802318 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:01.802228 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7db58356-2c8a-447c-85fb-28a24f10d285-secret-kube-rbac-proxy\") pod \"7db58356-2c8a-447c-85fb-28a24f10d285\" (UID: \"7db58356-2c8a-447c-85fb-28a24f10d285\") " May 20 15:37:01.802318 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:01.802257 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7db58356-2c8a-447c-85fb-28a24f10d285-secret-grpc-tls\") pod \"7db58356-2c8a-447c-85fb-28a24f10d285\" (UID: \"7db58356-2c8a-447c-85fb-28a24f10d285\") " May 20 15:37:01.802318 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:01.802291 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r7hlq\" (UniqueName: \"kubernetes.io/projected/7db58356-2c8a-447c-85fb-28a24f10d285-kube-api-access-r7hlq\") pod \"7db58356-2c8a-447c-85fb-28a24f10d285\" (UID: \"7db58356-2c8a-447c-85fb-28a24f10d285\") " May 20 15:37:01.803022 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:01.802533 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7db58356-2c8a-447c-85fb-28a24f10d285-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "7db58356-2c8a-447c-85fb-28a24f10d285" (UID: "7db58356-2c8a-447c-85fb-28a24f10d285"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 20 15:37:01.803022 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:01.802573 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7db58356-2c8a-447c-85fb-28a24f10d285-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "7db58356-2c8a-447c-85fb-28a24f10d285" (UID: "7db58356-2c8a-447c-85fb-28a24f10d285"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 20 15:37:01.803022 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:01.802630 2557 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7db58356-2c8a-447c-85fb-28a24f10d285-prometheus-k8s-db\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" May 20 15:37:01.803022 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:01.802650 2557 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7db58356-2c8a-447c-85fb-28a24f10d285-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" May 20 15:37:01.803022 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:01.802667 2557 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7db58356-2c8a-447c-85fb-28a24f10d285-configmap-metrics-client-ca\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" May 20 15:37:01.803022 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:01.802681 2557 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7db58356-2c8a-447c-85fb-28a24f10d285-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" May 20 15:37:01.804064 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:01.804004 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7db58356-2c8a-447c-85fb-28a24f10d285-config-out" (OuterVolumeSpecName: "config-out") pod "7db58356-2c8a-447c-85fb-28a24f10d285" (UID: "7db58356-2c8a-447c-85fb-28a24f10d285"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 20 15:37:01.804682 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:01.804585 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7db58356-2c8a-447c-85fb-28a24f10d285-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "7db58356-2c8a-447c-85fb-28a24f10d285" (UID: "7db58356-2c8a-447c-85fb-28a24f10d285"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 20 15:37:01.804682 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:01.804653 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7db58356-2c8a-447c-85fb-28a24f10d285-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "7db58356-2c8a-447c-85fb-28a24f10d285" (UID: "7db58356-2c8a-447c-85fb-28a24f10d285"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 15:37:01.804878 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:01.804684 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7db58356-2c8a-447c-85fb-28a24f10d285-config" (OuterVolumeSpecName: "config") pod "7db58356-2c8a-447c-85fb-28a24f10d285" (UID: "7db58356-2c8a-447c-85fb-28a24f10d285"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 15:37:01.805056 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:01.805006 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7db58356-2c8a-447c-85fb-28a24f10d285-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "7db58356-2c8a-447c-85fb-28a24f10d285" (UID: "7db58356-2c8a-447c-85fb-28a24f10d285"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 15:37:01.805806 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:01.805757 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7db58356-2c8a-447c-85fb-28a24f10d285-kube-api-access-r7hlq" (OuterVolumeSpecName: "kube-api-access-r7hlq") pod "7db58356-2c8a-447c-85fb-28a24f10d285" (UID: "7db58356-2c8a-447c-85fb-28a24f10d285"). InnerVolumeSpecName "kube-api-access-r7hlq". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 15:37:01.805932 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:01.805893 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7db58356-2c8a-447c-85fb-28a24f10d285-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "7db58356-2c8a-447c-85fb-28a24f10d285" (UID: "7db58356-2c8a-447c-85fb-28a24f10d285"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 15:37:01.806055 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:01.805990 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7db58356-2c8a-447c-85fb-28a24f10d285-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "7db58356-2c8a-447c-85fb-28a24f10d285" (UID: "7db58356-2c8a-447c-85fb-28a24f10d285"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 15:37:01.806388 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:01.806364 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7db58356-2c8a-447c-85fb-28a24f10d285-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "7db58356-2c8a-447c-85fb-28a24f10d285" (UID: "7db58356-2c8a-447c-85fb-28a24f10d285"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 15:37:01.806501 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:01.806384 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7db58356-2c8a-447c-85fb-28a24f10d285-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "7db58356-2c8a-447c-85fb-28a24f10d285" (UID: "7db58356-2c8a-447c-85fb-28a24f10d285"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 15:37:01.806646 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:01.806630 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7db58356-2c8a-447c-85fb-28a24f10d285-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "7db58356-2c8a-447c-85fb-28a24f10d285" (UID: "7db58356-2c8a-447c-85fb-28a24f10d285"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 15:37:01.807058 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:01.807038 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7db58356-2c8a-447c-85fb-28a24f10d285-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "7db58356-2c8a-447c-85fb-28a24f10d285" (UID: "7db58356-2c8a-447c-85fb-28a24f10d285"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 15:37:01.817293 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:01.817272 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7db58356-2c8a-447c-85fb-28a24f10d285-web-config" (OuterVolumeSpecName: "web-config") pod "7db58356-2c8a-447c-85fb-28a24f10d285" (UID: "7db58356-2c8a-447c-85fb-28a24f10d285"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 15:37:01.903934 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:01.903910 2557 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7db58356-2c8a-447c-85fb-28a24f10d285-secret-metrics-client-certs\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" May 20 15:37:01.903934 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:01.903931 2557 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7db58356-2c8a-447c-85fb-28a24f10d285-config-out\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" May 20 15:37:01.904058 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:01.903942 2557 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7db58356-2c8a-447c-85fb-28a24f10d285-thanos-prometheus-http-client-file\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" May 20 15:37:01.904058 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:01.903951 2557 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/7db58356-2c8a-447c-85fb-28a24f10d285-config\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" May 20 15:37:01.904058 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:01.903962 2557 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7db58356-2c8a-447c-85fb-28a24f10d285-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" May 20 15:37:01.904058 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:01.903972 2557 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7db58356-2c8a-447c-85fb-28a24f10d285-web-config\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" May 20 15:37:01.904058 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:01.903981 2557 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7db58356-2c8a-447c-85fb-28a24f10d285-prometheus-trusted-ca-bundle\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" May 20 15:37:01.904058 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:01.903989 2557 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7db58356-2c8a-447c-85fb-28a24f10d285-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" May 20 15:37:01.904058 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:01.903998 2557 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7db58356-2c8a-447c-85fb-28a24f10d285-tls-assets\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" May 20 15:37:01.904058 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:01.904006 2557 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7db58356-2c8a-447c-85fb-28a24f10d285-secret-prometheus-k8s-tls\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" May 20 15:37:01.904058 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:01.904016 2557 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7db58356-2c8a-447c-85fb-28a24f10d285-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" May 20 15:37:01.904058 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:01.904025 2557 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7db58356-2c8a-447c-85fb-28a24f10d285-secret-kube-rbac-proxy\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" May 20 15:37:01.904058 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:01.904032 2557 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7db58356-2c8a-447c-85fb-28a24f10d285-secret-grpc-tls\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" May 20 15:37:01.904058 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:01.904041 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r7hlq\" (UniqueName: \"kubernetes.io/projected/7db58356-2c8a-447c-85fb-28a24f10d285-kube-api-access-r7hlq\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" May 20 15:37:02.255796 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.255760 2557 generic.go:358] "Generic (PLEG): container finished" podID="7db58356-2c8a-447c-85fb-28a24f10d285" containerID="6248bab6aa5dd9a44db401478bf3ea133c6d8abd83cd36aff5a102f4e990304b" exitCode=0 May 20 15:37:02.256189 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.255846 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7db58356-2c8a-447c-85fb-28a24f10d285","Type":"ContainerDied","Data":"6248bab6aa5dd9a44db401478bf3ea133c6d8abd83cd36aff5a102f4e990304b"} May 20 15:37:02.256189 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.255889 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7db58356-2c8a-447c-85fb-28a24f10d285","Type":"ContainerDied","Data":"de73cb4e66aa77fcbc309b1820e6135893060920848ca2b0eb105699ed5aa815"} May 20 15:37:02.256189 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.255908 2557 scope.go:117] "RemoveContainer" containerID="5edc328e3af87ae8f5428c3520b91aa9bfd74b5ef5253b200c25cfb94b2aa03c" May 20 15:37:02.256189 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.255920 2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 20 15:37:02.257903 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.257877 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wszj2" event={"ID":"54872a9c-6091-4768-8cd9-e81ab987ba01","Type":"ContainerStarted","Data":"b25b632def625d23aa8468daabbb4a8b4260502f88e0c6310954bd5e9752ffa9"} May 20 15:37:02.258012 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.257912 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wszj2" event={"ID":"54872a9c-6091-4768-8cd9-e81ab987ba01","Type":"ContainerStarted","Data":"894f33cff615e47b8fd127c1cd9770655834a7748f00721e9cb7b4a737b4b456"} May 20 15:37:02.264871 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.264742 2557 scope.go:117] "RemoveContainer" containerID="5ddf8aba83b1bcf706ea6fdce514984e5a99950cfae99fd900e492bf2f799342" May 20 15:37:02.272786 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.272770 2557 scope.go:117] "RemoveContainer" containerID="6248bab6aa5dd9a44db401478bf3ea133c6d8abd83cd36aff5a102f4e990304b" May 20 15:37:02.279298 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.279284 2557 scope.go:117] "RemoveContainer" containerID="afc9f693f078a682b2570209435d6b5af179daf2b1f8c35e8fbcfa8ae47d5124" May 20 15:37:02.285015 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.282247 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-wszj2" podStartSLOduration=252.136096563 podStartE2EDuration="4m13.282232492s" podCreationTimestamp="2026-05-20 15:32:49 +0000 UTC" firstStartedPulling="2026-05-20 15:37:00.365454597 +0000 UTC m=+251.580377370" lastFinishedPulling="2026-05-20 15:37:01.51159051 +0000 UTC m=+252.726513299" observedRunningTime="2026-05-20 15:37:02.280312755 +0000 UTC m=+253.495235550" watchObservedRunningTime="2026-05-20 15:37:02.282232492 +0000 UTC m=+253.497155286" May 20 15:37:02.290848 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.290829 2557 scope.go:117] "RemoveContainer" containerID="59851b6c310fe208ee6ea7c0f8d851f494262118ba79206725488d566c77d3b2" May 20 15:37:02.297148 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.297118 2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 20 15:37:02.298500 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.298482 2557 scope.go:117] "RemoveContainer" containerID="03c6fe9a43183f6e1da4ca69204090466c5b7f1af15d6bd4ae5a37692e1ca8f1" May 20 15:37:02.299582 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.299517 2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 20 15:37:02.305293 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.305278 2557 scope.go:117] "RemoveContainer" containerID="3fab75b344502b651bd95d7323ec1d8964a753fa1c914b0ef81cfea4bc8b3d3e" May 20 15:37:02.311781 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.311767 2557 scope.go:117] "RemoveContainer" containerID="5edc328e3af87ae8f5428c3520b91aa9bfd74b5ef5253b200c25cfb94b2aa03c" May 20 15:37:02.312008 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:37:02.311991 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5edc328e3af87ae8f5428c3520b91aa9bfd74b5ef5253b200c25cfb94b2aa03c\": container with ID starting with 5edc328e3af87ae8f5428c3520b91aa9bfd74b5ef5253b200c25cfb94b2aa03c not found: ID does not exist" containerID="5edc328e3af87ae8f5428c3520b91aa9bfd74b5ef5253b200c25cfb94b2aa03c" May 20 15:37:02.312078 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.312016 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5edc328e3af87ae8f5428c3520b91aa9bfd74b5ef5253b200c25cfb94b2aa03c"} err="failed to get container status \"5edc328e3af87ae8f5428c3520b91aa9bfd74b5ef5253b200c25cfb94b2aa03c\": rpc error: code = NotFound desc = could not find container \"5edc328e3af87ae8f5428c3520b91aa9bfd74b5ef5253b200c25cfb94b2aa03c\": container with ID starting with 5edc328e3af87ae8f5428c3520b91aa9bfd74b5ef5253b200c25cfb94b2aa03c not found: ID does not exist" May 20 15:37:02.312078 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.312032 2557 scope.go:117] "RemoveContainer" containerID="5ddf8aba83b1bcf706ea6fdce514984e5a99950cfae99fd900e492bf2f799342" May 20 15:37:02.312280 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:37:02.312263 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ddf8aba83b1bcf706ea6fdce514984e5a99950cfae99fd900e492bf2f799342\": container with ID starting with 5ddf8aba83b1bcf706ea6fdce514984e5a99950cfae99fd900e492bf2f799342 not found: ID does not exist" containerID="5ddf8aba83b1bcf706ea6fdce514984e5a99950cfae99fd900e492bf2f799342" May 20 15:37:02.312342 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.312288 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ddf8aba83b1bcf706ea6fdce514984e5a99950cfae99fd900e492bf2f799342"} err="failed to get container status \"5ddf8aba83b1bcf706ea6fdce514984e5a99950cfae99fd900e492bf2f799342\": rpc error: code = NotFound desc = could not find container \"5ddf8aba83b1bcf706ea6fdce514984e5a99950cfae99fd900e492bf2f799342\": container with ID starting with 5ddf8aba83b1bcf706ea6fdce514984e5a99950cfae99fd900e492bf2f799342 not found: ID does not exist" May 20 15:37:02.312342 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.312311 2557 scope.go:117] "RemoveContainer" containerID="6248bab6aa5dd9a44db401478bf3ea133c6d8abd83cd36aff5a102f4e990304b" May 20 15:37:02.312522 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:37:02.312508 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6248bab6aa5dd9a44db401478bf3ea133c6d8abd83cd36aff5a102f4e990304b\": container with ID starting with 6248bab6aa5dd9a44db401478bf3ea133c6d8abd83cd36aff5a102f4e990304b not found: ID does not exist" containerID="6248bab6aa5dd9a44db401478bf3ea133c6d8abd83cd36aff5a102f4e990304b" May 20 15:37:02.312564 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.312525 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6248bab6aa5dd9a44db401478bf3ea133c6d8abd83cd36aff5a102f4e990304b"} err="failed to get container status \"6248bab6aa5dd9a44db401478bf3ea133c6d8abd83cd36aff5a102f4e990304b\": rpc error: code = NotFound desc = could not find container \"6248bab6aa5dd9a44db401478bf3ea133c6d8abd83cd36aff5a102f4e990304b\": container with ID starting with 6248bab6aa5dd9a44db401478bf3ea133c6d8abd83cd36aff5a102f4e990304b not found: ID does not exist" May 20 15:37:02.312564 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.312538 2557 scope.go:117] "RemoveContainer" containerID="afc9f693f078a682b2570209435d6b5af179daf2b1f8c35e8fbcfa8ae47d5124" May 20 15:37:02.312732 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:37:02.312715 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"afc9f693f078a682b2570209435d6b5af179daf2b1f8c35e8fbcfa8ae47d5124\": container with ID starting with afc9f693f078a682b2570209435d6b5af179daf2b1f8c35e8fbcfa8ae47d5124 not found: ID does not exist" containerID="afc9f693f078a682b2570209435d6b5af179daf2b1f8c35e8fbcfa8ae47d5124" May 20 15:37:02.312795 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.312741 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afc9f693f078a682b2570209435d6b5af179daf2b1f8c35e8fbcfa8ae47d5124"} err="failed to get container status \"afc9f693f078a682b2570209435d6b5af179daf2b1f8c35e8fbcfa8ae47d5124\": rpc error: code = NotFound desc = could not find container \"afc9f693f078a682b2570209435d6b5af179daf2b1f8c35e8fbcfa8ae47d5124\": container with ID starting with afc9f693f078a682b2570209435d6b5af179daf2b1f8c35e8fbcfa8ae47d5124 not found: ID does not exist" May 20 15:37:02.312795 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.312761 2557 scope.go:117] "RemoveContainer" containerID="59851b6c310fe208ee6ea7c0f8d851f494262118ba79206725488d566c77d3b2" May 20 15:37:02.313003 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:37:02.312981 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59851b6c310fe208ee6ea7c0f8d851f494262118ba79206725488d566c77d3b2\": container with ID starting with 59851b6c310fe208ee6ea7c0f8d851f494262118ba79206725488d566c77d3b2 not found: ID does not exist" containerID="59851b6c310fe208ee6ea7c0f8d851f494262118ba79206725488d566c77d3b2" May 20 15:37:02.313042 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.313010 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59851b6c310fe208ee6ea7c0f8d851f494262118ba79206725488d566c77d3b2"} err="failed to get container status \"59851b6c310fe208ee6ea7c0f8d851f494262118ba79206725488d566c77d3b2\": rpc error: code = NotFound desc = could not find container \"59851b6c310fe208ee6ea7c0f8d851f494262118ba79206725488d566c77d3b2\": container with ID starting with 59851b6c310fe208ee6ea7c0f8d851f494262118ba79206725488d566c77d3b2 not found: ID does not exist" May 20 15:37:02.313042 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.313035 2557 scope.go:117] "RemoveContainer" containerID="03c6fe9a43183f6e1da4ca69204090466c5b7f1af15d6bd4ae5a37692e1ca8f1" May 20 15:37:02.313250 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:37:02.313235 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03c6fe9a43183f6e1da4ca69204090466c5b7f1af15d6bd4ae5a37692e1ca8f1\": container with ID starting with 03c6fe9a43183f6e1da4ca69204090466c5b7f1af15d6bd4ae5a37692e1ca8f1 not found: ID does not exist" containerID="03c6fe9a43183f6e1da4ca69204090466c5b7f1af15d6bd4ae5a37692e1ca8f1" May 20 15:37:02.313299 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.313253 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03c6fe9a43183f6e1da4ca69204090466c5b7f1af15d6bd4ae5a37692e1ca8f1"} err="failed to get container status \"03c6fe9a43183f6e1da4ca69204090466c5b7f1af15d6bd4ae5a37692e1ca8f1\": rpc error: code = NotFound desc = could not find container \"03c6fe9a43183f6e1da4ca69204090466c5b7f1af15d6bd4ae5a37692e1ca8f1\": container with ID starting with 03c6fe9a43183f6e1da4ca69204090466c5b7f1af15d6bd4ae5a37692e1ca8f1 not found: ID does not exist" May 20 15:37:02.313299 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.313265 2557 scope.go:117] "RemoveContainer" containerID="3fab75b344502b651bd95d7323ec1d8964a753fa1c914b0ef81cfea4bc8b3d3e" May 20 15:37:02.313464 ip-10-0-130-228 kubenswrapper[2557]: E0520 15:37:02.313449 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3fab75b344502b651bd95d7323ec1d8964a753fa1c914b0ef81cfea4bc8b3d3e\": container with ID starting with 3fab75b344502b651bd95d7323ec1d8964a753fa1c914b0ef81cfea4bc8b3d3e not found: ID does not exist" containerID="3fab75b344502b651bd95d7323ec1d8964a753fa1c914b0ef81cfea4bc8b3d3e" May 20 15:37:02.313500 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.313467 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fab75b344502b651bd95d7323ec1d8964a753fa1c914b0ef81cfea4bc8b3d3e"} err="failed to get container status \"3fab75b344502b651bd95d7323ec1d8964a753fa1c914b0ef81cfea4bc8b3d3e\": rpc error: code = NotFound desc = could not find container \"3fab75b344502b651bd95d7323ec1d8964a753fa1c914b0ef81cfea4bc8b3d3e\": container with ID starting with 3fab75b344502b651bd95d7323ec1d8964a753fa1c914b0ef81cfea4bc8b3d3e not found: ID does not exist" May 20 15:37:02.330458 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.330438 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 20 15:37:02.330871 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.330852 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7db58356-2c8a-447c-85fb-28a24f10d285" containerName="kube-rbac-proxy" May 20 15:37:02.330996 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.330874 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="7db58356-2c8a-447c-85fb-28a24f10d285" containerName="kube-rbac-proxy" May 20 15:37:02.330996 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.330884 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7db58356-2c8a-447c-85fb-28a24f10d285" containerName="thanos-sidecar" May 20 15:37:02.330996 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.330889 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="7db58356-2c8a-447c-85fb-28a24f10d285" containerName="thanos-sidecar" May 20 15:37:02.330996 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.330899 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7db58356-2c8a-447c-85fb-28a24f10d285" containerName="kube-rbac-proxy-web" May 20 15:37:02.330996 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.330904 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="7db58356-2c8a-447c-85fb-28a24f10d285" containerName="kube-rbac-proxy-web" May 20 15:37:02.330996 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.330912 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7db58356-2c8a-447c-85fb-28a24f10d285" containerName="init-config-reloader" May 20 15:37:02.330996 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.330917 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="7db58356-2c8a-447c-85fb-28a24f10d285" containerName="init-config-reloader" May 20 15:37:02.330996 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.330922 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7db58356-2c8a-447c-85fb-28a24f10d285" containerName="config-reloader" May 20 15:37:02.330996 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.330927 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="7db58356-2c8a-447c-85fb-28a24f10d285" containerName="config-reloader" May 20 15:37:02.330996 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.330934 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7db58356-2c8a-447c-85fb-28a24f10d285" containerName="prometheus" May 20 15:37:02.330996 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.330939 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="7db58356-2c8a-447c-85fb-28a24f10d285" containerName="prometheus" May 20 15:37:02.330996 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.330950 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7db58356-2c8a-447c-85fb-28a24f10d285" containerName="kube-rbac-proxy-thanos" May 20 15:37:02.330996 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.330955 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="7db58356-2c8a-447c-85fb-28a24f10d285" containerName="kube-rbac-proxy-thanos" May 20 15:37:02.330996 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.331002 2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="7db58356-2c8a-447c-85fb-28a24f10d285" containerName="prometheus" May 20 15:37:02.331456 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.331010 2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="7db58356-2c8a-447c-85fb-28a24f10d285" containerName="config-reloader" May 20 15:37:02.331456 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.331018 2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="7db58356-2c8a-447c-85fb-28a24f10d285" containerName="kube-rbac-proxy-thanos" May 20 15:37:02.331456 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.331027 2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="7db58356-2c8a-447c-85fb-28a24f10d285" containerName="thanos-sidecar" May 20 15:37:02.331456 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.331033 2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="7db58356-2c8a-447c-85fb-28a24f10d285" containerName="kube-rbac-proxy-web" May 20 15:37:02.331456 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.331040 2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="7db58356-2c8a-447c-85fb-28a24f10d285" containerName="kube-rbac-proxy" May 20 15:37:02.336495 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.336476 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 20 15:37:02.338753 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.338733 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 20 15:37:02.338862 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.338839 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 20 15:37:02.338958 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.338940 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 20 15:37:02.339066 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.339049 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 20 15:37:02.339163 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.339149 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 20 15:37:02.339231 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.339181 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 20 15:37:02.339231 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.339198 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 20 15:37:02.339381 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.339362 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 20 15:37:02.339438 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.339384 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-5c6b7\"" May 20 15:37:02.339492 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.339470 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 20 15:37:02.339629 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.339611 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 20 15:37:02.339683 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.339652 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-ak78t0k1gr017\"" May 20 15:37:02.339744 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.339690 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" May 20 15:37:02.342271 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.342223 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 20 15:37:02.345912 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.345896 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 20 15:37:02.348734 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.348714 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 20 15:37:02.407868 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.407841 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f3d2a37e-2df4-4eeb-ab02-1d9e286449ab-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f3d2a37e-2df4-4eeb-ab02-1d9e286449ab\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:37:02.407962 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.407874 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f3d2a37e-2df4-4eeb-ab02-1d9e286449ab-web-config\") pod \"prometheus-k8s-0\" (UID: \"f3d2a37e-2df4-4eeb-ab02-1d9e286449ab\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:37:02.407962 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.407893 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f3d2a37e-2df4-4eeb-ab02-1d9e286449ab-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f3d2a37e-2df4-4eeb-ab02-1d9e286449ab\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:37:02.407962 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.407925 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f3d2a37e-2df4-4eeb-ab02-1d9e286449ab-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f3d2a37e-2df4-4eeb-ab02-1d9e286449ab\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:37:02.407962 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.407949 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f3d2a37e-2df4-4eeb-ab02-1d9e286449ab-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f3d2a37e-2df4-4eeb-ab02-1d9e286449ab\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:37:02.408116 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.407978 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3d2a37e-2df4-4eeb-ab02-1d9e286449ab-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3d2a37e-2df4-4eeb-ab02-1d9e286449ab\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:37:02.408116 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.408015 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f3d2a37e-2df4-4eeb-ab02-1d9e286449ab-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f3d2a37e-2df4-4eeb-ab02-1d9e286449ab\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:37:02.408116 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.408035 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f3d2a37e-2df4-4eeb-ab02-1d9e286449ab-config\") pod \"prometheus-k8s-0\" (UID: \"f3d2a37e-2df4-4eeb-ab02-1d9e286449ab\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:37:02.408116 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.408071 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6sns\" (UniqueName: \"kubernetes.io/projected/f3d2a37e-2df4-4eeb-ab02-1d9e286449ab-kube-api-access-p6sns\") pod \"prometheus-k8s-0\" (UID: \"f3d2a37e-2df4-4eeb-ab02-1d9e286449ab\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:37:02.408116 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.408097 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f3d2a37e-2df4-4eeb-ab02-1d9e286449ab-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f3d2a37e-2df4-4eeb-ab02-1d9e286449ab\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:37:02.408313 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.408168 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3d2a37e-2df4-4eeb-ab02-1d9e286449ab-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3d2a37e-2df4-4eeb-ab02-1d9e286449ab\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:37:02.408313 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.408207 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f3d2a37e-2df4-4eeb-ab02-1d9e286449ab-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f3d2a37e-2df4-4eeb-ab02-1d9e286449ab\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:37:02.408313 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.408226 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f3d2a37e-2df4-4eeb-ab02-1d9e286449ab-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f3d2a37e-2df4-4eeb-ab02-1d9e286449ab\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:37:02.408313 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.408245 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f3d2a37e-2df4-4eeb-ab02-1d9e286449ab-config-out\") pod \"prometheus-k8s-0\" (UID: \"f3d2a37e-2df4-4eeb-ab02-1d9e286449ab\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:37:02.408313 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.408281 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f3d2a37e-2df4-4eeb-ab02-1d9e286449ab-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f3d2a37e-2df4-4eeb-ab02-1d9e286449ab\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:37:02.408460 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.408381 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3d2a37e-2df4-4eeb-ab02-1d9e286449ab-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3d2a37e-2df4-4eeb-ab02-1d9e286449ab\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:37:02.408460 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.408420 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f3d2a37e-2df4-4eeb-ab02-1d9e286449ab-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f3d2a37e-2df4-4eeb-ab02-1d9e286449ab\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:37:02.408517 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.408468 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f3d2a37e-2df4-4eeb-ab02-1d9e286449ab-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f3d2a37e-2df4-4eeb-ab02-1d9e286449ab\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:37:02.509503 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.509474 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p6sns\" (UniqueName: \"kubernetes.io/projected/f3d2a37e-2df4-4eeb-ab02-1d9e286449ab-kube-api-access-p6sns\") pod \"prometheus-k8s-0\" (UID: \"f3d2a37e-2df4-4eeb-ab02-1d9e286449ab\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:37:02.509639 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.509510 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f3d2a37e-2df4-4eeb-ab02-1d9e286449ab-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f3d2a37e-2df4-4eeb-ab02-1d9e286449ab\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:37:02.509639 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.509539 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3d2a37e-2df4-4eeb-ab02-1d9e286449ab-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3d2a37e-2df4-4eeb-ab02-1d9e286449ab\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:37:02.509639 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.509569 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f3d2a37e-2df4-4eeb-ab02-1d9e286449ab-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f3d2a37e-2df4-4eeb-ab02-1d9e286449ab\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:37:02.509639 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.509594 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f3d2a37e-2df4-4eeb-ab02-1d9e286449ab-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f3d2a37e-2df4-4eeb-ab02-1d9e286449ab\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:37:02.509639 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.509619 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f3d2a37e-2df4-4eeb-ab02-1d9e286449ab-config-out\") pod \"prometheus-k8s-0\" (UID: \"f3d2a37e-2df4-4eeb-ab02-1d9e286449ab\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:37:02.509926 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.509645 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f3d2a37e-2df4-4eeb-ab02-1d9e286449ab-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f3d2a37e-2df4-4eeb-ab02-1d9e286449ab\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:37:02.509926 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.509778 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3d2a37e-2df4-4eeb-ab02-1d9e286449ab-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3d2a37e-2df4-4eeb-ab02-1d9e286449ab\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:37:02.509926 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.509863 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f3d2a37e-2df4-4eeb-ab02-1d9e286449ab-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f3d2a37e-2df4-4eeb-ab02-1d9e286449ab\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:37:02.509926 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.509902 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f3d2a37e-2df4-4eeb-ab02-1d9e286449ab-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f3d2a37e-2df4-4eeb-ab02-1d9e286449ab\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:37:02.510110 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.509949 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f3d2a37e-2df4-4eeb-ab02-1d9e286449ab-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f3d2a37e-2df4-4eeb-ab02-1d9e286449ab\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:37:02.510110 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.509987 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f3d2a37e-2df4-4eeb-ab02-1d9e286449ab-web-config\") pod \"prometheus-k8s-0\" (UID: \"f3d2a37e-2df4-4eeb-ab02-1d9e286449ab\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:37:02.510110 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.510029 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f3d2a37e-2df4-4eeb-ab02-1d9e286449ab-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f3d2a37e-2df4-4eeb-ab02-1d9e286449ab\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:37:02.510110 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.510078 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f3d2a37e-2df4-4eeb-ab02-1d9e286449ab-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f3d2a37e-2df4-4eeb-ab02-1d9e286449ab\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:37:02.510110 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.510100 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f3d2a37e-2df4-4eeb-ab02-1d9e286449ab-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f3d2a37e-2df4-4eeb-ab02-1d9e286449ab\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:37:02.510361 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.510127 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3d2a37e-2df4-4eeb-ab02-1d9e286449ab-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3d2a37e-2df4-4eeb-ab02-1d9e286449ab\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:37:02.510361 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.510148 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f3d2a37e-2df4-4eeb-ab02-1d9e286449ab-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f3d2a37e-2df4-4eeb-ab02-1d9e286449ab\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:37:02.510361 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.510343 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f3d2a37e-2df4-4eeb-ab02-1d9e286449ab-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f3d2a37e-2df4-4eeb-ab02-1d9e286449ab\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:37:02.510516 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.510343 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3d2a37e-2df4-4eeb-ab02-1d9e286449ab-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3d2a37e-2df4-4eeb-ab02-1d9e286449ab\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:37:02.510571 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.510505 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3d2a37e-2df4-4eeb-ab02-1d9e286449ab-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3d2a37e-2df4-4eeb-ab02-1d9e286449ab\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:37:02.510733 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.510154 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f3d2a37e-2df4-4eeb-ab02-1d9e286449ab-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f3d2a37e-2df4-4eeb-ab02-1d9e286449ab\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:37:02.510733 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.510707 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f3d2a37e-2df4-4eeb-ab02-1d9e286449ab-config\") pod \"prometheus-k8s-0\" (UID: \"f3d2a37e-2df4-4eeb-ab02-1d9e286449ab\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:37:02.513237 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.512940 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f3d2a37e-2df4-4eeb-ab02-1d9e286449ab-config-out\") pod \"prometheus-k8s-0\" (UID: \"f3d2a37e-2df4-4eeb-ab02-1d9e286449ab\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:37:02.513237 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.512993 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f3d2a37e-2df4-4eeb-ab02-1d9e286449ab-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f3d2a37e-2df4-4eeb-ab02-1d9e286449ab\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:37:02.513395 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.513341 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f3d2a37e-2df4-4eeb-ab02-1d9e286449ab-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f3d2a37e-2df4-4eeb-ab02-1d9e286449ab\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:37:02.513457 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.513413 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f3d2a37e-2df4-4eeb-ab02-1d9e286449ab-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f3d2a37e-2df4-4eeb-ab02-1d9e286449ab\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:37:02.513513 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.513493 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f3d2a37e-2df4-4eeb-ab02-1d9e286449ab-web-config\") pod \"prometheus-k8s-0\" (UID: \"f3d2a37e-2df4-4eeb-ab02-1d9e286449ab\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:37:02.513828 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.513754 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/f3d2a37e-2df4-4eeb-ab02-1d9e286449ab-config\") pod \"prometheus-k8s-0\" (UID: \"f3d2a37e-2df4-4eeb-ab02-1d9e286449ab\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:37:02.513936 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.513881 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f3d2a37e-2df4-4eeb-ab02-1d9e286449ab-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f3d2a37e-2df4-4eeb-ab02-1d9e286449ab\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:37:02.514003 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.513940 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f3d2a37e-2df4-4eeb-ab02-1d9e286449ab-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f3d2a37e-2df4-4eeb-ab02-1d9e286449ab\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:37:02.514613 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.514585 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3d2a37e-2df4-4eeb-ab02-1d9e286449ab-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3d2a37e-2df4-4eeb-ab02-1d9e286449ab\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:37:02.515727 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.515710 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f3d2a37e-2df4-4eeb-ab02-1d9e286449ab-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f3d2a37e-2df4-4eeb-ab02-1d9e286449ab\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:37:02.515727 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.515717 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f3d2a37e-2df4-4eeb-ab02-1d9e286449ab-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f3d2a37e-2df4-4eeb-ab02-1d9e286449ab\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:37:02.516174 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.516155 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f3d2a37e-2df4-4eeb-ab02-1d9e286449ab-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f3d2a37e-2df4-4eeb-ab02-1d9e286449ab\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:37:02.516395 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.516380 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f3d2a37e-2df4-4eeb-ab02-1d9e286449ab-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f3d2a37e-2df4-4eeb-ab02-1d9e286449ab\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:37:02.518859 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.518835 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6sns\" (UniqueName: \"kubernetes.io/projected/f3d2a37e-2df4-4eeb-ab02-1d9e286449ab-kube-api-access-p6sns\") pod \"prometheus-k8s-0\" (UID: \"f3d2a37e-2df4-4eeb-ab02-1d9e286449ab\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 15:37:02.647411 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.647315 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 20 15:37:02.781431 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:02.781319 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 20 15:37:02.784046 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:37:02.784017 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3d2a37e_2df4_4eeb_ab02_1d9e286449ab.slice/crio-3eafe43992f7734e7b6c0bb020b766746c9c3c87b345b62157acd411eb39eda5 WatchSource:0}: Error finding container 3eafe43992f7734e7b6c0bb020b766746c9c3c87b345b62157acd411eb39eda5: Status 404 returned error can't find the container with id 3eafe43992f7734e7b6c0bb020b766746c9c3c87b345b62157acd411eb39eda5 May 20 15:37:03.262302 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:03.262260 2557 generic.go:358] "Generic (PLEG): container finished" podID="f3d2a37e-2df4-4eeb-ab02-1d9e286449ab" containerID="9fd1967be918811cfbd17c2c215fbe29014fb5e5e78d6c9f5a7d8c48c2c7e7e6" exitCode=0 May 20 15:37:03.262636 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:03.262355 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3d2a37e-2df4-4eeb-ab02-1d9e286449ab","Type":"ContainerDied","Data":"9fd1967be918811cfbd17c2c215fbe29014fb5e5e78d6c9f5a7d8c48c2c7e7e6"} May 20 15:37:03.262636 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:03.262386 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3d2a37e-2df4-4eeb-ab02-1d9e286449ab","Type":"ContainerStarted","Data":"3eafe43992f7734e7b6c0bb020b766746c9c3c87b345b62157acd411eb39eda5"} May 20 15:37:03.384262 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:03.384223 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7db58356-2c8a-447c-85fb-28a24f10d285" path="/var/lib/kubelet/pods/7db58356-2c8a-447c-85fb-28a24f10d285/volumes" May 20 15:37:04.268538 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:04.268504 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3d2a37e-2df4-4eeb-ab02-1d9e286449ab","Type":"ContainerStarted","Data":"682b54db64597e26f2ded8010f8aabf9e7b9ae6e8b8a46c6a13913e71c8a6f12"} May 20 15:37:04.268538 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:04.268541 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3d2a37e-2df4-4eeb-ab02-1d9e286449ab","Type":"ContainerStarted","Data":"04ac742659423d3399fa27644f6618363b8e7e100b2c44ecb73a19709696e37f"} May 20 15:37:04.268977 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:04.268552 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3d2a37e-2df4-4eeb-ab02-1d9e286449ab","Type":"ContainerStarted","Data":"92798e6d3c88d36217e7e6220ae152f75246487901821613de8706dfa3358c7c"} May 20 15:37:04.268977 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:04.268560 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3d2a37e-2df4-4eeb-ab02-1d9e286449ab","Type":"ContainerStarted","Data":"255ba8677b3fc835795fb1cf92e6eb260b3b7764c0b06da24720d7f82d20cc6f"} May 20 15:37:04.268977 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:04.268568 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3d2a37e-2df4-4eeb-ab02-1d9e286449ab","Type":"ContainerStarted","Data":"9408e5450ec701a389c0f2f2d88fab91a21923ede219e5b86635fcf9c29d7203"} May 20 15:37:04.268977 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:04.268576 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3d2a37e-2df4-4eeb-ab02-1d9e286449ab","Type":"ContainerStarted","Data":"717243018a7742e87a9008e68988dfd41fd12f0b0cf130259e45e07f242a2e42"} May 20 15:37:07.647925 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:07.647871 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 20 15:37:28.162072 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:28.161998 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=26.161982425 podStartE2EDuration="26.161982425s" podCreationTimestamp="2026-05-20 15:37:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 15:37:04.315714238 +0000 UTC m=+255.530637068" watchObservedRunningTime="2026-05-20 15:37:28.161982425 +0000 UTC m=+279.376905217" May 20 15:37:28.162525 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:28.162508 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-whszt"] May 20 15:37:28.165697 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:28.165677 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-whszt" May 20 15:37:28.167931 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:28.167911 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 20 15:37:28.178763 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:28.178742 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-whszt"] May 20 15:37:28.227648 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:28.227627 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/767ea813-7609-43cf-8bed-5c6909ebe4bb-kubelet-config\") pod \"global-pull-secret-syncer-whszt\" (UID: \"767ea813-7609-43cf-8bed-5c6909ebe4bb\") " pod="kube-system/global-pull-secret-syncer-whszt" May 20 15:37:28.227757 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:28.227658 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/767ea813-7609-43cf-8bed-5c6909ebe4bb-original-pull-secret\") pod \"global-pull-secret-syncer-whszt\" (UID: \"767ea813-7609-43cf-8bed-5c6909ebe4bb\") " pod="kube-system/global-pull-secret-syncer-whszt" May 20 15:37:28.227757 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:28.227678 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/767ea813-7609-43cf-8bed-5c6909ebe4bb-dbus\") pod \"global-pull-secret-syncer-whszt\" (UID: \"767ea813-7609-43cf-8bed-5c6909ebe4bb\") " pod="kube-system/global-pull-secret-syncer-whszt" May 20 15:37:28.329102 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:28.329047 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/767ea813-7609-43cf-8bed-5c6909ebe4bb-kubelet-config\") pod \"global-pull-secret-syncer-whszt\" (UID: \"767ea813-7609-43cf-8bed-5c6909ebe4bb\") " pod="kube-system/global-pull-secret-syncer-whszt" May 20 15:37:28.329102 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:28.329108 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/767ea813-7609-43cf-8bed-5c6909ebe4bb-original-pull-secret\") pod \"global-pull-secret-syncer-whszt\" (UID: \"767ea813-7609-43cf-8bed-5c6909ebe4bb\") " pod="kube-system/global-pull-secret-syncer-whszt" May 20 15:37:28.329346 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:28.329147 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/767ea813-7609-43cf-8bed-5c6909ebe4bb-dbus\") pod \"global-pull-secret-syncer-whszt\" (UID: \"767ea813-7609-43cf-8bed-5c6909ebe4bb\") " pod="kube-system/global-pull-secret-syncer-whszt" May 20 15:37:28.329346 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:28.329195 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/767ea813-7609-43cf-8bed-5c6909ebe4bb-kubelet-config\") pod \"global-pull-secret-syncer-whszt\" (UID: \"767ea813-7609-43cf-8bed-5c6909ebe4bb\") " pod="kube-system/global-pull-secret-syncer-whszt" May 20 15:37:28.329346 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:28.329309 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/767ea813-7609-43cf-8bed-5c6909ebe4bb-dbus\") pod \"global-pull-secret-syncer-whszt\" (UID: \"767ea813-7609-43cf-8bed-5c6909ebe4bb\") " pod="kube-system/global-pull-secret-syncer-whszt" May 20 15:37:28.331536 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:28.331516 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/767ea813-7609-43cf-8bed-5c6909ebe4bb-original-pull-secret\") pod \"global-pull-secret-syncer-whszt\" (UID: \"767ea813-7609-43cf-8bed-5c6909ebe4bb\") " pod="kube-system/global-pull-secret-syncer-whszt" May 20 15:37:28.475649 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:28.475625 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-whszt" May 20 15:37:28.601930 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:28.601836 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-whszt"] May 20 15:37:28.604726 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:37:28.604700 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod767ea813_7609_43cf_8bed_5c6909ebe4bb.slice/crio-fb26783564a8c7dbe5a3a6e9df4bea2bfe2ff797b3f4d6fba7f37c7ef7207d1d WatchSource:0}: Error finding container fb26783564a8c7dbe5a3a6e9df4bea2bfe2ff797b3f4d6fba7f37c7ef7207d1d: Status 404 returned error can't find the container with id fb26783564a8c7dbe5a3a6e9df4bea2bfe2ff797b3f4d6fba7f37c7ef7207d1d May 20 15:37:29.343667 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:29.343635 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-whszt" event={"ID":"767ea813-7609-43cf-8bed-5c6909ebe4bb","Type":"ContainerStarted","Data":"fb26783564a8c7dbe5a3a6e9df4bea2bfe2ff797b3f4d6fba7f37c7ef7207d1d"} May 20 15:37:34.362752 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:34.362716 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-whszt" event={"ID":"767ea813-7609-43cf-8bed-5c6909ebe4bb","Type":"ContainerStarted","Data":"674efd6d9e8b87eade11cc858a51babd553a8ad9e1056ece6c414efc8ebc239e"} May 20 15:37:34.385690 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:34.385644 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-whszt" podStartSLOduration=1.658102674 podStartE2EDuration="6.385629955s" podCreationTimestamp="2026-05-20 15:37:28 +0000 UTC" firstStartedPulling="2026-05-20 15:37:28.606533352 +0000 UTC m=+279.821456141" lastFinishedPulling="2026-05-20 15:37:33.334060646 +0000 UTC m=+284.548983422" observedRunningTime="2026-05-20 15:37:34.384740973 +0000 UTC m=+285.599663777" watchObservedRunningTime="2026-05-20 15:37:34.385629955 +0000 UTC m=+285.600552759" May 20 15:37:49.261094 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:49.261063 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-gwx4j_574489b4-f926-4667-be55-8e4e4d4f98e4/console-operator/2.log" May 20 15:37:49.261543 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:49.261319 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-gwx4j_574489b4-f926-4667-be55-8e4e4d4f98e4/console-operator/2.log" May 20 15:37:49.270907 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:37:49.270887 2557 kubelet.go:1628] "Image garbage collection succeeded" May 20 15:38:02.648184 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:38:02.648149 2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 20 15:38:02.664225 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:38:02.664194 2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 20 15:38:03.459905 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:38:03.459870 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 20 15:41:16.178469 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:41:16.178436 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve/s3-init-j7mqv"] May 20 15:41:16.181678 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:41:16.181662 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-j7mqv" May 20 15:41:16.184155 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:41:16.184125 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" May 20 15:41:16.184282 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:41:16.184167 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-mzpqf\"" May 20 15:41:16.184282 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:41:16.184211 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" May 20 15:41:16.184895 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:41:16.184879 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" May 20 15:41:16.192770 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:41:16.192748 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-j7mqv"] May 20 15:41:16.272422 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:41:16.272391 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8rrs\" (UniqueName: \"kubernetes.io/projected/a46c1c68-0714-4e2b-b01e-a3828b70ad1a-kube-api-access-t8rrs\") pod \"s3-init-j7mqv\" (UID: \"a46c1c68-0714-4e2b-b01e-a3828b70ad1a\") " pod="kserve/s3-init-j7mqv" May 20 15:41:16.373065 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:41:16.373028 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t8rrs\" (UniqueName: \"kubernetes.io/projected/a46c1c68-0714-4e2b-b01e-a3828b70ad1a-kube-api-access-t8rrs\") pod \"s3-init-j7mqv\" (UID: \"a46c1c68-0714-4e2b-b01e-a3828b70ad1a\") " pod="kserve/s3-init-j7mqv" May 20 15:41:16.384631 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:41:16.384593 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8rrs\" (UniqueName: \"kubernetes.io/projected/a46c1c68-0714-4e2b-b01e-a3828b70ad1a-kube-api-access-t8rrs\") pod \"s3-init-j7mqv\" (UID: \"a46c1c68-0714-4e2b-b01e-a3828b70ad1a\") " pod="kserve/s3-init-j7mqv" May 20 15:41:16.506592 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:41:16.506562 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-j7mqv" May 20 15:41:16.639104 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:41:16.639082 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-j7mqv"] May 20 15:41:16.641618 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:41:16.641587 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda46c1c68_0714_4e2b_b01e_a3828b70ad1a.slice/crio-592b877f860bf7496f1b19cee76c695de586f0829eb1eab2ec068622ad1d6613 WatchSource:0}: Error finding container 592b877f860bf7496f1b19cee76c695de586f0829eb1eab2ec068622ad1d6613: Status 404 returned error can't find the container with id 592b877f860bf7496f1b19cee76c695de586f0829eb1eab2ec068622ad1d6613 May 20 15:41:16.643332 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:41:16.643316 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 20 15:41:17.012885 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:41:17.012843 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-j7mqv" event={"ID":"a46c1c68-0714-4e2b-b01e-a3828b70ad1a","Type":"ContainerStarted","Data":"592b877f860bf7496f1b19cee76c695de586f0829eb1eab2ec068622ad1d6613"} May 20 15:41:22.030478 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:41:22.030443 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-j7mqv" event={"ID":"a46c1c68-0714-4e2b-b01e-a3828b70ad1a","Type":"ContainerStarted","Data":"f046bce87d9e9afb5b4e446f2c536f5c8579a1e51b1e95e89f01129b274e9d69"} May 20 15:41:25.040345 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:41:25.040308 2557 generic.go:358] "Generic (PLEG): container finished" podID="a46c1c68-0714-4e2b-b01e-a3828b70ad1a" containerID="f046bce87d9e9afb5b4e446f2c536f5c8579a1e51b1e95e89f01129b274e9d69" exitCode=0 May 20 15:41:25.040716 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:41:25.040384 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-j7mqv" event={"ID":"a46c1c68-0714-4e2b-b01e-a3828b70ad1a","Type":"ContainerDied","Data":"f046bce87d9e9afb5b4e446f2c536f5c8579a1e51b1e95e89f01129b274e9d69"} May 20 15:41:26.167788 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:41:26.167763 2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-j7mqv" May 20 15:41:26.260005 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:41:26.259978 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t8rrs\" (UniqueName: \"kubernetes.io/projected/a46c1c68-0714-4e2b-b01e-a3828b70ad1a-kube-api-access-t8rrs\") pod \"a46c1c68-0714-4e2b-b01e-a3828b70ad1a\" (UID: \"a46c1c68-0714-4e2b-b01e-a3828b70ad1a\") " May 20 15:41:26.262244 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:41:26.262211 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a46c1c68-0714-4e2b-b01e-a3828b70ad1a-kube-api-access-t8rrs" (OuterVolumeSpecName: "kube-api-access-t8rrs") pod "a46c1c68-0714-4e2b-b01e-a3828b70ad1a" (UID: "a46c1c68-0714-4e2b-b01e-a3828b70ad1a"). InnerVolumeSpecName "kube-api-access-t8rrs". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 15:41:26.360841 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:41:26.360750 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t8rrs\" (UniqueName: \"kubernetes.io/projected/a46c1c68-0714-4e2b-b01e-a3828b70ad1a-kube-api-access-t8rrs\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" May 20 15:41:27.047159 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:41:27.047123 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-j7mqv" event={"ID":"a46c1c68-0714-4e2b-b01e-a3828b70ad1a","Type":"ContainerDied","Data":"592b877f860bf7496f1b19cee76c695de586f0829eb1eab2ec068622ad1d6613"} May 20 15:41:27.047159 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:41:27.047159 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="592b877f860bf7496f1b19cee76c695de586f0829eb1eab2ec068622ad1d6613" May 20 15:41:27.047159 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:41:27.047131 2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-j7mqv" May 20 15:42:00.855845 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:42:00.855731 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve/s3-tls-init-custom-rjt8t"] May 20 15:42:00.856289 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:42:00.856061 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a46c1c68-0714-4e2b-b01e-a3828b70ad1a" containerName="s3-init" May 20 15:42:00.856289 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:42:00.856074 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="a46c1c68-0714-4e2b-b01e-a3828b70ad1a" containerName="s3-init" May 20 15:42:00.856289 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:42:00.856129 2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="a46c1c68-0714-4e2b-b01e-a3828b70ad1a" containerName="s3-init" May 20 15:42:00.858759 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:42:00.858741 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-custom-rjt8t" May 20 15:42:00.861210 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:42:00.861188 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-custom-artifact\"" May 20 15:42:00.861319 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:42:00.861230 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" May 20 15:42:00.861319 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:42:00.861196 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-mzpqf\"" May 20 15:42:00.861319 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:42:00.861198 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" May 20 15:42:00.866978 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:42:00.866953 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/s3-tls-init-custom-rjt8t"] May 20 15:42:00.943273 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:42:00.943233 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9wj8\" (UniqueName: \"kubernetes.io/projected/bf31921b-2418-4be0-8459-9ea84446e091-kube-api-access-q9wj8\") pod \"s3-tls-init-custom-rjt8t\" (UID: \"bf31921b-2418-4be0-8459-9ea84446e091\") " pod="kserve/s3-tls-init-custom-rjt8t" May 20 15:42:01.044542 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:42:01.044510 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q9wj8\" (UniqueName: \"kubernetes.io/projected/bf31921b-2418-4be0-8459-9ea84446e091-kube-api-access-q9wj8\") pod \"s3-tls-init-custom-rjt8t\" (UID: \"bf31921b-2418-4be0-8459-9ea84446e091\") " pod="kserve/s3-tls-init-custom-rjt8t" May 20 15:42:01.053767 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:42:01.053728 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9wj8\" (UniqueName: \"kubernetes.io/projected/bf31921b-2418-4be0-8459-9ea84446e091-kube-api-access-q9wj8\") pod \"s3-tls-init-custom-rjt8t\" (UID: \"bf31921b-2418-4be0-8459-9ea84446e091\") " pod="kserve/s3-tls-init-custom-rjt8t" May 20 15:42:01.174230 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:42:01.174130 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-custom-rjt8t" May 20 15:42:01.308639 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:42:01.308604 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/s3-tls-init-custom-rjt8t"] May 20 15:42:01.311835 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:42:01.311797 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbf31921b_2418_4be0_8459_9ea84446e091.slice/crio-e9306ff66e8376f59426e19ff8d99b400d96330ac89d27d665a3975615cfbf1d WatchSource:0}: Error finding container e9306ff66e8376f59426e19ff8d99b400d96330ac89d27d665a3975615cfbf1d: Status 404 returned error can't find the container with id e9306ff66e8376f59426e19ff8d99b400d96330ac89d27d665a3975615cfbf1d May 20 15:42:02.150099 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:42:02.150061 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-rjt8t" event={"ID":"bf31921b-2418-4be0-8459-9ea84446e091","Type":"ContainerStarted","Data":"d15d7841ee04c935447855dcfe3b1dc3e327bd68bf25ad9405147c51e4c5730c"} May 20 15:42:02.150099 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:42:02.150100 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-rjt8t" event={"ID":"bf31921b-2418-4be0-8459-9ea84446e091","Type":"ContainerStarted","Data":"e9306ff66e8376f59426e19ff8d99b400d96330ac89d27d665a3975615cfbf1d"} May 20 15:42:02.166940 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:42:02.166889 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve/s3-tls-init-custom-rjt8t" podStartSLOduration=2.166873582 podStartE2EDuration="2.166873582s" podCreationTimestamp="2026-05-20 15:42:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 15:42:02.165610617 +0000 UTC m=+553.380533410" watchObservedRunningTime="2026-05-20 15:42:02.166873582 +0000 UTC m=+553.381796376" May 20 15:42:07.165622 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:42:07.165583 2557 generic.go:358] "Generic (PLEG): container finished" podID="bf31921b-2418-4be0-8459-9ea84446e091" containerID="d15d7841ee04c935447855dcfe3b1dc3e327bd68bf25ad9405147c51e4c5730c" exitCode=0 May 20 15:42:07.166055 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:42:07.165646 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-rjt8t" event={"ID":"bf31921b-2418-4be0-8459-9ea84446e091","Type":"ContainerDied","Data":"d15d7841ee04c935447855dcfe3b1dc3e327bd68bf25ad9405147c51e4c5730c"} May 20 15:42:08.297016 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:42:08.296989 2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-custom-rjt8t" May 20 15:42:08.392969 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:42:08.392939 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q9wj8\" (UniqueName: \"kubernetes.io/projected/bf31921b-2418-4be0-8459-9ea84446e091-kube-api-access-q9wj8\") pod \"bf31921b-2418-4be0-8459-9ea84446e091\" (UID: \"bf31921b-2418-4be0-8459-9ea84446e091\") " May 20 15:42:08.395091 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:42:08.395058 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf31921b-2418-4be0-8459-9ea84446e091-kube-api-access-q9wj8" (OuterVolumeSpecName: "kube-api-access-q9wj8") pod "bf31921b-2418-4be0-8459-9ea84446e091" (UID: "bf31921b-2418-4be0-8459-9ea84446e091"). InnerVolumeSpecName "kube-api-access-q9wj8". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 15:42:08.493506 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:42:08.493480 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q9wj8\" (UniqueName: \"kubernetes.io/projected/bf31921b-2418-4be0-8459-9ea84446e091-kube-api-access-q9wj8\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" May 20 15:42:09.172000 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:42:09.171965 2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-custom-rjt8t" May 20 15:42:09.172000 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:42:09.171978 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-rjt8t" event={"ID":"bf31921b-2418-4be0-8459-9ea84446e091","Type":"ContainerDied","Data":"e9306ff66e8376f59426e19ff8d99b400d96330ac89d27d665a3975615cfbf1d"} May 20 15:42:09.172000 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:42:09.172007 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e9306ff66e8376f59426e19ff8d99b400d96330ac89d27d665a3975615cfbf1d" May 20 15:42:12.155132 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:42:12.155095 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve/s3-tls-init-serving-db5fc"] May 20 15:42:12.155611 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:42:12.155541 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf31921b-2418-4be0-8459-9ea84446e091" containerName="s3-tls-init-custom" May 20 15:42:12.155611 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:42:12.155559 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf31921b-2418-4be0-8459-9ea84446e091" containerName="s3-tls-init-custom" May 20 15:42:12.155728 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:42:12.155657 2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="bf31921b-2418-4be0-8459-9ea84446e091" containerName="s3-tls-init-custom" May 20 15:42:12.158734 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:42:12.158712 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-serving-db5fc" May 20 15:42:12.161126 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:42:12.161107 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-serving-artifact\"" May 20 15:42:12.161237 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:42:12.161128 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" May 20 15:42:12.161237 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:42:12.161153 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-mzpqf\"" May 20 15:42:12.161237 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:42:12.161128 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" May 20 15:42:12.165756 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:42:12.165640 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/s3-tls-init-serving-db5fc"] May 20 15:42:12.222402 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:42:12.222369 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfmm4\" (UniqueName: \"kubernetes.io/projected/a356292f-2817-405f-a7cc-2f1240b05db1-kube-api-access-qfmm4\") pod \"s3-tls-init-serving-db5fc\" (UID: \"a356292f-2817-405f-a7cc-2f1240b05db1\") " pod="kserve/s3-tls-init-serving-db5fc" May 20 15:42:12.323561 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:42:12.323513 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qfmm4\" (UniqueName: \"kubernetes.io/projected/a356292f-2817-405f-a7cc-2f1240b05db1-kube-api-access-qfmm4\") pod \"s3-tls-init-serving-db5fc\" (UID: \"a356292f-2817-405f-a7cc-2f1240b05db1\") " pod="kserve/s3-tls-init-serving-db5fc" May 20 15:42:12.333422 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:42:12.333389 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfmm4\" (UniqueName: \"kubernetes.io/projected/a356292f-2817-405f-a7cc-2f1240b05db1-kube-api-access-qfmm4\") pod \"s3-tls-init-serving-db5fc\" (UID: \"a356292f-2817-405f-a7cc-2f1240b05db1\") " pod="kserve/s3-tls-init-serving-db5fc" May 20 15:42:12.477049 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:42:12.477015 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-serving-db5fc" May 20 15:42:12.615887 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:42:12.615840 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/s3-tls-init-serving-db5fc"] May 20 15:42:12.618423 ip-10-0-130-228 kubenswrapper[2557]: W0520 15:42:12.618393 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda356292f_2817_405f_a7cc_2f1240b05db1.slice/crio-b801d7384f5e5d63826c79407bb2d9bb9b4be34f56bd9fb21fa54bb4c9268036 WatchSource:0}: Error finding container b801d7384f5e5d63826c79407bb2d9bb9b4be34f56bd9fb21fa54bb4c9268036: Status 404 returned error can't find the container with id b801d7384f5e5d63826c79407bb2d9bb9b4be34f56bd9fb21fa54bb4c9268036 May 20 15:42:13.185375 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:42:13.185339 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-serving-db5fc" event={"ID":"a356292f-2817-405f-a7cc-2f1240b05db1","Type":"ContainerStarted","Data":"b945ea623cde95ccf05ae1470781b1f167e5e46c211cc4644a4093a9fe35ccc2"} May 20 15:42:13.185375 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:42:13.185381 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-serving-db5fc" event={"ID":"a356292f-2817-405f-a7cc-2f1240b05db1","Type":"ContainerStarted","Data":"b801d7384f5e5d63826c79407bb2d9bb9b4be34f56bd9fb21fa54bb4c9268036"} May 20 15:42:19.205860 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:42:19.205794 2557 generic.go:358] "Generic (PLEG): container finished" podID="a356292f-2817-405f-a7cc-2f1240b05db1" containerID="b945ea623cde95ccf05ae1470781b1f167e5e46c211cc4644a4093a9fe35ccc2" exitCode=0 May 20 15:42:19.206232 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:42:19.205863 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-serving-db5fc" event={"ID":"a356292f-2817-405f-a7cc-2f1240b05db1","Type":"ContainerDied","Data":"b945ea623cde95ccf05ae1470781b1f167e5e46c211cc4644a4093a9fe35ccc2"} May 20 15:42:20.344688 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:42:20.344664 2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-serving-db5fc" May 20 15:42:20.389998 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:42:20.389972 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qfmm4\" (UniqueName: \"kubernetes.io/projected/a356292f-2817-405f-a7cc-2f1240b05db1-kube-api-access-qfmm4\") pod \"a356292f-2817-405f-a7cc-2f1240b05db1\" (UID: \"a356292f-2817-405f-a7cc-2f1240b05db1\") " May 20 15:42:20.392185 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:42:20.392160 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a356292f-2817-405f-a7cc-2f1240b05db1-kube-api-access-qfmm4" (OuterVolumeSpecName: "kube-api-access-qfmm4") pod "a356292f-2817-405f-a7cc-2f1240b05db1" (UID: "a356292f-2817-405f-a7cc-2f1240b05db1"). InnerVolumeSpecName "kube-api-access-qfmm4". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 15:42:20.490567 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:42:20.490536 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qfmm4\" (UniqueName: \"kubernetes.io/projected/a356292f-2817-405f-a7cc-2f1240b05db1-kube-api-access-qfmm4\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" May 20 15:42:21.212401 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:42:21.212370 2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-serving-db5fc" May 20 15:42:21.212401 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:42:21.212392 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-serving-db5fc" event={"ID":"a356292f-2817-405f-a7cc-2f1240b05db1","Type":"ContainerDied","Data":"b801d7384f5e5d63826c79407bb2d9bb9b4be34f56bd9fb21fa54bb4c9268036"} May 20 15:42:21.212599 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:42:21.212423 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b801d7384f5e5d63826c79407bb2d9bb9b4be34f56bd9fb21fa54bb4c9268036" May 20 15:42:49.285489 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:42:49.285462 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-gwx4j_574489b4-f926-4667-be55-8e4e4d4f98e4/console-operator/2.log" May 20 15:42:49.286777 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:42:49.286753 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-gwx4j_574489b4-f926-4667-be55-8e4e4d4f98e4/console-operator/2.log" May 20 15:47:49.310540 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:47:49.310516 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-gwx4j_574489b4-f926-4667-be55-8e4e4d4f98e4/console-operator/2.log" May 20 15:47:49.313129 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:47:49.313106 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-gwx4j_574489b4-f926-4667-be55-8e4e4d4f98e4/console-operator/2.log" May 20 15:52:49.332930 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:52:49.332901 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-gwx4j_574489b4-f926-4667-be55-8e4e4d4f98e4/console-operator/2.log" May 20 15:52:49.335013 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:52:49.334987 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-gwx4j_574489b4-f926-4667-be55-8e4e4d4f98e4/console-operator/2.log" May 20 15:57:49.354885 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:57:49.354857 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-gwx4j_574489b4-f926-4667-be55-8e4e4d4f98e4/console-operator/2.log" May 20 15:57:49.358618 ip-10-0-130-228 kubenswrapper[2557]: I0520 15:57:49.358587 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-gwx4j_574489b4-f926-4667-be55-8e4e4d4f98e4/console-operator/2.log" May 20 16:02:49.384640 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:02:49.384608 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-gwx4j_574489b4-f926-4667-be55-8e4e4d4f98e4/console-operator/2.log" May 20 16:02:49.389617 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:02:49.389596 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-gwx4j_574489b4-f926-4667-be55-8e4e4d4f98e4/console-operator/2.log" May 20 16:07:49.406841 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:07:49.406791 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-gwx4j_574489b4-f926-4667-be55-8e4e4d4f98e4/console-operator/2.log" May 20 16:07:49.411960 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:07:49.411940 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-gwx4j_574489b4-f926-4667-be55-8e4e4d4f98e4/console-operator/2.log" May 20 16:12:49.429750 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:12:49.429724 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-gwx4j_574489b4-f926-4667-be55-8e4e4d4f98e4/console-operator/2.log" May 20 16:12:49.434786 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:12:49.434763 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-gwx4j_574489b4-f926-4667-be55-8e4e4d4f98e4/console-operator/2.log" May 20 16:17:49.456435 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:17:49.456365 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-gwx4j_574489b4-f926-4667-be55-8e4e4d4f98e4/console-operator/2.log" May 20 16:17:49.462971 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:17:49.462950 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-gwx4j_574489b4-f926-4667-be55-8e4e4d4f98e4/console-operator/2.log" May 20 16:22:49.479593 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:22:49.479565 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-gwx4j_574489b4-f926-4667-be55-8e4e4d4f98e4/console-operator/2.log" May 20 16:22:49.485798 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:22:49.485774 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-gwx4j_574489b4-f926-4667-be55-8e4e4d4f98e4/console-operator/2.log" May 20 16:27:49.502915 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:27:49.502886 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-gwx4j_574489b4-f926-4667-be55-8e4e4d4f98e4/console-operator/2.log" May 20 16:27:49.508959 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:27:49.508938 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-gwx4j_574489b4-f926-4667-be55-8e4e4d4f98e4/console-operator/2.log" May 20 16:32:49.526139 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:32:49.526110 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-gwx4j_574489b4-f926-4667-be55-8e4e4d4f98e4/console-operator/2.log" May 20 16:32:49.531308 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:32:49.531277 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-gwx4j_574489b4-f926-4667-be55-8e4e4d4f98e4/console-operator/2.log" May 20 16:36:52.306509 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:36:52.306473 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9xxmx/must-gather-8rrsv"] May 20 16:36:52.307039 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:36:52.306792 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a356292f-2817-405f-a7cc-2f1240b05db1" containerName="s3-tls-init-serving" May 20 16:36:52.307039 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:36:52.306803 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="a356292f-2817-405f-a7cc-2f1240b05db1" containerName="s3-tls-init-serving" May 20 16:36:52.307039 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:36:52.306880 2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="a356292f-2817-405f-a7cc-2f1240b05db1" containerName="s3-tls-init-serving" May 20 16:36:52.309361 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:36:52.309344 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9xxmx/must-gather-8rrsv" May 20 16:36:52.311206 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:36:52.311180 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9xxmx\"/\"default-dockercfg-8l7kl\"" May 20 16:36:52.311410 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:36:52.311398 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9xxmx\"/\"kube-root-ca.crt\"" May 20 16:36:52.311542 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:36:52.311524 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9xxmx\"/\"openshift-service-ca.crt\"" May 20 16:36:52.318848 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:36:52.318804 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9xxmx/must-gather-8rrsv"] May 20 16:36:52.448660 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:36:52.448624 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54ccl\" (UniqueName: \"kubernetes.io/projected/e88c0250-d8d7-4e92-b38b-8720d77ce321-kube-api-access-54ccl\") pod \"must-gather-8rrsv\" (UID: \"e88c0250-d8d7-4e92-b38b-8720d77ce321\") " pod="openshift-must-gather-9xxmx/must-gather-8rrsv" May 20 16:36:52.448875 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:36:52.448750 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e88c0250-d8d7-4e92-b38b-8720d77ce321-must-gather-output\") pod \"must-gather-8rrsv\" (UID: \"e88c0250-d8d7-4e92-b38b-8720d77ce321\") " pod="openshift-must-gather-9xxmx/must-gather-8rrsv" May 20 16:36:52.549590 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:36:52.549541 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-54ccl\" (UniqueName: \"kubernetes.io/projected/e88c0250-d8d7-4e92-b38b-8720d77ce321-kube-api-access-54ccl\") pod \"must-gather-8rrsv\" (UID: \"e88c0250-d8d7-4e92-b38b-8720d77ce321\") " pod="openshift-must-gather-9xxmx/must-gather-8rrsv" May 20 16:36:52.549798 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:36:52.549626 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e88c0250-d8d7-4e92-b38b-8720d77ce321-must-gather-output\") pod \"must-gather-8rrsv\" (UID: \"e88c0250-d8d7-4e92-b38b-8720d77ce321\") " pod="openshift-must-gather-9xxmx/must-gather-8rrsv" May 20 16:36:52.550047 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:36:52.550024 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e88c0250-d8d7-4e92-b38b-8720d77ce321-must-gather-output\") pod \"must-gather-8rrsv\" (UID: \"e88c0250-d8d7-4e92-b38b-8720d77ce321\") " pod="openshift-must-gather-9xxmx/must-gather-8rrsv" May 20 16:36:52.560078 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:36:52.560017 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-54ccl\" (UniqueName: \"kubernetes.io/projected/e88c0250-d8d7-4e92-b38b-8720d77ce321-kube-api-access-54ccl\") pod \"must-gather-8rrsv\" (UID: \"e88c0250-d8d7-4e92-b38b-8720d77ce321\") " pod="openshift-must-gather-9xxmx/must-gather-8rrsv" May 20 16:36:52.628954 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:36:52.628918 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9xxmx/must-gather-8rrsv" May 20 16:36:52.761165 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:36:52.761138 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9xxmx/must-gather-8rrsv"] May 20 16:36:52.763880 ip-10-0-130-228 kubenswrapper[2557]: W0520 16:36:52.763848 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode88c0250_d8d7_4e92_b38b_8720d77ce321.slice/crio-204260e147a79c1b10a836ce92c09ed2a3fd9cb1837390d394f37c3d2796e113 WatchSource:0}: Error finding container 204260e147a79c1b10a836ce92c09ed2a3fd9cb1837390d394f37c3d2796e113: Status 404 returned error can't find the container with id 204260e147a79c1b10a836ce92c09ed2a3fd9cb1837390d394f37c3d2796e113 May 20 16:36:52.765514 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:36:52.765494 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 20 16:36:53.696245 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:36:53.696179 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9xxmx/must-gather-8rrsv" event={"ID":"e88c0250-d8d7-4e92-b38b-8720d77ce321","Type":"ContainerStarted","Data":"204260e147a79c1b10a836ce92c09ed2a3fd9cb1837390d394f37c3d2796e113"} May 20 16:36:59.719017 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:36:59.718978 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9xxmx/must-gather-8rrsv" event={"ID":"e88c0250-d8d7-4e92-b38b-8720d77ce321","Type":"ContainerStarted","Data":"c99912ae25ac9b0c427addf3b12778334c6d14cd39b13de8d5708c221f4fa9b5"} May 20 16:36:59.719017 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:36:59.719016 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9xxmx/must-gather-8rrsv" event={"ID":"e88c0250-d8d7-4e92-b38b-8720d77ce321","Type":"ContainerStarted","Data":"f56a0220255387f41ab4bb42d76eea7a52be00afe2442efa12c163a3495f8b0d"} May 20 16:36:59.738579 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:36:59.738531 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-9xxmx/must-gather-8rrsv" podStartSLOduration=1.543370527 podStartE2EDuration="7.738513162s" podCreationTimestamp="2026-05-20 16:36:52 +0000 UTC" firstStartedPulling="2026-05-20 16:36:52.765655125 +0000 UTC m=+3843.980577897" lastFinishedPulling="2026-05-20 16:36:58.960797761 +0000 UTC m=+3850.175720532" observedRunningTime="2026-05-20 16:36:59.736713628 +0000 UTC m=+3850.951636422" watchObservedRunningTime="2026-05-20 16:36:59.738513162 +0000 UTC m=+3850.953435954" May 20 16:37:22.796031 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:22.795996 2557 generic.go:358] "Generic (PLEG): container finished" podID="e88c0250-d8d7-4e92-b38b-8720d77ce321" containerID="f56a0220255387f41ab4bb42d76eea7a52be00afe2442efa12c163a3495f8b0d" exitCode=0 May 20 16:37:22.796562 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:22.796079 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9xxmx/must-gather-8rrsv" event={"ID":"e88c0250-d8d7-4e92-b38b-8720d77ce321","Type":"ContainerDied","Data":"f56a0220255387f41ab4bb42d76eea7a52be00afe2442efa12c163a3495f8b0d"} May 20 16:37:22.796562 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:22.796479 2557 scope.go:117] "RemoveContainer" containerID="f56a0220255387f41ab4bb42d76eea7a52be00afe2442efa12c163a3495f8b0d" May 20 16:37:22.987182 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:22.987150 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-9xxmx_must-gather-8rrsv_e88c0250-d8d7-4e92-b38b-8720d77ce321/gather/0.log" May 20 16:37:26.699034 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:26.699003 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-whszt_767ea813-7609-43cf-8bed-5c6909ebe4bb/global-pull-secret-syncer/0.log" May 20 16:37:26.857174 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:26.857141 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-r9qzn_a8e3f0da-9b88-4b25-9836-21def71adfe1/konnectivity-agent/0.log" May 20 16:37:26.885572 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:26.885544 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-228.ec2.internal_e78fe5c75454ec5097ce49d1da0faa03/haproxy/0.log" May 20 16:37:28.517319 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:28.517279 2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-9xxmx/must-gather-8rrsv"] May 20 16:37:28.517798 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:28.517544 2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-must-gather-9xxmx/must-gather-8rrsv" podUID="e88c0250-d8d7-4e92-b38b-8720d77ce321" containerName="copy" containerID="cri-o://c99912ae25ac9b0c427addf3b12778334c6d14cd39b13de8d5708c221f4fa9b5" gracePeriod=2 May 20 16:37:28.522021 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:28.521407 2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-9xxmx/must-gather-8rrsv"] May 20 16:37:28.746293 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:28.746272 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-9xxmx_must-gather-8rrsv_e88c0250-d8d7-4e92-b38b-8720d77ce321/copy/0.log" May 20 16:37:28.746704 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:28.746689 2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9xxmx/must-gather-8rrsv" May 20 16:37:28.748585 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:28.748563 2557 status_manager.go:895] "Failed to get status for pod" podUID="e88c0250-d8d7-4e92-b38b-8720d77ce321" pod="openshift-must-gather-9xxmx/must-gather-8rrsv" err="pods \"must-gather-8rrsv\" is forbidden: User \"system:node:ip-10-0-130-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-9xxmx\": no relationship found between node 'ip-10-0-130-228.ec2.internal' and this object" May 20 16:37:28.772403 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:28.772357 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e88c0250-d8d7-4e92-b38b-8720d77ce321-must-gather-output\") pod \"e88c0250-d8d7-4e92-b38b-8720d77ce321\" (UID: \"e88c0250-d8d7-4e92-b38b-8720d77ce321\") " May 20 16:37:28.772403 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:28.772388 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-54ccl\" (UniqueName: \"kubernetes.io/projected/e88c0250-d8d7-4e92-b38b-8720d77ce321-kube-api-access-54ccl\") pod \"e88c0250-d8d7-4e92-b38b-8720d77ce321\" (UID: \"e88c0250-d8d7-4e92-b38b-8720d77ce321\") " May 20 16:37:28.773924 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:28.773903 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e88c0250-d8d7-4e92-b38b-8720d77ce321-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "e88c0250-d8d7-4e92-b38b-8720d77ce321" (UID: "e88c0250-d8d7-4e92-b38b-8720d77ce321"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 20 16:37:28.774594 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:28.774576 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e88c0250-d8d7-4e92-b38b-8720d77ce321-kube-api-access-54ccl" (OuterVolumeSpecName: "kube-api-access-54ccl") pod "e88c0250-d8d7-4e92-b38b-8720d77ce321" (UID: "e88c0250-d8d7-4e92-b38b-8720d77ce321"). InnerVolumeSpecName "kube-api-access-54ccl". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 16:37:28.815499 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:28.815482 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-9xxmx_must-gather-8rrsv_e88c0250-d8d7-4e92-b38b-8720d77ce321/copy/0.log" May 20 16:37:28.815830 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:28.815795 2557 generic.go:358] "Generic (PLEG): container finished" podID="e88c0250-d8d7-4e92-b38b-8720d77ce321" containerID="c99912ae25ac9b0c427addf3b12778334c6d14cd39b13de8d5708c221f4fa9b5" exitCode=143 May 20 16:37:28.815891 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:28.815856 2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9xxmx/must-gather-8rrsv" May 20 16:37:28.815891 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:28.815874 2557 scope.go:117] "RemoveContainer" containerID="c99912ae25ac9b0c427addf3b12778334c6d14cd39b13de8d5708c221f4fa9b5" May 20 16:37:28.817845 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:28.817795 2557 status_manager.go:895] "Failed to get status for pod" podUID="e88c0250-d8d7-4e92-b38b-8720d77ce321" pod="openshift-must-gather-9xxmx/must-gather-8rrsv" err="pods \"must-gather-8rrsv\" is forbidden: User \"system:node:ip-10-0-130-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-9xxmx\": no relationship found between node 'ip-10-0-130-228.ec2.internal' and this object" May 20 16:37:28.823468 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:28.823451 2557 scope.go:117] "RemoveContainer" containerID="f56a0220255387f41ab4bb42d76eea7a52be00afe2442efa12c163a3495f8b0d" May 20 16:37:28.824773 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:28.824747 2557 status_manager.go:895] "Failed to get status for pod" podUID="e88c0250-d8d7-4e92-b38b-8720d77ce321" pod="openshift-must-gather-9xxmx/must-gather-8rrsv" err="pods \"must-gather-8rrsv\" is forbidden: User \"system:node:ip-10-0-130-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-9xxmx\": no relationship found between node 'ip-10-0-130-228.ec2.internal' and this object" May 20 16:37:28.835649 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:28.835629 2557 scope.go:117] "RemoveContainer" containerID="c99912ae25ac9b0c427addf3b12778334c6d14cd39b13de8d5708c221f4fa9b5" May 20 16:37:28.835886 ip-10-0-130-228 kubenswrapper[2557]: E0520 16:37:28.835871 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c99912ae25ac9b0c427addf3b12778334c6d14cd39b13de8d5708c221f4fa9b5\": container with ID starting with c99912ae25ac9b0c427addf3b12778334c6d14cd39b13de8d5708c221f4fa9b5 not found: ID does not exist" containerID="c99912ae25ac9b0c427addf3b12778334c6d14cd39b13de8d5708c221f4fa9b5" May 20 16:37:28.835950 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:28.835893 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c99912ae25ac9b0c427addf3b12778334c6d14cd39b13de8d5708c221f4fa9b5"} err="failed to get container status \"c99912ae25ac9b0c427addf3b12778334c6d14cd39b13de8d5708c221f4fa9b5\": rpc error: code = NotFound desc = could not find container \"c99912ae25ac9b0c427addf3b12778334c6d14cd39b13de8d5708c221f4fa9b5\": container with ID starting with c99912ae25ac9b0c427addf3b12778334c6d14cd39b13de8d5708c221f4fa9b5 not found: ID does not exist" May 20 16:37:28.835950 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:28.835910 2557 scope.go:117] "RemoveContainer" containerID="f56a0220255387f41ab4bb42d76eea7a52be00afe2442efa12c163a3495f8b0d" May 20 16:37:28.836142 ip-10-0-130-228 kubenswrapper[2557]: E0520 16:37:28.836127 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f56a0220255387f41ab4bb42d76eea7a52be00afe2442efa12c163a3495f8b0d\": container with ID starting with f56a0220255387f41ab4bb42d76eea7a52be00afe2442efa12c163a3495f8b0d not found: ID does not exist" containerID="f56a0220255387f41ab4bb42d76eea7a52be00afe2442efa12c163a3495f8b0d" May 20 16:37:28.836185 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:28.836144 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f56a0220255387f41ab4bb42d76eea7a52be00afe2442efa12c163a3495f8b0d"} err="failed to get container status \"f56a0220255387f41ab4bb42d76eea7a52be00afe2442efa12c163a3495f8b0d\": rpc error: code = NotFound desc = could not find container \"f56a0220255387f41ab4bb42d76eea7a52be00afe2442efa12c163a3495f8b0d\": container with ID starting with f56a0220255387f41ab4bb42d76eea7a52be00afe2442efa12c163a3495f8b0d not found: ID does not exist" May 20 16:37:28.873624 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:28.873605 2557 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e88c0250-d8d7-4e92-b38b-8720d77ce321-must-gather-output\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" May 20 16:37:28.873698 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:28.873625 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-54ccl\" (UniqueName: \"kubernetes.io/projected/e88c0250-d8d7-4e92-b38b-8720d77ce321-kube-api-access-54ccl\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" May 20 16:37:29.384453 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:29.384417 2557 status_manager.go:895] "Failed to get status for pod" podUID="e88c0250-d8d7-4e92-b38b-8720d77ce321" pod="openshift-must-gather-9xxmx/must-gather-8rrsv" err="pods \"must-gather-8rrsv\" is forbidden: User \"system:node:ip-10-0-130-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-9xxmx\": no relationship found between node 'ip-10-0-130-228.ec2.internal' and this object" May 20 16:37:29.384704 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:29.384684 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e88c0250-d8d7-4e92-b38b-8720d77ce321" path="/var/lib/kubelet/pods/e88c0250-d8d7-4e92-b38b-8720d77ce321/volumes" May 20 16:37:30.034340 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:30.034302 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3793ed15-f7e2-464a-86ec-3318c5d4f4ee/alertmanager/0.log" May 20 16:37:30.066938 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:30.066909 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3793ed15-f7e2-464a-86ec-3318c5d4f4ee/config-reloader/0.log" May 20 16:37:30.097598 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:30.097574 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3793ed15-f7e2-464a-86ec-3318c5d4f4ee/kube-rbac-proxy-web/0.log" May 20 16:37:30.134423 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:30.134369 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3793ed15-f7e2-464a-86ec-3318c5d4f4ee/kube-rbac-proxy/0.log" May 20 16:37:30.166892 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:30.166869 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3793ed15-f7e2-464a-86ec-3318c5d4f4ee/kube-rbac-proxy-metric/0.log" May 20 16:37:30.191212 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:30.191187 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3793ed15-f7e2-464a-86ec-3318c5d4f4ee/prom-label-proxy/0.log" May 20 16:37:30.215326 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:30.215299 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3793ed15-f7e2-464a-86ec-3318c5d4f4ee/init-config-reloader/0.log" May 20 16:37:30.610292 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:30.610261 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p9426_c83885b8-12f2-434f-9349-f811f5507c19/node-exporter/0.log" May 20 16:37:30.633249 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:30.633228 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p9426_c83885b8-12f2-434f-9349-f811f5507c19/kube-rbac-proxy/0.log" May 20 16:37:30.654094 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:30.654073 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p9426_c83885b8-12f2-434f-9349-f811f5507c19/init-textfile/0.log" May 20 16:37:30.778102 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:30.778060 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f3d2a37e-2df4-4eeb-ab02-1d9e286449ab/prometheus/0.log" May 20 16:37:30.798697 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:30.798616 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f3d2a37e-2df4-4eeb-ab02-1d9e286449ab/config-reloader/0.log" May 20 16:37:30.830012 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:30.829987 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f3d2a37e-2df4-4eeb-ab02-1d9e286449ab/thanos-sidecar/0.log" May 20 16:37:30.852910 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:30.852885 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f3d2a37e-2df4-4eeb-ab02-1d9e286449ab/kube-rbac-proxy-web/0.log" May 20 16:37:30.874413 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:30.874387 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f3d2a37e-2df4-4eeb-ab02-1d9e286449ab/kube-rbac-proxy/0.log" May 20 16:37:30.897562 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:30.897538 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f3d2a37e-2df4-4eeb-ab02-1d9e286449ab/kube-rbac-proxy-thanos/0.log" May 20 16:37:30.922404 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:30.922386 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f3d2a37e-2df4-4eeb-ab02-1d9e286449ab/init-config-reloader/0.log" May 20 16:37:30.955975 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:30.955950 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-68267_f9ba6193-844a-482e-9b55-198cc419d021/prometheus-operator/0.log" May 20 16:37:30.976241 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:30.976219 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-68267_f9ba6193-844a-482e-9b55-198cc419d021/kube-rbac-proxy/0.log" May 20 16:37:31.030958 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:31.030926 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-64776754bd-b48h7_603977fd-0596-4003-8d30-d44493503248/telemeter-client/0.log" May 20 16:37:31.052250 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:31.052192 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-64776754bd-b48h7_603977fd-0596-4003-8d30-d44493503248/reload/0.log" May 20 16:37:31.073004 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:31.072975 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-64776754bd-b48h7_603977fd-0596-4003-8d30-d44493503248/kube-rbac-proxy/0.log" May 20 16:37:32.764728 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:32.764698 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-gwx4j_574489b4-f926-4667-be55-8e4e4d4f98e4/console-operator/2.log" May 20 16:37:32.772400 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:32.772345 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-gwx4j_574489b4-f926-4667-be55-8e4e4d4f98e4/console-operator/3.log" May 20 16:37:33.572273 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:33.572244 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5cf8c89d64-qrbth_5b574a1a-8a5f-486e-94f7-8f388c7cf6b9/volume-data-source-validator/0.log" May 20 16:37:33.691424 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:33.691389 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mwsjl/perf-node-gather-daemonset-lvjw7"] May 20 16:37:33.691902 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:33.691883 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e88c0250-d8d7-4e92-b38b-8720d77ce321" containerName="gather" May 20 16:37:33.691996 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:33.691905 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="e88c0250-d8d7-4e92-b38b-8720d77ce321" containerName="gather" May 20 16:37:33.691996 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:33.691917 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e88c0250-d8d7-4e92-b38b-8720d77ce321" containerName="copy" May 20 16:37:33.691996 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:33.691924 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="e88c0250-d8d7-4e92-b38b-8720d77ce321" containerName="copy" May 20 16:37:33.691996 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:33.691993 2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="e88c0250-d8d7-4e92-b38b-8720d77ce321" containerName="copy" May 20 16:37:33.692486 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:33.692011 2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="e88c0250-d8d7-4e92-b38b-8720d77ce321" containerName="gather" May 20 16:37:33.696225 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:33.696208 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mwsjl/perf-node-gather-daemonset-lvjw7" May 20 16:37:33.698352 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:33.698336 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mwsjl\"/\"kube-root-ca.crt\"" May 20 16:37:33.699046 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:33.699027 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mwsjl\"/\"openshift-service-ca.crt\"" May 20 16:37:33.699046 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:33.699032 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mwsjl\"/\"default-dockercfg-b4sdk\"" May 20 16:37:33.708194 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:33.708168 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mwsjl/perf-node-gather-daemonset-lvjw7"] May 20 16:37:33.815436 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:33.815405 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/17300fa4-3da6-4470-bf98-9e55b2c73886-proc\") pod \"perf-node-gather-daemonset-lvjw7\" (UID: \"17300fa4-3da6-4470-bf98-9e55b2c73886\") " pod="openshift-must-gather-mwsjl/perf-node-gather-daemonset-lvjw7" May 20 16:37:33.815436 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:33.815436 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/17300fa4-3da6-4470-bf98-9e55b2c73886-podres\") pod \"perf-node-gather-daemonset-lvjw7\" (UID: \"17300fa4-3da6-4470-bf98-9e55b2c73886\") " pod="openshift-must-gather-mwsjl/perf-node-gather-daemonset-lvjw7" May 20 16:37:33.815772 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:33.815472 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/17300fa4-3da6-4470-bf98-9e55b2c73886-lib-modules\") pod \"perf-node-gather-daemonset-lvjw7\" (UID: \"17300fa4-3da6-4470-bf98-9e55b2c73886\") " pod="openshift-must-gather-mwsjl/perf-node-gather-daemonset-lvjw7" May 20 16:37:33.815772 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:33.815521 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtvqw\" (UniqueName: \"kubernetes.io/projected/17300fa4-3da6-4470-bf98-9e55b2c73886-kube-api-access-wtvqw\") pod \"perf-node-gather-daemonset-lvjw7\" (UID: \"17300fa4-3da6-4470-bf98-9e55b2c73886\") " pod="openshift-must-gather-mwsjl/perf-node-gather-daemonset-lvjw7" May 20 16:37:33.815772 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:33.815595 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/17300fa4-3da6-4470-bf98-9e55b2c73886-sys\") pod \"perf-node-gather-daemonset-lvjw7\" (UID: \"17300fa4-3da6-4470-bf98-9e55b2c73886\") " pod="openshift-must-gather-mwsjl/perf-node-gather-daemonset-lvjw7" May 20 16:37:33.916485 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:33.916419 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/17300fa4-3da6-4470-bf98-9e55b2c73886-lib-modules\") pod \"perf-node-gather-daemonset-lvjw7\" (UID: \"17300fa4-3da6-4470-bf98-9e55b2c73886\") " pod="openshift-must-gather-mwsjl/perf-node-gather-daemonset-lvjw7" May 20 16:37:33.916485 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:33.916455 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wtvqw\" (UniqueName: \"kubernetes.io/projected/17300fa4-3da6-4470-bf98-9e55b2c73886-kube-api-access-wtvqw\") pod \"perf-node-gather-daemonset-lvjw7\" (UID: \"17300fa4-3da6-4470-bf98-9e55b2c73886\") " pod="openshift-must-gather-mwsjl/perf-node-gather-daemonset-lvjw7" May 20 16:37:33.916633 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:33.916587 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/17300fa4-3da6-4470-bf98-9e55b2c73886-lib-modules\") pod \"perf-node-gather-daemonset-lvjw7\" (UID: \"17300fa4-3da6-4470-bf98-9e55b2c73886\") " pod="openshift-must-gather-mwsjl/perf-node-gather-daemonset-lvjw7" May 20 16:37:33.916633 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:33.916591 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/17300fa4-3da6-4470-bf98-9e55b2c73886-sys\") pod \"perf-node-gather-daemonset-lvjw7\" (UID: \"17300fa4-3da6-4470-bf98-9e55b2c73886\") " pod="openshift-must-gather-mwsjl/perf-node-gather-daemonset-lvjw7" May 20 16:37:33.916703 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:33.916641 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/17300fa4-3da6-4470-bf98-9e55b2c73886-sys\") pod \"perf-node-gather-daemonset-lvjw7\" (UID: \"17300fa4-3da6-4470-bf98-9e55b2c73886\") " pod="openshift-must-gather-mwsjl/perf-node-gather-daemonset-lvjw7" May 20 16:37:33.916703 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:33.916654 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/17300fa4-3da6-4470-bf98-9e55b2c73886-proc\") pod \"perf-node-gather-daemonset-lvjw7\" (UID: \"17300fa4-3da6-4470-bf98-9e55b2c73886\") " pod="openshift-must-gather-mwsjl/perf-node-gather-daemonset-lvjw7" May 20 16:37:33.916703 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:33.916678 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/17300fa4-3da6-4470-bf98-9e55b2c73886-podres\") pod \"perf-node-gather-daemonset-lvjw7\" (UID: \"17300fa4-3da6-4470-bf98-9e55b2c73886\") " pod="openshift-must-gather-mwsjl/perf-node-gather-daemonset-lvjw7" May 20 16:37:33.916703 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:33.916684 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/17300fa4-3da6-4470-bf98-9e55b2c73886-proc\") pod \"perf-node-gather-daemonset-lvjw7\" (UID: \"17300fa4-3da6-4470-bf98-9e55b2c73886\") " pod="openshift-must-gather-mwsjl/perf-node-gather-daemonset-lvjw7" May 20 16:37:33.916832 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:33.916754 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/17300fa4-3da6-4470-bf98-9e55b2c73886-podres\") pod \"perf-node-gather-daemonset-lvjw7\" (UID: \"17300fa4-3da6-4470-bf98-9e55b2c73886\") " pod="openshift-must-gather-mwsjl/perf-node-gather-daemonset-lvjw7" May 20 16:37:33.924441 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:33.924417 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtvqw\" (UniqueName: \"kubernetes.io/projected/17300fa4-3da6-4470-bf98-9e55b2c73886-kube-api-access-wtvqw\") pod \"perf-node-gather-daemonset-lvjw7\" (UID: \"17300fa4-3da6-4470-bf98-9e55b2c73886\") " pod="openshift-must-gather-mwsjl/perf-node-gather-daemonset-lvjw7" May 20 16:37:34.006146 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:34.006120 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mwsjl/perf-node-gather-daemonset-lvjw7" May 20 16:37:34.134574 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:34.134490 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mwsjl/perf-node-gather-daemonset-lvjw7"] May 20 16:37:34.137314 ip-10-0-130-228 kubenswrapper[2557]: W0520 16:37:34.137289 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod17300fa4_3da6_4470_bf98_9e55b2c73886.slice/crio-e9b9917210b5bedc824859b67d51b0c6a71249ff3da29fa4b9accc86fd382815 WatchSource:0}: Error finding container e9b9917210b5bedc824859b67d51b0c6a71249ff3da29fa4b9accc86fd382815: Status 404 returned error can't find the container with id e9b9917210b5bedc824859b67d51b0c6a71249ff3da29fa4b9accc86fd382815 May 20 16:37:34.398784 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:34.398755 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hxl9x_fcbc1cf6-64e2-42ce-b29d-2c21b26668ce/dns/0.log" May 20 16:37:34.425398 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:34.425341 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hxl9x_fcbc1cf6-64e2-42ce-b29d-2c21b26668ce/kube-rbac-proxy/0.log" May 20 16:37:34.473461 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:34.473442 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-r8sqr_f3564822-b89c-4974-8c53-986c6b3fd1e7/dns-node-resolver/0.log" May 20 16:37:34.834546 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:34.834509 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mwsjl/perf-node-gather-daemonset-lvjw7" event={"ID":"17300fa4-3da6-4470-bf98-9e55b2c73886","Type":"ContainerStarted","Data":"dbffbe6501864b44013385aeb26c0eaf563d21350336d32f374036d151fadee0"} May 20 16:37:34.834938 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:34.834552 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mwsjl/perf-node-gather-daemonset-lvjw7" event={"ID":"17300fa4-3da6-4470-bf98-9e55b2c73886","Type":"ContainerStarted","Data":"e9b9917210b5bedc824859b67d51b0c6a71249ff3da29fa4b9accc86fd382815"} May 20 16:37:34.834938 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:34.834632 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mwsjl/perf-node-gather-daemonset-lvjw7" May 20 16:37:34.852596 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:34.852537 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-mwsjl/perf-node-gather-daemonset-lvjw7" podStartSLOduration=1.852524881 podStartE2EDuration="1.852524881s" podCreationTimestamp="2026-05-20 16:37:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 16:37:34.851290937 +0000 UTC m=+3886.066213753" watchObservedRunningTime="2026-05-20 16:37:34.852524881 +0000 UTC m=+3886.067447674" May 20 16:37:35.013079 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:35.012961 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wmwps_3965fa01-ac56-43aa-b92e-985a0e59fdc6/node-ca/0.log" May 20 16:37:35.709838 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:35.709786 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-65694f9b86-s6z2z_dd197f83-6962-416f-9520-6532a33ae2c1/router/0.log" May 20 16:37:36.089528 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:36.089498 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fvbkd_9f13da06-401d-412b-a532-a02a3a620761/serve-healthcheck-canary/0.log" May 20 16:37:36.483750 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:36.483713 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6bzm6_0ee12c56-05a4-4013-8297-a9d329afc1a4/kube-rbac-proxy/0.log" May 20 16:37:36.503755 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:36.503731 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6bzm6_0ee12c56-05a4-4013-8297-a9d329afc1a4/exporter/0.log" May 20 16:37:36.525110 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:36.525087 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6bzm6_0ee12c56-05a4-4013-8297-a9d329afc1a4/extractor/0.log" May 20 16:37:39.139254 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:39.139231 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-j7mqv_a46c1c68-0714-4e2b-b01e-a3828b70ad1a/s3-init/0.log" May 20 16:37:39.175588 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:39.175565 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-tls-init-custom-rjt8t_bf31921b-2418-4be0-8459-9ea84446e091/s3-tls-init-custom/0.log" May 20 16:37:39.232751 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:39.232725 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-tls-init-serving-db5fc_a356292f-2817-405f-a7cc-2f1240b05db1/s3-tls-init-serving/0.log" May 20 16:37:40.847939 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:40.847914 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mwsjl/perf-node-gather-daemonset-lvjw7" May 20 16:37:42.869110 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:42.869083 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-bbbs8_795c8587-73ca-4c0c-8f1f-dd2eedb6323a/migrator/0.log" May 20 16:37:42.891725 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:42.891706 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-bbbs8_795c8587-73ca-4c0c-8f1f-dd2eedb6323a/graceful-termination/0.log" May 20 16:37:43.254801 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:43.254760 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-sltsl_3fa0f676-1933-48b3-b1ed-65853b963ff0/kube-storage-version-migrator-operator/1.log" May 20 16:37:43.256482 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:43.256454 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-sltsl_3fa0f676-1933-48b3-b1ed-65853b963ff0/kube-storage-version-migrator-operator/0.log" May 20 16:37:44.603921 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:44.603885 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tzz5f_d4425adc-866b-4a45-8857-4a90c111f6ff/kube-multus-additional-cni-plugins/0.log" May 20 16:37:44.625199 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:44.625172 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tzz5f_d4425adc-866b-4a45-8857-4a90c111f6ff/egress-router-binary-copy/0.log" May 20 16:37:44.648593 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:44.648503 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tzz5f_d4425adc-866b-4a45-8857-4a90c111f6ff/cni-plugins/0.log" May 20 16:37:44.670060 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:44.670038 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tzz5f_d4425adc-866b-4a45-8857-4a90c111f6ff/bond-cni-plugin/0.log" May 20 16:37:44.689864 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:44.689834 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tzz5f_d4425adc-866b-4a45-8857-4a90c111f6ff/routeoverride-cni/0.log" May 20 16:37:44.709868 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:44.709848 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tzz5f_d4425adc-866b-4a45-8857-4a90c111f6ff/whereabouts-cni-bincopy/0.log" May 20 16:37:44.729826 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:44.729795 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tzz5f_d4425adc-866b-4a45-8857-4a90c111f6ff/whereabouts-cni/0.log" May 20 16:37:44.763759 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:44.763689 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-rsmqw_2ce6e5d4-1424-43c2-9263-ab0463bc8c6c/kube-multus/0.log" May 20 16:37:44.946996 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:44.946928 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-wszj2_54872a9c-6091-4768-8cd9-e81ab987ba01/network-metrics-daemon/0.log" May 20 16:37:44.966207 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:44.966174 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-wszj2_54872a9c-6091-4768-8cd9-e81ab987ba01/kube-rbac-proxy/0.log" May 20 16:37:45.748043 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:45.748014 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gvwgm_271da0d2-8828-4630-8143-39ef6964f7f4/ovn-controller/0.log" May 20 16:37:45.799169 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:45.799127 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gvwgm_271da0d2-8828-4630-8143-39ef6964f7f4/ovn-acl-logging/0.log" May 20 16:37:45.826878 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:45.826838 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gvwgm_271da0d2-8828-4630-8143-39ef6964f7f4/kube-rbac-proxy-node/0.log" May 20 16:37:45.850918 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:45.850893 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gvwgm_271da0d2-8828-4630-8143-39ef6964f7f4/kube-rbac-proxy-ovn-metrics/0.log" May 20 16:37:45.867492 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:45.867467 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gvwgm_271da0d2-8828-4630-8143-39ef6964f7f4/northd/0.log" May 20 16:37:45.887773 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:45.887751 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gvwgm_271da0d2-8828-4630-8143-39ef6964f7f4/nbdb/0.log" May 20 16:37:45.908749 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:45.908725 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gvwgm_271da0d2-8828-4630-8143-39ef6964f7f4/sbdb/0.log" May 20 16:37:46.076241 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:46.076161 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gvwgm_271da0d2-8828-4630-8143-39ef6964f7f4/ovnkube-controller/0.log" May 20 16:37:47.752805 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:47.752775 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-7f44b6dd87-cst47_251edcb6-4345-4fe1-8388-5c973498cbc4/check-endpoints/0.log" May 20 16:37:47.796123 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:47.796092 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-dv77n_ae4048cd-ad5b-4154-8b48-47363ccceda4/network-check-target-container/0.log" May 20 16:37:48.796264 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:48.796232 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-zfwc4_7b177a52-2efa-4ece-ae5a-52b2386682dd/iptables-alerter/0.log" May 20 16:37:49.413619 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:49.413592 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-w226m_81f3d24b-3a44-4ab6-8b9c-d8cfcef12eb4/tuned/0.log" May 20 16:37:49.552072 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:49.552047 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-gwx4j_574489b4-f926-4667-be55-8e4e4d4f98e4/console-operator/2.log" May 20 16:37:49.559567 ip-10-0-130-228 kubenswrapper[2557]: I0520 16:37:49.559546 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-gwx4j_574489b4-f926-4667-be55-8e4e4d4f98e4/console-operator/2.log"