May 28 07:56:43.217768 ip-10-0-139-133 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory May 28 07:56:43.217782 ip-10-0-139-133 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory May 28 07:56:43.217792 ip-10-0-139-133 systemd[1]: kubelet.service: Failed with result 'resources'. May 28 07:56:43.218101 ip-10-0-139-133 systemd[1]: Failed to start Kubernetes Kubelet. May 28 07:56:53.462397 ip-10-0-139-133 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. May 28 07:56:53.462419 ip-10-0-139-133 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot c5ea5bb4db534768b7b4979db1607c6e -- May 28 07:59:19.977982 ip-10-0-139-133 systemd[1]: Starting Kubernetes Kubelet... May 28 07:59:20.464444 ip-10-0-139-133 kubenswrapper[2560]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 28 07:59:20.464444 ip-10-0-139-133 kubenswrapper[2560]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 28 07:59:20.464444 ip-10-0-139-133 kubenswrapper[2560]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 28 07:59:20.464444 ip-10-0-139-133 kubenswrapper[2560]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 28 07:59:20.464444 ip-10-0-139-133 kubenswrapper[2560]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 28 07:59:20.468138 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.468044 2560 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 28 07:59:20.472776 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.472761 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 28 07:59:20.472776 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.472776 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 28 07:59:20.472842 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.472780 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 28 07:59:20.472842 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.472783 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 28 07:59:20.472842 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.472786 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 28 07:59:20.472842 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.472790 2560 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 28 07:59:20.472842 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.472794 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 28 07:59:20.472842 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.472797 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 28 07:59:20.472842 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.472800 2560 feature_gate.go:328] unrecognized feature gate: Example2 May 28 07:59:20.472842 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.472803 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 28 07:59:20.472842 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.472806 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 28 07:59:20.472842 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.472814 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 28 07:59:20.472842 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.472817 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages May 28 07:59:20.472842 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.472820 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 28 07:59:20.472842 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.472822 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 28 07:59:20.472842 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.472825 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 28 07:59:20.472842 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.472828 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 28 07:59:20.472842 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.472830 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 28 07:59:20.472842 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.472833 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 28 07:59:20.472842 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.472835 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 28 07:59:20.472842 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.472838 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 28 07:59:20.473296 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.472840 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 28 07:59:20.473296 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.472843 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 28 07:59:20.473296 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.472846 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 28 07:59:20.473296 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.472848 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 28 07:59:20.473296 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.472851 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 28 07:59:20.473296 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.472854 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 28 07:59:20.473296 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.472857 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 28 07:59:20.473296 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.472860 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 28 07:59:20.473296 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.472862 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 28 07:59:20.473296 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.472865 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 28 07:59:20.473296 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.472867 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 28 07:59:20.473296 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.472870 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 28 07:59:20.473296 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.472872 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 28 07:59:20.473296 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.472876 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 28 07:59:20.473296 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.472881 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 28 07:59:20.473296 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.472885 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 28 07:59:20.473296 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.472889 2560 feature_gate.go:328] unrecognized feature gate: DualReplica May 28 07:59:20.473296 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.472892 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 28 07:59:20.473296 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.472895 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 28 07:59:20.473796 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.472898 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 28 07:59:20.473796 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.472900 2560 feature_gate.go:328] unrecognized feature gate: NewOLM May 28 07:59:20.473796 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.472903 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores May 28 07:59:20.473796 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.472907 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 28 07:59:20.473796 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.472910 2560 feature_gate.go:328] unrecognized feature gate: Example May 28 07:59:20.473796 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.472913 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 28 07:59:20.473796 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.472915 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 28 07:59:20.473796 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.472918 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 28 07:59:20.473796 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.472921 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 28 07:59:20.473796 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.472923 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 28 07:59:20.473796 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.472925 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 28 07:59:20.473796 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.472928 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 28 07:59:20.473796 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.472930 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 28 07:59:20.473796 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.472933 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 28 07:59:20.473796 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.472937 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 28 07:59:20.473796 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.472940 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 28 07:59:20.473796 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.472943 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 28 07:59:20.473796 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.472945 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 28 07:59:20.473796 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.472948 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 28 07:59:20.473796 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.472950 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 28 07:59:20.473796 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.472953 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 28 07:59:20.474295 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.472955 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 28 07:59:20.474295 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.472958 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 28 07:59:20.474295 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.472960 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability May 28 07:59:20.474295 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.472963 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 28 07:59:20.474295 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.472966 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 28 07:59:20.474295 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.472969 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 28 07:59:20.474295 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.472971 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 28 07:59:20.474295 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.472974 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 28 07:59:20.474295 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.472976 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 28 07:59:20.474295 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.472979 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 28 07:59:20.474295 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.472982 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 28 07:59:20.474295 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.472984 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 28 07:59:20.474295 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.472986 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 28 07:59:20.474295 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.472990 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 28 07:59:20.474295 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.472992 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 28 07:59:20.474295 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.472995 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 28 07:59:20.474295 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.472998 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 28 07:59:20.474295 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473000 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 28 07:59:20.474295 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473004 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 28 07:59:20.474295 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473006 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 28 07:59:20.474784 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473009 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 28 07:59:20.474784 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473011 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 28 07:59:20.474784 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473014 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 28 07:59:20.474784 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473016 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 28 07:59:20.474784 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473019 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 28 07:59:20.474784 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473396 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 28 07:59:20.474784 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473401 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 28 07:59:20.474784 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473404 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 28 07:59:20.474784 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473407 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 28 07:59:20.474784 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473410 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 28 07:59:20.474784 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473412 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 28 07:59:20.474784 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473415 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 28 07:59:20.474784 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473419 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 28 07:59:20.474784 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473423 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 28 07:59:20.474784 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473426 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 28 07:59:20.474784 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473428 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 28 07:59:20.474784 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473431 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 28 07:59:20.474784 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473433 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 28 07:59:20.474784 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473436 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 28 07:59:20.475263 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473439 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 28 07:59:20.475263 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473442 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 28 07:59:20.475263 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473444 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 28 07:59:20.475263 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473447 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 28 07:59:20.475263 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473450 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 28 07:59:20.475263 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473453 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 28 07:59:20.475263 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473455 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 28 07:59:20.475263 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473458 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 28 07:59:20.475263 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473461 2560 feature_gate.go:328] unrecognized feature gate: DualReplica May 28 07:59:20.475263 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473464 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 28 07:59:20.475263 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473467 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 28 07:59:20.475263 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473469 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages May 28 07:59:20.475263 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473472 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 28 07:59:20.475263 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473474 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 28 07:59:20.475263 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473477 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 28 07:59:20.475263 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473479 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 28 07:59:20.475263 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473482 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 28 07:59:20.475263 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473484 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 28 07:59:20.475263 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473487 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 28 07:59:20.475263 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473490 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 28 07:59:20.475765 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473492 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 28 07:59:20.475765 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473495 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 28 07:59:20.475765 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473497 2560 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 28 07:59:20.475765 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473500 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 28 07:59:20.475765 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473502 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 28 07:59:20.475765 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473505 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 28 07:59:20.475765 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473507 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 28 07:59:20.475765 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473510 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 28 07:59:20.475765 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473512 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 28 07:59:20.475765 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473515 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 28 07:59:20.475765 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473517 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 28 07:59:20.475765 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473520 2560 feature_gate.go:328] unrecognized feature gate: Example2 May 28 07:59:20.475765 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473523 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 28 07:59:20.475765 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473525 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 28 07:59:20.475765 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473528 2560 feature_gate.go:328] unrecognized feature gate: NewOLM May 28 07:59:20.475765 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473530 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 28 07:59:20.475765 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473533 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 28 07:59:20.475765 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473535 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 28 07:59:20.475765 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473538 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 28 07:59:20.475765 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473540 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 28 07:59:20.476263 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473543 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 28 07:59:20.476263 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473545 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 28 07:59:20.476263 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473548 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 28 07:59:20.476263 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473551 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 28 07:59:20.476263 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473553 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 28 07:59:20.476263 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473555 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 28 07:59:20.476263 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473572 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 28 07:59:20.476263 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473575 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 28 07:59:20.476263 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473577 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 28 07:59:20.476263 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473580 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 28 07:59:20.476263 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473583 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 28 07:59:20.476263 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473587 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 28 07:59:20.476263 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473591 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 28 07:59:20.476263 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473594 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 28 07:59:20.476263 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473597 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 28 07:59:20.476263 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473600 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 28 07:59:20.476263 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473602 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability May 28 07:59:20.476263 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473605 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 28 07:59:20.476263 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473608 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 28 07:59:20.476263 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473611 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 28 07:59:20.476764 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473614 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 28 07:59:20.476764 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473617 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 28 07:59:20.476764 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473619 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores May 28 07:59:20.476764 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473626 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 28 07:59:20.476764 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473630 2560 feature_gate.go:328] unrecognized feature gate: Example May 28 07:59:20.476764 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473632 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 28 07:59:20.476764 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473635 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 28 07:59:20.476764 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473637 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 28 07:59:20.476764 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473640 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 28 07:59:20.476764 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473643 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 28 07:59:20.476764 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473645 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 28 07:59:20.476764 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.473648 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 28 07:59:20.476764 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474598 2560 flags.go:64] FLAG: --address="0.0.0.0" May 28 07:59:20.476764 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474612 2560 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 28 07:59:20.476764 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474622 2560 flags.go:64] FLAG: --anonymous-auth="true" May 28 07:59:20.476764 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474627 2560 flags.go:64] FLAG: --application-metrics-count-limit="100" May 28 07:59:20.476764 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474631 2560 flags.go:64] FLAG: --authentication-token-webhook="false" May 28 07:59:20.476764 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474635 2560 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 28 07:59:20.476764 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474639 2560 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 28 07:59:20.476764 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474643 2560 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 28 07:59:20.476764 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474646 2560 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 28 07:59:20.477274 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474649 2560 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 28 07:59:20.477274 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474653 2560 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 28 07:59:20.477274 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474656 2560 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 28 07:59:20.477274 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474660 2560 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 28 07:59:20.477274 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474663 2560 flags.go:64] FLAG: --cgroup-root="" May 28 07:59:20.477274 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474666 2560 flags.go:64] FLAG: --cgroups-per-qos="true" May 28 07:59:20.477274 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474669 2560 flags.go:64] FLAG: --client-ca-file="" May 28 07:59:20.477274 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474672 2560 flags.go:64] FLAG: --cloud-config="" May 28 07:59:20.477274 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474675 2560 flags.go:64] FLAG: --cloud-provider="external" May 28 07:59:20.477274 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474678 2560 flags.go:64] FLAG: --cluster-dns="[]" May 28 07:59:20.477274 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474683 2560 flags.go:64] FLAG: --cluster-domain="" May 28 07:59:20.477274 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474686 2560 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 28 07:59:20.477274 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474690 2560 flags.go:64] FLAG: --config-dir="" May 28 07:59:20.477274 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474693 2560 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 28 07:59:20.477274 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474698 2560 flags.go:64] FLAG: --container-log-max-files="5" May 28 07:59:20.477274 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474702 2560 flags.go:64] FLAG: --container-log-max-size="10Mi" May 28 07:59:20.477274 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474705 2560 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 28 07:59:20.477274 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474708 2560 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 28 07:59:20.477274 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474711 2560 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 28 07:59:20.477274 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474714 2560 flags.go:64] FLAG: --contention-profiling="false" May 28 07:59:20.477274 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474717 2560 flags.go:64] FLAG: --cpu-cfs-quota="true" May 28 07:59:20.477274 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474720 2560 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 28 07:59:20.477274 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474723 2560 flags.go:64] FLAG: --cpu-manager-policy="none" May 28 07:59:20.477274 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474726 2560 flags.go:64] FLAG: --cpu-manager-policy-options="" May 28 07:59:20.477274 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474730 2560 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 28 07:59:20.477900 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474734 2560 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 28 07:59:20.477900 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474737 2560 flags.go:64] FLAG: --enable-debugging-handlers="true" May 28 07:59:20.477900 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474740 2560 flags.go:64] FLAG: --enable-load-reader="false" May 28 07:59:20.477900 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474744 2560 flags.go:64] FLAG: --enable-server="true" May 28 07:59:20.477900 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474747 2560 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 28 07:59:20.477900 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474751 2560 flags.go:64] FLAG: --event-burst="100" May 28 07:59:20.477900 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474754 2560 flags.go:64] FLAG: --event-qps="50" May 28 07:59:20.477900 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474757 2560 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 28 07:59:20.477900 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474760 2560 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 28 07:59:20.477900 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474763 2560 flags.go:64] FLAG: --eviction-hard="" May 28 07:59:20.477900 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474767 2560 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 28 07:59:20.477900 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474769 2560 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 28 07:59:20.477900 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474773 2560 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 28 07:59:20.477900 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474775 2560 flags.go:64] FLAG: --eviction-soft="" May 28 07:59:20.477900 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474778 2560 flags.go:64] FLAG: --eviction-soft-grace-period="" May 28 07:59:20.477900 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474781 2560 flags.go:64] FLAG: --exit-on-lock-contention="false" May 28 07:59:20.477900 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474784 2560 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 28 07:59:20.477900 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474787 2560 flags.go:64] FLAG: --experimental-mounter-path="" May 28 07:59:20.477900 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474790 2560 flags.go:64] FLAG: --fail-cgroupv1="false" May 28 07:59:20.477900 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474793 2560 flags.go:64] FLAG: --fail-swap-on="true" May 28 07:59:20.477900 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474797 2560 flags.go:64] FLAG: --feature-gates="" May 28 07:59:20.477900 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474801 2560 flags.go:64] FLAG: --file-check-frequency="20s" May 28 07:59:20.477900 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474804 2560 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 28 07:59:20.477900 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474807 2560 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 28 07:59:20.477900 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474811 2560 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 28 07:59:20.478494 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474814 2560 flags.go:64] FLAG: --healthz-port="10248" May 28 07:59:20.478494 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474817 2560 flags.go:64] FLAG: --help="false" May 28 07:59:20.478494 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474819 2560 flags.go:64] FLAG: --hostname-override="ip-10-0-139-133.ec2.internal" May 28 07:59:20.478494 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474822 2560 flags.go:64] FLAG: --housekeeping-interval="10s" May 28 07:59:20.478494 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474825 2560 flags.go:64] FLAG: --http-check-frequency="20s" May 28 07:59:20.478494 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474828 2560 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 28 07:59:20.478494 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474831 2560 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 28 07:59:20.478494 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474835 2560 flags.go:64] FLAG: --image-gc-high-threshold="85" May 28 07:59:20.478494 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474838 2560 flags.go:64] FLAG: --image-gc-low-threshold="80" May 28 07:59:20.478494 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474841 2560 flags.go:64] FLAG: --image-service-endpoint="" May 28 07:59:20.478494 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474844 2560 flags.go:64] FLAG: --kernel-memcg-notification="false" May 28 07:59:20.478494 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474847 2560 flags.go:64] FLAG: --kube-api-burst="100" May 28 07:59:20.478494 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474850 2560 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 28 07:59:20.478494 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474853 2560 flags.go:64] FLAG: --kube-api-qps="50" May 28 07:59:20.478494 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474856 2560 flags.go:64] FLAG: --kube-reserved="" May 28 07:59:20.478494 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474859 2560 flags.go:64] FLAG: --kube-reserved-cgroup="" May 28 07:59:20.478494 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474862 2560 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 28 07:59:20.478494 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474865 2560 flags.go:64] FLAG: --kubelet-cgroups="" May 28 07:59:20.478494 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474867 2560 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 28 07:59:20.478494 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474870 2560 flags.go:64] FLAG: --lock-file="" May 28 07:59:20.478494 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474873 2560 flags.go:64] FLAG: --log-cadvisor-usage="false" May 28 07:59:20.478494 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474876 2560 flags.go:64] FLAG: --log-flush-frequency="5s" May 28 07:59:20.478494 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474879 2560 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 28 07:59:20.478494 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474884 2560 flags.go:64] FLAG: --log-json-split-stream="false" May 28 07:59:20.479093 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474887 2560 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 28 07:59:20.479093 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474890 2560 flags.go:64] FLAG: --log-text-split-stream="false" May 28 07:59:20.479093 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474893 2560 flags.go:64] FLAG: --logging-format="text" May 28 07:59:20.479093 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474896 2560 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 28 07:59:20.479093 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474899 2560 flags.go:64] FLAG: --make-iptables-util-chains="true" May 28 07:59:20.479093 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474902 2560 flags.go:64] FLAG: --manifest-url="" May 28 07:59:20.479093 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474905 2560 flags.go:64] FLAG: --manifest-url-header="" May 28 07:59:20.479093 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474910 2560 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 28 07:59:20.479093 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474913 2560 flags.go:64] FLAG: --max-open-files="1000000" May 28 07:59:20.479093 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474917 2560 flags.go:64] FLAG: --max-pods="110" May 28 07:59:20.479093 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474920 2560 flags.go:64] FLAG: --maximum-dead-containers="-1" May 28 07:59:20.479093 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474923 2560 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 28 07:59:20.479093 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474926 2560 flags.go:64] FLAG: --memory-manager-policy="None" May 28 07:59:20.479093 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474929 2560 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 28 07:59:20.479093 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474932 2560 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 28 07:59:20.479093 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474935 2560 flags.go:64] FLAG: --node-ip="0.0.0.0" May 28 07:59:20.479093 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474938 2560 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 28 07:59:20.479093 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474945 2560 flags.go:64] FLAG: --node-status-max-images="50" May 28 07:59:20.479093 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474949 2560 flags.go:64] FLAG: --node-status-update-frequency="10s" May 28 07:59:20.479093 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474953 2560 flags.go:64] FLAG: --oom-score-adj="-999" May 28 07:59:20.479093 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474956 2560 flags.go:64] FLAG: --pod-cidr="" May 28 07:59:20.479093 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474959 2560 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 28 07:59:20.479093 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474965 2560 flags.go:64] FLAG: --pod-manifest-path="" May 28 07:59:20.479705 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474968 2560 flags.go:64] FLAG: --pod-max-pids="-1" May 28 07:59:20.479705 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474971 2560 flags.go:64] FLAG: --pods-per-core="0" May 28 07:59:20.479705 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474974 2560 flags.go:64] FLAG: --port="10250" May 28 07:59:20.479705 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474977 2560 flags.go:64] FLAG: --protect-kernel-defaults="false" May 28 07:59:20.479705 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474980 2560 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0958ddafed2754466" May 28 07:59:20.479705 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474983 2560 flags.go:64] FLAG: --qos-reserved="" May 28 07:59:20.479705 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474986 2560 flags.go:64] FLAG: --read-only-port="10255" May 28 07:59:20.479705 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474989 2560 flags.go:64] FLAG: --register-node="true" May 28 07:59:20.479705 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474992 2560 flags.go:64] FLAG: --register-schedulable="true" May 28 07:59:20.479705 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474995 2560 flags.go:64] FLAG: --register-with-taints="" May 28 07:59:20.479705 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.474999 2560 flags.go:64] FLAG: --registry-burst="10" May 28 07:59:20.479705 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.475001 2560 flags.go:64] FLAG: --registry-qps="5" May 28 07:59:20.479705 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.475004 2560 flags.go:64] FLAG: --reserved-cpus="" May 28 07:59:20.479705 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.475007 2560 flags.go:64] FLAG: --reserved-memory="" May 28 07:59:20.479705 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.475011 2560 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 28 07:59:20.479705 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.475014 2560 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 28 07:59:20.479705 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.475017 2560 flags.go:64] FLAG: --rotate-certificates="false" May 28 07:59:20.479705 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.475020 2560 flags.go:64] FLAG: --rotate-server-certificates="false" May 28 07:59:20.479705 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.475023 2560 flags.go:64] FLAG: --runonce="false" May 28 07:59:20.479705 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.475026 2560 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 28 07:59:20.479705 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.475029 2560 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 28 07:59:20.479705 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.475032 2560 flags.go:64] FLAG: --seccomp-default="false" May 28 07:59:20.479705 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.475036 2560 flags.go:64] FLAG: --serialize-image-pulls="true" May 28 07:59:20.479705 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.475039 2560 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 28 07:59:20.479705 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.475042 2560 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 28 07:59:20.479705 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.475046 2560 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 28 07:59:20.480337 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.475049 2560 flags.go:64] FLAG: --storage-driver-password="root" May 28 07:59:20.480337 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.475052 2560 flags.go:64] FLAG: --storage-driver-secure="false" May 28 07:59:20.480337 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.475055 2560 flags.go:64] FLAG: --storage-driver-table="stats" May 28 07:59:20.480337 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.475066 2560 flags.go:64] FLAG: --storage-driver-user="root" May 28 07:59:20.480337 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.475069 2560 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 28 07:59:20.480337 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.475072 2560 flags.go:64] FLAG: --sync-frequency="1m0s" May 28 07:59:20.480337 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.475076 2560 flags.go:64] FLAG: --system-cgroups="" May 28 07:59:20.480337 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.475079 2560 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 28 07:59:20.480337 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.475084 2560 flags.go:64] FLAG: --system-reserved-cgroup="" May 28 07:59:20.480337 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.475087 2560 flags.go:64] FLAG: --tls-cert-file="" May 28 07:59:20.480337 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.475090 2560 flags.go:64] FLAG: --tls-cipher-suites="[]" May 28 07:59:20.480337 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.475097 2560 flags.go:64] FLAG: --tls-min-version="" May 28 07:59:20.480337 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.475099 2560 flags.go:64] FLAG: --tls-private-key-file="" May 28 07:59:20.480337 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.475102 2560 flags.go:64] FLAG: --topology-manager-policy="none" May 28 07:59:20.480337 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.475105 2560 flags.go:64] FLAG: --topology-manager-policy-options="" May 28 07:59:20.480337 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.475108 2560 flags.go:64] FLAG: --topology-manager-scope="container" May 28 07:59:20.480337 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.475111 2560 flags.go:64] FLAG: --v="2" May 28 07:59:20.480337 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.475115 2560 flags.go:64] FLAG: --version="false" May 28 07:59:20.480337 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.475119 2560 flags.go:64] FLAG: --vmodule="" May 28 07:59:20.480337 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.475124 2560 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 28 07:59:20.480337 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.475127 2560 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 28 07:59:20.480337 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475240 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 28 07:59:20.480337 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475243 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 28 07:59:20.480337 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475247 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 28 07:59:20.480956 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475250 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 28 07:59:20.480956 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475253 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 28 07:59:20.480956 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475256 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 28 07:59:20.480956 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475258 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 28 07:59:20.480956 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475261 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages May 28 07:59:20.480956 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475264 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 28 07:59:20.480956 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475267 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 28 07:59:20.480956 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475270 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 28 07:59:20.480956 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475273 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 28 07:59:20.480956 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475275 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 28 07:59:20.480956 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475278 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 28 07:59:20.480956 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475281 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 28 07:59:20.480956 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475287 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 28 07:59:20.480956 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475289 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 28 07:59:20.480956 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475292 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 28 07:59:20.480956 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475294 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 28 07:59:20.480956 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475297 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 28 07:59:20.480956 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475299 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 28 07:59:20.480956 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475302 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 28 07:59:20.481424 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475304 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 28 07:59:20.481424 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475307 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 28 07:59:20.481424 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475309 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 28 07:59:20.481424 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475312 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 28 07:59:20.481424 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475314 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 28 07:59:20.481424 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475317 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 28 07:59:20.481424 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475319 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 28 07:59:20.481424 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475323 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 28 07:59:20.481424 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475326 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 28 07:59:20.481424 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475329 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 28 07:59:20.481424 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475331 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 28 07:59:20.481424 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475334 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 28 07:59:20.481424 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475336 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 28 07:59:20.481424 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475339 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 28 07:59:20.481424 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475342 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 28 07:59:20.481424 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475345 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 28 07:59:20.481424 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475347 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 28 07:59:20.481424 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475350 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 28 07:59:20.481424 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475352 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 28 07:59:20.481424 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475355 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 28 07:59:20.482010 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475357 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 28 07:59:20.482010 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475360 2560 feature_gate.go:328] unrecognized feature gate: NewOLM May 28 07:59:20.482010 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475362 2560 feature_gate.go:328] unrecognized feature gate: Example May 28 07:59:20.482010 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475365 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 28 07:59:20.482010 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475368 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 28 07:59:20.482010 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475370 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 28 07:59:20.482010 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475378 2560 feature_gate.go:328] unrecognized feature gate: Example2 May 28 07:59:20.482010 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475381 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 28 07:59:20.482010 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475384 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 28 07:59:20.482010 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475386 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 28 07:59:20.482010 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475389 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 28 07:59:20.482010 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475391 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 28 07:59:20.482010 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475394 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 28 07:59:20.482010 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475397 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 28 07:59:20.482010 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475399 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 28 07:59:20.482010 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475402 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 28 07:59:20.482010 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475404 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 28 07:59:20.482010 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475407 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 28 07:59:20.482010 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475409 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 28 07:59:20.482010 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475413 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 28 07:59:20.482595 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475416 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 28 07:59:20.482595 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475420 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 28 07:59:20.482595 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475424 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 28 07:59:20.482595 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475429 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 28 07:59:20.482595 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475431 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 28 07:59:20.482595 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475434 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 28 07:59:20.482595 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475437 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 28 07:59:20.482595 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475439 2560 feature_gate.go:328] unrecognized feature gate: DualReplica May 28 07:59:20.482595 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475442 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores May 28 07:59:20.482595 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475445 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 28 07:59:20.482595 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475447 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability May 28 07:59:20.482595 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475450 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 28 07:59:20.482595 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475452 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 28 07:59:20.482595 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475454 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 28 07:59:20.482595 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475457 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 28 07:59:20.482595 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475459 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 28 07:59:20.482595 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475463 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 28 07:59:20.482595 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475467 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 28 07:59:20.482595 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475470 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 28 07:59:20.483237 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475476 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 28 07:59:20.483237 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475478 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 28 07:59:20.483237 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475481 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 28 07:59:20.483237 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475484 2560 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 28 07:59:20.483237 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.475487 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 28 07:59:20.483237 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.476164 2560 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 28 07:59:20.485170 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.485055 2560 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 28 07:59:20.485170 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.485169 2560 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 28 07:59:20.485324 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485236 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 28 07:59:20.485324 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485241 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 28 07:59:20.485324 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485245 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 28 07:59:20.485324 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485248 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 28 07:59:20.485324 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485251 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 28 07:59:20.485324 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485254 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 28 07:59:20.485324 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485256 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 28 07:59:20.485324 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485259 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 28 07:59:20.485324 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485261 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 28 07:59:20.485324 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485264 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 28 07:59:20.485324 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485267 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 28 07:59:20.485324 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485270 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 28 07:59:20.485324 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485273 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 28 07:59:20.485324 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485275 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 28 07:59:20.485324 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485278 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 28 07:59:20.485324 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485280 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 28 07:59:20.485324 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485283 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 28 07:59:20.485324 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485286 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 28 07:59:20.485324 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485288 2560 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 28 07:59:20.485809 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485291 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 28 07:59:20.485809 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485293 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 28 07:59:20.485809 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485296 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 28 07:59:20.485809 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485298 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 28 07:59:20.485809 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485301 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 28 07:59:20.485809 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485303 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 28 07:59:20.485809 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485307 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 28 07:59:20.485809 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485309 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 28 07:59:20.485809 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485312 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 28 07:59:20.485809 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485315 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 28 07:59:20.485809 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485317 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 28 07:59:20.485809 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485320 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 28 07:59:20.485809 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485322 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 28 07:59:20.485809 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485325 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 28 07:59:20.485809 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485328 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 28 07:59:20.485809 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485331 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 28 07:59:20.485809 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485334 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 28 07:59:20.485809 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485337 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 28 07:59:20.485809 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485340 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 28 07:59:20.485809 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485343 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 28 07:59:20.486303 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485346 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 28 07:59:20.486303 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485349 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 28 07:59:20.486303 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485351 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 28 07:59:20.486303 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485354 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability May 28 07:59:20.486303 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485357 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 28 07:59:20.486303 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485359 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 28 07:59:20.486303 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485362 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 28 07:59:20.486303 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485364 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 28 07:59:20.486303 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485368 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 28 07:59:20.486303 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485373 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 28 07:59:20.486303 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485376 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 28 07:59:20.486303 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485379 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 28 07:59:20.486303 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485382 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 28 07:59:20.486303 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485385 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 28 07:59:20.486303 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485388 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 28 07:59:20.486303 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485391 2560 feature_gate.go:328] unrecognized feature gate: Example May 28 07:59:20.486303 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485393 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 28 07:59:20.486303 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485396 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 28 07:59:20.486303 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485399 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 28 07:59:20.486303 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485401 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 28 07:59:20.486809 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485404 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 28 07:59:20.486809 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485406 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 28 07:59:20.486809 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485409 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 28 07:59:20.486809 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485411 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 28 07:59:20.486809 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485414 2560 feature_gate.go:328] unrecognized feature gate: DualReplica May 28 07:59:20.486809 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485417 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 28 07:59:20.486809 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485420 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 28 07:59:20.486809 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485423 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 28 07:59:20.486809 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485426 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 28 07:59:20.486809 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485428 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 28 07:59:20.486809 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485431 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 28 07:59:20.486809 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485434 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages May 28 07:59:20.486809 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485436 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 28 07:59:20.486809 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485439 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 28 07:59:20.486809 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485441 2560 feature_gate.go:328] unrecognized feature gate: Example2 May 28 07:59:20.486809 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485444 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 28 07:59:20.486809 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485446 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 28 07:59:20.486809 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485451 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 28 07:59:20.486809 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485455 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 28 07:59:20.487269 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485457 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 28 07:59:20.487269 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485460 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 28 07:59:20.487269 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485463 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 28 07:59:20.487269 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485465 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 28 07:59:20.487269 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485468 2560 feature_gate.go:328] unrecognized feature gate: NewOLM May 28 07:59:20.487269 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485471 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores May 28 07:59:20.487269 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485473 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 28 07:59:20.487269 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485476 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 28 07:59:20.487269 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.485481 2560 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 28 07:59:20.487269 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485594 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 28 07:59:20.487269 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485600 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 28 07:59:20.487269 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485603 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 28 07:59:20.487269 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485606 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 28 07:59:20.487269 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485609 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 28 07:59:20.487269 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485612 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 28 07:59:20.487269 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485615 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 28 07:59:20.487691 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485618 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 28 07:59:20.487691 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485621 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 28 07:59:20.487691 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485624 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 28 07:59:20.487691 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485627 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 28 07:59:20.487691 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485630 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 28 07:59:20.487691 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485633 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 28 07:59:20.487691 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485636 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 28 07:59:20.487691 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485639 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 28 07:59:20.487691 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485642 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 28 07:59:20.487691 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485645 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores May 28 07:59:20.487691 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485647 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 28 07:59:20.487691 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485650 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 28 07:59:20.487691 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485652 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 28 07:59:20.487691 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485655 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 28 07:59:20.487691 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485658 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 28 07:59:20.487691 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485661 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 28 07:59:20.487691 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485664 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 28 07:59:20.487691 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485666 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 28 07:59:20.487691 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485669 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 28 07:59:20.487691 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485671 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 28 07:59:20.488180 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485674 2560 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 28 07:59:20.488180 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485676 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 28 07:59:20.488180 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485679 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 28 07:59:20.488180 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485681 2560 feature_gate.go:328] unrecognized feature gate: NewOLM May 28 07:59:20.488180 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485684 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 28 07:59:20.488180 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485686 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 28 07:59:20.488180 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485689 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 28 07:59:20.488180 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485691 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 28 07:59:20.488180 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485694 2560 feature_gate.go:328] unrecognized feature gate: DualReplica May 28 07:59:20.488180 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485696 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 28 07:59:20.488180 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485699 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 28 07:59:20.488180 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485701 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 28 07:59:20.488180 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485704 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 28 07:59:20.488180 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485707 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 28 07:59:20.488180 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485709 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 28 07:59:20.488180 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485712 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 28 07:59:20.488180 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485715 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 28 07:59:20.488180 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485718 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 28 07:59:20.488180 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485721 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages May 28 07:59:20.488180 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485723 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 28 07:59:20.488839 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485726 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 28 07:59:20.488839 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485729 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 28 07:59:20.488839 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485731 2560 feature_gate.go:328] unrecognized feature gate: Example May 28 07:59:20.488839 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485734 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 28 07:59:20.488839 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485737 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability May 28 07:59:20.488839 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485739 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 28 07:59:20.488839 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485742 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 28 07:59:20.488839 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485744 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 28 07:59:20.488839 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485748 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 28 07:59:20.488839 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485752 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 28 07:59:20.488839 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485756 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 28 07:59:20.488839 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485759 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 28 07:59:20.488839 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485762 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 28 07:59:20.488839 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485765 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 28 07:59:20.488839 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485768 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 28 07:59:20.488839 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485771 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 28 07:59:20.488839 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485774 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 28 07:59:20.488839 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485777 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 28 07:59:20.488839 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485780 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 28 07:59:20.489322 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485782 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 28 07:59:20.489322 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485785 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 28 07:59:20.489322 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485787 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 28 07:59:20.489322 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485790 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 28 07:59:20.489322 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485792 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 28 07:59:20.489322 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485795 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 28 07:59:20.489322 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485798 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 28 07:59:20.489322 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485800 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 28 07:59:20.489322 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485803 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 28 07:59:20.489322 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485806 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 28 07:59:20.489322 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485808 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 28 07:59:20.489322 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485811 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 28 07:59:20.489322 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485814 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 28 07:59:20.489322 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485817 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 28 07:59:20.489322 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485820 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 28 07:59:20.489322 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485822 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 28 07:59:20.489322 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485825 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 28 07:59:20.489322 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485828 2560 feature_gate.go:328] unrecognized feature gate: Example2 May 28 07:59:20.489322 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485830 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 28 07:59:20.489322 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:20.485833 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 28 07:59:20.489816 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.485838 2560 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 28 07:59:20.489816 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.486740 2560 server.go:962] "Client rotation is on, will bootstrap in background" May 28 07:59:20.491741 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.491728 2560 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 28 07:59:20.492797 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.492785 2560 server.go:1019] "Starting client certificate rotation" May 28 07:59:20.492902 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.492885 2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 28 07:59:20.492933 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.492924 2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 28 07:59:20.522332 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.522313 2560 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 28 07:59:20.524202 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.524174 2560 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 28 07:59:20.544322 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.544303 2560 log.go:25] "Validated CRI v1 runtime API" May 28 07:59:20.550044 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.550030 2560 log.go:25] "Validated CRI v1 image API" May 28 07:59:20.551352 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.551333 2560 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 28 07:59:20.551482 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.551466 2560 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 28 07:59:20.555771 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.555753 2560 fs.go:135] Filesystem UUIDs: map[03d7e8d8-6f19-491f-9caf-1b4e789d1e29:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 d5c15230-2971-4dd7-abfe-e4846cf09fa1:/dev/nvme0n1p3] May 28 07:59:20.555842 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.555770 2560 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 28 07:59:20.561314 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.561200 2560 manager.go:217] Machine: {Timestamp:2026-05-28 07:59:20.560726058 +0000 UTC m=+0.447172190 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3108621 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2534aebd598ded3c6140654d987fc6 SystemUUID:ec2534ae-bd59-8ded-3c61-40654d987fc6 BootID:c5ea5bb4-db53-4768-b7b4-979db1607c6e Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:5a:f0:39:ed:21 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:5a:f0:39:ed:21 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:36:9e:be:18:22:b4 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 28 07:59:20.562135 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.562123 2560 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 28 07:59:20.562255 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.562242 2560 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 28 07:59:20.564449 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.564419 2560 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 28 07:59:20.564598 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.564452 2560 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-133.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 28 07:59:20.564649 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.564609 2560 topology_manager.go:138] "Creating topology manager with none policy" May 28 07:59:20.564649 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.564618 2560 container_manager_linux.go:306] "Creating device plugin manager" May 28 07:59:20.564649 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.564625 2560 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 28 07:59:20.565455 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.565445 2560 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 28 07:59:20.567692 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.567682 2560 state_mem.go:36] "Initialized new in-memory state store" May 28 07:59:20.567806 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.567797 2560 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 28 07:59:20.570329 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.570318 2560 kubelet.go:491] "Attempting to sync node with API server" May 28 07:59:20.570377 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.570336 2560 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 28 07:59:20.570377 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.570353 2560 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 28 07:59:20.570377 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.570363 2560 kubelet.go:397] "Adding apiserver pod source" May 28 07:59:20.570377 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.570372 2560 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 28 07:59:20.570523 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.570464 2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-226p7" May 28 07:59:20.571571 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.571550 2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 28 07:59:20.571618 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.571590 2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 28 07:59:20.575261 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.575242 2560 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 28 07:59:20.577520 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.577494 2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-226p7" May 28 07:59:20.577698 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.577684 2560 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 28 07:59:20.578659 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.578645 2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 28 07:59:20.578659 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.578662 2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 28 07:59:20.578779 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.578669 2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 28 07:59:20.578779 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.578675 2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 28 07:59:20.578779 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.578684 2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 28 07:59:20.578779 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.578693 2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 28 07:59:20.578779 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.578718 2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 28 07:59:20.578779 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.578724 2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 28 07:59:20.578779 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.578731 2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 28 07:59:20.578779 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.578737 2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 28 07:59:20.578779 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.578758 2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 28 07:59:20.579191 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.579179 2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 28 07:59:20.581001 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.580989 2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 28 07:59:20.581001 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.581001 2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 28 07:59:20.582944 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.582927 2560 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 28 07:59:20.584444 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.584431 2560 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 28 07:59:20.584501 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.584468 2560 server.go:1295] "Started kubelet" May 28 07:59:20.584575 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.584538 2560 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 28 07:59:20.584661 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.584615 2560 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 28 07:59:20.584716 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.584682 2560 server_v1.go:47] "podresources" method="list" useActivePods=true May 28 07:59:20.585812 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.585575 2560 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 28 07:59:20.585812 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.585700 2560 server.go:317] "Adding debug handlers to kubelet server" May 28 07:59:20.586069 ip-10-0-139-133 systemd[1]: Started Kubernetes Kubelet. May 28 07:59:20.586795 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.586780 2560 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 28 07:59:20.587206 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.587184 2560 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-139-133.ec2.internal" not found May 28 07:59:20.593681 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.593658 2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 28 07:59:20.594317 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.594301 2560 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 28 07:59:20.594485 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.594463 2560 volume_manager.go:295] "The desired_state_of_world populator starts" May 28 07:59:20.594485 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.594477 2560 volume_manager.go:297] "Starting Kubelet Volume Manager" May 28 07:59:20.594628 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.594581 2560 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 28 07:59:20.594628 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.594613 2560 reconstruct.go:97] "Volume reconstruction finished" May 28 07:59:20.594628 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.594618 2560 reconciler.go:26] "Reconciler: start to sync state" May 28 07:59:20.594957 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:20.594936 2560 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 28 07:59:20.595057 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.595013 2560 factory.go:153] Registering CRI-O factory May 28 07:59:20.595057 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.595035 2560 factory.go:223] Registration of the crio container factory successfully May 28 07:59:20.595155 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.595083 2560 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 28 07:59:20.595155 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.595093 2560 factory.go:55] Registering systemd factory May 28 07:59:20.595155 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.595100 2560 factory.go:223] Registration of the systemd container factory successfully May 28 07:59:20.595155 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.595120 2560 factory.go:103] Registering Raw factory May 28 07:59:20.595155 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.595135 2560 manager.go:1196] Started watching for new ooms in manager May 28 07:59:20.595330 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:20.595213 2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-133.ec2.internal\" not found" May 28 07:59:20.596070 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.596057 2560 manager.go:319] Starting recovery of all containers May 28 07:59:20.597105 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.597018 2560 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 28 07:59:20.598717 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:20.598692 2560 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-139-133.ec2.internal\" not found" node="ip-10-0-139-133.ec2.internal" May 28 07:59:20.601343 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.601325 2560 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-139-133.ec2.internal" not found May 28 07:59:20.605842 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.605823 2560 manager.go:324] Recovery completed May 28 07:59:20.607695 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:20.607679 2560 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory May 28 07:59:20.610301 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.610289 2560 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 07:59:20.612067 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.612053 2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-133.ec2.internal" event="NodeHasSufficientMemory" May 28 07:59:20.612144 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.612078 2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-133.ec2.internal" event="NodeHasNoDiskPressure" May 28 07:59:20.612144 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.612092 2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-133.ec2.internal" event="NodeHasSufficientPID" May 28 07:59:20.612526 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.612513 2560 cpu_manager.go:222] "Starting CPU manager" policy="none" May 28 07:59:20.612618 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.612527 2560 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 28 07:59:20.612618 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.612545 2560 state_mem.go:36] "Initialized new in-memory state store" May 28 07:59:20.616126 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.616113 2560 policy_none.go:49] "None policy: Start" May 28 07:59:20.616207 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.616135 2560 memory_manager.go:186] "Starting memorymanager" policy="None" May 28 07:59:20.616207 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.616157 2560 state_mem.go:35] "Initializing new in-memory state store" May 28 07:59:20.658382 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.658359 2560 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-139-133.ec2.internal" not found May 28 07:59:20.679523 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.664106 2560 manager.go:341] "Starting Device Plugin manager" May 28 07:59:20.679523 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:20.664131 2560 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 28 07:59:20.679523 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.664144 2560 server.go:85] "Starting device plugin registration server" May 28 07:59:20.679523 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.664395 2560 eviction_manager.go:189] "Eviction manager: starting control loop" May 28 07:59:20.679523 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.664425 2560 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 28 07:59:20.679523 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.664539 2560 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 28 07:59:20.679523 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.664634 2560 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 28 07:59:20.679523 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.664643 2560 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 28 07:59:20.679523 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:20.665258 2560 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 28 07:59:20.679523 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:20.665294 2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-133.ec2.internal\" not found" May 28 07:59:20.726105 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.726054 2560 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 28 07:59:20.727202 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.727185 2560 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 28 07:59:20.727278 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.727207 2560 status_manager.go:230] "Starting to sync pod status with apiserver" May 28 07:59:20.727278 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.727222 2560 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 28 07:59:20.727278 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.727227 2560 kubelet.go:2451] "Starting kubelet main sync loop" May 28 07:59:20.727420 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:20.727289 2560 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 28 07:59:20.729052 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.729035 2560 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 28 07:59:20.765077 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.765062 2560 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 07:59:20.766293 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.766279 2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-133.ec2.internal" event="NodeHasSufficientMemory" May 28 07:59:20.766360 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.766305 2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-133.ec2.internal" event="NodeHasNoDiskPressure" May 28 07:59:20.766360 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.766321 2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-133.ec2.internal" event="NodeHasSufficientPID" May 28 07:59:20.766360 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.766348 2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-133.ec2.internal" May 28 07:59:20.775891 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.775876 2560 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-133.ec2.internal" May 28 07:59:20.775978 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:20.775909 2560 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-133.ec2.internal\": node \"ip-10-0-139-133.ec2.internal\" not found" May 28 07:59:20.828263 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.828222 2560 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-133.ec2.internal"] May 28 07:59:20.830438 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.830423 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal" May 28 07:59:20.830519 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.830427 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-133.ec2.internal" May 28 07:59:20.856129 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.856110 2560 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal" May 28 07:59:20.860362 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.860344 2560 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-133.ec2.internal" May 28 07:59:20.867523 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.867509 2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 28 07:59:20.867608 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.867554 2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 28 07:59:20.896538 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.896518 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a0af03460d0b834f8e0ef9046b6b5145-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal\" (UID: \"a0af03460d0b834f8e0ef9046b6b5145\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal" May 28 07:59:20.896628 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.896541 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a0af03460d0b834f8e0ef9046b6b5145-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal\" (UID: \"a0af03460d0b834f8e0ef9046b6b5145\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal" May 28 07:59:20.896628 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.896577 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a235c96c5df75d6e3bfc1abeabef5111-config\") pod \"kube-apiserver-proxy-ip-10-0-139-133.ec2.internal\" (UID: \"a235c96c5df75d6e3bfc1abeabef5111\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-133.ec2.internal" May 28 07:59:20.997497 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.997448 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a0af03460d0b834f8e0ef9046b6b5145-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal\" (UID: \"a0af03460d0b834f8e0ef9046b6b5145\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal" May 28 07:59:20.997497 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.997476 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a0af03460d0b834f8e0ef9046b6b5145-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal\" (UID: \"a0af03460d0b834f8e0ef9046b6b5145\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal" May 28 07:59:20.997497 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.997492 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a235c96c5df75d6e3bfc1abeabef5111-config\") pod \"kube-apiserver-proxy-ip-10-0-139-133.ec2.internal\" (UID: \"a235c96c5df75d6e3bfc1abeabef5111\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-133.ec2.internal" May 28 07:59:20.997664 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.997531 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a235c96c5df75d6e3bfc1abeabef5111-config\") pod \"kube-apiserver-proxy-ip-10-0-139-133.ec2.internal\" (UID: \"a235c96c5df75d6e3bfc1abeabef5111\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-133.ec2.internal" May 28 07:59:20.997664 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.997536 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a0af03460d0b834f8e0ef9046b6b5145-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal\" (UID: \"a0af03460d0b834f8e0ef9046b6b5145\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal" May 28 07:59:20.997664 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:20.997545 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a0af03460d0b834f8e0ef9046b6b5145-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal\" (UID: \"a0af03460d0b834f8e0ef9046b6b5145\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal" May 28 07:59:21.169909 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.169890 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal" May 28 07:59:21.172513 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.172496 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-133.ec2.internal" May 28 07:59:21.492500 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.492472 2560 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 28 07:59:21.493229 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.492700 2560 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 28 07:59:21.493229 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.492711 2560 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 28 07:59:21.493229 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.492699 2560 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 28 07:59:21.570689 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.570533 2560 apiserver.go:52] "Watching apiserver" May 28 07:59:21.578028 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.578008 2560 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 28 07:59:21.578388 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.578365 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-h2fkd","openshift-image-registry/node-ca-ctxgq","openshift-multus/multus-additional-cni-plugins-dxbtn","openshift-network-diagnostics/network-check-target-w9gt5","openshift-network-operator/iptables-alerter-z4fbh","openshift-ovn-kubernetes/ovnkube-node-2llls","kube-system/kube-apiserver-proxy-ip-10-0-139-133.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n95hd","openshift-cluster-node-tuning-operator/tuned-lm42d","openshift-dns/node-resolver-xhm9j","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal","openshift-multus/multus-ldhht","openshift-multus/network-metrics-daemon-z5j9k"] May 28 07:59:21.579723 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.579689 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-27 07:54:20 +0000 UTC" deadline="2027-11-02 03:12:44.884868911 +0000 UTC" May 28 07:59:21.579777 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.579724 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12547h13m23.305148351s" May 28 07:59:21.583405 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.583385 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-h2fkd" May 28 07:59:21.585215 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.585196 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ctxgq" May 28 07:59:21.585595 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.585577 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-m5nj7\"" May 28 07:59:21.585595 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.585590 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 28 07:59:21.585713 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.585698 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 28 07:59:21.587187 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.587172 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 28 07:59:21.587323 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.587267 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dxbtn" May 28 07:59:21.587323 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.587282 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w9gt5" May 28 07:59:21.587457 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.587332 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-2jjw6\"" May 28 07:59:21.587457 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.587383 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 28 07:59:21.587607 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:21.587577 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w9gt5" podUID="8802231b-bd91-4690-9379-4e802d4d8853" May 28 07:59:21.587713 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.587638 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 28 07:59:21.589141 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.589123 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-z4fbh" May 28 07:59:21.589499 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.589485 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 28 07:59:21.589581 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.589519 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 28 07:59:21.589871 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.589840 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-qts89\"" May 28 07:59:21.589928 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.589900 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 28 07:59:21.589996 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.589906 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 28 07:59:21.590057 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.590042 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 28 07:59:21.590910 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.590885 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 28 07:59:21.591033 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.590993 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 28 07:59:21.591033 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.590998 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-9977k\"" May 28 07:59:21.591817 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.591790 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 28 07:59:21.593837 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.592074 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2llls" May 28 07:59:21.593837 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.593730 2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 28 07:59:21.593962 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.593887 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 28 07:59:21.594222 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.594208 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 28 07:59:21.595236 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.595203 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 28 07:59:21.595236 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.595204 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 28 07:59:21.595426 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.595209 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 28 07:59:21.595426 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.595222 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-hpls4\"" May 28 07:59:21.595426 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.595224 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 28 07:59:21.595781 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.595767 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n95hd" May 28 07:59:21.597459 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.597441 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 28 07:59:21.597459 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.597450 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-pclqd\"" May 28 07:59:21.597627 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.597583 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 28 07:59:21.598079 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.598061 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 28 07:59:21.598801 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.598786 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lm42d" May 28 07:59:21.599873 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.599856 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hn5qs\" (UniqueName: \"kubernetes.io/projected/4a2444a9-55c7-4ce5-b8e7-d394e0855f26-kube-api-access-hn5qs\") pod \"multus-additional-cni-plugins-dxbtn\" (UID: \"4a2444a9-55c7-4ce5-b8e7-d394e0855f26\") " pod="openshift-multus/multus-additional-cni-plugins-dxbtn" May 28 07:59:21.599955 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.599879 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f5b72cf0-375b-4d9b-af04-706c6348e6d1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n95hd\" (UID: \"f5b72cf0-375b-4d9b-af04-706c6348e6d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n95hd" May 28 07:59:21.599955 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.599896 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f5b72cf0-375b-4d9b-af04-706c6348e6d1-device-dir\") pod \"aws-ebs-csi-driver-node-n95hd\" (UID: \"f5b72cf0-375b-4d9b-af04-706c6348e6d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n95hd" May 28 07:59:21.599955 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.599909 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/724affe7-1ef8-4aa8-8828-b3de728946da-agent-certs\") pod \"konnectivity-agent-h2fkd\" (UID: \"724affe7-1ef8-4aa8-8828-b3de728946da\") " pod="kube-system/konnectivity-agent-h2fkd" May 28 07:59:21.599955 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.599925 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/092140cb-eea8-44c1-89f5-d8dd56d7d10a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2llls\" (UID: \"092140cb-eea8-44c1-89f5-d8dd56d7d10a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2llls" May 28 07:59:21.599955 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.599949 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4a2444a9-55c7-4ce5-b8e7-d394e0855f26-cni-binary-copy\") pod \"multus-additional-cni-plugins-dxbtn\" (UID: \"4a2444a9-55c7-4ce5-b8e7-d394e0855f26\") " pod="openshift-multus/multus-additional-cni-plugins-dxbtn" May 28 07:59:21.600167 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.599997 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k22t8\" (UniqueName: \"kubernetes.io/projected/f5b72cf0-375b-4d9b-af04-706c6348e6d1-kube-api-access-k22t8\") pod \"aws-ebs-csi-driver-node-n95hd\" (UID: \"f5b72cf0-375b-4d9b-af04-706c6348e6d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n95hd" May 28 07:59:21.600167 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.600038 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/092140cb-eea8-44c1-89f5-d8dd56d7d10a-var-lib-openvswitch\") pod \"ovnkube-node-2llls\" (UID: \"092140cb-eea8-44c1-89f5-d8dd56d7d10a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2llls" May 28 07:59:21.600167 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.600061 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/092140cb-eea8-44c1-89f5-d8dd56d7d10a-host-run-ovn-kubernetes\") pod \"ovnkube-node-2llls\" (UID: \"092140cb-eea8-44c1-89f5-d8dd56d7d10a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2llls" May 28 07:59:21.600167 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.600114 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/092140cb-eea8-44c1-89f5-d8dd56d7d10a-host-cni-bin\") pod \"ovnkube-node-2llls\" (UID: \"092140cb-eea8-44c1-89f5-d8dd56d7d10a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2llls" May 28 07:59:21.600167 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.600151 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4a2444a9-55c7-4ce5-b8e7-d394e0855f26-system-cni-dir\") pod \"multus-additional-cni-plugins-dxbtn\" (UID: \"4a2444a9-55c7-4ce5-b8e7-d394e0855f26\") " pod="openshift-multus/multus-additional-cni-plugins-dxbtn" May 28 07:59:21.600394 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.600207 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/23b33b50-4b8f-45d5-a5e7-362bdb2a04ea-iptables-alerter-script\") pod \"iptables-alerter-z4fbh\" (UID: \"23b33b50-4b8f-45d5-a5e7-362bdb2a04ea\") " pod="openshift-network-operator/iptables-alerter-z4fbh" May 28 07:59:21.600394 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.600233 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/092140cb-eea8-44c1-89f5-d8dd56d7d10a-run-openvswitch\") pod \"ovnkube-node-2llls\" (UID: \"092140cb-eea8-44c1-89f5-d8dd56d7d10a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2llls" May 28 07:59:21.600394 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.600274 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/092140cb-eea8-44c1-89f5-d8dd56d7d10a-log-socket\") pod \"ovnkube-node-2llls\" (UID: \"092140cb-eea8-44c1-89f5-d8dd56d7d10a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2llls" May 28 07:59:21.600394 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.600329 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/092140cb-eea8-44c1-89f5-d8dd56d7d10a-host-cni-netd\") pod \"ovnkube-node-2llls\" (UID: \"092140cb-eea8-44c1-89f5-d8dd56d7d10a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2llls" May 28 07:59:21.600394 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.600355 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/092140cb-eea8-44c1-89f5-d8dd56d7d10a-ovnkube-script-lib\") pod \"ovnkube-node-2llls\" (UID: \"092140cb-eea8-44c1-89f5-d8dd56d7d10a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2llls" May 28 07:59:21.600394 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.600394 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vnhd\" (UniqueName: \"kubernetes.io/projected/04a96139-4274-4e69-bb7b-18e9e99ba9e4-kube-api-access-6vnhd\") pod \"node-ca-ctxgq\" (UID: \"04a96139-4274-4e69-bb7b-18e9e99ba9e4\") " pod="openshift-image-registry/node-ca-ctxgq" May 28 07:59:21.600777 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.600419 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4a2444a9-55c7-4ce5-b8e7-d394e0855f26-cnibin\") pod \"multus-additional-cni-plugins-dxbtn\" (UID: \"4a2444a9-55c7-4ce5-b8e7-d394e0855f26\") " pod="openshift-multus/multus-additional-cni-plugins-dxbtn" May 28 07:59:21.600777 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.600441 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f5b72cf0-375b-4d9b-af04-706c6348e6d1-etc-selinux\") pod \"aws-ebs-csi-driver-node-n95hd\" (UID: \"f5b72cf0-375b-4d9b-af04-706c6348e6d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n95hd" May 28 07:59:21.600777 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.600459 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 28 07:59:21.600777 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.600479 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/092140cb-eea8-44c1-89f5-d8dd56d7d10a-host-kubelet\") pod \"ovnkube-node-2llls\" (UID: \"092140cb-eea8-44c1-89f5-d8dd56d7d10a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2llls" May 28 07:59:21.600777 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.600513 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/092140cb-eea8-44c1-89f5-d8dd56d7d10a-host-slash\") pod \"ovnkube-node-2llls\" (UID: \"092140cb-eea8-44c1-89f5-d8dd56d7d10a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2llls" May 28 07:59:21.600777 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.600534 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-mwvmm\"" May 28 07:59:21.600777 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.600580 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 28 07:59:21.600777 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.600536 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/092140cb-eea8-44c1-89f5-d8dd56d7d10a-etc-openvswitch\") pod \"ovnkube-node-2llls\" (UID: \"092140cb-eea8-44c1-89f5-d8dd56d7d10a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2llls" May 28 07:59:21.600777 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.600733 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/04a96139-4274-4e69-bb7b-18e9e99ba9e4-serviceca\") pod \"node-ca-ctxgq\" (UID: \"04a96139-4274-4e69-bb7b-18e9e99ba9e4\") " pod="openshift-image-registry/node-ca-ctxgq" May 28 07:59:21.600777 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.600772 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/092140cb-eea8-44c1-89f5-d8dd56d7d10a-host-run-netns\") pod \"ovnkube-node-2llls\" (UID: \"092140cb-eea8-44c1-89f5-d8dd56d7d10a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2llls" May 28 07:59:21.601460 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.600799 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4a2444a9-55c7-4ce5-b8e7-d394e0855f26-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dxbtn\" (UID: \"4a2444a9-55c7-4ce5-b8e7-d394e0855f26\") " pod="openshift-multus/multus-additional-cni-plugins-dxbtn" May 28 07:59:21.601460 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.600823 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f5b72cf0-375b-4d9b-af04-706c6348e6d1-socket-dir\") pod \"aws-ebs-csi-driver-node-n95hd\" (UID: \"f5b72cf0-375b-4d9b-af04-706c6348e6d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n95hd" May 28 07:59:21.601460 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.600846 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f5b72cf0-375b-4d9b-af04-706c6348e6d1-sys-fs\") pod \"aws-ebs-csi-driver-node-n95hd\" (UID: \"f5b72cf0-375b-4d9b-af04-706c6348e6d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n95hd" May 28 07:59:21.601460 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.600868 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/724affe7-1ef8-4aa8-8828-b3de728946da-konnectivity-ca\") pod \"konnectivity-agent-h2fkd\" (UID: \"724affe7-1ef8-4aa8-8828-b3de728946da\") " pod="kube-system/konnectivity-agent-h2fkd" May 28 07:59:21.601460 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.600909 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/092140cb-eea8-44c1-89f5-d8dd56d7d10a-env-overrides\") pod \"ovnkube-node-2llls\" (UID: \"092140cb-eea8-44c1-89f5-d8dd56d7d10a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2llls" May 28 07:59:21.601460 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.600935 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/04a96139-4274-4e69-bb7b-18e9e99ba9e4-host\") pod \"node-ca-ctxgq\" (UID: \"04a96139-4274-4e69-bb7b-18e9e99ba9e4\") " pod="openshift-image-registry/node-ca-ctxgq" May 28 07:59:21.601460 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.600986 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4a2444a9-55c7-4ce5-b8e7-d394e0855f26-os-release\") pod \"multus-additional-cni-plugins-dxbtn\" (UID: \"4a2444a9-55c7-4ce5-b8e7-d394e0855f26\") " pod="openshift-multus/multus-additional-cni-plugins-dxbtn" May 28 07:59:21.601460 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.601009 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4a2444a9-55c7-4ce5-b8e7-d394e0855f26-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dxbtn\" (UID: \"4a2444a9-55c7-4ce5-b8e7-d394e0855f26\") " pod="openshift-multus/multus-additional-cni-plugins-dxbtn" May 28 07:59:21.601460 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.601029 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/23b33b50-4b8f-45d5-a5e7-362bdb2a04ea-host-slash\") pod \"iptables-alerter-z4fbh\" (UID: \"23b33b50-4b8f-45d5-a5e7-362bdb2a04ea\") " pod="openshift-network-operator/iptables-alerter-z4fbh" May 28 07:59:21.601460 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.601057 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsgnb\" (UniqueName: \"kubernetes.io/projected/23b33b50-4b8f-45d5-a5e7-362bdb2a04ea-kube-api-access-rsgnb\") pod \"iptables-alerter-z4fbh\" (UID: \"23b33b50-4b8f-45d5-a5e7-362bdb2a04ea\") " pod="openshift-network-operator/iptables-alerter-z4fbh" May 28 07:59:21.601460 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.601095 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/092140cb-eea8-44c1-89f5-d8dd56d7d10a-run-systemd\") pod \"ovnkube-node-2llls\" (UID: \"092140cb-eea8-44c1-89f5-d8dd56d7d10a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2llls" May 28 07:59:21.601460 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.601136 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/092140cb-eea8-44c1-89f5-d8dd56d7d10a-ovn-node-metrics-cert\") pod \"ovnkube-node-2llls\" (UID: \"092140cb-eea8-44c1-89f5-d8dd56d7d10a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2llls" May 28 07:59:21.601460 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.601161 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6dfw\" (UniqueName: \"kubernetes.io/projected/092140cb-eea8-44c1-89f5-d8dd56d7d10a-kube-api-access-k6dfw\") pod \"ovnkube-node-2llls\" (UID: \"092140cb-eea8-44c1-89f5-d8dd56d7d10a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2llls" May 28 07:59:21.601460 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.601200 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4a2444a9-55c7-4ce5-b8e7-d394e0855f26-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dxbtn\" (UID: \"4a2444a9-55c7-4ce5-b8e7-d394e0855f26\") " pod="openshift-multus/multus-additional-cni-plugins-dxbtn" May 28 07:59:21.601460 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.601227 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59vxd\" (UniqueName: \"kubernetes.io/projected/8802231b-bd91-4690-9379-4e802d4d8853-kube-api-access-59vxd\") pod \"network-check-target-w9gt5\" (UID: \"8802231b-bd91-4690-9379-4e802d4d8853\") " pod="openshift-network-diagnostics/network-check-target-w9gt5" May 28 07:59:21.601460 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.601251 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/092140cb-eea8-44c1-89f5-d8dd56d7d10a-systemd-units\") pod \"ovnkube-node-2llls\" (UID: \"092140cb-eea8-44c1-89f5-d8dd56d7d10a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2llls" May 28 07:59:21.602136 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.601289 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/092140cb-eea8-44c1-89f5-d8dd56d7d10a-node-log\") pod \"ovnkube-node-2llls\" (UID: \"092140cb-eea8-44c1-89f5-d8dd56d7d10a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2llls" May 28 07:59:21.602136 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.601309 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/092140cb-eea8-44c1-89f5-d8dd56d7d10a-ovnkube-config\") pod \"ovnkube-node-2llls\" (UID: \"092140cb-eea8-44c1-89f5-d8dd56d7d10a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2llls" May 28 07:59:21.602136 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.601324 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f5b72cf0-375b-4d9b-af04-706c6348e6d1-registration-dir\") pod \"aws-ebs-csi-driver-node-n95hd\" (UID: \"f5b72cf0-375b-4d9b-af04-706c6348e6d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n95hd" May 28 07:59:21.602136 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.601340 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/092140cb-eea8-44c1-89f5-d8dd56d7d10a-run-ovn\") pod \"ovnkube-node-2llls\" (UID: \"092140cb-eea8-44c1-89f5-d8dd56d7d10a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2llls" May 28 07:59:21.603622 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.603603 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xhm9j" May 28 07:59:21.603679 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.603637 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ldhht" May 28 07:59:21.605852 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.605708 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-hhqkm\"" May 28 07:59:21.606005 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.605981 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 28 07:59:21.606072 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.606011 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 28 07:59:21.606312 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.606298 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 28 07:59:21.606528 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.606373 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-85gtk\"" May 28 07:59:21.606669 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.606653 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z5j9k" May 28 07:59:21.606727 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:21.606701 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z5j9k" podUID="5f2c94ed-4111-42f9-8ec1-7c96447b9c11" May 28 07:59:21.608304 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.608285 2560 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 28 07:59:21.623902 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.623885 2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-rtl5f" May 28 07:59:21.631298 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.631282 2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-rtl5f" May 28 07:59:21.670003 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:21.669967 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0af03460d0b834f8e0ef9046b6b5145.slice/crio-6ab7906938008e0c674c65e2529ab5df5bb4fbe79bcf52bf4f3a4218d2b677ab WatchSource:0}: Error finding container 6ab7906938008e0c674c65e2529ab5df5bb4fbe79bcf52bf4f3a4218d2b677ab: Status 404 returned error can't find the container with id 6ab7906938008e0c674c65e2529ab5df5bb4fbe79bcf52bf4f3a4218d2b677ab May 28 07:59:21.670226 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:21.670200 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda235c96c5df75d6e3bfc1abeabef5111.slice/crio-0e76c977069ff5643b31bbacce5cf814cb0cc18352eb0fb0cfee5965c10e091b WatchSource:0}: Error finding container 0e76c977069ff5643b31bbacce5cf814cb0cc18352eb0fb0cfee5965c10e091b: Status 404 returned error can't find the container with id 0e76c977069ff5643b31bbacce5cf814cb0cc18352eb0fb0cfee5965c10e091b May 28 07:59:21.674714 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.674697 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 28 07:59:21.695260 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.695241 2560 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 28 07:59:21.701761 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.701742 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4a2444a9-55c7-4ce5-b8e7-d394e0855f26-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dxbtn\" (UID: \"4a2444a9-55c7-4ce5-b8e7-d394e0855f26\") " pod="openshift-multus/multus-additional-cni-plugins-dxbtn" May 28 07:59:21.701851 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.701774 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-59vxd\" (UniqueName: \"kubernetes.io/projected/8802231b-bd91-4690-9379-4e802d4d8853-kube-api-access-59vxd\") pod \"network-check-target-w9gt5\" (UID: \"8802231b-bd91-4690-9379-4e802d4d8853\") " pod="openshift-network-diagnostics/network-check-target-w9gt5" May 28 07:59:21.701851 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.701799 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/092140cb-eea8-44c1-89f5-d8dd56d7d10a-ovnkube-config\") pod \"ovnkube-node-2llls\" (UID: \"092140cb-eea8-44c1-89f5-d8dd56d7d10a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2llls" May 28 07:59:21.701851 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.701828 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/632fd718-6604-42a2-aca2-e24e53bfdbb3-host-var-lib-kubelet\") pod \"multus-ldhht\" (UID: \"632fd718-6604-42a2-aca2-e24e53bfdbb3\") " pod="openshift-multus/multus-ldhht" May 28 07:59:21.702002 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.701853 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hn5qs\" (UniqueName: \"kubernetes.io/projected/4a2444a9-55c7-4ce5-b8e7-d394e0855f26-kube-api-access-hn5qs\") pod \"multus-additional-cni-plugins-dxbtn\" (UID: \"4a2444a9-55c7-4ce5-b8e7-d394e0855f26\") " pod="openshift-multus/multus-additional-cni-plugins-dxbtn" May 28 07:59:21.702002 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.701880 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f5b72cf0-375b-4d9b-af04-706c6348e6d1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n95hd\" (UID: \"f5b72cf0-375b-4d9b-af04-706c6348e6d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n95hd" May 28 07:59:21.702002 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.701905 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f5b72cf0-375b-4d9b-af04-706c6348e6d1-device-dir\") pod \"aws-ebs-csi-driver-node-n95hd\" (UID: \"f5b72cf0-375b-4d9b-af04-706c6348e6d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n95hd" May 28 07:59:21.702002 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.701912 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4a2444a9-55c7-4ce5-b8e7-d394e0855f26-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dxbtn\" (UID: \"4a2444a9-55c7-4ce5-b8e7-d394e0855f26\") " pod="openshift-multus/multus-additional-cni-plugins-dxbtn" May 28 07:59:21.702002 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.701930 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/724affe7-1ef8-4aa8-8828-b3de728946da-agent-certs\") pod \"konnectivity-agent-h2fkd\" (UID: \"724affe7-1ef8-4aa8-8828-b3de728946da\") " pod="kube-system/konnectivity-agent-h2fkd" May 28 07:59:21.702002 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.701948 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f5b72cf0-375b-4d9b-af04-706c6348e6d1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n95hd\" (UID: \"f5b72cf0-375b-4d9b-af04-706c6348e6d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n95hd" May 28 07:59:21.702002 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.701977 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f5b72cf0-375b-4d9b-af04-706c6348e6d1-device-dir\") pod \"aws-ebs-csi-driver-node-n95hd\" (UID: \"f5b72cf0-375b-4d9b-af04-706c6348e6d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n95hd" May 28 07:59:21.702309 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.702011 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/092140cb-eea8-44c1-89f5-d8dd56d7d10a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2llls\" (UID: \"092140cb-eea8-44c1-89f5-d8dd56d7d10a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2llls" May 28 07:59:21.702309 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.702063 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1826661e-2068-4391-9044-b01ffe8dbeac-tmp\") pod \"tuned-lm42d\" (UID: \"1826661e-2068-4391-9044-b01ffe8dbeac\") " pod="openshift-cluster-node-tuning-operator/tuned-lm42d" May 28 07:59:21.702309 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.702093 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f2c94ed-4111-42f9-8ec1-7c96447b9c11-metrics-certs\") pod \"network-metrics-daemon-z5j9k\" (UID: \"5f2c94ed-4111-42f9-8ec1-7c96447b9c11\") " pod="openshift-multus/network-metrics-daemon-z5j9k" May 28 07:59:21.702309 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.702092 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/092140cb-eea8-44c1-89f5-d8dd56d7d10a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2llls\" (UID: \"092140cb-eea8-44c1-89f5-d8dd56d7d10a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2llls" May 28 07:59:21.702309 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.702117 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4a2444a9-55c7-4ce5-b8e7-d394e0855f26-cni-binary-copy\") pod \"multus-additional-cni-plugins-dxbtn\" (UID: \"4a2444a9-55c7-4ce5-b8e7-d394e0855f26\") " pod="openshift-multus/multus-additional-cni-plugins-dxbtn" May 28 07:59:21.702309 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.702137 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/092140cb-eea8-44c1-89f5-d8dd56d7d10a-host-run-ovn-kubernetes\") pod \"ovnkube-node-2llls\" (UID: \"092140cb-eea8-44c1-89f5-d8dd56d7d10a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2llls" May 28 07:59:21.702309 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.702158 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1826661e-2068-4391-9044-b01ffe8dbeac-lib-modules\") pod \"tuned-lm42d\" (UID: \"1826661e-2068-4391-9044-b01ffe8dbeac\") " pod="openshift-cluster-node-tuning-operator/tuned-lm42d" May 28 07:59:21.702309 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.702179 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/632fd718-6604-42a2-aca2-e24e53bfdbb3-host-run-k8s-cni-cncf-io\") pod \"multus-ldhht\" (UID: \"632fd718-6604-42a2-aca2-e24e53bfdbb3\") " pod="openshift-multus/multus-ldhht" May 28 07:59:21.702309 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.702187 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/092140cb-eea8-44c1-89f5-d8dd56d7d10a-host-run-ovn-kubernetes\") pod \"ovnkube-node-2llls\" (UID: \"092140cb-eea8-44c1-89f5-d8dd56d7d10a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2llls" May 28 07:59:21.702309 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.702196 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/632fd718-6604-42a2-aca2-e24e53bfdbb3-host-run-netns\") pod \"multus-ldhht\" (UID: \"632fd718-6604-42a2-aca2-e24e53bfdbb3\") " pod="openshift-multus/multus-ldhht" May 28 07:59:21.702309 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.702212 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/632fd718-6604-42a2-aca2-e24e53bfdbb3-hostroot\") pod \"multus-ldhht\" (UID: \"632fd718-6604-42a2-aca2-e24e53bfdbb3\") " pod="openshift-multus/multus-ldhht" May 28 07:59:21.702309 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.702244 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1826661e-2068-4391-9044-b01ffe8dbeac-etc-sysctl-conf\") pod \"tuned-lm42d\" (UID: \"1826661e-2068-4391-9044-b01ffe8dbeac\") " pod="openshift-cluster-node-tuning-operator/tuned-lm42d" May 28 07:59:21.702309 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.702266 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4a2444a9-55c7-4ce5-b8e7-d394e0855f26-system-cni-dir\") pod \"multus-additional-cni-plugins-dxbtn\" (UID: \"4a2444a9-55c7-4ce5-b8e7-d394e0855f26\") " pod="openshift-multus/multus-additional-cni-plugins-dxbtn" May 28 07:59:21.702309 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.702283 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/092140cb-eea8-44c1-89f5-d8dd56d7d10a-run-openvswitch\") pod \"ovnkube-node-2llls\" (UID: \"092140cb-eea8-44c1-89f5-d8dd56d7d10a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2llls" May 28 07:59:21.702309 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.702261 2560 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 28 07:59:21.702984 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.702302 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/092140cb-eea8-44c1-89f5-d8dd56d7d10a-log-socket\") pod \"ovnkube-node-2llls\" (UID: \"092140cb-eea8-44c1-89f5-d8dd56d7d10a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2llls" May 28 07:59:21.702984 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.702332 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4a2444a9-55c7-4ce5-b8e7-d394e0855f26-system-cni-dir\") pod \"multus-additional-cni-plugins-dxbtn\" (UID: \"4a2444a9-55c7-4ce5-b8e7-d394e0855f26\") " pod="openshift-multus/multus-additional-cni-plugins-dxbtn" May 28 07:59:21.702984 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.702335 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/092140cb-eea8-44c1-89f5-d8dd56d7d10a-log-socket\") pod \"ovnkube-node-2llls\" (UID: \"092140cb-eea8-44c1-89f5-d8dd56d7d10a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2llls" May 28 07:59:21.702984 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.702357 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/092140cb-eea8-44c1-89f5-d8dd56d7d10a-host-cni-netd\") pod \"ovnkube-node-2llls\" (UID: \"092140cb-eea8-44c1-89f5-d8dd56d7d10a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2llls" May 28 07:59:21.702984 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.702371 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/092140cb-eea8-44c1-89f5-d8dd56d7d10a-run-openvswitch\") pod \"ovnkube-node-2llls\" (UID: \"092140cb-eea8-44c1-89f5-d8dd56d7d10a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2llls" May 28 07:59:21.702984 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.702385 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6vnhd\" (UniqueName: \"kubernetes.io/projected/04a96139-4274-4e69-bb7b-18e9e99ba9e4-kube-api-access-6vnhd\") pod \"node-ca-ctxgq\" (UID: \"04a96139-4274-4e69-bb7b-18e9e99ba9e4\") " pod="openshift-image-registry/node-ca-ctxgq" May 28 07:59:21.702984 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.702414 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6l826\" (UniqueName: \"kubernetes.io/projected/632fd718-6604-42a2-aca2-e24e53bfdbb3-kube-api-access-6l826\") pod \"multus-ldhht\" (UID: \"632fd718-6604-42a2-aca2-e24e53bfdbb3\") " pod="openshift-multus/multus-ldhht" May 28 07:59:21.702984 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.702439 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4a2444a9-55c7-4ce5-b8e7-d394e0855f26-cnibin\") pod \"multus-additional-cni-plugins-dxbtn\" (UID: \"4a2444a9-55c7-4ce5-b8e7-d394e0855f26\") " pod="openshift-multus/multus-additional-cni-plugins-dxbtn" May 28 07:59:21.702984 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.702440 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/092140cb-eea8-44c1-89f5-d8dd56d7d10a-host-cni-netd\") pod \"ovnkube-node-2llls\" (UID: \"092140cb-eea8-44c1-89f5-d8dd56d7d10a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2llls" May 28 07:59:21.702984 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.702447 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/092140cb-eea8-44c1-89f5-d8dd56d7d10a-ovnkube-config\") pod \"ovnkube-node-2llls\" (UID: \"092140cb-eea8-44c1-89f5-d8dd56d7d10a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2llls" May 28 07:59:21.702984 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.702464 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f5b72cf0-375b-4d9b-af04-706c6348e6d1-etc-selinux\") pod \"aws-ebs-csi-driver-node-n95hd\" (UID: \"f5b72cf0-375b-4d9b-af04-706c6348e6d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n95hd" May 28 07:59:21.702984 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.702488 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/092140cb-eea8-44c1-89f5-d8dd56d7d10a-etc-openvswitch\") pod \"ovnkube-node-2llls\" (UID: \"092140cb-eea8-44c1-89f5-d8dd56d7d10a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2llls" May 28 07:59:21.702984 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.702512 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1826661e-2068-4391-9044-b01ffe8dbeac-etc-kubernetes\") pod \"tuned-lm42d\" (UID: \"1826661e-2068-4391-9044-b01ffe8dbeac\") " pod="openshift-cluster-node-tuning-operator/tuned-lm42d" May 28 07:59:21.702984 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.702514 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4a2444a9-55c7-4ce5-b8e7-d394e0855f26-cnibin\") pod \"multus-additional-cni-plugins-dxbtn\" (UID: \"4a2444a9-55c7-4ce5-b8e7-d394e0855f26\") " pod="openshift-multus/multus-additional-cni-plugins-dxbtn" May 28 07:59:21.702984 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.702534 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1826661e-2068-4391-9044-b01ffe8dbeac-etc-systemd\") pod \"tuned-lm42d\" (UID: \"1826661e-2068-4391-9044-b01ffe8dbeac\") " pod="openshift-cluster-node-tuning-operator/tuned-lm42d" May 28 07:59:21.702984 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.702541 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f5b72cf0-375b-4d9b-af04-706c6348e6d1-etc-selinux\") pod \"aws-ebs-csi-driver-node-n95hd\" (UID: \"f5b72cf0-375b-4d9b-af04-706c6348e6d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n95hd" May 28 07:59:21.702984 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.702557 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1826661e-2068-4391-9044-b01ffe8dbeac-host\") pod \"tuned-lm42d\" (UID: \"1826661e-2068-4391-9044-b01ffe8dbeac\") " pod="openshift-cluster-node-tuning-operator/tuned-lm42d" May 28 07:59:21.703781 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.702588 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/092140cb-eea8-44c1-89f5-d8dd56d7d10a-etc-openvswitch\") pod \"ovnkube-node-2llls\" (UID: \"092140cb-eea8-44c1-89f5-d8dd56d7d10a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2llls" May 28 07:59:21.703781 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.702592 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4a2444a9-55c7-4ce5-b8e7-d394e0855f26-cni-binary-copy\") pod \"multus-additional-cni-plugins-dxbtn\" (UID: \"4a2444a9-55c7-4ce5-b8e7-d394e0855f26\") " pod="openshift-multus/multus-additional-cni-plugins-dxbtn" May 28 07:59:21.703781 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.702607 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/632fd718-6604-42a2-aca2-e24e53bfdbb3-system-cni-dir\") pod \"multus-ldhht\" (UID: \"632fd718-6604-42a2-aca2-e24e53bfdbb3\") " pod="openshift-multus/multus-ldhht" May 28 07:59:21.703781 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.702647 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4a2444a9-55c7-4ce5-b8e7-d394e0855f26-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dxbtn\" (UID: \"4a2444a9-55c7-4ce5-b8e7-d394e0855f26\") " pod="openshift-multus/multus-additional-cni-plugins-dxbtn" May 28 07:59:21.703781 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.702680 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/04a96139-4274-4e69-bb7b-18e9e99ba9e4-host\") pod \"node-ca-ctxgq\" (UID: \"04a96139-4274-4e69-bb7b-18e9e99ba9e4\") " pod="openshift-image-registry/node-ca-ctxgq" May 28 07:59:21.703781 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.702707 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/632fd718-6604-42a2-aca2-e24e53bfdbb3-cni-binary-copy\") pod \"multus-ldhht\" (UID: \"632fd718-6604-42a2-aca2-e24e53bfdbb3\") " pod="openshift-multus/multus-ldhht" May 28 07:59:21.703781 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.702726 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4a2444a9-55c7-4ce5-b8e7-d394e0855f26-os-release\") pod \"multus-additional-cni-plugins-dxbtn\" (UID: \"4a2444a9-55c7-4ce5-b8e7-d394e0855f26\") " pod="openshift-multus/multus-additional-cni-plugins-dxbtn" May 28 07:59:21.703781 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.702746 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/04a96139-4274-4e69-bb7b-18e9e99ba9e4-host\") pod \"node-ca-ctxgq\" (UID: \"04a96139-4274-4e69-bb7b-18e9e99ba9e4\") " pod="openshift-image-registry/node-ca-ctxgq" May 28 07:59:21.703781 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.702747 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4a2444a9-55c7-4ce5-b8e7-d394e0855f26-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dxbtn\" (UID: \"4a2444a9-55c7-4ce5-b8e7-d394e0855f26\") " pod="openshift-multus/multus-additional-cni-plugins-dxbtn" May 28 07:59:21.703781 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.702782 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/23b33b50-4b8f-45d5-a5e7-362bdb2a04ea-host-slash\") pod \"iptables-alerter-z4fbh\" (UID: \"23b33b50-4b8f-45d5-a5e7-362bdb2a04ea\") " pod="openshift-network-operator/iptables-alerter-z4fbh" May 28 07:59:21.703781 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.702810 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rsgnb\" (UniqueName: \"kubernetes.io/projected/23b33b50-4b8f-45d5-a5e7-362bdb2a04ea-kube-api-access-rsgnb\") pod \"iptables-alerter-z4fbh\" (UID: \"23b33b50-4b8f-45d5-a5e7-362bdb2a04ea\") " pod="openshift-network-operator/iptables-alerter-z4fbh" May 28 07:59:21.703781 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.702834 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/092140cb-eea8-44c1-89f5-d8dd56d7d10a-run-systemd\") pod \"ovnkube-node-2llls\" (UID: \"092140cb-eea8-44c1-89f5-d8dd56d7d10a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2llls" May 28 07:59:21.703781 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.702856 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/092140cb-eea8-44c1-89f5-d8dd56d7d10a-ovn-node-metrics-cert\") pod \"ovnkube-node-2llls\" (UID: \"092140cb-eea8-44c1-89f5-d8dd56d7d10a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2llls" May 28 07:59:21.703781 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.702880 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k6dfw\" (UniqueName: \"kubernetes.io/projected/092140cb-eea8-44c1-89f5-d8dd56d7d10a-kube-api-access-k6dfw\") pod \"ovnkube-node-2llls\" (UID: \"092140cb-eea8-44c1-89f5-d8dd56d7d10a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2llls" May 28 07:59:21.703781 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.702901 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/092140cb-eea8-44c1-89f5-d8dd56d7d10a-systemd-units\") pod \"ovnkube-node-2llls\" (UID: \"092140cb-eea8-44c1-89f5-d8dd56d7d10a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2llls" May 28 07:59:21.703781 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.702925 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/092140cb-eea8-44c1-89f5-d8dd56d7d10a-node-log\") pod \"ovnkube-node-2llls\" (UID: \"092140cb-eea8-44c1-89f5-d8dd56d7d10a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2llls" May 28 07:59:21.703781 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.702952 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1826661e-2068-4391-9044-b01ffe8dbeac-etc-sysconfig\") pod \"tuned-lm42d\" (UID: \"1826661e-2068-4391-9044-b01ffe8dbeac\") " pod="openshift-cluster-node-tuning-operator/tuned-lm42d" May 28 07:59:21.704522 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.702978 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1826661e-2068-4391-9044-b01ffe8dbeac-etc-sysctl-d\") pod \"tuned-lm42d\" (UID: \"1826661e-2068-4391-9044-b01ffe8dbeac\") " pod="openshift-cluster-node-tuning-operator/tuned-lm42d" May 28 07:59:21.704522 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.703000 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1826661e-2068-4391-9044-b01ffe8dbeac-etc-tuned\") pod \"tuned-lm42d\" (UID: \"1826661e-2068-4391-9044-b01ffe8dbeac\") " pod="openshift-cluster-node-tuning-operator/tuned-lm42d" May 28 07:59:21.704522 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.703027 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvxn5\" (UniqueName: \"kubernetes.io/projected/1826661e-2068-4391-9044-b01ffe8dbeac-kube-api-access-xvxn5\") pod \"tuned-lm42d\" (UID: \"1826661e-2068-4391-9044-b01ffe8dbeac\") " pod="openshift-cluster-node-tuning-operator/tuned-lm42d" May 28 07:59:21.704522 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.703052 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/632fd718-6604-42a2-aca2-e24e53bfdbb3-multus-conf-dir\") pod \"multus-ldhht\" (UID: \"632fd718-6604-42a2-aca2-e24e53bfdbb3\") " pod="openshift-multus/multus-ldhht" May 28 07:59:21.704522 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.703076 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/632fd718-6604-42a2-aca2-e24e53bfdbb3-multus-daemon-config\") pod \"multus-ldhht\" (UID: \"632fd718-6604-42a2-aca2-e24e53bfdbb3\") " pod="openshift-multus/multus-ldhht" May 28 07:59:21.704522 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.703085 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4a2444a9-55c7-4ce5-b8e7-d394e0855f26-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dxbtn\" (UID: \"4a2444a9-55c7-4ce5-b8e7-d394e0855f26\") " pod="openshift-multus/multus-additional-cni-plugins-dxbtn" May 28 07:59:21.704522 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.703102 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f5b72cf0-375b-4d9b-af04-706c6348e6d1-registration-dir\") pod \"aws-ebs-csi-driver-node-n95hd\" (UID: \"f5b72cf0-375b-4d9b-af04-706c6348e6d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n95hd" May 28 07:59:21.704522 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.703104 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/092140cb-eea8-44c1-89f5-d8dd56d7d10a-run-systemd\") pod \"ovnkube-node-2llls\" (UID: \"092140cb-eea8-44c1-89f5-d8dd56d7d10a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2llls" May 28 07:59:21.704522 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.703149 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/092140cb-eea8-44c1-89f5-d8dd56d7d10a-run-ovn\") pod \"ovnkube-node-2llls\" (UID: \"092140cb-eea8-44c1-89f5-d8dd56d7d10a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2llls" May 28 07:59:21.704522 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.703160 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f5b72cf0-375b-4d9b-af04-706c6348e6d1-registration-dir\") pod \"aws-ebs-csi-driver-node-n95hd\" (UID: \"f5b72cf0-375b-4d9b-af04-706c6348e6d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n95hd" May 28 07:59:21.704522 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.703177 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1826661e-2068-4391-9044-b01ffe8dbeac-sys\") pod \"tuned-lm42d\" (UID: \"1826661e-2068-4391-9044-b01ffe8dbeac\") " pod="openshift-cluster-node-tuning-operator/tuned-lm42d" May 28 07:59:21.704522 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.703202 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/632fd718-6604-42a2-aca2-e24e53bfdbb3-multus-socket-dir-parent\") pod \"multus-ldhht\" (UID: \"632fd718-6604-42a2-aca2-e24e53bfdbb3\") " pod="openshift-multus/multus-ldhht" May 28 07:59:21.704522 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.702900 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4a2444a9-55c7-4ce5-b8e7-d394e0855f26-os-release\") pod \"multus-additional-cni-plugins-dxbtn\" (UID: \"4a2444a9-55c7-4ce5-b8e7-d394e0855f26\") " pod="openshift-multus/multus-additional-cni-plugins-dxbtn" May 28 07:59:21.704522 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.703228 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8db07e49-d641-48b0-89e4-2f4bdf6999a5-hosts-file\") pod \"node-resolver-xhm9j\" (UID: \"8db07e49-d641-48b0-89e4-2f4bdf6999a5\") " pod="openshift-dns/node-resolver-xhm9j" May 28 07:59:21.704522 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.703244 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4a2444a9-55c7-4ce5-b8e7-d394e0855f26-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dxbtn\" (UID: \"4a2444a9-55c7-4ce5-b8e7-d394e0855f26\") " pod="openshift-multus/multus-additional-cni-plugins-dxbtn" May 28 07:59:21.704522 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.703253 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8db07e49-d641-48b0-89e4-2f4bdf6999a5-tmp-dir\") pod \"node-resolver-xhm9j\" (UID: \"8db07e49-d641-48b0-89e4-2f4bdf6999a5\") " pod="openshift-dns/node-resolver-xhm9j" May 28 07:59:21.704522 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.703260 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/092140cb-eea8-44c1-89f5-d8dd56d7d10a-systemd-units\") pod \"ovnkube-node-2llls\" (UID: \"092140cb-eea8-44c1-89f5-d8dd56d7d10a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2llls" May 28 07:59:21.705248 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.703277 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/632fd718-6604-42a2-aca2-e24e53bfdbb3-os-release\") pod \"multus-ldhht\" (UID: \"632fd718-6604-42a2-aca2-e24e53bfdbb3\") " pod="openshift-multus/multus-ldhht" May 28 07:59:21.705248 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.703315 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/092140cb-eea8-44c1-89f5-d8dd56d7d10a-run-ovn\") pod \"ovnkube-node-2llls\" (UID: \"092140cb-eea8-44c1-89f5-d8dd56d7d10a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2llls" May 28 07:59:21.705248 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.703326 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/092140cb-eea8-44c1-89f5-d8dd56d7d10a-node-log\") pod \"ovnkube-node-2llls\" (UID: \"092140cb-eea8-44c1-89f5-d8dd56d7d10a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2llls" May 28 07:59:21.705248 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.703363 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/632fd718-6604-42a2-aca2-e24e53bfdbb3-host-var-lib-cni-bin\") pod \"multus-ldhht\" (UID: \"632fd718-6604-42a2-aca2-e24e53bfdbb3\") " pod="openshift-multus/multus-ldhht" May 28 07:59:21.705248 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.703420 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/632fd718-6604-42a2-aca2-e24e53bfdbb3-host-var-lib-cni-multus\") pod \"multus-ldhht\" (UID: \"632fd718-6604-42a2-aca2-e24e53bfdbb3\") " pod="openshift-multus/multus-ldhht" May 28 07:59:21.705248 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.703432 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/23b33b50-4b8f-45d5-a5e7-362bdb2a04ea-host-slash\") pod \"iptables-alerter-z4fbh\" (UID: \"23b33b50-4b8f-45d5-a5e7-362bdb2a04ea\") " pod="openshift-network-operator/iptables-alerter-z4fbh" May 28 07:59:21.705248 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.703466 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5smq8\" (UniqueName: \"kubernetes.io/projected/5f2c94ed-4111-42f9-8ec1-7c96447b9c11-kube-api-access-5smq8\") pod \"network-metrics-daemon-z5j9k\" (UID: \"5f2c94ed-4111-42f9-8ec1-7c96447b9c11\") " pod="openshift-multus/network-metrics-daemon-z5j9k" May 28 07:59:21.705248 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.703507 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z69kg\" (UniqueName: \"kubernetes.io/projected/8db07e49-d641-48b0-89e4-2f4bdf6999a5-kube-api-access-z69kg\") pod \"node-resolver-xhm9j\" (UID: \"8db07e49-d641-48b0-89e4-2f4bdf6999a5\") " pod="openshift-dns/node-resolver-xhm9j" May 28 07:59:21.705248 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.703538 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k22t8\" (UniqueName: \"kubernetes.io/projected/f5b72cf0-375b-4d9b-af04-706c6348e6d1-kube-api-access-k22t8\") pod \"aws-ebs-csi-driver-node-n95hd\" (UID: \"f5b72cf0-375b-4d9b-af04-706c6348e6d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n95hd" May 28 07:59:21.705248 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.703582 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/092140cb-eea8-44c1-89f5-d8dd56d7d10a-var-lib-openvswitch\") pod \"ovnkube-node-2llls\" (UID: \"092140cb-eea8-44c1-89f5-d8dd56d7d10a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2llls" May 28 07:59:21.705248 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.703608 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/092140cb-eea8-44c1-89f5-d8dd56d7d10a-host-cni-bin\") pod \"ovnkube-node-2llls\" (UID: \"092140cb-eea8-44c1-89f5-d8dd56d7d10a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2llls" May 28 07:59:21.705248 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.703634 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/632fd718-6604-42a2-aca2-e24e53bfdbb3-multus-cni-dir\") pod \"multus-ldhht\" (UID: \"632fd718-6604-42a2-aca2-e24e53bfdbb3\") " pod="openshift-multus/multus-ldhht" May 28 07:59:21.705248 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.703658 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/632fd718-6604-42a2-aca2-e24e53bfdbb3-etc-kubernetes\") pod \"multus-ldhht\" (UID: \"632fd718-6604-42a2-aca2-e24e53bfdbb3\") " pod="openshift-multus/multus-ldhht" May 28 07:59:21.705248 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.703675 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/092140cb-eea8-44c1-89f5-d8dd56d7d10a-host-cni-bin\") pod \"ovnkube-node-2llls\" (UID: \"092140cb-eea8-44c1-89f5-d8dd56d7d10a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2llls" May 28 07:59:21.705248 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.703687 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/23b33b50-4b8f-45d5-a5e7-362bdb2a04ea-iptables-alerter-script\") pod \"iptables-alerter-z4fbh\" (UID: \"23b33b50-4b8f-45d5-a5e7-362bdb2a04ea\") " pod="openshift-network-operator/iptables-alerter-z4fbh" May 28 07:59:21.705248 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.703713 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/092140cb-eea8-44c1-89f5-d8dd56d7d10a-ovnkube-script-lib\") pod \"ovnkube-node-2llls\" (UID: \"092140cb-eea8-44c1-89f5-d8dd56d7d10a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2llls" May 28 07:59:21.705248 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.703674 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/092140cb-eea8-44c1-89f5-d8dd56d7d10a-var-lib-openvswitch\") pod \"ovnkube-node-2llls\" (UID: \"092140cb-eea8-44c1-89f5-d8dd56d7d10a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2llls" May 28 07:59:21.705760 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.703757 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/632fd718-6604-42a2-aca2-e24e53bfdbb3-host-run-multus-certs\") pod \"multus-ldhht\" (UID: \"632fd718-6604-42a2-aca2-e24e53bfdbb3\") " pod="openshift-multus/multus-ldhht" May 28 07:59:21.705760 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.703780 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/092140cb-eea8-44c1-89f5-d8dd56d7d10a-host-kubelet\") pod \"ovnkube-node-2llls\" (UID: \"092140cb-eea8-44c1-89f5-d8dd56d7d10a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2llls" May 28 07:59:21.705760 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.703797 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/092140cb-eea8-44c1-89f5-d8dd56d7d10a-host-slash\") pod \"ovnkube-node-2llls\" (UID: \"092140cb-eea8-44c1-89f5-d8dd56d7d10a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2llls" May 28 07:59:21.705760 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.703816 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/04a96139-4274-4e69-bb7b-18e9e99ba9e4-serviceca\") pod \"node-ca-ctxgq\" (UID: \"04a96139-4274-4e69-bb7b-18e9e99ba9e4\") " pod="openshift-image-registry/node-ca-ctxgq" May 28 07:59:21.705760 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.703841 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1826661e-2068-4391-9044-b01ffe8dbeac-etc-modprobe-d\") pod \"tuned-lm42d\" (UID: \"1826661e-2068-4391-9044-b01ffe8dbeac\") " pod="openshift-cluster-node-tuning-operator/tuned-lm42d" May 28 07:59:21.705760 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.703850 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/092140cb-eea8-44c1-89f5-d8dd56d7d10a-host-kubelet\") pod \"ovnkube-node-2llls\" (UID: \"092140cb-eea8-44c1-89f5-d8dd56d7d10a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2llls" May 28 07:59:21.705760 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.703861 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/092140cb-eea8-44c1-89f5-d8dd56d7d10a-host-slash\") pod \"ovnkube-node-2llls\" (UID: \"092140cb-eea8-44c1-89f5-d8dd56d7d10a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2llls" May 28 07:59:21.705760 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.703864 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1826661e-2068-4391-9044-b01ffe8dbeac-run\") pod \"tuned-lm42d\" (UID: \"1826661e-2068-4391-9044-b01ffe8dbeac\") " pod="openshift-cluster-node-tuning-operator/tuned-lm42d" May 28 07:59:21.705760 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.703914 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/092140cb-eea8-44c1-89f5-d8dd56d7d10a-host-run-netns\") pod \"ovnkube-node-2llls\" (UID: \"092140cb-eea8-44c1-89f5-d8dd56d7d10a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2llls" May 28 07:59:21.705760 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.703985 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/092140cb-eea8-44c1-89f5-d8dd56d7d10a-host-run-netns\") pod \"ovnkube-node-2llls\" (UID: \"092140cb-eea8-44c1-89f5-d8dd56d7d10a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2llls" May 28 07:59:21.705760 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.703979 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f5b72cf0-375b-4d9b-af04-706c6348e6d1-socket-dir\") pod \"aws-ebs-csi-driver-node-n95hd\" (UID: \"f5b72cf0-375b-4d9b-af04-706c6348e6d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n95hd" May 28 07:59:21.705760 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.704028 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f5b72cf0-375b-4d9b-af04-706c6348e6d1-sys-fs\") pod \"aws-ebs-csi-driver-node-n95hd\" (UID: \"f5b72cf0-375b-4d9b-af04-706c6348e6d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n95hd" May 28 07:59:21.705760 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.704054 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/724affe7-1ef8-4aa8-8828-b3de728946da-konnectivity-ca\") pod \"konnectivity-agent-h2fkd\" (UID: \"724affe7-1ef8-4aa8-8828-b3de728946da\") " pod="kube-system/konnectivity-agent-h2fkd" May 28 07:59:21.705760 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.704078 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/092140cb-eea8-44c1-89f5-d8dd56d7d10a-env-overrides\") pod \"ovnkube-node-2llls\" (UID: \"092140cb-eea8-44c1-89f5-d8dd56d7d10a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2llls" May 28 07:59:21.705760 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.704105 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1826661e-2068-4391-9044-b01ffe8dbeac-var-lib-kubelet\") pod \"tuned-lm42d\" (UID: \"1826661e-2068-4391-9044-b01ffe8dbeac\") " pod="openshift-cluster-node-tuning-operator/tuned-lm42d" May 28 07:59:21.705760 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.704165 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f5b72cf0-375b-4d9b-af04-706c6348e6d1-sys-fs\") pod \"aws-ebs-csi-driver-node-n95hd\" (UID: \"f5b72cf0-375b-4d9b-af04-706c6348e6d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n95hd" May 28 07:59:21.705760 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.704187 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/632fd718-6604-42a2-aca2-e24e53bfdbb3-cnibin\") pod \"multus-ldhht\" (UID: \"632fd718-6604-42a2-aca2-e24e53bfdbb3\") " pod="openshift-multus/multus-ldhht" May 28 07:59:21.706207 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.704235 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/092140cb-eea8-44c1-89f5-d8dd56d7d10a-ovnkube-script-lib\") pod \"ovnkube-node-2llls\" (UID: \"092140cb-eea8-44c1-89f5-d8dd56d7d10a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2llls" May 28 07:59:21.706207 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.704288 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/23b33b50-4b8f-45d5-a5e7-362bdb2a04ea-iptables-alerter-script\") pod \"iptables-alerter-z4fbh\" (UID: \"23b33b50-4b8f-45d5-a5e7-362bdb2a04ea\") " pod="openshift-network-operator/iptables-alerter-z4fbh" May 28 07:59:21.706207 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.704321 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/04a96139-4274-4e69-bb7b-18e9e99ba9e4-serviceca\") pod \"node-ca-ctxgq\" (UID: \"04a96139-4274-4e69-bb7b-18e9e99ba9e4\") " pod="openshift-image-registry/node-ca-ctxgq" May 28 07:59:21.706207 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.704390 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f5b72cf0-375b-4d9b-af04-706c6348e6d1-socket-dir\") pod \"aws-ebs-csi-driver-node-n95hd\" (UID: \"f5b72cf0-375b-4d9b-af04-706c6348e6d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n95hd" May 28 07:59:21.706207 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.704532 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/092140cb-eea8-44c1-89f5-d8dd56d7d10a-env-overrides\") pod \"ovnkube-node-2llls\" (UID: \"092140cb-eea8-44c1-89f5-d8dd56d7d10a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2llls" May 28 07:59:21.706207 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.704603 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/724affe7-1ef8-4aa8-8828-b3de728946da-konnectivity-ca\") pod \"konnectivity-agent-h2fkd\" (UID: \"724affe7-1ef8-4aa8-8828-b3de728946da\") " pod="kube-system/konnectivity-agent-h2fkd" May 28 07:59:21.706207 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.705520 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/092140cb-eea8-44c1-89f5-d8dd56d7d10a-ovn-node-metrics-cert\") pod \"ovnkube-node-2llls\" (UID: \"092140cb-eea8-44c1-89f5-d8dd56d7d10a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2llls" May 28 07:59:21.706207 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.705658 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/724affe7-1ef8-4aa8-8828-b3de728946da-agent-certs\") pod \"konnectivity-agent-h2fkd\" (UID: \"724affe7-1ef8-4aa8-8828-b3de728946da\") " pod="kube-system/konnectivity-agent-h2fkd" May 28 07:59:21.710295 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:21.710277 2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 07:59:21.710370 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:21.710298 2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 07:59:21.710370 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:21.710309 2560 projected.go:194] Error preparing data for projected volume kube-api-access-59vxd for pod openshift-network-diagnostics/network-check-target-w9gt5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 07:59:21.710443 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:21.710387 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8802231b-bd91-4690-9379-4e802d4d8853-kube-api-access-59vxd podName:8802231b-bd91-4690-9379-4e802d4d8853 nodeName:}" failed. No retries permitted until 2026-05-28 07:59:22.210343469 +0000 UTC m=+2.096789589 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-59vxd" (UniqueName: "kubernetes.io/projected/8802231b-bd91-4690-9379-4e802d4d8853-kube-api-access-59vxd") pod "network-check-target-w9gt5" (UID: "8802231b-bd91-4690-9379-4e802d4d8853") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 07:59:21.711920 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.711895 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hn5qs\" (UniqueName: \"kubernetes.io/projected/4a2444a9-55c7-4ce5-b8e7-d394e0855f26-kube-api-access-hn5qs\") pod \"multus-additional-cni-plugins-dxbtn\" (UID: \"4a2444a9-55c7-4ce5-b8e7-d394e0855f26\") " pod="openshift-multus/multus-additional-cni-plugins-dxbtn" May 28 07:59:21.712756 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.712731 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vnhd\" (UniqueName: \"kubernetes.io/projected/04a96139-4274-4e69-bb7b-18e9e99ba9e4-kube-api-access-6vnhd\") pod \"node-ca-ctxgq\" (UID: \"04a96139-4274-4e69-bb7b-18e9e99ba9e4\") " pod="openshift-image-registry/node-ca-ctxgq" May 28 07:59:21.712845 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.712821 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsgnb\" (UniqueName: \"kubernetes.io/projected/23b33b50-4b8f-45d5-a5e7-362bdb2a04ea-kube-api-access-rsgnb\") pod \"iptables-alerter-z4fbh\" (UID: \"23b33b50-4b8f-45d5-a5e7-362bdb2a04ea\") " pod="openshift-network-operator/iptables-alerter-z4fbh" May 28 07:59:21.712845 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.712828 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k22t8\" (UniqueName: \"kubernetes.io/projected/f5b72cf0-375b-4d9b-af04-706c6348e6d1-kube-api-access-k22t8\") pod \"aws-ebs-csi-driver-node-n95hd\" (UID: \"f5b72cf0-375b-4d9b-af04-706c6348e6d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n95hd" May 28 07:59:21.712921 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.712860 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6dfw\" (UniqueName: \"kubernetes.io/projected/092140cb-eea8-44c1-89f5-d8dd56d7d10a-kube-api-access-k6dfw\") pod \"ovnkube-node-2llls\" (UID: \"092140cb-eea8-44c1-89f5-d8dd56d7d10a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2llls" May 28 07:59:21.729934 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.729900 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-133.ec2.internal" event={"ID":"a235c96c5df75d6e3bfc1abeabef5111","Type":"ContainerStarted","Data":"0e76c977069ff5643b31bbacce5cf814cb0cc18352eb0fb0cfee5965c10e091b"} May 28 07:59:21.730752 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.730734 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal" event={"ID":"a0af03460d0b834f8e0ef9046b6b5145","Type":"ContainerStarted","Data":"6ab7906938008e0c674c65e2529ab5df5bb4fbe79bcf52bf4f3a4218d2b677ab"} May 28 07:59:21.804465 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.804444 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/632fd718-6604-42a2-aca2-e24e53bfdbb3-cni-binary-copy\") pod \"multus-ldhht\" (UID: \"632fd718-6604-42a2-aca2-e24e53bfdbb3\") " pod="openshift-multus/multus-ldhht" May 28 07:59:21.804550 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.804484 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1826661e-2068-4391-9044-b01ffe8dbeac-etc-sysconfig\") pod \"tuned-lm42d\" (UID: \"1826661e-2068-4391-9044-b01ffe8dbeac\") " pod="openshift-cluster-node-tuning-operator/tuned-lm42d" May 28 07:59:21.804550 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.804508 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1826661e-2068-4391-9044-b01ffe8dbeac-etc-sysctl-d\") pod \"tuned-lm42d\" (UID: \"1826661e-2068-4391-9044-b01ffe8dbeac\") " pod="openshift-cluster-node-tuning-operator/tuned-lm42d" May 28 07:59:21.804550 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.804530 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1826661e-2068-4391-9044-b01ffe8dbeac-etc-tuned\") pod \"tuned-lm42d\" (UID: \"1826661e-2068-4391-9044-b01ffe8dbeac\") " pod="openshift-cluster-node-tuning-operator/tuned-lm42d" May 28 07:59:21.804727 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.804557 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1826661e-2068-4391-9044-b01ffe8dbeac-etc-sysconfig\") pod \"tuned-lm42d\" (UID: \"1826661e-2068-4391-9044-b01ffe8dbeac\") " pod="openshift-cluster-node-tuning-operator/tuned-lm42d" May 28 07:59:21.804727 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.804605 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xvxn5\" (UniqueName: \"kubernetes.io/projected/1826661e-2068-4391-9044-b01ffe8dbeac-kube-api-access-xvxn5\") pod \"tuned-lm42d\" (UID: \"1826661e-2068-4391-9044-b01ffe8dbeac\") " pod="openshift-cluster-node-tuning-operator/tuned-lm42d" May 28 07:59:21.804727 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.804641 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/632fd718-6604-42a2-aca2-e24e53bfdbb3-multus-conf-dir\") pod \"multus-ldhht\" (UID: \"632fd718-6604-42a2-aca2-e24e53bfdbb3\") " pod="openshift-multus/multus-ldhht" May 28 07:59:21.804727 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.804659 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1826661e-2068-4391-9044-b01ffe8dbeac-etc-sysctl-d\") pod \"tuned-lm42d\" (UID: \"1826661e-2068-4391-9044-b01ffe8dbeac\") " pod="openshift-cluster-node-tuning-operator/tuned-lm42d" May 28 07:59:21.804727 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.804699 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/632fd718-6604-42a2-aca2-e24e53bfdbb3-multus-conf-dir\") pod \"multus-ldhht\" (UID: \"632fd718-6604-42a2-aca2-e24e53bfdbb3\") " pod="openshift-multus/multus-ldhht" May 28 07:59:21.804927 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.804667 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/632fd718-6604-42a2-aca2-e24e53bfdbb3-multus-daemon-config\") pod \"multus-ldhht\" (UID: \"632fd718-6604-42a2-aca2-e24e53bfdbb3\") " pod="openshift-multus/multus-ldhht" May 28 07:59:21.804927 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.804764 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1826661e-2068-4391-9044-b01ffe8dbeac-sys\") pod \"tuned-lm42d\" (UID: \"1826661e-2068-4391-9044-b01ffe8dbeac\") " pod="openshift-cluster-node-tuning-operator/tuned-lm42d" May 28 07:59:21.804927 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.804788 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/632fd718-6604-42a2-aca2-e24e53bfdbb3-multus-socket-dir-parent\") pod \"multus-ldhht\" (UID: \"632fd718-6604-42a2-aca2-e24e53bfdbb3\") " pod="openshift-multus/multus-ldhht" May 28 07:59:21.804927 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.804811 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8db07e49-d641-48b0-89e4-2f4bdf6999a5-hosts-file\") pod \"node-resolver-xhm9j\" (UID: \"8db07e49-d641-48b0-89e4-2f4bdf6999a5\") " pod="openshift-dns/node-resolver-xhm9j" May 28 07:59:21.804927 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.804837 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8db07e49-d641-48b0-89e4-2f4bdf6999a5-tmp-dir\") pod \"node-resolver-xhm9j\" (UID: \"8db07e49-d641-48b0-89e4-2f4bdf6999a5\") " pod="openshift-dns/node-resolver-xhm9j" May 28 07:59:21.805642 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.805109 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/632fd718-6604-42a2-aca2-e24e53bfdbb3-os-release\") pod \"multus-ldhht\" (UID: \"632fd718-6604-42a2-aca2-e24e53bfdbb3\") " pod="openshift-multus/multus-ldhht" May 28 07:59:21.805642 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.805158 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/632fd718-6604-42a2-aca2-e24e53bfdbb3-host-var-lib-cni-bin\") pod \"multus-ldhht\" (UID: \"632fd718-6604-42a2-aca2-e24e53bfdbb3\") " pod="openshift-multus/multus-ldhht" May 28 07:59:21.805642 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.805176 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1826661e-2068-4391-9044-b01ffe8dbeac-sys\") pod \"tuned-lm42d\" (UID: \"1826661e-2068-4391-9044-b01ffe8dbeac\") " pod="openshift-cluster-node-tuning-operator/tuned-lm42d" May 28 07:59:21.805642 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.805192 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/632fd718-6604-42a2-aca2-e24e53bfdbb3-host-var-lib-cni-multus\") pod \"multus-ldhht\" (UID: \"632fd718-6604-42a2-aca2-e24e53bfdbb3\") " pod="openshift-multus/multus-ldhht" May 28 07:59:21.805642 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.805226 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5smq8\" (UniqueName: \"kubernetes.io/projected/5f2c94ed-4111-42f9-8ec1-7c96447b9c11-kube-api-access-5smq8\") pod \"network-metrics-daemon-z5j9k\" (UID: \"5f2c94ed-4111-42f9-8ec1-7c96447b9c11\") " pod="openshift-multus/network-metrics-daemon-z5j9k" May 28 07:59:21.805642 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.805257 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z69kg\" (UniqueName: \"kubernetes.io/projected/8db07e49-d641-48b0-89e4-2f4bdf6999a5-kube-api-access-z69kg\") pod \"node-resolver-xhm9j\" (UID: \"8db07e49-d641-48b0-89e4-2f4bdf6999a5\") " pod="openshift-dns/node-resolver-xhm9j" May 28 07:59:21.805642 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.805261 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/632fd718-6604-42a2-aca2-e24e53bfdbb3-multus-socket-dir-parent\") pod \"multus-ldhht\" (UID: \"632fd718-6604-42a2-aca2-e24e53bfdbb3\") " pod="openshift-multus/multus-ldhht" May 28 07:59:21.805642 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.805264 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8db07e49-d641-48b0-89e4-2f4bdf6999a5-hosts-file\") pod \"node-resolver-xhm9j\" (UID: \"8db07e49-d641-48b0-89e4-2f4bdf6999a5\") " pod="openshift-dns/node-resolver-xhm9j" May 28 07:59:21.805642 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.805352 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/632fd718-6604-42a2-aca2-e24e53bfdbb3-os-release\") pod \"multus-ldhht\" (UID: \"632fd718-6604-42a2-aca2-e24e53bfdbb3\") " pod="openshift-multus/multus-ldhht" May 28 07:59:21.805642 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.805438 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/632fd718-6604-42a2-aca2-e24e53bfdbb3-multus-cni-dir\") pod \"multus-ldhht\" (UID: \"632fd718-6604-42a2-aca2-e24e53bfdbb3\") " pod="openshift-multus/multus-ldhht" May 28 07:59:21.805642 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.805469 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/632fd718-6604-42a2-aca2-e24e53bfdbb3-etc-kubernetes\") pod \"multus-ldhht\" (UID: \"632fd718-6604-42a2-aca2-e24e53bfdbb3\") " pod="openshift-multus/multus-ldhht" May 28 07:59:21.805642 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.805476 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/632fd718-6604-42a2-aca2-e24e53bfdbb3-multus-daemon-config\") pod \"multus-ldhht\" (UID: \"632fd718-6604-42a2-aca2-e24e53bfdbb3\") " pod="openshift-multus/multus-ldhht" May 28 07:59:21.805642 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.805484 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/632fd718-6604-42a2-aca2-e24e53bfdbb3-cni-binary-copy\") pod \"multus-ldhht\" (UID: \"632fd718-6604-42a2-aca2-e24e53bfdbb3\") " pod="openshift-multus/multus-ldhht" May 28 07:59:21.805642 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.805497 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/632fd718-6604-42a2-aca2-e24e53bfdbb3-host-run-multus-certs\") pod \"multus-ldhht\" (UID: \"632fd718-6604-42a2-aca2-e24e53bfdbb3\") " pod="openshift-multus/multus-ldhht" May 28 07:59:21.805642 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.805545 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1826661e-2068-4391-9044-b01ffe8dbeac-etc-modprobe-d\") pod \"tuned-lm42d\" (UID: \"1826661e-2068-4391-9044-b01ffe8dbeac\") " pod="openshift-cluster-node-tuning-operator/tuned-lm42d" May 28 07:59:21.805642 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.805554 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/632fd718-6604-42a2-aca2-e24e53bfdbb3-etc-kubernetes\") pod \"multus-ldhht\" (UID: \"632fd718-6604-42a2-aca2-e24e53bfdbb3\") " pod="openshift-multus/multus-ldhht" May 28 07:59:21.805642 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.805558 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/632fd718-6604-42a2-aca2-e24e53bfdbb3-multus-cni-dir\") pod \"multus-ldhht\" (UID: \"632fd718-6604-42a2-aca2-e24e53bfdbb3\") " pod="openshift-multus/multus-ldhht" May 28 07:59:21.805642 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.805601 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1826661e-2068-4391-9044-b01ffe8dbeac-run\") pod \"tuned-lm42d\" (UID: \"1826661e-2068-4391-9044-b01ffe8dbeac\") " pod="openshift-cluster-node-tuning-operator/tuned-lm42d" May 28 07:59:21.806796 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.805636 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/632fd718-6604-42a2-aca2-e24e53bfdbb3-host-run-multus-certs\") pod \"multus-ldhht\" (UID: \"632fd718-6604-42a2-aca2-e24e53bfdbb3\") " pod="openshift-multus/multus-ldhht" May 28 07:59:21.806796 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.805646 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8db07e49-d641-48b0-89e4-2f4bdf6999a5-tmp-dir\") pod \"node-resolver-xhm9j\" (UID: \"8db07e49-d641-48b0-89e4-2f4bdf6999a5\") " pod="openshift-dns/node-resolver-xhm9j" May 28 07:59:21.806796 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.805689 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/632fd718-6604-42a2-aca2-e24e53bfdbb3-host-var-lib-cni-bin\") pod \"multus-ldhht\" (UID: \"632fd718-6604-42a2-aca2-e24e53bfdbb3\") " pod="openshift-multus/multus-ldhht" May 28 07:59:21.806796 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.805737 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/632fd718-6604-42a2-aca2-e24e53bfdbb3-host-var-lib-cni-multus\") pod \"multus-ldhht\" (UID: \"632fd718-6604-42a2-aca2-e24e53bfdbb3\") " pod="openshift-multus/multus-ldhht" May 28 07:59:21.806796 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.805772 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1826661e-2068-4391-9044-b01ffe8dbeac-run\") pod \"tuned-lm42d\" (UID: \"1826661e-2068-4391-9044-b01ffe8dbeac\") " pod="openshift-cluster-node-tuning-operator/tuned-lm42d" May 28 07:59:21.806796 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.805828 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1826661e-2068-4391-9044-b01ffe8dbeac-var-lib-kubelet\") pod \"tuned-lm42d\" (UID: \"1826661e-2068-4391-9044-b01ffe8dbeac\") " pod="openshift-cluster-node-tuning-operator/tuned-lm42d" May 28 07:59:21.806796 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.805836 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1826661e-2068-4391-9044-b01ffe8dbeac-etc-modprobe-d\") pod \"tuned-lm42d\" (UID: \"1826661e-2068-4391-9044-b01ffe8dbeac\") " pod="openshift-cluster-node-tuning-operator/tuned-lm42d" May 28 07:59:21.806796 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.805866 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/632fd718-6604-42a2-aca2-e24e53bfdbb3-cnibin\") pod \"multus-ldhht\" (UID: \"632fd718-6604-42a2-aca2-e24e53bfdbb3\") " pod="openshift-multus/multus-ldhht" May 28 07:59:21.806796 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.805915 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1826661e-2068-4391-9044-b01ffe8dbeac-var-lib-kubelet\") pod \"tuned-lm42d\" (UID: \"1826661e-2068-4391-9044-b01ffe8dbeac\") " pod="openshift-cluster-node-tuning-operator/tuned-lm42d" May 28 07:59:21.806796 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.805918 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/632fd718-6604-42a2-aca2-e24e53bfdbb3-host-var-lib-kubelet\") pod \"multus-ldhht\" (UID: \"632fd718-6604-42a2-aca2-e24e53bfdbb3\") " pod="openshift-multus/multus-ldhht" May 28 07:59:21.806796 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.805956 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/632fd718-6604-42a2-aca2-e24e53bfdbb3-host-var-lib-kubelet\") pod \"multus-ldhht\" (UID: \"632fd718-6604-42a2-aca2-e24e53bfdbb3\") " pod="openshift-multus/multus-ldhht" May 28 07:59:21.806796 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.805962 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1826661e-2068-4391-9044-b01ffe8dbeac-tmp\") pod \"tuned-lm42d\" (UID: \"1826661e-2068-4391-9044-b01ffe8dbeac\") " pod="openshift-cluster-node-tuning-operator/tuned-lm42d" May 28 07:59:21.806796 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.805997 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f2c94ed-4111-42f9-8ec1-7c96447b9c11-metrics-certs\") pod \"network-metrics-daemon-z5j9k\" (UID: \"5f2c94ed-4111-42f9-8ec1-7c96447b9c11\") " pod="openshift-multus/network-metrics-daemon-z5j9k" May 28 07:59:21.806796 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.806019 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/632fd718-6604-42a2-aca2-e24e53bfdbb3-cnibin\") pod \"multus-ldhht\" (UID: \"632fd718-6604-42a2-aca2-e24e53bfdbb3\") " pod="openshift-multus/multus-ldhht" May 28 07:59:21.806796 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.806027 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1826661e-2068-4391-9044-b01ffe8dbeac-lib-modules\") pod \"tuned-lm42d\" (UID: \"1826661e-2068-4391-9044-b01ffe8dbeac\") " pod="openshift-cluster-node-tuning-operator/tuned-lm42d" May 28 07:59:21.806796 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:21.806099 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 07:59:21.806796 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.806118 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1826661e-2068-4391-9044-b01ffe8dbeac-lib-modules\") pod \"tuned-lm42d\" (UID: \"1826661e-2068-4391-9044-b01ffe8dbeac\") " pod="openshift-cluster-node-tuning-operator/tuned-lm42d" May 28 07:59:21.806796 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.806157 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/632fd718-6604-42a2-aca2-e24e53bfdbb3-host-run-k8s-cni-cncf-io\") pod \"multus-ldhht\" (UID: \"632fd718-6604-42a2-aca2-e24e53bfdbb3\") " pod="openshift-multus/multus-ldhht" May 28 07:59:21.806796 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.806186 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/632fd718-6604-42a2-aca2-e24e53bfdbb3-host-run-netns\") pod \"multus-ldhht\" (UID: \"632fd718-6604-42a2-aca2-e24e53bfdbb3\") " pod="openshift-multus/multus-ldhht" May 28 07:59:21.808734 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.806217 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/632fd718-6604-42a2-aca2-e24e53bfdbb3-host-run-k8s-cni-cncf-io\") pod \"multus-ldhht\" (UID: \"632fd718-6604-42a2-aca2-e24e53bfdbb3\") " pod="openshift-multus/multus-ldhht" May 28 07:59:21.808734 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.806219 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/632fd718-6604-42a2-aca2-e24e53bfdbb3-hostroot\") pod \"multus-ldhht\" (UID: \"632fd718-6604-42a2-aca2-e24e53bfdbb3\") " pod="openshift-multus/multus-ldhht" May 28 07:59:21.808734 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.806259 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/632fd718-6604-42a2-aca2-e24e53bfdbb3-hostroot\") pod \"multus-ldhht\" (UID: \"632fd718-6604-42a2-aca2-e24e53bfdbb3\") " pod="openshift-multus/multus-ldhht" May 28 07:59:21.808734 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.806280 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1826661e-2068-4391-9044-b01ffe8dbeac-etc-sysctl-conf\") pod \"tuned-lm42d\" (UID: \"1826661e-2068-4391-9044-b01ffe8dbeac\") " pod="openshift-cluster-node-tuning-operator/tuned-lm42d" May 28 07:59:21.808734 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:21.806302 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f2c94ed-4111-42f9-8ec1-7c96447b9c11-metrics-certs podName:5f2c94ed-4111-42f9-8ec1-7c96447b9c11 nodeName:}" failed. No retries permitted until 2026-05-28 07:59:22.306276051 +0000 UTC m=+2.192722172 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5f2c94ed-4111-42f9-8ec1-7c96447b9c11-metrics-certs") pod "network-metrics-daemon-z5j9k" (UID: "5f2c94ed-4111-42f9-8ec1-7c96447b9c11") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 07:59:21.808734 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.806343 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6l826\" (UniqueName: \"kubernetes.io/projected/632fd718-6604-42a2-aca2-e24e53bfdbb3-kube-api-access-6l826\") pod \"multus-ldhht\" (UID: \"632fd718-6604-42a2-aca2-e24e53bfdbb3\") " pod="openshift-multus/multus-ldhht" May 28 07:59:21.808734 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.806375 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1826661e-2068-4391-9044-b01ffe8dbeac-etc-kubernetes\") pod \"tuned-lm42d\" (UID: \"1826661e-2068-4391-9044-b01ffe8dbeac\") " pod="openshift-cluster-node-tuning-operator/tuned-lm42d" May 28 07:59:21.808734 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.806385 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1826661e-2068-4391-9044-b01ffe8dbeac-etc-sysctl-conf\") pod \"tuned-lm42d\" (UID: \"1826661e-2068-4391-9044-b01ffe8dbeac\") " pod="openshift-cluster-node-tuning-operator/tuned-lm42d" May 28 07:59:21.808734 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.806375 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/632fd718-6604-42a2-aca2-e24e53bfdbb3-host-run-netns\") pod \"multus-ldhht\" (UID: \"632fd718-6604-42a2-aca2-e24e53bfdbb3\") " pod="openshift-multus/multus-ldhht" May 28 07:59:21.808734 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.806428 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1826661e-2068-4391-9044-b01ffe8dbeac-etc-systemd\") pod \"tuned-lm42d\" (UID: \"1826661e-2068-4391-9044-b01ffe8dbeac\") " pod="openshift-cluster-node-tuning-operator/tuned-lm42d" May 28 07:59:21.808734 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.806446 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1826661e-2068-4391-9044-b01ffe8dbeac-etc-kubernetes\") pod \"tuned-lm42d\" (UID: \"1826661e-2068-4391-9044-b01ffe8dbeac\") " pod="openshift-cluster-node-tuning-operator/tuned-lm42d" May 28 07:59:21.808734 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.806456 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1826661e-2068-4391-9044-b01ffe8dbeac-host\") pod \"tuned-lm42d\" (UID: \"1826661e-2068-4391-9044-b01ffe8dbeac\") " pod="openshift-cluster-node-tuning-operator/tuned-lm42d" May 28 07:59:21.808734 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.806488 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/632fd718-6604-42a2-aca2-e24e53bfdbb3-system-cni-dir\") pod \"multus-ldhht\" (UID: \"632fd718-6604-42a2-aca2-e24e53bfdbb3\") " pod="openshift-multus/multus-ldhht" May 28 07:59:21.808734 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.806546 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1826661e-2068-4391-9044-b01ffe8dbeac-host\") pod \"tuned-lm42d\" (UID: \"1826661e-2068-4391-9044-b01ffe8dbeac\") " pod="openshift-cluster-node-tuning-operator/tuned-lm42d" May 28 07:59:21.808734 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.806552 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1826661e-2068-4391-9044-b01ffe8dbeac-etc-systemd\") pod \"tuned-lm42d\" (UID: \"1826661e-2068-4391-9044-b01ffe8dbeac\") " pod="openshift-cluster-node-tuning-operator/tuned-lm42d" May 28 07:59:21.808734 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.806622 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/632fd718-6604-42a2-aca2-e24e53bfdbb3-system-cni-dir\") pod \"multus-ldhht\" (UID: \"632fd718-6604-42a2-aca2-e24e53bfdbb3\") " pod="openshift-multus/multus-ldhht" May 28 07:59:21.808734 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.806634 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1826661e-2068-4391-9044-b01ffe8dbeac-etc-tuned\") pod \"tuned-lm42d\" (UID: \"1826661e-2068-4391-9044-b01ffe8dbeac\") " pod="openshift-cluster-node-tuning-operator/tuned-lm42d" May 28 07:59:21.809235 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.808173 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1826661e-2068-4391-9044-b01ffe8dbeac-tmp\") pod \"tuned-lm42d\" (UID: \"1826661e-2068-4391-9044-b01ffe8dbeac\") " pod="openshift-cluster-node-tuning-operator/tuned-lm42d" May 28 07:59:21.811741 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.811722 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvxn5\" (UniqueName: \"kubernetes.io/projected/1826661e-2068-4391-9044-b01ffe8dbeac-kube-api-access-xvxn5\") pod \"tuned-lm42d\" (UID: \"1826661e-2068-4391-9044-b01ffe8dbeac\") " pod="openshift-cluster-node-tuning-operator/tuned-lm42d" May 28 07:59:21.812920 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.812897 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z69kg\" (UniqueName: \"kubernetes.io/projected/8db07e49-d641-48b0-89e4-2f4bdf6999a5-kube-api-access-z69kg\") pod \"node-resolver-xhm9j\" (UID: \"8db07e49-d641-48b0-89e4-2f4bdf6999a5\") " pod="openshift-dns/node-resolver-xhm9j" May 28 07:59:21.813220 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.813204 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5smq8\" (UniqueName: \"kubernetes.io/projected/5f2c94ed-4111-42f9-8ec1-7c96447b9c11-kube-api-access-5smq8\") pod \"network-metrics-daemon-z5j9k\" (UID: \"5f2c94ed-4111-42f9-8ec1-7c96447b9c11\") " pod="openshift-multus/network-metrics-daemon-z5j9k" May 28 07:59:21.813595 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.813580 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6l826\" (UniqueName: \"kubernetes.io/projected/632fd718-6604-42a2-aca2-e24e53bfdbb3-kube-api-access-6l826\") pod \"multus-ldhht\" (UID: \"632fd718-6604-42a2-aca2-e24e53bfdbb3\") " pod="openshift-multus/multus-ldhht" May 28 07:59:21.905706 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.905684 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-h2fkd" May 28 07:59:21.912060 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:21.912041 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod724affe7_1ef8_4aa8_8828_b3de728946da.slice/crio-aa4d4daa5e6003e6b0fa4ed830e2a6bc30ae74d75dac6b5fe1b67be5ad0e15c6 WatchSource:0}: Error finding container aa4d4daa5e6003e6b0fa4ed830e2a6bc30ae74d75dac6b5fe1b67be5ad0e15c6: Status 404 returned error can't find the container with id aa4d4daa5e6003e6b0fa4ed830e2a6bc30ae74d75dac6b5fe1b67be5ad0e15c6 May 28 07:59:21.917799 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.917783 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ctxgq" May 28 07:59:21.923513 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:21.923491 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04a96139_4274_4e69_bb7b_18e9e99ba9e4.slice/crio-8e7be61f88312297cf2ed15884076060fd65623fd4b732cb32971b4fb9f92217 WatchSource:0}: Error finding container 8e7be61f88312297cf2ed15884076060fd65623fd4b732cb32971b4fb9f92217: Status 404 returned error can't find the container with id 8e7be61f88312297cf2ed15884076060fd65623fd4b732cb32971b4fb9f92217 May 28 07:59:21.924995 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.924979 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dxbtn" May 28 07:59:21.930371 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:21.930352 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a2444a9_55c7_4ce5_b8e7_d394e0855f26.slice/crio-26cdadfdc729e73325a254360eef2c9ec63ad6cf18e3c26c7cdd1a551a8065d6 WatchSource:0}: Error finding container 26cdadfdc729e73325a254360eef2c9ec63ad6cf18e3c26c7cdd1a551a8065d6: Status 404 returned error can't find the container with id 26cdadfdc729e73325a254360eef2c9ec63ad6cf18e3c26c7cdd1a551a8065d6 May 28 07:59:21.939808 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.939791 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-z4fbh" May 28 07:59:21.944954 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:21.944935 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23b33b50_4b8f_45d5_a5e7_362bdb2a04ea.slice/crio-be987ee54b01660696cb4a88c90cbe9afa6ba54f25861c9d2ad52fe3ad1f01af WatchSource:0}: Error finding container be987ee54b01660696cb4a88c90cbe9afa6ba54f25861c9d2ad52fe3ad1f01af: Status 404 returned error can't find the container with id be987ee54b01660696cb4a88c90cbe9afa6ba54f25861c9d2ad52fe3ad1f01af May 28 07:59:21.951322 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.951307 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2llls" May 28 07:59:21.956482 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:21.956460 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod092140cb_eea8_44c1_89f5_d8dd56d7d10a.slice/crio-7078b60ca0d88a3780eb7dd33d8e1193751bb9bc21c1c95469181b0d25b4920b WatchSource:0}: Error finding container 7078b60ca0d88a3780eb7dd33d8e1193751bb9bc21c1c95469181b0d25b4920b: Status 404 returned error can't find the container with id 7078b60ca0d88a3780eb7dd33d8e1193751bb9bc21c1c95469181b0d25b4920b May 28 07:59:21.974718 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.974702 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n95hd" May 28 07:59:21.979812 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.979790 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lm42d" May 28 07:59:21.980032 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:21.980005 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5b72cf0_375b_4d9b_af04_706c6348e6d1.slice/crio-6216d1ebcc785e6ee0c62c02b73ae93690193369cd5c638595e3ee134639f741 WatchSource:0}: Error finding container 6216d1ebcc785e6ee0c62c02b73ae93690193369cd5c638595e3ee134639f741: Status 404 returned error can't find the container with id 6216d1ebcc785e6ee0c62c02b73ae93690193369cd5c638595e3ee134639f741 May 28 07:59:21.985415 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.985397 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xhm9j" May 28 07:59:21.985713 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:21.985691 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1826661e_2068_4391_9044_b01ffe8dbeac.slice/crio-b88a51ad9ed025a56c66e94ab318f1f178350ed7eb5ff87a5af887af4bc9f71b WatchSource:0}: Error finding container b88a51ad9ed025a56c66e94ab318f1f178350ed7eb5ff87a5af887af4bc9f71b: Status 404 returned error can't find the container with id b88a51ad9ed025a56c66e94ab318f1f178350ed7eb5ff87a5af887af4bc9f71b May 28 07:59:21.989503 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:21.989488 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ldhht" May 28 07:59:21.991070 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:21.991044 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8db07e49_d641_48b0_89e4_2f4bdf6999a5.slice/crio-6d984778f2beef28f421398eb70625a19e4056d7596f00a95b6c03b4afa6cb84 WatchSource:0}: Error finding container 6d984778f2beef28f421398eb70625a19e4056d7596f00a95b6c03b4afa6cb84: Status 404 returned error can't find the container with id 6d984778f2beef28f421398eb70625a19e4056d7596f00a95b6c03b4afa6cb84 May 28 07:59:21.995147 ip-10-0-139-133 kubenswrapper[2560]: W0528 07:59:21.995123 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod632fd718_6604_42a2_aca2_e24e53bfdbb3.slice/crio-5a46e27cfdd2cb66dcec5794fc190990db6024700d55a96b37c6e824ae63e886 WatchSource:0}: Error finding container 5a46e27cfdd2cb66dcec5794fc190990db6024700d55a96b37c6e824ae63e886: Status 404 returned error can't find the container with id 5a46e27cfdd2cb66dcec5794fc190990db6024700d55a96b37c6e824ae63e886 May 28 07:59:22.310573 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:22.309830 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-59vxd\" (UniqueName: \"kubernetes.io/projected/8802231b-bd91-4690-9379-4e802d4d8853-kube-api-access-59vxd\") pod \"network-check-target-w9gt5\" (UID: \"8802231b-bd91-4690-9379-4e802d4d8853\") " pod="openshift-network-diagnostics/network-check-target-w9gt5" May 28 07:59:22.310573 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:22.309885 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f2c94ed-4111-42f9-8ec1-7c96447b9c11-metrics-certs\") pod \"network-metrics-daemon-z5j9k\" (UID: \"5f2c94ed-4111-42f9-8ec1-7c96447b9c11\") " pod="openshift-multus/network-metrics-daemon-z5j9k" May 28 07:59:22.310573 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:22.310014 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 07:59:22.310573 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:22.310072 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f2c94ed-4111-42f9-8ec1-7c96447b9c11-metrics-certs podName:5f2c94ed-4111-42f9-8ec1-7c96447b9c11 nodeName:}" failed. No retries permitted until 2026-05-28 07:59:23.310053087 +0000 UTC m=+3.196499230 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5f2c94ed-4111-42f9-8ec1-7c96447b9c11-metrics-certs") pod "network-metrics-daemon-z5j9k" (UID: "5f2c94ed-4111-42f9-8ec1-7c96447b9c11") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 07:59:22.310573 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:22.310482 2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 07:59:22.310573 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:22.310497 2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 07:59:22.310573 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:22.310510 2560 projected.go:194] Error preparing data for projected volume kube-api-access-59vxd for pod openshift-network-diagnostics/network-check-target-w9gt5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 07:59:22.310573 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:22.310556 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8802231b-bd91-4690-9379-4e802d4d8853-kube-api-access-59vxd podName:8802231b-bd91-4690-9379-4e802d4d8853 nodeName:}" failed. No retries permitted until 2026-05-28 07:59:23.310541761 +0000 UTC m=+3.196987889 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-59vxd" (UniqueName: "kubernetes.io/projected/8802231b-bd91-4690-9379-4e802d4d8853-kube-api-access-59vxd") pod "network-check-target-w9gt5" (UID: "8802231b-bd91-4690-9379-4e802d4d8853") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 07:59:22.542651 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:22.542425 2560 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 28 07:59:22.631906 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:22.631826 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-27 07:54:21 +0000 UTC" deadline="2027-11-07 22:16:56.670931084 +0000 UTC" May 28 07:59:22.631906 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:22.631859 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12686h17m34.039075068s" May 28 07:59:22.652081 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:22.651893 2560 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 28 07:59:22.747049 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:22.747015 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-h2fkd" event={"ID":"724affe7-1ef8-4aa8-8828-b3de728946da","Type":"ContainerStarted","Data":"aa4d4daa5e6003e6b0fa4ed830e2a6bc30ae74d75dac6b5fe1b67be5ad0e15c6"} May 28 07:59:22.758784 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:22.758718 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ldhht" event={"ID":"632fd718-6604-42a2-aca2-e24e53bfdbb3","Type":"ContainerStarted","Data":"5a46e27cfdd2cb66dcec5794fc190990db6024700d55a96b37c6e824ae63e886"} May 28 07:59:22.760677 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:22.760627 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xhm9j" event={"ID":"8db07e49-d641-48b0-89e4-2f4bdf6999a5","Type":"ContainerStarted","Data":"6d984778f2beef28f421398eb70625a19e4056d7596f00a95b6c03b4afa6cb84"} May 28 07:59:22.766406 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:22.766382 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lm42d" event={"ID":"1826661e-2068-4391-9044-b01ffe8dbeac","Type":"ContainerStarted","Data":"b88a51ad9ed025a56c66e94ab318f1f178350ed7eb5ff87a5af887af4bc9f71b"} May 28 07:59:22.772090 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:22.772064 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n95hd" event={"ID":"f5b72cf0-375b-4d9b-af04-706c6348e6d1","Type":"ContainerStarted","Data":"6216d1ebcc785e6ee0c62c02b73ae93690193369cd5c638595e3ee134639f741"} May 28 07:59:22.783098 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:22.783062 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2llls" event={"ID":"092140cb-eea8-44c1-89f5-d8dd56d7d10a","Type":"ContainerStarted","Data":"7078b60ca0d88a3780eb7dd33d8e1193751bb9bc21c1c95469181b0d25b4920b"} May 28 07:59:22.786472 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:22.786451 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-z4fbh" event={"ID":"23b33b50-4b8f-45d5-a5e7-362bdb2a04ea","Type":"ContainerStarted","Data":"be987ee54b01660696cb4a88c90cbe9afa6ba54f25861c9d2ad52fe3ad1f01af"} May 28 07:59:22.795409 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:22.795322 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dxbtn" event={"ID":"4a2444a9-55c7-4ce5-b8e7-d394e0855f26","Type":"ContainerStarted","Data":"26cdadfdc729e73325a254360eef2c9ec63ad6cf18e3c26c7cdd1a551a8065d6"} May 28 07:59:22.811721 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:22.811693 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ctxgq" event={"ID":"04a96139-4274-4e69-bb7b-18e9e99ba9e4","Type":"ContainerStarted","Data":"8e7be61f88312297cf2ed15884076060fd65623fd4b732cb32971b4fb9f92217"} May 28 07:59:22.874369 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:22.874137 2560 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 28 07:59:23.316976 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:23.316934 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-59vxd\" (UniqueName: \"kubernetes.io/projected/8802231b-bd91-4690-9379-4e802d4d8853-kube-api-access-59vxd\") pod \"network-check-target-w9gt5\" (UID: \"8802231b-bd91-4690-9379-4e802d4d8853\") " pod="openshift-network-diagnostics/network-check-target-w9gt5" May 28 07:59:23.317158 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:23.316983 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f2c94ed-4111-42f9-8ec1-7c96447b9c11-metrics-certs\") pod \"network-metrics-daemon-z5j9k\" (UID: \"5f2c94ed-4111-42f9-8ec1-7c96447b9c11\") " pod="openshift-multus/network-metrics-daemon-z5j9k" May 28 07:59:23.317158 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:23.317142 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 07:59:23.317374 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:23.317358 2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 07:59:23.317456 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:23.317382 2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 07:59:23.317456 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:23.317402 2560 projected.go:194] Error preparing data for projected volume kube-api-access-59vxd for pod openshift-network-diagnostics/network-check-target-w9gt5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 07:59:23.317551 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:23.317460 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8802231b-bd91-4690-9379-4e802d4d8853-kube-api-access-59vxd podName:8802231b-bd91-4690-9379-4e802d4d8853 nodeName:}" failed. No retries permitted until 2026-05-28 07:59:25.317441402 +0000 UTC m=+5.203887523 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-59vxd" (UniqueName: "kubernetes.io/projected/8802231b-bd91-4690-9379-4e802d4d8853-kube-api-access-59vxd") pod "network-check-target-w9gt5" (UID: "8802231b-bd91-4690-9379-4e802d4d8853") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 07:59:23.317867 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:23.317850 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f2c94ed-4111-42f9-8ec1-7c96447b9c11-metrics-certs podName:5f2c94ed-4111-42f9-8ec1-7c96447b9c11 nodeName:}" failed. No retries permitted until 2026-05-28 07:59:25.317831192 +0000 UTC m=+5.204277332 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5f2c94ed-4111-42f9-8ec1-7c96447b9c11-metrics-certs") pod "network-metrics-daemon-z5j9k" (UID: "5f2c94ed-4111-42f9-8ec1-7c96447b9c11") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 07:59:23.632139 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:23.632022 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-27 07:54:21 +0000 UTC" deadline="2027-11-23 21:19:42.290307595 +0000 UTC" May 28 07:59:23.632139 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:23.632056 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13069h20m18.658254498s" May 28 07:59:23.727705 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:23.727671 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z5j9k" May 28 07:59:23.727859 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:23.727796 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z5j9k" podUID="5f2c94ed-4111-42f9-8ec1-7c96447b9c11" May 28 07:59:23.728229 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:23.728208 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w9gt5" May 28 07:59:23.728331 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:23.728301 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w9gt5" podUID="8802231b-bd91-4690-9379-4e802d4d8853" May 28 07:59:25.334271 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:25.334232 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-59vxd\" (UniqueName: \"kubernetes.io/projected/8802231b-bd91-4690-9379-4e802d4d8853-kube-api-access-59vxd\") pod \"network-check-target-w9gt5\" (UID: \"8802231b-bd91-4690-9379-4e802d4d8853\") " pod="openshift-network-diagnostics/network-check-target-w9gt5" May 28 07:59:25.334784 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:25.334299 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f2c94ed-4111-42f9-8ec1-7c96447b9c11-metrics-certs\") pod \"network-metrics-daemon-z5j9k\" (UID: \"5f2c94ed-4111-42f9-8ec1-7c96447b9c11\") " pod="openshift-multus/network-metrics-daemon-z5j9k" May 28 07:59:25.334784 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:25.334419 2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 07:59:25.334784 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:25.334444 2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 07:59:25.334784 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:25.334459 2560 projected.go:194] Error preparing data for projected volume kube-api-access-59vxd for pod openshift-network-diagnostics/network-check-target-w9gt5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 07:59:25.334784 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:25.334518 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8802231b-bd91-4690-9379-4e802d4d8853-kube-api-access-59vxd podName:8802231b-bd91-4690-9379-4e802d4d8853 nodeName:}" failed. No retries permitted until 2026-05-28 07:59:29.334497935 +0000 UTC m=+9.220944067 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-59vxd" (UniqueName: "kubernetes.io/projected/8802231b-bd91-4690-9379-4e802d4d8853-kube-api-access-59vxd") pod "network-check-target-w9gt5" (UID: "8802231b-bd91-4690-9379-4e802d4d8853") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 07:59:25.334784 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:25.334418 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 07:59:25.334784 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:25.334581 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f2c94ed-4111-42f9-8ec1-7c96447b9c11-metrics-certs podName:5f2c94ed-4111-42f9-8ec1-7c96447b9c11 nodeName:}" failed. No retries permitted until 2026-05-28 07:59:29.334553994 +0000 UTC m=+9.221000125 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5f2c94ed-4111-42f9-8ec1-7c96447b9c11-metrics-certs") pod "network-metrics-daemon-z5j9k" (UID: "5f2c94ed-4111-42f9-8ec1-7c96447b9c11") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 07:59:25.728070 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:25.727997 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w9gt5" May 28 07:59:25.728214 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:25.728128 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w9gt5" podUID="8802231b-bd91-4690-9379-4e802d4d8853" May 28 07:59:25.728214 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:25.727998 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z5j9k" May 28 07:59:25.728327 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:25.728242 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z5j9k" podUID="5f2c94ed-4111-42f9-8ec1-7c96447b9c11" May 28 07:59:27.728287 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:27.728255 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w9gt5" May 28 07:59:27.728287 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:27.728291 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z5j9k" May 28 07:59:27.728827 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:27.728379 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w9gt5" podUID="8802231b-bd91-4690-9379-4e802d4d8853" May 28 07:59:27.728827 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:27.728505 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z5j9k" podUID="5f2c94ed-4111-42f9-8ec1-7c96447b9c11" May 28 07:59:29.363291 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:29.363255 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-59vxd\" (UniqueName: \"kubernetes.io/projected/8802231b-bd91-4690-9379-4e802d4d8853-kube-api-access-59vxd\") pod \"network-check-target-w9gt5\" (UID: \"8802231b-bd91-4690-9379-4e802d4d8853\") " pod="openshift-network-diagnostics/network-check-target-w9gt5" May 28 07:59:29.363759 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:29.363309 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f2c94ed-4111-42f9-8ec1-7c96447b9c11-metrics-certs\") pod \"network-metrics-daemon-z5j9k\" (UID: \"5f2c94ed-4111-42f9-8ec1-7c96447b9c11\") " pod="openshift-multus/network-metrics-daemon-z5j9k" May 28 07:59:29.363759 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:29.363452 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 07:59:29.363759 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:29.363467 2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 07:59:29.363759 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:29.363492 2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 07:59:29.363759 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:29.363507 2560 projected.go:194] Error preparing data for projected volume kube-api-access-59vxd for pod openshift-network-diagnostics/network-check-target-w9gt5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 07:59:29.363759 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:29.363519 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f2c94ed-4111-42f9-8ec1-7c96447b9c11-metrics-certs podName:5f2c94ed-4111-42f9-8ec1-7c96447b9c11 nodeName:}" failed. No retries permitted until 2026-05-28 07:59:37.363499769 +0000 UTC m=+17.249945890 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5f2c94ed-4111-42f9-8ec1-7c96447b9c11-metrics-certs") pod "network-metrics-daemon-z5j9k" (UID: "5f2c94ed-4111-42f9-8ec1-7c96447b9c11") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 07:59:29.363759 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:29.363575 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8802231b-bd91-4690-9379-4e802d4d8853-kube-api-access-59vxd podName:8802231b-bd91-4690-9379-4e802d4d8853 nodeName:}" failed. No retries permitted until 2026-05-28 07:59:37.363544199 +0000 UTC m=+17.249990330 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-59vxd" (UniqueName: "kubernetes.io/projected/8802231b-bd91-4690-9379-4e802d4d8853-kube-api-access-59vxd") pod "network-check-target-w9gt5" (UID: "8802231b-bd91-4690-9379-4e802d4d8853") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 07:59:29.728304 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:29.728224 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w9gt5" May 28 07:59:29.728459 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:29.728233 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z5j9k" May 28 07:59:29.728459 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:29.728369 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w9gt5" podUID="8802231b-bd91-4690-9379-4e802d4d8853" May 28 07:59:29.728599 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:29.728452 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z5j9k" podUID="5f2c94ed-4111-42f9-8ec1-7c96447b9c11" May 28 07:59:31.727862 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:31.727826 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z5j9k" May 28 07:59:31.728331 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:31.727826 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w9gt5" May 28 07:59:31.728331 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:31.727946 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z5j9k" podUID="5f2c94ed-4111-42f9-8ec1-7c96447b9c11" May 28 07:59:31.728331 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:31.728009 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w9gt5" podUID="8802231b-bd91-4690-9379-4e802d4d8853" May 28 07:59:33.727608 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:33.727576 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z5j9k" May 28 07:59:33.728064 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:33.727574 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w9gt5" May 28 07:59:33.728064 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:33.727699 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z5j9k" podUID="5f2c94ed-4111-42f9-8ec1-7c96447b9c11" May 28 07:59:33.728064 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:33.727775 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w9gt5" podUID="8802231b-bd91-4690-9379-4e802d4d8853" May 28 07:59:35.728075 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:35.728042 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z5j9k" May 28 07:59:35.728511 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:35.728043 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w9gt5" May 28 07:59:35.728511 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:35.728176 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z5j9k" podUID="5f2c94ed-4111-42f9-8ec1-7c96447b9c11" May 28 07:59:35.728511 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:35.728220 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w9gt5" podUID="8802231b-bd91-4690-9379-4e802d4d8853" May 28 07:59:37.422777 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:37.422685 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-59vxd\" (UniqueName: \"kubernetes.io/projected/8802231b-bd91-4690-9379-4e802d4d8853-kube-api-access-59vxd\") pod \"network-check-target-w9gt5\" (UID: \"8802231b-bd91-4690-9379-4e802d4d8853\") " pod="openshift-network-diagnostics/network-check-target-w9gt5" May 28 07:59:37.422777 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:37.422736 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f2c94ed-4111-42f9-8ec1-7c96447b9c11-metrics-certs\") pod \"network-metrics-daemon-z5j9k\" (UID: \"5f2c94ed-4111-42f9-8ec1-7c96447b9c11\") " pod="openshift-multus/network-metrics-daemon-z5j9k" May 28 07:59:37.423281 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:37.422858 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 07:59:37.423281 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:37.422865 2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 07:59:37.423281 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:37.422886 2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 07:59:37.423281 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:37.422897 2560 projected.go:194] Error preparing data for projected volume kube-api-access-59vxd for pod openshift-network-diagnostics/network-check-target-w9gt5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 07:59:37.423281 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:37.422934 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f2c94ed-4111-42f9-8ec1-7c96447b9c11-metrics-certs podName:5f2c94ed-4111-42f9-8ec1-7c96447b9c11 nodeName:}" failed. No retries permitted until 2026-05-28 07:59:53.422911466 +0000 UTC m=+33.309357603 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5f2c94ed-4111-42f9-8ec1-7c96447b9c11-metrics-certs") pod "network-metrics-daemon-z5j9k" (UID: "5f2c94ed-4111-42f9-8ec1-7c96447b9c11") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 07:59:37.423281 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:37.422956 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8802231b-bd91-4690-9379-4e802d4d8853-kube-api-access-59vxd podName:8802231b-bd91-4690-9379-4e802d4d8853 nodeName:}" failed. No retries permitted until 2026-05-28 07:59:53.422940854 +0000 UTC m=+33.309386991 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-59vxd" (UniqueName: "kubernetes.io/projected/8802231b-bd91-4690-9379-4e802d4d8853-kube-api-access-59vxd") pod "network-check-target-w9gt5" (UID: "8802231b-bd91-4690-9379-4e802d4d8853") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 07:59:37.728073 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:37.728000 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w9gt5" May 28 07:59:37.728238 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:37.728000 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z5j9k" May 28 07:59:37.728238 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:37.728116 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w9gt5" podUID="8802231b-bd91-4690-9379-4e802d4d8853" May 28 07:59:37.728350 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:37.728236 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z5j9k" podUID="5f2c94ed-4111-42f9-8ec1-7c96447b9c11" May 28 07:59:39.728157 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:39.728108 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w9gt5" May 28 07:59:39.728629 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:39.728237 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w9gt5" podUID="8802231b-bd91-4690-9379-4e802d4d8853" May 28 07:59:39.728629 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:39.728317 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z5j9k" May 28 07:59:39.728629 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:39.728416 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z5j9k" podUID="5f2c94ed-4111-42f9-8ec1-7c96447b9c11" May 28 07:59:40.841311 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:40.841284 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-133.ec2.internal" event={"ID":"a235c96c5df75d6e3bfc1abeabef5111","Type":"ContainerStarted","Data":"f8c25f22e3091753da468d9fd91ef46873cd1d564d99691ae012048da3b308f5"} May 28 07:59:41.728126 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:41.727965 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z5j9k" May 28 07:59:41.728238 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:41.727965 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w9gt5" May 28 07:59:41.728274 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:41.728233 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z5j9k" podUID="5f2c94ed-4111-42f9-8ec1-7c96447b9c11" May 28 07:59:41.728309 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:41.728268 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w9gt5" podUID="8802231b-bd91-4690-9379-4e802d4d8853" May 28 07:59:41.844478 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:41.844446 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-h2fkd" event={"ID":"724affe7-1ef8-4aa8-8828-b3de728946da","Type":"ContainerStarted","Data":"e94b2fc5f84f09e26afd3daf5290bd2eedaafbeafc76ea4f0ca7286ce3a36858"} May 28 07:59:41.846061 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:41.846033 2560 generic.go:358] "Generic (PLEG): container finished" podID="a0af03460d0b834f8e0ef9046b6b5145" containerID="632789d5748c69714d4de02433d34dbfe994dfa7358c98c648237067be6a1a71" exitCode=0 May 28 07:59:41.846184 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:41.846115 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal" event={"ID":"a0af03460d0b834f8e0ef9046b6b5145","Type":"ContainerDied","Data":"632789d5748c69714d4de02433d34dbfe994dfa7358c98c648237067be6a1a71"} May 28 07:59:41.848086 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:41.847649 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ldhht" event={"ID":"632fd718-6604-42a2-aca2-e24e53bfdbb3","Type":"ContainerStarted","Data":"e2d5c0eabcdc5f6574815b939d83d588aee13cbf9b717a9b783cf5bdfb8d301e"} May 28 07:59:41.849554 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:41.849527 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xhm9j" event={"ID":"8db07e49-d641-48b0-89e4-2f4bdf6999a5","Type":"ContainerStarted","Data":"62a3aa6ebdaedd56e9e62a2ec5003ff8276a12f35f19db9ec50b06e6767685d9"} May 28 07:59:41.853312 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:41.853243 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lm42d" event={"ID":"1826661e-2068-4391-9044-b01ffe8dbeac","Type":"ContainerStarted","Data":"d9d75b2bde819f0f0f59f18473fa8068f7331d4f67922969b134dda9cd0be73e"} May 28 07:59:41.854982 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:41.854956 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n95hd" event={"ID":"f5b72cf0-375b-4d9b-af04-706c6348e6d1","Type":"ContainerStarted","Data":"21e0e3b5a3c59135efd7bb1d1627f57ca42c99f3ae6ddb27249d17aa31541b00"} May 28 07:59:41.857796 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:41.857777 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2llls_092140cb-eea8-44c1-89f5-d8dd56d7d10a/ovn-acl-logging/0.log" May 28 07:59:41.858110 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:41.858086 2560 generic.go:358] "Generic (PLEG): container finished" podID="092140cb-eea8-44c1-89f5-d8dd56d7d10a" containerID="d3bb32af9f165dc4fd2557b8c771f761d08fb6396925f62933eef5ae0a7b3366" exitCode=1 May 28 07:59:41.858206 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:41.858151 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2llls" event={"ID":"092140cb-eea8-44c1-89f5-d8dd56d7d10a","Type":"ContainerStarted","Data":"d438dee9ac8bdaf87d2aa7aeefa687e35455e9525badebc2abdea3d05f2f2423"} May 28 07:59:41.858206 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:41.858170 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2llls" event={"ID":"092140cb-eea8-44c1-89f5-d8dd56d7d10a","Type":"ContainerStarted","Data":"b8357479b6c499adce4792c814c4d18f4f0f3a11c8e436328b9d509f19a451cc"} May 28 07:59:41.858206 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:41.858184 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2llls" event={"ID":"092140cb-eea8-44c1-89f5-d8dd56d7d10a","Type":"ContainerStarted","Data":"d9b07d96d8b2f52ab8beaa0879a4b36a40bb309bf61bb03e8630340b76cc09ea"} May 28 07:59:41.858206 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:41.858196 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2llls" event={"ID":"092140cb-eea8-44c1-89f5-d8dd56d7d10a","Type":"ContainerStarted","Data":"87ab001b3266d4ef977e3de8ed48f68b9cc7b512e7e913e2ca27fb00131a5148"} May 28 07:59:41.858409 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:41.858211 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2llls" event={"ID":"092140cb-eea8-44c1-89f5-d8dd56d7d10a","Type":"ContainerDied","Data":"d3bb32af9f165dc4fd2557b8c771f761d08fb6396925f62933eef5ae0a7b3366"} May 28 07:59:41.858409 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:41.858227 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2llls" event={"ID":"092140cb-eea8-44c1-89f5-d8dd56d7d10a","Type":"ContainerStarted","Data":"0c25fa7adbcc380ca1207e9c0974a4949d6ff910da540711d6d25ce73e863dbb"} May 28 07:59:41.859031 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:41.858928 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-h2fkd" podStartSLOduration=3.214919444 podStartE2EDuration="21.858914431s" podCreationTimestamp="2026-05-28 07:59:20 +0000 UTC" firstStartedPulling="2026-05-28 07:59:21.913474877 +0000 UTC m=+1.799920997" lastFinishedPulling="2026-05-28 07:59:40.557469862 +0000 UTC m=+20.443915984" observedRunningTime="2026-05-28 07:59:41.857801122 +0000 UTC m=+21.744247266" watchObservedRunningTime="2026-05-28 07:59:41.858914431 +0000 UTC m=+21.745360573" May 28 07:59:41.859985 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:41.859958 2560 generic.go:358] "Generic (PLEG): container finished" podID="4a2444a9-55c7-4ce5-b8e7-d394e0855f26" containerID="f3923615a7cfe498372990f1987ab7020dd3b74e7eb49932c201236036df00d6" exitCode=0 May 28 07:59:41.860110 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:41.860062 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dxbtn" event={"ID":"4a2444a9-55c7-4ce5-b8e7-d394e0855f26","Type":"ContainerDied","Data":"f3923615a7cfe498372990f1987ab7020dd3b74e7eb49932c201236036df00d6"} May 28 07:59:41.863952 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:41.863923 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ctxgq" event={"ID":"04a96139-4274-4e69-bb7b-18e9e99ba9e4","Type":"ContainerStarted","Data":"d928ac8a390903e473711bd5e2636ee88bb03f5d2e3dab69c62e2785909311e8"} May 28 07:59:41.873119 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:41.873071 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-lm42d" podStartSLOduration=3.299854506 podStartE2EDuration="21.873057964s" podCreationTimestamp="2026-05-28 07:59:20 +0000 UTC" firstStartedPulling="2026-05-28 07:59:21.988114311 +0000 UTC m=+1.874560434" lastFinishedPulling="2026-05-28 07:59:40.561317767 +0000 UTC m=+20.447763892" observedRunningTime="2026-05-28 07:59:41.872808804 +0000 UTC m=+21.759254950" watchObservedRunningTime="2026-05-28 07:59:41.873057964 +0000 UTC m=+21.759504107" May 28 07:59:41.886190 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:41.885916 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-xhm9j" podStartSLOduration=3.314586555 podStartE2EDuration="21.885902872s" podCreationTimestamp="2026-05-28 07:59:20 +0000 UTC" firstStartedPulling="2026-05-28 07:59:21.992576746 +0000 UTC m=+1.879022879" lastFinishedPulling="2026-05-28 07:59:40.563893062 +0000 UTC m=+20.450339196" observedRunningTime="2026-05-28 07:59:41.885229413 +0000 UTC m=+21.771675560" watchObservedRunningTime="2026-05-28 07:59:41.885902872 +0000 UTC m=+21.772349012" May 28 07:59:41.917049 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:41.917011 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-ldhht" podStartSLOduration=2.682700462 podStartE2EDuration="21.916999444s" podCreationTimestamp="2026-05-28 07:59:20 +0000 UTC" firstStartedPulling="2026-05-28 07:59:21.996484251 +0000 UTC m=+1.882930370" lastFinishedPulling="2026-05-28 07:59:41.230783229 +0000 UTC m=+21.117229352" observedRunningTime="2026-05-28 07:59:41.904728658 +0000 UTC m=+21.791174801" watchObservedRunningTime="2026-05-28 07:59:41.916999444 +0000 UTC m=+21.803445585" May 28 07:59:41.944157 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:41.944071 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-133.ec2.internal" podStartSLOduration=21.944059149 podStartE2EDuration="21.944059149s" podCreationTimestamp="2026-05-28 07:59:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 07:59:41.928469599 +0000 UTC m=+21.814915742" watchObservedRunningTime="2026-05-28 07:59:41.944059149 +0000 UTC m=+21.830505328" May 28 07:59:41.944425 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:41.944394 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-ctxgq" podStartSLOduration=3.380914368 podStartE2EDuration="21.944387745s" podCreationTimestamp="2026-05-28 07:59:20 +0000 UTC" firstStartedPulling="2026-05-28 07:59:21.924889798 +0000 UTC m=+1.811335917" lastFinishedPulling="2026-05-28 07:59:40.488363175 +0000 UTC m=+20.374809294" observedRunningTime="2026-05-28 07:59:41.943991 +0000 UTC m=+21.830437143" watchObservedRunningTime="2026-05-28 07:59:41.944387745 +0000 UTC m=+21.830833892" May 28 07:59:42.316702 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:42.316472 2560 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 28 07:59:42.676238 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:42.676099 2560 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-28T07:59:42.316690692Z","UUID":"c3bad8f4-8a63-44c1-b7e1-d72d18d38036","Handler":null,"Name":"","Endpoint":""} May 28 07:59:42.678230 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:42.678209 2560 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 28 07:59:42.678230 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:42.678235 2560 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 28 07:59:42.867148 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:42.867099 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-z4fbh" event={"ID":"23b33b50-4b8f-45d5-a5e7-362bdb2a04ea","Type":"ContainerStarted","Data":"a619bd4f961ea3c657bee728e9fa80af794a59756694f3f1153f606feb4ca652"} May 28 07:59:42.869058 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:42.869025 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal" event={"ID":"a0af03460d0b834f8e0ef9046b6b5145","Type":"ContainerStarted","Data":"1383dc70bc980632e90f89e65ef04b20598ad04cbdf84f718d9551f81d7b662e"} May 28 07:59:42.870763 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:42.870735 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n95hd" event={"ID":"f5b72cf0-375b-4d9b-af04-706c6348e6d1","Type":"ContainerStarted","Data":"d39bde473e519c5f2d287248d7f6e670dc56811eaaf538b33445762da4acb3fa"} May 28 07:59:42.880718 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:42.880672 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-z4fbh" podStartSLOduration=4.271455303 podStartE2EDuration="22.880654443s" podCreationTimestamp="2026-05-28 07:59:20 +0000 UTC" firstStartedPulling="2026-05-28 07:59:21.947941712 +0000 UTC m=+1.834387832" lastFinishedPulling="2026-05-28 07:59:40.557140841 +0000 UTC m=+20.443586972" observedRunningTime="2026-05-28 07:59:42.879677755 +0000 UTC m=+22.766123899" watchObservedRunningTime="2026-05-28 07:59:42.880654443 +0000 UTC m=+22.767100585" May 28 07:59:42.896084 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:42.896045 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal" podStartSLOduration=22.896033959 podStartE2EDuration="22.896033959s" podCreationTimestamp="2026-05-28 07:59:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 07:59:42.895546624 +0000 UTC m=+22.781992767" watchObservedRunningTime="2026-05-28 07:59:42.896033959 +0000 UTC m=+22.782480100" May 28 07:59:43.728059 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:43.727942 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z5j9k" May 28 07:59:43.728059 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:43.727961 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w9gt5" May 28 07:59:43.728365 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:43.728096 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z5j9k" podUID="5f2c94ed-4111-42f9-8ec1-7c96447b9c11" May 28 07:59:43.728365 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:43.728225 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w9gt5" podUID="8802231b-bd91-4690-9379-4e802d4d8853" May 28 07:59:43.877272 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:43.877238 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n95hd" event={"ID":"f5b72cf0-375b-4d9b-af04-706c6348e6d1","Type":"ContainerStarted","Data":"754de220ca2127b7a400ec9cadca0b12f644c30594e2a6857c206ad12554c008"} May 28 07:59:43.879983 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:43.879963 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2llls_092140cb-eea8-44c1-89f5-d8dd56d7d10a/ovn-acl-logging/0.log" May 28 07:59:43.880264 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:43.880238 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2llls" event={"ID":"092140cb-eea8-44c1-89f5-d8dd56d7d10a","Type":"ContainerStarted","Data":"26cf09c3a9ce56ad26ed50e7ab6c8b89240e5e3cbaddd55ba0ce6df700b19e36"} May 28 07:59:43.892986 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:43.892938 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n95hd" podStartSLOduration=2.739022045 podStartE2EDuration="23.892923572s" podCreationTimestamp="2026-05-28 07:59:20 +0000 UTC" firstStartedPulling="2026-05-28 07:59:21.98147778 +0000 UTC m=+1.867923900" lastFinishedPulling="2026-05-28 07:59:43.135379292 +0000 UTC m=+23.021825427" observedRunningTime="2026-05-28 07:59:43.892501348 +0000 UTC m=+23.778947489" watchObservedRunningTime="2026-05-28 07:59:43.892923572 +0000 UTC m=+23.779369713" May 28 07:59:45.728158 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:45.728127 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z5j9k" May 28 07:59:45.728660 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:45.728127 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w9gt5" May 28 07:59:45.728660 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:45.728245 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z5j9k" podUID="5f2c94ed-4111-42f9-8ec1-7c96447b9c11" May 28 07:59:45.728660 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:45.728299 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w9gt5" podUID="8802231b-bd91-4690-9379-4e802d4d8853" May 28 07:59:46.588908 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:46.588716 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-h2fkd" May 28 07:59:46.589269 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:46.589244 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-h2fkd" May 28 07:59:46.889628 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:46.889542 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2llls_092140cb-eea8-44c1-89f5-d8dd56d7d10a/ovn-acl-logging/0.log" May 28 07:59:46.890011 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:46.889880 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2llls" event={"ID":"092140cb-eea8-44c1-89f5-d8dd56d7d10a","Type":"ContainerStarted","Data":"391205b18e590da4227a40601d6b9fc2b4b938b1e4f0329c2b80115d2f28c90d"} May 28 07:59:46.890242 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:46.890217 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2llls" May 28 07:59:46.890402 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:46.890381 2560 scope.go:117] "RemoveContainer" containerID="d3bb32af9f165dc4fd2557b8c771f761d08fb6396925f62933eef5ae0a7b3366" May 28 07:59:46.891747 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:46.891718 2560 generic.go:358] "Generic (PLEG): container finished" podID="4a2444a9-55c7-4ce5-b8e7-d394e0855f26" containerID="8822409149e91ca5f07c956a2a83b1443e532fda34ba04a951d562951bf049a7" exitCode=0 May 28 07:59:46.891817 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:46.891765 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dxbtn" event={"ID":"4a2444a9-55c7-4ce5-b8e7-d394e0855f26","Type":"ContainerDied","Data":"8822409149e91ca5f07c956a2a83b1443e532fda34ba04a951d562951bf049a7"} May 28 07:59:46.892141 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:46.892014 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-h2fkd" May 28 07:59:46.892432 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:46.892419 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-h2fkd" May 28 07:59:46.907167 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:46.907141 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2llls" May 28 07:59:47.727775 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:47.727539 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w9gt5" May 28 07:59:47.727904 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:47.727875 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w9gt5" podUID="8802231b-bd91-4690-9379-4e802d4d8853" May 28 07:59:47.728230 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:47.727541 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z5j9k" May 28 07:59:47.728338 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:47.728312 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z5j9k" podUID="5f2c94ed-4111-42f9-8ec1-7c96447b9c11" May 28 07:59:47.895962 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:47.895888 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2llls_092140cb-eea8-44c1-89f5-d8dd56d7d10a/ovn-acl-logging/0.log" May 28 07:59:47.896553 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:47.896238 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2llls" event={"ID":"092140cb-eea8-44c1-89f5-d8dd56d7d10a","Type":"ContainerStarted","Data":"5643fb5495e990984ad14781e1bd484e40a7daed2cebf9ee7c7d048179de00ba"} May 28 07:59:47.896553 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:47.896460 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2llls" May 28 07:59:47.896553 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:47.896484 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2llls" May 28 07:59:47.898092 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:47.898071 2560 generic.go:358] "Generic (PLEG): container finished" podID="4a2444a9-55c7-4ce5-b8e7-d394e0855f26" containerID="16eda962e092d5f2c26609be3c52127c5ed42f71bb92b6336725e7a7201d7190" exitCode=0 May 28 07:59:47.898206 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:47.898151 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dxbtn" event={"ID":"4a2444a9-55c7-4ce5-b8e7-d394e0855f26","Type":"ContainerDied","Data":"16eda962e092d5f2c26609be3c52127c5ed42f71bb92b6336725e7a7201d7190"} May 28 07:59:47.912318 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:47.912302 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2llls" May 28 07:59:47.922215 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:47.922179 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-2llls" podStartSLOduration=9.018546633 podStartE2EDuration="27.922167608s" podCreationTimestamp="2026-05-28 07:59:20 +0000 UTC" firstStartedPulling="2026-05-28 07:59:21.957869549 +0000 UTC m=+1.844315668" lastFinishedPulling="2026-05-28 07:59:40.861490512 +0000 UTC m=+20.747936643" observedRunningTime="2026-05-28 07:59:47.920742445 +0000 UTC m=+27.807188591" watchObservedRunningTime="2026-05-28 07:59:47.922167608 +0000 UTC m=+27.808613750" May 28 07:59:48.002139 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:48.002114 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-w9gt5"] May 28 07:59:48.002270 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:48.002206 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w9gt5" May 28 07:59:48.002326 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:48.002304 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w9gt5" podUID="8802231b-bd91-4690-9379-4e802d4d8853" May 28 07:59:48.005186 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:48.005165 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-z5j9k"] May 28 07:59:48.005306 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:48.005253 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z5j9k" May 28 07:59:48.005377 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:48.005357 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z5j9k" podUID="5f2c94ed-4111-42f9-8ec1-7c96447b9c11" May 28 07:59:48.902319 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:48.902276 2560 generic.go:358] "Generic (PLEG): container finished" podID="4a2444a9-55c7-4ce5-b8e7-d394e0855f26" containerID="bd76e5ee6f0bdc42391c81146912102f57900d410f3d4a529f084e382e26ae95" exitCode=0 May 28 07:59:48.902705 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:48.902336 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dxbtn" event={"ID":"4a2444a9-55c7-4ce5-b8e7-d394e0855f26","Type":"ContainerDied","Data":"bd76e5ee6f0bdc42391c81146912102f57900d410f3d4a529f084e382e26ae95"} May 28 07:59:49.727705 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:49.727671 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w9gt5" May 28 07:59:49.727826 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:49.727719 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z5j9k" May 28 07:59:49.727826 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:49.727811 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w9gt5" podUID="8802231b-bd91-4690-9379-4e802d4d8853" May 28 07:59:49.728073 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:49.728051 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z5j9k" podUID="5f2c94ed-4111-42f9-8ec1-7c96447b9c11" May 28 07:59:51.727517 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:51.727435 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w9gt5" May 28 07:59:51.727987 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:51.727442 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z5j9k" May 28 07:59:51.727987 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:51.727578 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w9gt5" podUID="8802231b-bd91-4690-9379-4e802d4d8853" May 28 07:59:51.727987 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:51.727651 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z5j9k" podUID="5f2c94ed-4111-42f9-8ec1-7c96447b9c11" May 28 07:59:52.901481 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:52.901238 2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-133.ec2.internal" event="NodeReady" May 28 07:59:52.901892 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:52.901533 2560 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 28 07:59:52.941450 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:52.941417 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-88fmq"] May 28 07:59:52.973146 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:52.973114 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-qtd5f"] May 28 07:59:52.973283 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:52.973163 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-88fmq" May 28 07:59:52.975402 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:52.975260 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 28 07:59:52.975402 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:52.975268 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4hh68\"" May 28 07:59:52.975616 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:52.975454 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 28 07:59:52.995438 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:52.995416 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-88fmq"] May 28 07:59:52.995438 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:52.995435 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qtd5f" May 28 07:59:52.995597 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:52.995444 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qtd5f"] May 28 07:59:52.997647 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:52.997626 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 28 07:59:52.997766 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:52.997694 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 28 07:59:52.997809 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:52.997764 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 28 07:59:52.997809 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:52.997633 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-47xg9\"" May 28 07:59:53.034526 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:53.034504 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ec820620-b736-430c-831d-5d2b97e83d32-metrics-tls\") pod \"dns-default-88fmq\" (UID: \"ec820620-b736-430c-831d-5d2b97e83d32\") " pod="openshift-dns/dns-default-88fmq" May 28 07:59:53.034672 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:53.034539 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec820620-b736-430c-831d-5d2b97e83d32-tmp-dir\") pod \"dns-default-88fmq\" (UID: \"ec820620-b736-430c-831d-5d2b97e83d32\") " pod="openshift-dns/dns-default-88fmq" May 28 07:59:53.034672 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:53.034577 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ks45j\" (UniqueName: \"kubernetes.io/projected/ec820620-b736-430c-831d-5d2b97e83d32-kube-api-access-ks45j\") pod \"dns-default-88fmq\" (UID: \"ec820620-b736-430c-831d-5d2b97e83d32\") " pod="openshift-dns/dns-default-88fmq" May 28 07:59:53.034770 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:53.034673 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ec820620-b736-430c-831d-5d2b97e83d32-config-volume\") pod \"dns-default-88fmq\" (UID: \"ec820620-b736-430c-831d-5d2b97e83d32\") " pod="openshift-dns/dns-default-88fmq" May 28 07:59:53.135585 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:53.135525 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ec820620-b736-430c-831d-5d2b97e83d32-metrics-tls\") pod \"dns-default-88fmq\" (UID: \"ec820620-b736-430c-831d-5d2b97e83d32\") " pod="openshift-dns/dns-default-88fmq" May 28 07:59:53.135585 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:53.135579 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec820620-b736-430c-831d-5d2b97e83d32-tmp-dir\") pod \"dns-default-88fmq\" (UID: \"ec820620-b736-430c-831d-5d2b97e83d32\") " pod="openshift-dns/dns-default-88fmq" May 28 07:59:53.135787 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:53.135605 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ks45j\" (UniqueName: \"kubernetes.io/projected/ec820620-b736-430c-831d-5d2b97e83d32-kube-api-access-ks45j\") pod \"dns-default-88fmq\" (UID: \"ec820620-b736-430c-831d-5d2b97e83d32\") " pod="openshift-dns/dns-default-88fmq" May 28 07:59:53.135787 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:53.135629 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b2d0b175-5e98-4b80-94e3-92a78b286c16-cert\") pod \"ingress-canary-qtd5f\" (UID: \"b2d0b175-5e98-4b80-94e3-92a78b286c16\") " pod="openshift-ingress-canary/ingress-canary-qtd5f" May 28 07:59:53.135787 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:53.135656 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-br7cc\" (UniqueName: \"kubernetes.io/projected/b2d0b175-5e98-4b80-94e3-92a78b286c16-kube-api-access-br7cc\") pod \"ingress-canary-qtd5f\" (UID: \"b2d0b175-5e98-4b80-94e3-92a78b286c16\") " pod="openshift-ingress-canary/ingress-canary-qtd5f" May 28 07:59:53.135787 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:53.135686 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 28 07:59:53.135787 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:53.135698 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ec820620-b736-430c-831d-5d2b97e83d32-config-volume\") pod \"dns-default-88fmq\" (UID: \"ec820620-b736-430c-831d-5d2b97e83d32\") " pod="openshift-dns/dns-default-88fmq" May 28 07:59:53.135787 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:53.135751 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec820620-b736-430c-831d-5d2b97e83d32-metrics-tls podName:ec820620-b736-430c-831d-5d2b97e83d32 nodeName:}" failed. No retries permitted until 2026-05-28 07:59:53.635732098 +0000 UTC m=+33.522178232 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ec820620-b736-430c-831d-5d2b97e83d32-metrics-tls") pod "dns-default-88fmq" (UID: "ec820620-b736-430c-831d-5d2b97e83d32") : secret "dns-default-metrics-tls" not found May 28 07:59:53.136061 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:53.136026 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec820620-b736-430c-831d-5d2b97e83d32-tmp-dir\") pod \"dns-default-88fmq\" (UID: \"ec820620-b736-430c-831d-5d2b97e83d32\") " pod="openshift-dns/dns-default-88fmq" May 28 07:59:53.136344 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:53.136327 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ec820620-b736-430c-831d-5d2b97e83d32-config-volume\") pod \"dns-default-88fmq\" (UID: \"ec820620-b736-430c-831d-5d2b97e83d32\") " pod="openshift-dns/dns-default-88fmq" May 28 07:59:53.145664 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:53.145644 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ks45j\" (UniqueName: \"kubernetes.io/projected/ec820620-b736-430c-831d-5d2b97e83d32-kube-api-access-ks45j\") pod \"dns-default-88fmq\" (UID: \"ec820620-b736-430c-831d-5d2b97e83d32\") " pod="openshift-dns/dns-default-88fmq" May 28 07:59:53.236952 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:53.236877 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b2d0b175-5e98-4b80-94e3-92a78b286c16-cert\") pod \"ingress-canary-qtd5f\" (UID: \"b2d0b175-5e98-4b80-94e3-92a78b286c16\") " pod="openshift-ingress-canary/ingress-canary-qtd5f" May 28 07:59:53.236952 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:53.236932 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-br7cc\" (UniqueName: \"kubernetes.io/projected/b2d0b175-5e98-4b80-94e3-92a78b286c16-kube-api-access-br7cc\") pod \"ingress-canary-qtd5f\" (UID: \"b2d0b175-5e98-4b80-94e3-92a78b286c16\") " pod="openshift-ingress-canary/ingress-canary-qtd5f" May 28 07:59:53.237168 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:53.237057 2560 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 28 07:59:53.237168 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:53.237143 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2d0b175-5e98-4b80-94e3-92a78b286c16-cert podName:b2d0b175-5e98-4b80-94e3-92a78b286c16 nodeName:}" failed. No retries permitted until 2026-05-28 07:59:53.73712192 +0000 UTC m=+33.623568057 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b2d0b175-5e98-4b80-94e3-92a78b286c16-cert") pod "ingress-canary-qtd5f" (UID: "b2d0b175-5e98-4b80-94e3-92a78b286c16") : secret "canary-serving-cert" not found May 28 07:59:53.247227 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:53.247205 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-br7cc\" (UniqueName: \"kubernetes.io/projected/b2d0b175-5e98-4b80-94e3-92a78b286c16-kube-api-access-br7cc\") pod \"ingress-canary-qtd5f\" (UID: \"b2d0b175-5e98-4b80-94e3-92a78b286c16\") " pod="openshift-ingress-canary/ingress-canary-qtd5f" May 28 07:59:53.439021 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:53.438975 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f2c94ed-4111-42f9-8ec1-7c96447b9c11-metrics-certs\") pod \"network-metrics-daemon-z5j9k\" (UID: \"5f2c94ed-4111-42f9-8ec1-7c96447b9c11\") " pod="openshift-multus/network-metrics-daemon-z5j9k" May 28 07:59:53.439200 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:53.439167 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 07:59:53.439261 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:53.439204 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-59vxd\" (UniqueName: \"kubernetes.io/projected/8802231b-bd91-4690-9379-4e802d4d8853-kube-api-access-59vxd\") pod \"network-check-target-w9gt5\" (UID: \"8802231b-bd91-4690-9379-4e802d4d8853\") " pod="openshift-network-diagnostics/network-check-target-w9gt5" May 28 07:59:53.439261 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:53.439229 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f2c94ed-4111-42f9-8ec1-7c96447b9c11-metrics-certs podName:5f2c94ed-4111-42f9-8ec1-7c96447b9c11 nodeName:}" failed. No retries permitted until 2026-05-28 08:00:25.439214396 +0000 UTC m=+65.325660516 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5f2c94ed-4111-42f9-8ec1-7c96447b9c11-metrics-certs") pod "network-metrics-daemon-z5j9k" (UID: "5f2c94ed-4111-42f9-8ec1-7c96447b9c11") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 07:59:53.439358 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:53.439323 2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 07:59:53.439358 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:53.439339 2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 07:59:53.439436 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:53.439361 2560 projected.go:194] Error preparing data for projected volume kube-api-access-59vxd for pod openshift-network-diagnostics/network-check-target-w9gt5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 07:59:53.439436 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:53.439413 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8802231b-bd91-4690-9379-4e802d4d8853-kube-api-access-59vxd podName:8802231b-bd91-4690-9379-4e802d4d8853 nodeName:}" failed. No retries permitted until 2026-05-28 08:00:25.439398444 +0000 UTC m=+65.325844564 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-59vxd" (UniqueName: "kubernetes.io/projected/8802231b-bd91-4690-9379-4e802d4d8853-kube-api-access-59vxd") pod "network-check-target-w9gt5" (UID: "8802231b-bd91-4690-9379-4e802d4d8853") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 07:59:53.640882 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:53.640845 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ec820620-b736-430c-831d-5d2b97e83d32-metrics-tls\") pod \"dns-default-88fmq\" (UID: \"ec820620-b736-430c-831d-5d2b97e83d32\") " pod="openshift-dns/dns-default-88fmq" May 28 07:59:53.641084 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:53.641023 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 28 07:59:53.641135 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:53.641107 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec820620-b736-430c-831d-5d2b97e83d32-metrics-tls podName:ec820620-b736-430c-831d-5d2b97e83d32 nodeName:}" failed. No retries permitted until 2026-05-28 07:59:54.641083127 +0000 UTC m=+34.527529265 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ec820620-b736-430c-831d-5d2b97e83d32-metrics-tls") pod "dns-default-88fmq" (UID: "ec820620-b736-430c-831d-5d2b97e83d32") : secret "dns-default-metrics-tls" not found May 28 07:59:53.728430 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:53.728393 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z5j9k" May 28 07:59:53.728704 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:53.728393 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w9gt5" May 28 07:59:53.730805 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:53.730783 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 28 07:59:53.730944 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:53.730829 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 28 07:59:53.730944 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:53.730899 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fxd67\"" May 28 07:59:53.730944 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:53.730929 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 28 07:59:53.731156 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:53.731139 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-q9jcs\"" May 28 07:59:53.741453 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:53.741429 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b2d0b175-5e98-4b80-94e3-92a78b286c16-cert\") pod \"ingress-canary-qtd5f\" (UID: \"b2d0b175-5e98-4b80-94e3-92a78b286c16\") " pod="openshift-ingress-canary/ingress-canary-qtd5f" May 28 07:59:53.741616 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:53.741535 2560 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 28 07:59:53.741691 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:53.741636 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2d0b175-5e98-4b80-94e3-92a78b286c16-cert podName:b2d0b175-5e98-4b80-94e3-92a78b286c16 nodeName:}" failed. No retries permitted until 2026-05-28 07:59:54.741618308 +0000 UTC m=+34.628064434 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b2d0b175-5e98-4b80-94e3-92a78b286c16-cert") pod "ingress-canary-qtd5f" (UID: "b2d0b175-5e98-4b80-94e3-92a78b286c16") : secret "canary-serving-cert" not found May 28 07:59:54.648136 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:54.648100 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ec820620-b736-430c-831d-5d2b97e83d32-metrics-tls\") pod \"dns-default-88fmq\" (UID: \"ec820620-b736-430c-831d-5d2b97e83d32\") " pod="openshift-dns/dns-default-88fmq" May 28 07:59:54.648680 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:54.648266 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 28 07:59:54.648680 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:54.648340 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec820620-b736-430c-831d-5d2b97e83d32-metrics-tls podName:ec820620-b736-430c-831d-5d2b97e83d32 nodeName:}" failed. No retries permitted until 2026-05-28 07:59:56.648319306 +0000 UTC m=+36.534765429 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ec820620-b736-430c-831d-5d2b97e83d32-metrics-tls") pod "dns-default-88fmq" (UID: "ec820620-b736-430c-831d-5d2b97e83d32") : secret "dns-default-metrics-tls" not found May 28 07:59:54.748945 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:54.748913 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b2d0b175-5e98-4b80-94e3-92a78b286c16-cert\") pod \"ingress-canary-qtd5f\" (UID: \"b2d0b175-5e98-4b80-94e3-92a78b286c16\") " pod="openshift-ingress-canary/ingress-canary-qtd5f" May 28 07:59:54.749105 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:54.749029 2560 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 28 07:59:54.749105 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:54.749083 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2d0b175-5e98-4b80-94e3-92a78b286c16-cert podName:b2d0b175-5e98-4b80-94e3-92a78b286c16 nodeName:}" failed. No retries permitted until 2026-05-28 07:59:56.749064456 +0000 UTC m=+36.635510595 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b2d0b175-5e98-4b80-94e3-92a78b286c16-cert") pod "ingress-canary-qtd5f" (UID: "b2d0b175-5e98-4b80-94e3-92a78b286c16") : secret "canary-serving-cert" not found May 28 07:59:55.918232 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:55.918201 2560 generic.go:358] "Generic (PLEG): container finished" podID="4a2444a9-55c7-4ce5-b8e7-d394e0855f26" containerID="c8cc4b3076b8c6c6d6597649500759fe6ee0f0dbe08735d93873371e45fb263d" exitCode=0 May 28 07:59:55.918632 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:55.918268 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dxbtn" event={"ID":"4a2444a9-55c7-4ce5-b8e7-d394e0855f26","Type":"ContainerDied","Data":"c8cc4b3076b8c6c6d6597649500759fe6ee0f0dbe08735d93873371e45fb263d"} May 28 07:59:56.661593 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:56.661546 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ec820620-b736-430c-831d-5d2b97e83d32-metrics-tls\") pod \"dns-default-88fmq\" (UID: \"ec820620-b736-430c-831d-5d2b97e83d32\") " pod="openshift-dns/dns-default-88fmq" May 28 07:59:56.661743 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:56.661664 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 28 07:59:56.661743 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:56.661729 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec820620-b736-430c-831d-5d2b97e83d32-metrics-tls podName:ec820620-b736-430c-831d-5d2b97e83d32 nodeName:}" failed. No retries permitted until 2026-05-28 08:00:00.661714 +0000 UTC m=+40.548160119 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ec820620-b736-430c-831d-5d2b97e83d32-metrics-tls") pod "dns-default-88fmq" (UID: "ec820620-b736-430c-831d-5d2b97e83d32") : secret "dns-default-metrics-tls" not found May 28 07:59:56.761985 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:56.761953 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b2d0b175-5e98-4b80-94e3-92a78b286c16-cert\") pod \"ingress-canary-qtd5f\" (UID: \"b2d0b175-5e98-4b80-94e3-92a78b286c16\") " pod="openshift-ingress-canary/ingress-canary-qtd5f" May 28 07:59:56.762122 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:56.762069 2560 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 28 07:59:56.762122 ip-10-0-139-133 kubenswrapper[2560]: E0528 07:59:56.762117 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2d0b175-5e98-4b80-94e3-92a78b286c16-cert podName:b2d0b175-5e98-4b80-94e3-92a78b286c16 nodeName:}" failed. No retries permitted until 2026-05-28 08:00:00.762102998 +0000 UTC m=+40.648549118 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b2d0b175-5e98-4b80-94e3-92a78b286c16-cert") pod "ingress-canary-qtd5f" (UID: "b2d0b175-5e98-4b80-94e3-92a78b286c16") : secret "canary-serving-cert" not found May 28 07:59:56.922532 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:56.922457 2560 generic.go:358] "Generic (PLEG): container finished" podID="4a2444a9-55c7-4ce5-b8e7-d394e0855f26" containerID="4fa5cd0b7c64d79a3b8f492bd387063147be0a08835c64d6cf9de96dea01449b" exitCode=0 May 28 07:59:56.922532 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:56.922518 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dxbtn" event={"ID":"4a2444a9-55c7-4ce5-b8e7-d394e0855f26","Type":"ContainerDied","Data":"4fa5cd0b7c64d79a3b8f492bd387063147be0a08835c64d6cf9de96dea01449b"} May 28 07:59:57.926848 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:57.926810 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dxbtn" event={"ID":"4a2444a9-55c7-4ce5-b8e7-d394e0855f26","Type":"ContainerStarted","Data":"835764493c856b0adcf6ec5437a514c8a32e5e136cde421fd9477c69485767e9"} May 28 07:59:57.947643 ip-10-0-139-133 kubenswrapper[2560]: I0528 07:59:57.947597 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-dxbtn" podStartSLOduration=4.644008686 podStartE2EDuration="37.947580741s" podCreationTimestamp="2026-05-28 07:59:20 +0000 UTC" firstStartedPulling="2026-05-28 07:59:21.931707117 +0000 UTC m=+1.818153238" lastFinishedPulling="2026-05-28 07:59:55.235279173 +0000 UTC m=+35.121725293" observedRunningTime="2026-05-28 07:59:57.94616221 +0000 UTC m=+37.832608354" watchObservedRunningTime="2026-05-28 07:59:57.947580741 +0000 UTC m=+37.834026884" May 28 08:00:00.688469 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:00:00.688437 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ec820620-b736-430c-831d-5d2b97e83d32-metrics-tls\") pod \"dns-default-88fmq\" (UID: \"ec820620-b736-430c-831d-5d2b97e83d32\") " pod="openshift-dns/dns-default-88fmq" May 28 08:00:00.688864 ip-10-0-139-133 kubenswrapper[2560]: E0528 08:00:00.688526 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 28 08:00:00.688864 ip-10-0-139-133 kubenswrapper[2560]: E0528 08:00:00.688590 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec820620-b736-430c-831d-5d2b97e83d32-metrics-tls podName:ec820620-b736-430c-831d-5d2b97e83d32 nodeName:}" failed. No retries permitted until 2026-05-28 08:00:08.688558634 +0000 UTC m=+48.575004754 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ec820620-b736-430c-831d-5d2b97e83d32-metrics-tls") pod "dns-default-88fmq" (UID: "ec820620-b736-430c-831d-5d2b97e83d32") : secret "dns-default-metrics-tls" not found May 28 08:00:00.788866 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:00:00.788836 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b2d0b175-5e98-4b80-94e3-92a78b286c16-cert\") pod \"ingress-canary-qtd5f\" (UID: \"b2d0b175-5e98-4b80-94e3-92a78b286c16\") " pod="openshift-ingress-canary/ingress-canary-qtd5f" May 28 08:00:00.789024 ip-10-0-139-133 kubenswrapper[2560]: E0528 08:00:00.788982 2560 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 28 08:00:00.789104 ip-10-0-139-133 kubenswrapper[2560]: E0528 08:00:00.789091 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2d0b175-5e98-4b80-94e3-92a78b286c16-cert podName:b2d0b175-5e98-4b80-94e3-92a78b286c16 nodeName:}" failed. No retries permitted until 2026-05-28 08:00:08.789069738 +0000 UTC m=+48.675515863 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b2d0b175-5e98-4b80-94e3-92a78b286c16-cert") pod "ingress-canary-qtd5f" (UID: "b2d0b175-5e98-4b80-94e3-92a78b286c16") : secret "canary-serving-cert" not found May 28 08:00:08.740579 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:00:08.740539 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ec820620-b736-430c-831d-5d2b97e83d32-metrics-tls\") pod \"dns-default-88fmq\" (UID: \"ec820620-b736-430c-831d-5d2b97e83d32\") " pod="openshift-dns/dns-default-88fmq" May 28 08:00:08.741004 ip-10-0-139-133 kubenswrapper[2560]: E0528 08:00:08.740671 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 28 08:00:08.741004 ip-10-0-139-133 kubenswrapper[2560]: E0528 08:00:08.740720 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec820620-b736-430c-831d-5d2b97e83d32-metrics-tls podName:ec820620-b736-430c-831d-5d2b97e83d32 nodeName:}" failed. No retries permitted until 2026-05-28 08:00:24.740706736 +0000 UTC m=+64.627152856 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ec820620-b736-430c-831d-5d2b97e83d32-metrics-tls") pod "dns-default-88fmq" (UID: "ec820620-b736-430c-831d-5d2b97e83d32") : secret "dns-default-metrics-tls" not found May 28 08:00:08.841205 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:00:08.841177 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b2d0b175-5e98-4b80-94e3-92a78b286c16-cert\") pod \"ingress-canary-qtd5f\" (UID: \"b2d0b175-5e98-4b80-94e3-92a78b286c16\") " pod="openshift-ingress-canary/ingress-canary-qtd5f" May 28 08:00:08.841336 ip-10-0-139-133 kubenswrapper[2560]: E0528 08:00:08.841264 2560 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 28 08:00:08.841336 ip-10-0-139-133 kubenswrapper[2560]: E0528 08:00:08.841307 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2d0b175-5e98-4b80-94e3-92a78b286c16-cert podName:b2d0b175-5e98-4b80-94e3-92a78b286c16 nodeName:}" failed. No retries permitted until 2026-05-28 08:00:24.841295446 +0000 UTC m=+64.727741566 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b2d0b175-5e98-4b80-94e3-92a78b286c16-cert") pod "ingress-canary-qtd5f" (UID: "b2d0b175-5e98-4b80-94e3-92a78b286c16") : secret "canary-serving-cert" not found May 28 08:00:19.915274 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:00:19.915247 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2llls" May 28 08:00:24.756887 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:00:24.756850 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ec820620-b736-430c-831d-5d2b97e83d32-metrics-tls\") pod \"dns-default-88fmq\" (UID: \"ec820620-b736-430c-831d-5d2b97e83d32\") " pod="openshift-dns/dns-default-88fmq" May 28 08:00:24.757274 ip-10-0-139-133 kubenswrapper[2560]: E0528 08:00:24.756987 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 28 08:00:24.757274 ip-10-0-139-133 kubenswrapper[2560]: E0528 08:00:24.757047 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec820620-b736-430c-831d-5d2b97e83d32-metrics-tls podName:ec820620-b736-430c-831d-5d2b97e83d32 nodeName:}" failed. No retries permitted until 2026-05-28 08:00:56.75703233 +0000 UTC m=+96.643478450 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ec820620-b736-430c-831d-5d2b97e83d32-metrics-tls") pod "dns-default-88fmq" (UID: "ec820620-b736-430c-831d-5d2b97e83d32") : secret "dns-default-metrics-tls" not found May 28 08:00:24.857698 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:00:24.857672 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b2d0b175-5e98-4b80-94e3-92a78b286c16-cert\") pod \"ingress-canary-qtd5f\" (UID: \"b2d0b175-5e98-4b80-94e3-92a78b286c16\") " pod="openshift-ingress-canary/ingress-canary-qtd5f" May 28 08:00:24.857841 ip-10-0-139-133 kubenswrapper[2560]: E0528 08:00:24.857762 2560 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 28 08:00:24.857841 ip-10-0-139-133 kubenswrapper[2560]: E0528 08:00:24.857806 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2d0b175-5e98-4b80-94e3-92a78b286c16-cert podName:b2d0b175-5e98-4b80-94e3-92a78b286c16 nodeName:}" failed. No retries permitted until 2026-05-28 08:00:56.857792973 +0000 UTC m=+96.744239093 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b2d0b175-5e98-4b80-94e3-92a78b286c16-cert") pod "ingress-canary-qtd5f" (UID: "b2d0b175-5e98-4b80-94e3-92a78b286c16") : secret "canary-serving-cert" not found May 28 08:00:25.461421 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:00:25.461382 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-59vxd\" (UniqueName: \"kubernetes.io/projected/8802231b-bd91-4690-9379-4e802d4d8853-kube-api-access-59vxd\") pod \"network-check-target-w9gt5\" (UID: \"8802231b-bd91-4690-9379-4e802d4d8853\") " pod="openshift-network-diagnostics/network-check-target-w9gt5" May 28 08:00:25.461421 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:00:25.461423 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f2c94ed-4111-42f9-8ec1-7c96447b9c11-metrics-certs\") pod \"network-metrics-daemon-z5j9k\" (UID: \"5f2c94ed-4111-42f9-8ec1-7c96447b9c11\") " pod="openshift-multus/network-metrics-daemon-z5j9k" May 28 08:00:25.463972 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:00:25.463953 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 28 08:00:25.464034 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:00:25.463973 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 28 08:00:25.472453 ip-10-0-139-133 kubenswrapper[2560]: E0528 08:00:25.472433 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 28 08:00:25.472596 ip-10-0-139-133 kubenswrapper[2560]: E0528 08:00:25.472485 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f2c94ed-4111-42f9-8ec1-7c96447b9c11-metrics-certs podName:5f2c94ed-4111-42f9-8ec1-7c96447b9c11 nodeName:}" failed. No retries permitted until 2026-05-28 08:01:29.472470661 +0000 UTC m=+129.358916795 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5f2c94ed-4111-42f9-8ec1-7c96447b9c11-metrics-certs") pod "network-metrics-daemon-z5j9k" (UID: "5f2c94ed-4111-42f9-8ec1-7c96447b9c11") : secret "metrics-daemon-secret" not found May 28 08:00:25.474795 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:00:25.474780 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 28 08:00:25.486681 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:00:25.486659 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-59vxd\" (UniqueName: \"kubernetes.io/projected/8802231b-bd91-4690-9379-4e802d4d8853-kube-api-access-59vxd\") pod \"network-check-target-w9gt5\" (UID: \"8802231b-bd91-4690-9379-4e802d4d8853\") " pod="openshift-network-diagnostics/network-check-target-w9gt5" May 28 08:00:25.546963 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:00:25.546943 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fxd67\"" May 28 08:00:25.555627 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:00:25.555611 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w9gt5" May 28 08:00:25.722767 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:00:25.722700 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-w9gt5"] May 28 08:00:25.726296 ip-10-0-139-133 kubenswrapper[2560]: W0528 08:00:25.726266 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8802231b_bd91_4690_9379_4e802d4d8853.slice/crio-15c7072c8215dd41ce35fc786489cd092fc08f5fa079da39e412360679974c50 WatchSource:0}: Error finding container 15c7072c8215dd41ce35fc786489cd092fc08f5fa079da39e412360679974c50: Status 404 returned error can't find the container with id 15c7072c8215dd41ce35fc786489cd092fc08f5fa079da39e412360679974c50 May 28 08:00:25.974872 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:00:25.974805 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-w9gt5" event={"ID":"8802231b-bd91-4690-9379-4e802d4d8853","Type":"ContainerStarted","Data":"15c7072c8215dd41ce35fc786489cd092fc08f5fa079da39e412360679974c50"} May 28 08:00:28.981285 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:00:28.981245 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-w9gt5" event={"ID":"8802231b-bd91-4690-9379-4e802d4d8853","Type":"ContainerStarted","Data":"f22b9e8282fbc7a68c5804677c5ed40befbff95264f9d62ed09cbcd8cacb731d"} May 28 08:00:28.981618 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:00:28.981387 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-w9gt5" May 28 08:00:28.997842 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:00:28.997796 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-w9gt5" podStartSLOduration=65.872702381 podStartE2EDuration="1m8.997783516s" podCreationTimestamp="2026-05-28 07:59:20 +0000 UTC" firstStartedPulling="2026-05-28 08:00:25.728015168 +0000 UTC m=+65.614461287" lastFinishedPulling="2026-05-28 08:00:28.853096299 +0000 UTC m=+68.739542422" observedRunningTime="2026-05-28 08:00:28.996931405 +0000 UTC m=+68.883377549" watchObservedRunningTime="2026-05-28 08:00:28.997783516 +0000 UTC m=+68.884229657" May 28 08:00:56.766073 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:00:56.765945 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ec820620-b736-430c-831d-5d2b97e83d32-metrics-tls\") pod \"dns-default-88fmq\" (UID: \"ec820620-b736-430c-831d-5d2b97e83d32\") " pod="openshift-dns/dns-default-88fmq" May 28 08:00:56.766518 ip-10-0-139-133 kubenswrapper[2560]: E0528 08:00:56.766094 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 28 08:00:56.766518 ip-10-0-139-133 kubenswrapper[2560]: E0528 08:00:56.766170 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec820620-b736-430c-831d-5d2b97e83d32-metrics-tls podName:ec820620-b736-430c-831d-5d2b97e83d32 nodeName:}" failed. No retries permitted until 2026-05-28 08:02:00.766155072 +0000 UTC m=+160.652601193 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ec820620-b736-430c-831d-5d2b97e83d32-metrics-tls") pod "dns-default-88fmq" (UID: "ec820620-b736-430c-831d-5d2b97e83d32") : secret "dns-default-metrics-tls" not found May 28 08:00:56.866474 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:00:56.866441 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b2d0b175-5e98-4b80-94e3-92a78b286c16-cert\") pod \"ingress-canary-qtd5f\" (UID: \"b2d0b175-5e98-4b80-94e3-92a78b286c16\") " pod="openshift-ingress-canary/ingress-canary-qtd5f" May 28 08:00:56.866629 ip-10-0-139-133 kubenswrapper[2560]: E0528 08:00:56.866553 2560 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 28 08:00:56.866629 ip-10-0-139-133 kubenswrapper[2560]: E0528 08:00:56.866628 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2d0b175-5e98-4b80-94e3-92a78b286c16-cert podName:b2d0b175-5e98-4b80-94e3-92a78b286c16 nodeName:}" failed. No retries permitted until 2026-05-28 08:02:00.866613139 +0000 UTC m=+160.753059259 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b2d0b175-5e98-4b80-94e3-92a78b286c16-cert") pod "ingress-canary-qtd5f" (UID: "b2d0b175-5e98-4b80-94e3-92a78b286c16") : secret "canary-serving-cert" not found May 28 08:00:59.985614 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:00:59.985588 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-w9gt5" May 28 08:01:29.479482 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:29.479428 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f2c94ed-4111-42f9-8ec1-7c96447b9c11-metrics-certs\") pod \"network-metrics-daemon-z5j9k\" (UID: \"5f2c94ed-4111-42f9-8ec1-7c96447b9c11\") " pod="openshift-multus/network-metrics-daemon-z5j9k" May 28 08:01:29.480010 ip-10-0-139-133 kubenswrapper[2560]: E0528 08:01:29.479606 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 28 08:01:29.480010 ip-10-0-139-133 kubenswrapper[2560]: E0528 08:01:29.479690 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f2c94ed-4111-42f9-8ec1-7c96447b9c11-metrics-certs podName:5f2c94ed-4111-42f9-8ec1-7c96447b9c11 nodeName:}" failed. No retries permitted until 2026-05-28 08:03:31.479673675 +0000 UTC m=+251.366119795 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5f2c94ed-4111-42f9-8ec1-7c96447b9c11-metrics-certs") pod "network-metrics-daemon-z5j9k" (UID: "5f2c94ed-4111-42f9-8ec1-7c96447b9c11") : secret "metrics-daemon-secret" not found May 28 08:01:37.704932 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:37.704899 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-d8zp5"] May 28 08:01:37.707546 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:37.707529 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-d8zp5" May 28 08:01:37.709149 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:37.709126 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-8974698c9-jzf5f"] May 28 08:01:37.709978 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:37.709949 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" May 28 08:01:37.710189 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:37.710171 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" May 28 08:01:37.710189 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:37.710182 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" May 28 08:01:37.710319 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:37.710182 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-wmtd4\"" May 28 08:01:37.711590 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:37.711574 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8974698c9-jzf5f" May 28 08:01:37.713618 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:37.713601 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 28 08:01:37.713713 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:37.713690 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mxgfh\"" May 28 08:01:37.713778 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:37.713730 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 28 08:01:37.713846 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:37.713828 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 28 08:01:37.718657 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:37.718639 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-d8zp5"] May 28 08:01:37.721648 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:37.721625 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 28 08:01:37.730277 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:37.730258 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8974698c9-jzf5f"] May 28 08:01:37.803887 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:37.803863 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-bxk8j"] May 28 08:01:37.806594 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:37.806580 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-bxk8j" May 28 08:01:37.808926 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:37.808906 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" May 28 08:01:37.809046 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:37.808936 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" May 28 08:01:37.809046 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:37.808996 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" May 28 08:01:37.809169 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:37.809045 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" May 28 08:01:37.809272 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:37.809257 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-jxrlb\"" May 28 08:01:37.811103 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:37.811083 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-449zx"] May 28 08:01:37.813688 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:37.813672 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-8mk4q"] May 28 08:01:37.813824 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:37.813811 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-449zx" May 28 08:01:37.815758 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:37.815742 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-4z5fm\"" May 28 08:01:37.816029 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:37.816007 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 28 08:01:37.816029 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:37.816019 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" May 28 08:01:37.816167 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:37.816016 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" May 28 08:01:37.816167 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:37.816012 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 28 08:01:37.816327 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:37.816177 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-8mk4q" May 28 08:01:37.817628 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:37.817609 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-bxk8j"] May 28 08:01:37.818599 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:37.818547 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" May 28 08:01:37.818693 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:37.818633 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" May 28 08:01:37.818693 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:37.818575 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-8czmw\"" May 28 08:01:37.818776 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:37.818552 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" May 28 08:01:37.819012 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:37.818996 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" May 28 08:01:37.824092 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:37.824062 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" May 28 08:01:37.826329 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:37.826311 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-8mk4q"] May 28 08:01:37.828046 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:37.827730 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-449zx"] May 28 08:01:37.832003 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:37.831981 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvpgf\" (UniqueName: \"kubernetes.io/projected/88dbb2bd-a657-41b0-ba0b-cc35ee5caea0-kube-api-access-qvpgf\") pod \"cluster-samples-operator-697587599-d8zp5\" (UID: \"88dbb2bd-a657-41b0-ba0b-cc35ee5caea0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-d8zp5" May 28 08:01:37.832092 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:37.832017 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/64c31255-a020-4e2b-9a33-942aa1476d99-registry-tls\") pod \"image-registry-8974698c9-jzf5f\" (UID: \"64c31255-a020-4e2b-9a33-942aa1476d99\") " pod="openshift-image-registry/image-registry-8974698c9-jzf5f" May 28 08:01:37.832092 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:37.832035 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/64c31255-a020-4e2b-9a33-942aa1476d99-trusted-ca\") pod \"image-registry-8974698c9-jzf5f\" (UID: \"64c31255-a020-4e2b-9a33-942aa1476d99\") " pod="openshift-image-registry/image-registry-8974698c9-jzf5f" May 28 08:01:37.832092 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:37.832052 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/64c31255-a020-4e2b-9a33-942aa1476d99-registry-certificates\") pod \"image-registry-8974698c9-jzf5f\" (UID: \"64c31255-a020-4e2b-9a33-942aa1476d99\") " pod="openshift-image-registry/image-registry-8974698c9-jzf5f" May 28 08:01:37.832092 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:37.832081 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gs5m5\" (UniqueName: \"kubernetes.io/projected/64c31255-a020-4e2b-9a33-942aa1476d99-kube-api-access-gs5m5\") pod \"image-registry-8974698c9-jzf5f\" (UID: \"64c31255-a020-4e2b-9a33-942aa1476d99\") " pod="openshift-image-registry/image-registry-8974698c9-jzf5f" May 28 08:01:37.832251 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:37.832174 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/64c31255-a020-4e2b-9a33-942aa1476d99-image-registry-private-configuration\") pod \"image-registry-8974698c9-jzf5f\" (UID: \"64c31255-a020-4e2b-9a33-942aa1476d99\") " pod="openshift-image-registry/image-registry-8974698c9-jzf5f" May 28 08:01:37.832251 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:37.832226 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/64c31255-a020-4e2b-9a33-942aa1476d99-bound-sa-token\") pod \"image-registry-8974698c9-jzf5f\" (UID: \"64c31255-a020-4e2b-9a33-942aa1476d99\") " pod="openshift-image-registry/image-registry-8974698c9-jzf5f" May 28 08:01:37.832332 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:37.832282 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/88dbb2bd-a657-41b0-ba0b-cc35ee5caea0-samples-operator-tls\") pod \"cluster-samples-operator-697587599-d8zp5\" (UID: \"88dbb2bd-a657-41b0-ba0b-cc35ee5caea0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-d8zp5" May 28 08:01:37.832385 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:37.832359 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/64c31255-a020-4e2b-9a33-942aa1476d99-ca-trust-extracted\") pod \"image-registry-8974698c9-jzf5f\" (UID: \"64c31255-a020-4e2b-9a33-942aa1476d99\") " pod="openshift-image-registry/image-registry-8974698c9-jzf5f" May 28 08:01:37.832435 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:37.832394 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/64c31255-a020-4e2b-9a33-942aa1476d99-installation-pull-secrets\") pod \"image-registry-8974698c9-jzf5f\" (UID: \"64c31255-a020-4e2b-9a33-942aa1476d99\") " pod="openshift-image-registry/image-registry-8974698c9-jzf5f" May 28 08:01:37.932661 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:37.932638 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qvpgf\" (UniqueName: \"kubernetes.io/projected/88dbb2bd-a657-41b0-ba0b-cc35ee5caea0-kube-api-access-qvpgf\") pod \"cluster-samples-operator-697587599-d8zp5\" (UID: \"88dbb2bd-a657-41b0-ba0b-cc35ee5caea0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-d8zp5" May 28 08:01:37.932779 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:37.932666 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c983dbdf-f0a8-4bb6-b8cc-0a759a317eb7-snapshots\") pod \"insights-operator-78bdfb888c-449zx\" (UID: \"c983dbdf-f0a8-4bb6-b8cc-0a759a317eb7\") " pod="openshift-insights/insights-operator-78bdfb888c-449zx" May 28 08:01:37.932779 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:37.932683 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7811826f-af04-4605-a732-f165273106d4-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-8mk4q\" (UID: \"7811826f-af04-4605-a732-f165273106d4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-8mk4q" May 28 08:01:37.932779 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:37.932703 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/64c31255-a020-4e2b-9a33-942aa1476d99-registry-tls\") pod \"image-registry-8974698c9-jzf5f\" (UID: \"64c31255-a020-4e2b-9a33-942aa1476d99\") " pod="openshift-image-registry/image-registry-8974698c9-jzf5f" May 28 08:01:37.932779 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:37.932723 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/64c31255-a020-4e2b-9a33-942aa1476d99-trusted-ca\") pod \"image-registry-8974698c9-jzf5f\" (UID: \"64c31255-a020-4e2b-9a33-942aa1476d99\") " pod="openshift-image-registry/image-registry-8974698c9-jzf5f" May 28 08:01:37.932779 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:37.932747 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c983dbdf-f0a8-4bb6-b8cc-0a759a317eb7-tmp\") pod \"insights-operator-78bdfb888c-449zx\" (UID: \"c983dbdf-f0a8-4bb6-b8cc-0a759a317eb7\") " pod="openshift-insights/insights-operator-78bdfb888c-449zx" May 28 08:01:37.933062 ip-10-0-139-133 kubenswrapper[2560]: E0528 08:01:37.932797 2560 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 28 08:01:37.933062 ip-10-0-139-133 kubenswrapper[2560]: E0528 08:01:37.932810 2560 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8974698c9-jzf5f: secret "image-registry-tls" not found May 28 08:01:37.933062 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:37.932852 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/64c31255-a020-4e2b-9a33-942aa1476d99-registry-certificates\") pod \"image-registry-8974698c9-jzf5f\" (UID: \"64c31255-a020-4e2b-9a33-942aa1476d99\") " pod="openshift-image-registry/image-registry-8974698c9-jzf5f" May 28 08:01:37.933062 ip-10-0-139-133 kubenswrapper[2560]: E0528 08:01:37.932869 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/64c31255-a020-4e2b-9a33-942aa1476d99-registry-tls podName:64c31255-a020-4e2b-9a33-942aa1476d99 nodeName:}" failed. No retries permitted until 2026-05-28 08:01:38.432849311 +0000 UTC m=+138.319295444 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/64c31255-a020-4e2b-9a33-942aa1476d99-registry-tls") pod "image-registry-8974698c9-jzf5f" (UID: "64c31255-a020-4e2b-9a33-942aa1476d99") : secret "image-registry-tls" not found May 28 08:01:37.933062 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:37.932969 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gs5m5\" (UniqueName: \"kubernetes.io/projected/64c31255-a020-4e2b-9a33-942aa1476d99-kube-api-access-gs5m5\") pod \"image-registry-8974698c9-jzf5f\" (UID: \"64c31255-a020-4e2b-9a33-942aa1476d99\") " pod="openshift-image-registry/image-registry-8974698c9-jzf5f" May 28 08:01:37.933062 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:37.933009 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1f418e03-845a-44f2-a3bd-5dcc46b6df6c-config\") pod \"service-ca-operator-57b5b68b8-bxk8j\" (UID: \"1f418e03-845a-44f2-a3bd-5dcc46b6df6c\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-bxk8j" May 28 08:01:37.933062 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:37.933038 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvjjl\" (UniqueName: \"kubernetes.io/projected/7811826f-af04-4605-a732-f165273106d4-kube-api-access-jvjjl\") pod \"kube-storage-version-migrator-operator-565644f49-8mk4q\" (UID: \"7811826f-af04-4605-a732-f165273106d4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-8mk4q" May 28 08:01:37.933426 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:37.933088 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/64c31255-a020-4e2b-9a33-942aa1476d99-image-registry-private-configuration\") pod \"image-registry-8974698c9-jzf5f\" (UID: \"64c31255-a020-4e2b-9a33-942aa1476d99\") " pod="openshift-image-registry/image-registry-8974698c9-jzf5f" May 28 08:01:37.933426 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:37.933123 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qh5z\" (UniqueName: \"kubernetes.io/projected/1f418e03-845a-44f2-a3bd-5dcc46b6df6c-kube-api-access-7qh5z\") pod \"service-ca-operator-57b5b68b8-bxk8j\" (UID: \"1f418e03-845a-44f2-a3bd-5dcc46b6df6c\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-bxk8j" May 28 08:01:37.933426 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:37.933161 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/64c31255-a020-4e2b-9a33-942aa1476d99-bound-sa-token\") pod \"image-registry-8974698c9-jzf5f\" (UID: \"64c31255-a020-4e2b-9a33-942aa1476d99\") " pod="openshift-image-registry/image-registry-8974698c9-jzf5f" May 28 08:01:37.933426 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:37.933190 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c983dbdf-f0a8-4bb6-b8cc-0a759a317eb7-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-449zx\" (UID: \"c983dbdf-f0a8-4bb6-b8cc-0a759a317eb7\") " pod="openshift-insights/insights-operator-78bdfb888c-449zx" May 28 08:01:37.933426 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:37.933216 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c983dbdf-f0a8-4bb6-b8cc-0a759a317eb7-serving-cert\") pod \"insights-operator-78bdfb888c-449zx\" (UID: \"c983dbdf-f0a8-4bb6-b8cc-0a759a317eb7\") " pod="openshift-insights/insights-operator-78bdfb888c-449zx" May 28 08:01:37.933426 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:37.933240 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llwqp\" (UniqueName: \"kubernetes.io/projected/c983dbdf-f0a8-4bb6-b8cc-0a759a317eb7-kube-api-access-llwqp\") pod \"insights-operator-78bdfb888c-449zx\" (UID: \"c983dbdf-f0a8-4bb6-b8cc-0a759a317eb7\") " pod="openshift-insights/insights-operator-78bdfb888c-449zx" May 28 08:01:37.933426 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:37.933267 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7811826f-af04-4605-a732-f165273106d4-config\") pod \"kube-storage-version-migrator-operator-565644f49-8mk4q\" (UID: \"7811826f-af04-4605-a732-f165273106d4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-8mk4q" May 28 08:01:37.933426 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:37.933342 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1f418e03-845a-44f2-a3bd-5dcc46b6df6c-serving-cert\") pod \"service-ca-operator-57b5b68b8-bxk8j\" (UID: \"1f418e03-845a-44f2-a3bd-5dcc46b6df6c\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-bxk8j" May 28 08:01:37.933426 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:37.933374 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/88dbb2bd-a657-41b0-ba0b-cc35ee5caea0-samples-operator-tls\") pod \"cluster-samples-operator-697587599-d8zp5\" (UID: \"88dbb2bd-a657-41b0-ba0b-cc35ee5caea0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-d8zp5" May 28 08:01:37.933860 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:37.933432 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/64c31255-a020-4e2b-9a33-942aa1476d99-ca-trust-extracted\") pod \"image-registry-8974698c9-jzf5f\" (UID: \"64c31255-a020-4e2b-9a33-942aa1476d99\") " pod="openshift-image-registry/image-registry-8974698c9-jzf5f" May 28 08:01:37.933860 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:37.933467 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/64c31255-a020-4e2b-9a33-942aa1476d99-installation-pull-secrets\") pod \"image-registry-8974698c9-jzf5f\" (UID: \"64c31255-a020-4e2b-9a33-942aa1476d99\") " pod="openshift-image-registry/image-registry-8974698c9-jzf5f" May 28 08:01:37.933860 ip-10-0-139-133 kubenswrapper[2560]: E0528 08:01:37.933443 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 28 08:01:37.933860 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:37.933503 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c983dbdf-f0a8-4bb6-b8cc-0a759a317eb7-service-ca-bundle\") pod \"insights-operator-78bdfb888c-449zx\" (UID: \"c983dbdf-f0a8-4bb6-b8cc-0a759a317eb7\") " pod="openshift-insights/insights-operator-78bdfb888c-449zx" May 28 08:01:37.933860 ip-10-0-139-133 kubenswrapper[2560]: E0528 08:01:37.933518 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88dbb2bd-a657-41b0-ba0b-cc35ee5caea0-samples-operator-tls podName:88dbb2bd-a657-41b0-ba0b-cc35ee5caea0 nodeName:}" failed. No retries permitted until 2026-05-28 08:01:38.433507058 +0000 UTC m=+138.319953179 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/88dbb2bd-a657-41b0-ba0b-cc35ee5caea0-samples-operator-tls") pod "cluster-samples-operator-697587599-d8zp5" (UID: "88dbb2bd-a657-41b0-ba0b-cc35ee5caea0") : secret "samples-operator-tls" not found May 28 08:01:37.933860 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:37.933470 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/64c31255-a020-4e2b-9a33-942aa1476d99-registry-certificates\") pod \"image-registry-8974698c9-jzf5f\" (UID: \"64c31255-a020-4e2b-9a33-942aa1476d99\") " pod="openshift-image-registry/image-registry-8974698c9-jzf5f" May 28 08:01:37.933860 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:37.933710 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/64c31255-a020-4e2b-9a33-942aa1476d99-ca-trust-extracted\") pod \"image-registry-8974698c9-jzf5f\" (UID: \"64c31255-a020-4e2b-9a33-942aa1476d99\") " pod="openshift-image-registry/image-registry-8974698c9-jzf5f" May 28 08:01:37.933860 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:37.933771 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/64c31255-a020-4e2b-9a33-942aa1476d99-trusted-ca\") pod \"image-registry-8974698c9-jzf5f\" (UID: \"64c31255-a020-4e2b-9a33-942aa1476d99\") " pod="openshift-image-registry/image-registry-8974698c9-jzf5f" May 28 08:01:37.935273 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:37.935254 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/64c31255-a020-4e2b-9a33-942aa1476d99-image-registry-private-configuration\") pod \"image-registry-8974698c9-jzf5f\" (UID: \"64c31255-a020-4e2b-9a33-942aa1476d99\") " pod="openshift-image-registry/image-registry-8974698c9-jzf5f" May 28 08:01:37.935475 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:37.935457 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/64c31255-a020-4e2b-9a33-942aa1476d99-installation-pull-secrets\") pod \"image-registry-8974698c9-jzf5f\" (UID: \"64c31255-a020-4e2b-9a33-942aa1476d99\") " pod="openshift-image-registry/image-registry-8974698c9-jzf5f" May 28 08:01:37.940672 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:37.940654 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gs5m5\" (UniqueName: \"kubernetes.io/projected/64c31255-a020-4e2b-9a33-942aa1476d99-kube-api-access-gs5m5\") pod \"image-registry-8974698c9-jzf5f\" (UID: \"64c31255-a020-4e2b-9a33-942aa1476d99\") " pod="openshift-image-registry/image-registry-8974698c9-jzf5f" May 28 08:01:37.940820 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:37.940800 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvpgf\" (UniqueName: \"kubernetes.io/projected/88dbb2bd-a657-41b0-ba0b-cc35ee5caea0-kube-api-access-qvpgf\") pod \"cluster-samples-operator-697587599-d8zp5\" (UID: \"88dbb2bd-a657-41b0-ba0b-cc35ee5caea0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-d8zp5" May 28 08:01:37.940888 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:37.940843 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/64c31255-a020-4e2b-9a33-942aa1476d99-bound-sa-token\") pod \"image-registry-8974698c9-jzf5f\" (UID: \"64c31255-a020-4e2b-9a33-942aa1476d99\") " pod="openshift-image-registry/image-registry-8974698c9-jzf5f" May 28 08:01:38.034469 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:38.034424 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7qh5z\" (UniqueName: \"kubernetes.io/projected/1f418e03-845a-44f2-a3bd-5dcc46b6df6c-kube-api-access-7qh5z\") pod \"service-ca-operator-57b5b68b8-bxk8j\" (UID: \"1f418e03-845a-44f2-a3bd-5dcc46b6df6c\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-bxk8j" May 28 08:01:38.034469 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:38.034454 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c983dbdf-f0a8-4bb6-b8cc-0a759a317eb7-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-449zx\" (UID: \"c983dbdf-f0a8-4bb6-b8cc-0a759a317eb7\") " pod="openshift-insights/insights-operator-78bdfb888c-449zx" May 28 08:01:38.034604 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:38.034471 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c983dbdf-f0a8-4bb6-b8cc-0a759a317eb7-serving-cert\") pod \"insights-operator-78bdfb888c-449zx\" (UID: \"c983dbdf-f0a8-4bb6-b8cc-0a759a317eb7\") " pod="openshift-insights/insights-operator-78bdfb888c-449zx" May 28 08:01:38.034604 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:38.034487 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-llwqp\" (UniqueName: \"kubernetes.io/projected/c983dbdf-f0a8-4bb6-b8cc-0a759a317eb7-kube-api-access-llwqp\") pod \"insights-operator-78bdfb888c-449zx\" (UID: \"c983dbdf-f0a8-4bb6-b8cc-0a759a317eb7\") " pod="openshift-insights/insights-operator-78bdfb888c-449zx" May 28 08:01:38.034604 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:38.034502 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7811826f-af04-4605-a732-f165273106d4-config\") pod \"kube-storage-version-migrator-operator-565644f49-8mk4q\" (UID: \"7811826f-af04-4605-a732-f165273106d4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-8mk4q" May 28 08:01:38.034604 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:38.034532 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1f418e03-845a-44f2-a3bd-5dcc46b6df6c-serving-cert\") pod \"service-ca-operator-57b5b68b8-bxk8j\" (UID: \"1f418e03-845a-44f2-a3bd-5dcc46b6df6c\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-bxk8j" May 28 08:01:38.034604 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:38.034584 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c983dbdf-f0a8-4bb6-b8cc-0a759a317eb7-service-ca-bundle\") pod \"insights-operator-78bdfb888c-449zx\" (UID: \"c983dbdf-f0a8-4bb6-b8cc-0a759a317eb7\") " pod="openshift-insights/insights-operator-78bdfb888c-449zx" May 28 08:01:38.034859 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:38.034606 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c983dbdf-f0a8-4bb6-b8cc-0a759a317eb7-snapshots\") pod \"insights-operator-78bdfb888c-449zx\" (UID: \"c983dbdf-f0a8-4bb6-b8cc-0a759a317eb7\") " pod="openshift-insights/insights-operator-78bdfb888c-449zx" May 28 08:01:38.034859 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:38.034633 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7811826f-af04-4605-a732-f165273106d4-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-8mk4q\" (UID: \"7811826f-af04-4605-a732-f165273106d4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-8mk4q" May 28 08:01:38.034859 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:38.034685 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c983dbdf-f0a8-4bb6-b8cc-0a759a317eb7-tmp\") pod \"insights-operator-78bdfb888c-449zx\" (UID: \"c983dbdf-f0a8-4bb6-b8cc-0a759a317eb7\") " pod="openshift-insights/insights-operator-78bdfb888c-449zx" May 28 08:01:38.034859 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:38.034716 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1f418e03-845a-44f2-a3bd-5dcc46b6df6c-config\") pod \"service-ca-operator-57b5b68b8-bxk8j\" (UID: \"1f418e03-845a-44f2-a3bd-5dcc46b6df6c\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-bxk8j" May 28 08:01:38.034859 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:38.034741 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jvjjl\" (UniqueName: \"kubernetes.io/projected/7811826f-af04-4605-a732-f165273106d4-kube-api-access-jvjjl\") pod \"kube-storage-version-migrator-operator-565644f49-8mk4q\" (UID: \"7811826f-af04-4605-a732-f165273106d4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-8mk4q" May 28 08:01:38.035187 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:38.035164 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c983dbdf-f0a8-4bb6-b8cc-0a759a317eb7-service-ca-bundle\") pod \"insights-operator-78bdfb888c-449zx\" (UID: \"c983dbdf-f0a8-4bb6-b8cc-0a759a317eb7\") " pod="openshift-insights/insights-operator-78bdfb888c-449zx" May 28 08:01:38.035187 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:38.035178 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7811826f-af04-4605-a732-f165273106d4-config\") pod \"kube-storage-version-migrator-operator-565644f49-8mk4q\" (UID: \"7811826f-af04-4605-a732-f165273106d4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-8mk4q" May 28 08:01:38.035280 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:38.035221 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c983dbdf-f0a8-4bb6-b8cc-0a759a317eb7-tmp\") pod \"insights-operator-78bdfb888c-449zx\" (UID: \"c983dbdf-f0a8-4bb6-b8cc-0a759a317eb7\") " pod="openshift-insights/insights-operator-78bdfb888c-449zx" May 28 08:01:38.035512 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:38.035491 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c983dbdf-f0a8-4bb6-b8cc-0a759a317eb7-snapshots\") pod \"insights-operator-78bdfb888c-449zx\" (UID: \"c983dbdf-f0a8-4bb6-b8cc-0a759a317eb7\") " pod="openshift-insights/insights-operator-78bdfb888c-449zx" May 28 08:01:38.035587 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:38.035529 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1f418e03-845a-44f2-a3bd-5dcc46b6df6c-config\") pod \"service-ca-operator-57b5b68b8-bxk8j\" (UID: \"1f418e03-845a-44f2-a3bd-5dcc46b6df6c\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-bxk8j" May 28 08:01:38.035908 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:38.035888 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c983dbdf-f0a8-4bb6-b8cc-0a759a317eb7-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-449zx\" (UID: \"c983dbdf-f0a8-4bb6-b8cc-0a759a317eb7\") " pod="openshift-insights/insights-operator-78bdfb888c-449zx" May 28 08:01:38.036526 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:38.036503 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c983dbdf-f0a8-4bb6-b8cc-0a759a317eb7-serving-cert\") pod \"insights-operator-78bdfb888c-449zx\" (UID: \"c983dbdf-f0a8-4bb6-b8cc-0a759a317eb7\") " pod="openshift-insights/insights-operator-78bdfb888c-449zx" May 28 08:01:38.036636 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:38.036620 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1f418e03-845a-44f2-a3bd-5dcc46b6df6c-serving-cert\") pod \"service-ca-operator-57b5b68b8-bxk8j\" (UID: \"1f418e03-845a-44f2-a3bd-5dcc46b6df6c\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-bxk8j" May 28 08:01:38.037212 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:38.037197 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7811826f-af04-4605-a732-f165273106d4-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-8mk4q\" (UID: \"7811826f-af04-4605-a732-f165273106d4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-8mk4q" May 28 08:01:38.042124 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:38.042103 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qh5z\" (UniqueName: \"kubernetes.io/projected/1f418e03-845a-44f2-a3bd-5dcc46b6df6c-kube-api-access-7qh5z\") pod \"service-ca-operator-57b5b68b8-bxk8j\" (UID: \"1f418e03-845a-44f2-a3bd-5dcc46b6df6c\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-bxk8j" May 28 08:01:38.042318 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:38.042297 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvjjl\" (UniqueName: \"kubernetes.io/projected/7811826f-af04-4605-a732-f165273106d4-kube-api-access-jvjjl\") pod \"kube-storage-version-migrator-operator-565644f49-8mk4q\" (UID: \"7811826f-af04-4605-a732-f165273106d4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-8mk4q" May 28 08:01:38.042318 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:38.042313 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-llwqp\" (UniqueName: \"kubernetes.io/projected/c983dbdf-f0a8-4bb6-b8cc-0a759a317eb7-kube-api-access-llwqp\") pod \"insights-operator-78bdfb888c-449zx\" (UID: \"c983dbdf-f0a8-4bb6-b8cc-0a759a317eb7\") " pod="openshift-insights/insights-operator-78bdfb888c-449zx" May 28 08:01:38.115571 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:38.115548 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-bxk8j" May 28 08:01:38.124072 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:38.124055 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-449zx" May 28 08:01:38.130637 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:38.130615 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-8mk4q" May 28 08:01:38.249949 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:38.249921 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-bxk8j"] May 28 08:01:38.253081 ip-10-0-139-133 kubenswrapper[2560]: W0528 08:01:38.253055 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f418e03_845a_44f2_a3bd_5dcc46b6df6c.slice/crio-9d603430f710b8ad71a5a41f89e63292120f568b40af6a7d06e6c32fad64a905 WatchSource:0}: Error finding container 9d603430f710b8ad71a5a41f89e63292120f568b40af6a7d06e6c32fad64a905: Status 404 returned error can't find the container with id 9d603430f710b8ad71a5a41f89e63292120f568b40af6a7d06e6c32fad64a905 May 28 08:01:38.437544 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:38.437515 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/88dbb2bd-a657-41b0-ba0b-cc35ee5caea0-samples-operator-tls\") pod \"cluster-samples-operator-697587599-d8zp5\" (UID: \"88dbb2bd-a657-41b0-ba0b-cc35ee5caea0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-d8zp5" May 28 08:01:38.437684 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:38.437558 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/64c31255-a020-4e2b-9a33-942aa1476d99-registry-tls\") pod \"image-registry-8974698c9-jzf5f\" (UID: \"64c31255-a020-4e2b-9a33-942aa1476d99\") " pod="openshift-image-registry/image-registry-8974698c9-jzf5f" May 28 08:01:38.437684 ip-10-0-139-133 kubenswrapper[2560]: E0528 08:01:38.437656 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 28 08:01:38.437765 ip-10-0-139-133 kubenswrapper[2560]: E0528 08:01:38.437718 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88dbb2bd-a657-41b0-ba0b-cc35ee5caea0-samples-operator-tls podName:88dbb2bd-a657-41b0-ba0b-cc35ee5caea0 nodeName:}" failed. No retries permitted until 2026-05-28 08:01:39.437703816 +0000 UTC m=+139.324149936 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/88dbb2bd-a657-41b0-ba0b-cc35ee5caea0-samples-operator-tls") pod "cluster-samples-operator-697587599-d8zp5" (UID: "88dbb2bd-a657-41b0-ba0b-cc35ee5caea0") : secret "samples-operator-tls" not found May 28 08:01:38.437765 ip-10-0-139-133 kubenswrapper[2560]: E0528 08:01:38.437660 2560 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 28 08:01:38.437765 ip-10-0-139-133 kubenswrapper[2560]: E0528 08:01:38.437756 2560 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8974698c9-jzf5f: secret "image-registry-tls" not found May 28 08:01:38.437863 ip-10-0-139-133 kubenswrapper[2560]: E0528 08:01:38.437798 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/64c31255-a020-4e2b-9a33-942aa1476d99-registry-tls podName:64c31255-a020-4e2b-9a33-942aa1476d99 nodeName:}" failed. No retries permitted until 2026-05-28 08:01:39.437784174 +0000 UTC m=+139.324230293 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/64c31255-a020-4e2b-9a33-942aa1476d99-registry-tls") pod "image-registry-8974698c9-jzf5f" (UID: "64c31255-a020-4e2b-9a33-942aa1476d99") : secret "image-registry-tls" not found May 28 08:01:38.470947 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:38.470912 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-8mk4q"] May 28 08:01:38.473961 ip-10-0-139-133 kubenswrapper[2560]: W0528 08:01:38.473937 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7811826f_af04_4605_a732_f165273106d4.slice/crio-7202cc178a0e093545bc749bbe88593ed1924cb69272e84121d2c86f903dbd11 WatchSource:0}: Error finding container 7202cc178a0e093545bc749bbe88593ed1924cb69272e84121d2c86f903dbd11: Status 404 returned error can't find the container with id 7202cc178a0e093545bc749bbe88593ed1924cb69272e84121d2c86f903dbd11 May 28 08:01:38.474309 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:38.474290 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-449zx"] May 28 08:01:38.477252 ip-10-0-139-133 kubenswrapper[2560]: W0528 08:01:38.477230 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc983dbdf_f0a8_4bb6_b8cc_0a759a317eb7.slice/crio-04ee5f4fbe0ce10150fdd5eb8c032588bb9ea6ec0e24cac4da57d90e65aaad17 WatchSource:0}: Error finding container 04ee5f4fbe0ce10150fdd5eb8c032588bb9ea6ec0e24cac4da57d90e65aaad17: Status 404 returned error can't find the container with id 04ee5f4fbe0ce10150fdd5eb8c032588bb9ea6ec0e24cac4da57d90e65aaad17 May 28 08:01:39.113709 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:39.113654 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-8mk4q" event={"ID":"7811826f-af04-4605-a732-f165273106d4","Type":"ContainerStarted","Data":"7202cc178a0e093545bc749bbe88593ed1924cb69272e84121d2c86f903dbd11"} May 28 08:01:39.114905 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:39.114853 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-bxk8j" event={"ID":"1f418e03-845a-44f2-a3bd-5dcc46b6df6c","Type":"ContainerStarted","Data":"9d603430f710b8ad71a5a41f89e63292120f568b40af6a7d06e6c32fad64a905"} May 28 08:01:39.116151 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:39.116116 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-449zx" event={"ID":"c983dbdf-f0a8-4bb6-b8cc-0a759a317eb7","Type":"ContainerStarted","Data":"04ee5f4fbe0ce10150fdd5eb8c032588bb9ea6ec0e24cac4da57d90e65aaad17"} May 28 08:01:39.445091 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:39.445006 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/88dbb2bd-a657-41b0-ba0b-cc35ee5caea0-samples-operator-tls\") pod \"cluster-samples-operator-697587599-d8zp5\" (UID: \"88dbb2bd-a657-41b0-ba0b-cc35ee5caea0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-d8zp5" May 28 08:01:39.445264 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:39.445158 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/64c31255-a020-4e2b-9a33-942aa1476d99-registry-tls\") pod \"image-registry-8974698c9-jzf5f\" (UID: \"64c31255-a020-4e2b-9a33-942aa1476d99\") " pod="openshift-image-registry/image-registry-8974698c9-jzf5f" May 28 08:01:39.445264 ip-10-0-139-133 kubenswrapper[2560]: E0528 08:01:39.445170 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 28 08:01:39.445264 ip-10-0-139-133 kubenswrapper[2560]: E0528 08:01:39.445247 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88dbb2bd-a657-41b0-ba0b-cc35ee5caea0-samples-operator-tls podName:88dbb2bd-a657-41b0-ba0b-cc35ee5caea0 nodeName:}" failed. No retries permitted until 2026-05-28 08:01:41.445225633 +0000 UTC m=+141.331671778 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/88dbb2bd-a657-41b0-ba0b-cc35ee5caea0-samples-operator-tls") pod "cluster-samples-operator-697587599-d8zp5" (UID: "88dbb2bd-a657-41b0-ba0b-cc35ee5caea0") : secret "samples-operator-tls" not found May 28 08:01:39.445429 ip-10-0-139-133 kubenswrapper[2560]: E0528 08:01:39.445311 2560 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 28 08:01:39.445429 ip-10-0-139-133 kubenswrapper[2560]: E0528 08:01:39.445329 2560 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8974698c9-jzf5f: secret "image-registry-tls" not found May 28 08:01:39.445429 ip-10-0-139-133 kubenswrapper[2560]: E0528 08:01:39.445383 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/64c31255-a020-4e2b-9a33-942aa1476d99-registry-tls podName:64c31255-a020-4e2b-9a33-942aa1476d99 nodeName:}" failed. No retries permitted until 2026-05-28 08:01:41.445367415 +0000 UTC m=+141.331813541 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/64c31255-a020-4e2b-9a33-942aa1476d99-registry-tls") pod "image-registry-8974698c9-jzf5f" (UID: "64c31255-a020-4e2b-9a33-942aa1476d99") : secret "image-registry-tls" not found May 28 08:01:40.156998 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:40.156871 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-b4xhl"] May 28 08:01:40.159919 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:40.159895 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-b4xhl" May 28 08:01:40.162135 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:40.162107 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-9tqxc\"" May 28 08:01:40.166487 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:40.166463 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-b4xhl"] May 28 08:01:40.251397 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:40.251369 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phdct\" (UniqueName: \"kubernetes.io/projected/36db01f6-3d08-43ca-9b7e-350cf7afc74b-kube-api-access-phdct\") pod \"network-check-source-7f44b6dd87-b4xhl\" (UID: \"36db01f6-3d08-43ca-9b7e-350cf7afc74b\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-b4xhl" May 28 08:01:40.352932 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:40.352897 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-phdct\" (UniqueName: \"kubernetes.io/projected/36db01f6-3d08-43ca-9b7e-350cf7afc74b-kube-api-access-phdct\") pod \"network-check-source-7f44b6dd87-b4xhl\" (UID: \"36db01f6-3d08-43ca-9b7e-350cf7afc74b\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-b4xhl" May 28 08:01:40.360817 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:40.360787 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-phdct\" (UniqueName: \"kubernetes.io/projected/36db01f6-3d08-43ca-9b7e-350cf7afc74b-kube-api-access-phdct\") pod \"network-check-source-7f44b6dd87-b4xhl\" (UID: \"36db01f6-3d08-43ca-9b7e-350cf7afc74b\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-b4xhl" May 28 08:01:40.471221 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:40.471138 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-b4xhl" May 28 08:01:41.365034 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:41.364973 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-b4xhl"] May 28 08:01:41.368067 ip-10-0-139-133 kubenswrapper[2560]: W0528 08:01:41.368020 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36db01f6_3d08_43ca_9b7e_350cf7afc74b.slice/crio-4ac493dfe4ebaa7686a82588b14c8d7ee709d948e33b21956b48d7cd0745d5db WatchSource:0}: Error finding container 4ac493dfe4ebaa7686a82588b14c8d7ee709d948e33b21956b48d7cd0745d5db: Status 404 returned error can't find the container with id 4ac493dfe4ebaa7686a82588b14c8d7ee709d948e33b21956b48d7cd0745d5db May 28 08:01:41.462290 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:41.462232 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/64c31255-a020-4e2b-9a33-942aa1476d99-registry-tls\") pod \"image-registry-8974698c9-jzf5f\" (UID: \"64c31255-a020-4e2b-9a33-942aa1476d99\") " pod="openshift-image-registry/image-registry-8974698c9-jzf5f" May 28 08:01:41.462384 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:41.462300 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/88dbb2bd-a657-41b0-ba0b-cc35ee5caea0-samples-operator-tls\") pod \"cluster-samples-operator-697587599-d8zp5\" (UID: \"88dbb2bd-a657-41b0-ba0b-cc35ee5caea0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-d8zp5" May 28 08:01:41.462423 ip-10-0-139-133 kubenswrapper[2560]: E0528 08:01:41.462396 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 28 08:01:41.462453 ip-10-0-139-133 kubenswrapper[2560]: E0528 08:01:41.462437 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88dbb2bd-a657-41b0-ba0b-cc35ee5caea0-samples-operator-tls podName:88dbb2bd-a657-41b0-ba0b-cc35ee5caea0 nodeName:}" failed. No retries permitted until 2026-05-28 08:01:45.462422729 +0000 UTC m=+145.348868862 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/88dbb2bd-a657-41b0-ba0b-cc35ee5caea0-samples-operator-tls") pod "cluster-samples-operator-697587599-d8zp5" (UID: "88dbb2bd-a657-41b0-ba0b-cc35ee5caea0") : secret "samples-operator-tls" not found May 28 08:01:41.462605 ip-10-0-139-133 kubenswrapper[2560]: E0528 08:01:41.462580 2560 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 28 08:01:41.462605 ip-10-0-139-133 kubenswrapper[2560]: E0528 08:01:41.462602 2560 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8974698c9-jzf5f: secret "image-registry-tls" not found May 28 08:01:41.462765 ip-10-0-139-133 kubenswrapper[2560]: E0528 08:01:41.462652 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/64c31255-a020-4e2b-9a33-942aa1476d99-registry-tls podName:64c31255-a020-4e2b-9a33-942aa1476d99 nodeName:}" failed. No retries permitted until 2026-05-28 08:01:45.462635452 +0000 UTC m=+145.349081571 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/64c31255-a020-4e2b-9a33-942aa1476d99-registry-tls") pod "image-registry-8974698c9-jzf5f" (UID: "64c31255-a020-4e2b-9a33-942aa1476d99") : secret "image-registry-tls" not found May 28 08:01:42.125691 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:42.125642 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-8mk4q" event={"ID":"7811826f-af04-4605-a732-f165273106d4","Type":"ContainerStarted","Data":"9332a717313f16aecf3fb8b5319d7224d1e8457e09fc3ae702740338a4d04ea1"} May 28 08:01:42.127468 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:42.127434 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-bxk8j" event={"ID":"1f418e03-845a-44f2-a3bd-5dcc46b6df6c","Type":"ContainerStarted","Data":"d11292a9fde602a6e83921a9dc8fac758ddd728eecdcaf561aa51ab5d9152d2f"} May 28 08:01:42.128872 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:42.128834 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-449zx" event={"ID":"c983dbdf-f0a8-4bb6-b8cc-0a759a317eb7","Type":"ContainerStarted","Data":"b70947cac77ab0e2ee72c3862ef909964279da0598105e90b43959540ed0a4a3"} May 28 08:01:42.130435 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:42.130411 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-b4xhl" event={"ID":"36db01f6-3d08-43ca-9b7e-350cf7afc74b","Type":"ContainerStarted","Data":"7c8ece1d4ebdad56319a34af16bc997cb0d9e51f7e95581fd8d5994a3332dce5"} May 28 08:01:42.130582 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:42.130438 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-b4xhl" event={"ID":"36db01f6-3d08-43ca-9b7e-350cf7afc74b","Type":"ContainerStarted","Data":"4ac493dfe4ebaa7686a82588b14c8d7ee709d948e33b21956b48d7cd0745d5db"} May 28 08:01:42.140221 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:42.140151 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-8mk4q" podStartSLOduration=2.384462157 podStartE2EDuration="5.140139628s" podCreationTimestamp="2026-05-28 08:01:37 +0000 UTC" firstStartedPulling="2026-05-28 08:01:38.475739803 +0000 UTC m=+138.362185923" lastFinishedPulling="2026-05-28 08:01:41.231417257 +0000 UTC m=+141.117863394" observedRunningTime="2026-05-28 08:01:42.139472244 +0000 UTC m=+142.025918382" watchObservedRunningTime="2026-05-28 08:01:42.140139628 +0000 UTC m=+142.026585770" May 28 08:01:42.153403 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:42.153357 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-bxk8j" podStartSLOduration=2.178777579 podStartE2EDuration="5.153308075s" podCreationTimestamp="2026-05-28 08:01:37 +0000 UTC" firstStartedPulling="2026-05-28 08:01:38.254897601 +0000 UTC m=+138.141343721" lastFinishedPulling="2026-05-28 08:01:41.229428092 +0000 UTC m=+141.115874217" observedRunningTime="2026-05-28 08:01:42.152314584 +0000 UTC m=+142.038760719" watchObservedRunningTime="2026-05-28 08:01:42.153308075 +0000 UTC m=+142.039754218" May 28 08:01:42.168269 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:42.168225 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-b4xhl" podStartSLOduration=2.168215498 podStartE2EDuration="2.168215498s" podCreationTimestamp="2026-05-28 08:01:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 08:01:42.168008368 +0000 UTC m=+142.054454511" watchObservedRunningTime="2026-05-28 08:01:42.168215498 +0000 UTC m=+142.054661634" May 28 08:01:42.822637 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:42.822581 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-78bdfb888c-449zx" podStartSLOduration=3.064127125 podStartE2EDuration="5.822545544s" podCreationTimestamp="2026-05-28 08:01:37 +0000 UTC" firstStartedPulling="2026-05-28 08:01:38.478764714 +0000 UTC m=+138.365210834" lastFinishedPulling="2026-05-28 08:01:41.23718313 +0000 UTC m=+141.123629253" observedRunningTime="2026-05-28 08:01:42.182984185 +0000 UTC m=+142.069430328" watchObservedRunningTime="2026-05-28 08:01:42.822545544 +0000 UTC m=+142.708991686" May 28 08:01:42.823123 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:42.822866 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-rt2wl"] May 28 08:01:42.826278 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:42.826255 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-rt2wl" May 28 08:01:42.828399 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:42.828376 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" May 28 08:01:42.828550 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:42.828531 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" May 28 08:01:42.828622 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:42.828582 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-gjn65\"" May 28 08:01:42.836399 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:42.836373 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-rt2wl"] May 28 08:01:42.876392 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:42.876370 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lvrl\" (UniqueName: \"kubernetes.io/projected/98fa889b-5b1e-4744-b209-41126bf0c184-kube-api-access-2lvrl\") pod \"migrator-b985f5d89-rt2wl\" (UID: \"98fa889b-5b1e-4744-b209-41126bf0c184\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-rt2wl" May 28 08:01:42.976945 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:42.976913 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2lvrl\" (UniqueName: \"kubernetes.io/projected/98fa889b-5b1e-4744-b209-41126bf0c184-kube-api-access-2lvrl\") pod \"migrator-b985f5d89-rt2wl\" (UID: \"98fa889b-5b1e-4744-b209-41126bf0c184\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-rt2wl" May 28 08:01:42.983804 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:42.983783 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lvrl\" (UniqueName: \"kubernetes.io/projected/98fa889b-5b1e-4744-b209-41126bf0c184-kube-api-access-2lvrl\") pod \"migrator-b985f5d89-rt2wl\" (UID: \"98fa889b-5b1e-4744-b209-41126bf0c184\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-rt2wl" May 28 08:01:43.134825 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:43.134641 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-rt2wl" May 28 08:01:43.267140 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:43.267022 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-rt2wl"] May 28 08:01:43.269496 ip-10-0-139-133 kubenswrapper[2560]: W0528 08:01:43.269468 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98fa889b_5b1e_4744_b209_41126bf0c184.slice/crio-4b2e6429682fed9da8f32d689531941a09fe6993b8d94139d4642f9c6ac8b1fe WatchSource:0}: Error finding container 4b2e6429682fed9da8f32d689531941a09fe6993b8d94139d4642f9c6ac8b1fe: Status 404 returned error can't find the container with id 4b2e6429682fed9da8f32d689531941a09fe6993b8d94139d4642f9c6ac8b1fe May 28 08:01:44.140272 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:44.140235 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-rt2wl" event={"ID":"98fa889b-5b1e-4744-b209-41126bf0c184","Type":"ContainerStarted","Data":"4b2e6429682fed9da8f32d689531941a09fe6993b8d94139d4642f9c6ac8b1fe"} May 28 08:01:45.144254 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:45.144220 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-rt2wl" event={"ID":"98fa889b-5b1e-4744-b209-41126bf0c184","Type":"ContainerStarted","Data":"8e4bb340f803a2bf86a4d79f1c5472d7006f403abee915e66f517027303273e0"} May 28 08:01:45.144254 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:45.144254 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-rt2wl" event={"ID":"98fa889b-5b1e-4744-b209-41126bf0c184","Type":"ContainerStarted","Data":"f365e34c89a6619e0d5f50e356193b9b5aaea5c3eaf1024e7068c3759f1cc340"} May 28 08:01:45.157850 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:45.157813 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-rt2wl" podStartSLOduration=2.112322095 podStartE2EDuration="3.157799979s" podCreationTimestamp="2026-05-28 08:01:42 +0000 UTC" firstStartedPulling="2026-05-28 08:01:43.27150556 +0000 UTC m=+143.157951679" lastFinishedPulling="2026-05-28 08:01:44.316983443 +0000 UTC m=+144.203429563" observedRunningTime="2026-05-28 08:01:45.157646922 +0000 UTC m=+145.044093064" watchObservedRunningTime="2026-05-28 08:01:45.157799979 +0000 UTC m=+145.044246121" May 28 08:01:45.495889 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:45.495808 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/64c31255-a020-4e2b-9a33-942aa1476d99-registry-tls\") pod \"image-registry-8974698c9-jzf5f\" (UID: \"64c31255-a020-4e2b-9a33-942aa1476d99\") " pod="openshift-image-registry/image-registry-8974698c9-jzf5f" May 28 08:01:45.495889 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:45.495859 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/88dbb2bd-a657-41b0-ba0b-cc35ee5caea0-samples-operator-tls\") pod \"cluster-samples-operator-697587599-d8zp5\" (UID: \"88dbb2bd-a657-41b0-ba0b-cc35ee5caea0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-d8zp5" May 28 08:01:45.496062 ip-10-0-139-133 kubenswrapper[2560]: E0528 08:01:45.495947 2560 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 28 08:01:45.496062 ip-10-0-139-133 kubenswrapper[2560]: E0528 08:01:45.495966 2560 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8974698c9-jzf5f: secret "image-registry-tls" not found May 28 08:01:45.496062 ip-10-0-139-133 kubenswrapper[2560]: E0528 08:01:45.495970 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 28 08:01:45.496062 ip-10-0-139-133 kubenswrapper[2560]: E0528 08:01:45.496018 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/64c31255-a020-4e2b-9a33-942aa1476d99-registry-tls podName:64c31255-a020-4e2b-9a33-942aa1476d99 nodeName:}" failed. No retries permitted until 2026-05-28 08:01:53.496002824 +0000 UTC m=+153.382448943 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/64c31255-a020-4e2b-9a33-942aa1476d99-registry-tls") pod "image-registry-8974698c9-jzf5f" (UID: "64c31255-a020-4e2b-9a33-942aa1476d99") : secret "image-registry-tls" not found May 28 08:01:45.496062 ip-10-0-139-133 kubenswrapper[2560]: E0528 08:01:45.496032 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88dbb2bd-a657-41b0-ba0b-cc35ee5caea0-samples-operator-tls podName:88dbb2bd-a657-41b0-ba0b-cc35ee5caea0 nodeName:}" failed. No retries permitted until 2026-05-28 08:01:53.496025816 +0000 UTC m=+153.382471973 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/88dbb2bd-a657-41b0-ba0b-cc35ee5caea0-samples-operator-tls") pod "cluster-samples-operator-697587599-d8zp5" (UID: "88dbb2bd-a657-41b0-ba0b-cc35ee5caea0") : secret "samples-operator-tls" not found May 28 08:01:46.154764 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:46.154737 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xhm9j_8db07e49-d641-48b0-89e4-2f4bdf6999a5/dns-node-resolver/0.log" May 28 08:01:46.755143 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:46.755119 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ctxgq_04a96139-4274-4e69-bb7b-18e9e99ba9e4/node-ca/0.log" May 28 08:01:48.154436 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:48.154414 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-rt2wl_98fa889b-5b1e-4744-b209-41126bf0c184/migrator/0.log" May 28 08:01:48.355177 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:48.355147 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-rt2wl_98fa889b-5b1e-4744-b209-41126bf0c184/graceful-termination/0.log" May 28 08:01:48.556083 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:48.556058 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-8mk4q_7811826f-af04-4605-a732-f165273106d4/kube-storage-version-migrator-operator/0.log" May 28 08:01:53.554672 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:53.554634 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/88dbb2bd-a657-41b0-ba0b-cc35ee5caea0-samples-operator-tls\") pod \"cluster-samples-operator-697587599-d8zp5\" (UID: \"88dbb2bd-a657-41b0-ba0b-cc35ee5caea0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-d8zp5" May 28 08:01:53.555144 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:53.554739 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/64c31255-a020-4e2b-9a33-942aa1476d99-registry-tls\") pod \"image-registry-8974698c9-jzf5f\" (UID: \"64c31255-a020-4e2b-9a33-942aa1476d99\") " pod="openshift-image-registry/image-registry-8974698c9-jzf5f" May 28 08:01:53.557054 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:53.557025 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/64c31255-a020-4e2b-9a33-942aa1476d99-registry-tls\") pod \"image-registry-8974698c9-jzf5f\" (UID: \"64c31255-a020-4e2b-9a33-942aa1476d99\") " pod="openshift-image-registry/image-registry-8974698c9-jzf5f" May 28 08:01:53.557054 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:53.557044 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/88dbb2bd-a657-41b0-ba0b-cc35ee5caea0-samples-operator-tls\") pod \"cluster-samples-operator-697587599-d8zp5\" (UID: \"88dbb2bd-a657-41b0-ba0b-cc35ee5caea0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-d8zp5" May 28 08:01:53.618882 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:53.618859 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-d8zp5" May 28 08:01:53.624505 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:53.624485 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8974698c9-jzf5f" May 28 08:01:53.746322 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:53.746288 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-d8zp5"] May 28 08:01:53.761036 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:53.761006 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8974698c9-jzf5f"] May 28 08:01:53.764513 ip-10-0-139-133 kubenswrapper[2560]: W0528 08:01:53.764480 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64c31255_a020_4e2b_9a33_942aa1476d99.slice/crio-3bde6002ac8fd45d2b64dd1809ddcbbea9982a68e0c5db758cab3d1d3e77cff0 WatchSource:0}: Error finding container 3bde6002ac8fd45d2b64dd1809ddcbbea9982a68e0c5db758cab3d1d3e77cff0: Status 404 returned error can't find the container with id 3bde6002ac8fd45d2b64dd1809ddcbbea9982a68e0c5db758cab3d1d3e77cff0 May 28 08:01:54.165618 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:54.165555 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8974698c9-jzf5f" event={"ID":"64c31255-a020-4e2b-9a33-942aa1476d99","Type":"ContainerStarted","Data":"a8a06cc3cfd55894dac09b52bf17e8b91b8c081c8c50ff690d98f314a3b43067"} May 28 08:01:54.165618 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:54.165623 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8974698c9-jzf5f" event={"ID":"64c31255-a020-4e2b-9a33-942aa1476d99","Type":"ContainerStarted","Data":"3bde6002ac8fd45d2b64dd1809ddcbbea9982a68e0c5db758cab3d1d3e77cff0"} May 28 08:01:54.165840 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:54.165645 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-8974698c9-jzf5f" May 28 08:01:54.166580 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:54.166535 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-d8zp5" event={"ID":"88dbb2bd-a657-41b0-ba0b-cc35ee5caea0","Type":"ContainerStarted","Data":"3712414df7bef5e8eb8fc336ddafcd83522badee71f34d80480fd720016702e1"} May 28 08:01:54.183735 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:54.183694 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-8974698c9-jzf5f" podStartSLOduration=17.18367629 podStartE2EDuration="17.18367629s" podCreationTimestamp="2026-05-28 08:01:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 08:01:54.182618834 +0000 UTC m=+154.069064978" watchObservedRunningTime="2026-05-28 08:01:54.18367629 +0000 UTC m=+154.070122426" May 28 08:01:55.985172 ip-10-0-139-133 kubenswrapper[2560]: E0528 08:01:55.985134 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-88fmq" podUID="ec820620-b736-430c-831d-5d2b97e83d32" May 28 08:01:56.005352 ip-10-0-139-133 kubenswrapper[2560]: E0528 08:01:56.005323 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-qtd5f" podUID="b2d0b175-5e98-4b80-94e3-92a78b286c16" May 28 08:01:56.174387 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:56.174355 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qtd5f" May 28 08:01:56.174597 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:56.174357 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-d8zp5" event={"ID":"88dbb2bd-a657-41b0-ba0b-cc35ee5caea0","Type":"ContainerStarted","Data":"767957b18e230da6318ebbab17d1f4e016f29d4fadfb2d5241bc8672cecdc5c2"} May 28 08:01:56.174597 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:56.174456 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-88fmq" May 28 08:01:56.174597 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:56.174474 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-d8zp5" event={"ID":"88dbb2bd-a657-41b0-ba0b-cc35ee5caea0","Type":"ContainerStarted","Data":"f1c2c88909a4e4befda7a0917322ba0b52b955dbab787c8e2290c858210454c5"} May 28 08:01:56.187686 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:01:56.187642 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-d8zp5" podStartSLOduration=17.699628636 podStartE2EDuration="19.187632165s" podCreationTimestamp="2026-05-28 08:01:37 +0000 UTC" firstStartedPulling="2026-05-28 08:01:53.795190878 +0000 UTC m=+153.681637004" lastFinishedPulling="2026-05-28 08:01:55.283194413 +0000 UTC m=+155.169640533" observedRunningTime="2026-05-28 08:01:56.186394431 +0000 UTC m=+156.072840573" watchObservedRunningTime="2026-05-28 08:01:56.187632165 +0000 UTC m=+156.074078306" May 28 08:01:56.739425 ip-10-0-139-133 kubenswrapper[2560]: E0528 08:01:56.739387 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-z5j9k" podUID="5f2c94ed-4111-42f9-8ec1-7c96447b9c11" May 28 08:02:00.803024 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:00.802990 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ec820620-b736-430c-831d-5d2b97e83d32-metrics-tls\") pod \"dns-default-88fmq\" (UID: \"ec820620-b736-430c-831d-5d2b97e83d32\") " pod="openshift-dns/dns-default-88fmq" May 28 08:02:00.805185 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:00.805167 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ec820620-b736-430c-831d-5d2b97e83d32-metrics-tls\") pod \"dns-default-88fmq\" (UID: \"ec820620-b736-430c-831d-5d2b97e83d32\") " pod="openshift-dns/dns-default-88fmq" May 28 08:02:00.903547 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:00.903521 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b2d0b175-5e98-4b80-94e3-92a78b286c16-cert\") pod \"ingress-canary-qtd5f\" (UID: \"b2d0b175-5e98-4b80-94e3-92a78b286c16\") " pod="openshift-ingress-canary/ingress-canary-qtd5f" May 28 08:02:00.905574 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:00.905536 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b2d0b175-5e98-4b80-94e3-92a78b286c16-cert\") pod \"ingress-canary-qtd5f\" (UID: \"b2d0b175-5e98-4b80-94e3-92a78b286c16\") " pod="openshift-ingress-canary/ingress-canary-qtd5f" May 28 08:02:00.977455 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:00.977405 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4hh68\"" May 28 08:02:00.978170 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:00.978157 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-47xg9\"" May 28 08:02:00.985686 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:00.985670 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-88fmq" May 28 08:02:00.985733 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:00.985690 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qtd5f" May 28 08:02:01.112262 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:01.112231 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qtd5f"] May 28 08:02:01.115510 ip-10-0-139-133 kubenswrapper[2560]: W0528 08:02:01.115473 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2d0b175_5e98_4b80_94e3_92a78b286c16.slice/crio-6701b7e031138260ea98479bc0f7ff75f8f196844eb9ea7404e39e3b4e13e2e1 WatchSource:0}: Error finding container 6701b7e031138260ea98479bc0f7ff75f8f196844eb9ea7404e39e3b4e13e2e1: Status 404 returned error can't find the container with id 6701b7e031138260ea98479bc0f7ff75f8f196844eb9ea7404e39e3b4e13e2e1 May 28 08:02:01.130697 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:01.130675 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-88fmq"] May 28 08:02:01.133143 ip-10-0-139-133 kubenswrapper[2560]: W0528 08:02:01.133119 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec820620_b736_430c_831d_5d2b97e83d32.slice/crio-0d2d47b12b6c2c034da539a4dfa998a7cdf8fff9d49011fc46d4bb4d00487182 WatchSource:0}: Error finding container 0d2d47b12b6c2c034da539a4dfa998a7cdf8fff9d49011fc46d4bb4d00487182: Status 404 returned error can't find the container with id 0d2d47b12b6c2c034da539a4dfa998a7cdf8fff9d49011fc46d4bb4d00487182 May 28 08:02:01.189866 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:01.189840 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-88fmq" event={"ID":"ec820620-b736-430c-831d-5d2b97e83d32","Type":"ContainerStarted","Data":"0d2d47b12b6c2c034da539a4dfa998a7cdf8fff9d49011fc46d4bb4d00487182"} May 28 08:02:01.190803 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:01.190783 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qtd5f" event={"ID":"b2d0b175-5e98-4b80-94e3-92a78b286c16","Type":"ContainerStarted","Data":"6701b7e031138260ea98479bc0f7ff75f8f196844eb9ea7404e39e3b4e13e2e1"} May 28 08:02:03.197671 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:03.197633 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-88fmq" event={"ID":"ec820620-b736-430c-831d-5d2b97e83d32","Type":"ContainerStarted","Data":"9ccd30c7b01439aa1d3535a606eed19f5b5403582196bbca2e87d6e8d1f0110b"} May 28 08:02:03.197671 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:03.197671 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-88fmq" event={"ID":"ec820620-b736-430c-831d-5d2b97e83d32","Type":"ContainerStarted","Data":"4fceef3c6bdae0d5a9747c630f0e874da9a81d0c96be87e18a21e642655806f8"} May 28 08:02:03.198144 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:03.197734 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-88fmq" May 28 08:02:03.199001 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:03.198974 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qtd5f" event={"ID":"b2d0b175-5e98-4b80-94e3-92a78b286c16","Type":"ContainerStarted","Data":"70fdf2b32ed2a006b033b0622da6524bfe40caba99593b081fca12d16de19806"} May 28 08:02:03.213305 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:03.213260 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-88fmq" podStartSLOduration=129.382438069 podStartE2EDuration="2m11.213248299s" podCreationTimestamp="2026-05-28 07:59:52 +0000 UTC" firstStartedPulling="2026-05-28 08:02:01.134742601 +0000 UTC m=+161.021188724" lastFinishedPulling="2026-05-28 08:02:02.965552834 +0000 UTC m=+162.851998954" observedRunningTime="2026-05-28 08:02:03.212281782 +0000 UTC m=+163.098727935" watchObservedRunningTime="2026-05-28 08:02:03.213248299 +0000 UTC m=+163.099694440" May 28 08:02:03.226156 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:03.226084 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-qtd5f" podStartSLOduration=129.374081942 podStartE2EDuration="2m11.22607213s" podCreationTimestamp="2026-05-28 07:59:52 +0000 UTC" firstStartedPulling="2026-05-28 08:02:01.117446583 +0000 UTC m=+161.003892702" lastFinishedPulling="2026-05-28 08:02:02.969436771 +0000 UTC m=+162.855882890" observedRunningTime="2026-05-28 08:02:03.22590695 +0000 UTC m=+163.112353091" watchObservedRunningTime="2026-05-28 08:02:03.22607213 +0000 UTC m=+163.112518263" May 28 08:02:03.620326 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:03.620295 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-jljsw"] May 28 08:02:03.623469 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:03.623450 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jljsw" May 28 08:02:03.627236 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:03.627217 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-j77x8\"" May 28 08:02:03.627496 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:03.627478 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 28 08:02:03.627601 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:03.627583 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 28 08:02:03.636906 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:03.636882 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jljsw"] May 28 08:02:03.715075 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:03.715042 2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8974698c9-jzf5f"] May 28 08:02:03.724972 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:03.724947 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5962f9ac-b4a6-472d-ba4c-dfc39932a8ca-crio-socket\") pod \"insights-runtime-extractor-jljsw\" (UID: \"5962f9ac-b4a6-472d-ba4c-dfc39932a8ca\") " pod="openshift-insights/insights-runtime-extractor-jljsw" May 28 08:02:03.725115 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:03.724977 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5962f9ac-b4a6-472d-ba4c-dfc39932a8ca-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jljsw\" (UID: \"5962f9ac-b4a6-472d-ba4c-dfc39932a8ca\") " pod="openshift-insights/insights-runtime-extractor-jljsw" May 28 08:02:03.725115 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:03.725058 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5962f9ac-b4a6-472d-ba4c-dfc39932a8ca-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jljsw\" (UID: \"5962f9ac-b4a6-472d-ba4c-dfc39932a8ca\") " pod="openshift-insights/insights-runtime-extractor-jljsw" May 28 08:02:03.725209 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:03.725140 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stwfg\" (UniqueName: \"kubernetes.io/projected/5962f9ac-b4a6-472d-ba4c-dfc39932a8ca-kube-api-access-stwfg\") pod \"insights-runtime-extractor-jljsw\" (UID: \"5962f9ac-b4a6-472d-ba4c-dfc39932a8ca\") " pod="openshift-insights/insights-runtime-extractor-jljsw" May 28 08:02:03.725209 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:03.725181 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5962f9ac-b4a6-472d-ba4c-dfc39932a8ca-data-volume\") pod \"insights-runtime-extractor-jljsw\" (UID: \"5962f9ac-b4a6-472d-ba4c-dfc39932a8ca\") " pod="openshift-insights/insights-runtime-extractor-jljsw" May 28 08:02:03.826238 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:03.826202 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-stwfg\" (UniqueName: \"kubernetes.io/projected/5962f9ac-b4a6-472d-ba4c-dfc39932a8ca-kube-api-access-stwfg\") pod \"insights-runtime-extractor-jljsw\" (UID: \"5962f9ac-b4a6-472d-ba4c-dfc39932a8ca\") " pod="openshift-insights/insights-runtime-extractor-jljsw" May 28 08:02:03.826238 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:03.826243 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5962f9ac-b4a6-472d-ba4c-dfc39932a8ca-data-volume\") pod \"insights-runtime-extractor-jljsw\" (UID: \"5962f9ac-b4a6-472d-ba4c-dfc39932a8ca\") " pod="openshift-insights/insights-runtime-extractor-jljsw" May 28 08:02:03.826484 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:03.826272 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5962f9ac-b4a6-472d-ba4c-dfc39932a8ca-crio-socket\") pod \"insights-runtime-extractor-jljsw\" (UID: \"5962f9ac-b4a6-472d-ba4c-dfc39932a8ca\") " pod="openshift-insights/insights-runtime-extractor-jljsw" May 28 08:02:03.826484 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:03.826295 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5962f9ac-b4a6-472d-ba4c-dfc39932a8ca-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jljsw\" (UID: \"5962f9ac-b4a6-472d-ba4c-dfc39932a8ca\") " pod="openshift-insights/insights-runtime-extractor-jljsw" May 28 08:02:03.826484 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:03.826353 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5962f9ac-b4a6-472d-ba4c-dfc39932a8ca-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jljsw\" (UID: \"5962f9ac-b4a6-472d-ba4c-dfc39932a8ca\") " pod="openshift-insights/insights-runtime-extractor-jljsw" May 28 08:02:03.826484 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:03.826365 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5962f9ac-b4a6-472d-ba4c-dfc39932a8ca-crio-socket\") pod \"insights-runtime-extractor-jljsw\" (UID: \"5962f9ac-b4a6-472d-ba4c-dfc39932a8ca\") " pod="openshift-insights/insights-runtime-extractor-jljsw" May 28 08:02:03.826682 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:03.826646 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5962f9ac-b4a6-472d-ba4c-dfc39932a8ca-data-volume\") pod \"insights-runtime-extractor-jljsw\" (UID: \"5962f9ac-b4a6-472d-ba4c-dfc39932a8ca\") " pod="openshift-insights/insights-runtime-extractor-jljsw" May 28 08:02:03.826855 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:03.826839 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5962f9ac-b4a6-472d-ba4c-dfc39932a8ca-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jljsw\" (UID: \"5962f9ac-b4a6-472d-ba4c-dfc39932a8ca\") " pod="openshift-insights/insights-runtime-extractor-jljsw" May 28 08:02:03.828641 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:03.828617 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5962f9ac-b4a6-472d-ba4c-dfc39932a8ca-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jljsw\" (UID: \"5962f9ac-b4a6-472d-ba4c-dfc39932a8ca\") " pod="openshift-insights/insights-runtime-extractor-jljsw" May 28 08:02:03.834784 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:03.834763 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-stwfg\" (UniqueName: \"kubernetes.io/projected/5962f9ac-b4a6-472d-ba4c-dfc39932a8ca-kube-api-access-stwfg\") pod \"insights-runtime-extractor-jljsw\" (UID: \"5962f9ac-b4a6-472d-ba4c-dfc39932a8ca\") " pod="openshift-insights/insights-runtime-extractor-jljsw" May 28 08:02:03.933011 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:03.932940 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jljsw" May 28 08:02:04.069711 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:04.069683 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jljsw"] May 28 08:02:04.072748 ip-10-0-139-133 kubenswrapper[2560]: W0528 08:02:04.072711 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5962f9ac_b4a6_472d_ba4c_dfc39932a8ca.slice/crio-9353ba0c6657dc1428c660f0d76bad875c4b9f7bdc2ce2b186c59a8dc396ee50 WatchSource:0}: Error finding container 9353ba0c6657dc1428c660f0d76bad875c4b9f7bdc2ce2b186c59a8dc396ee50: Status 404 returned error can't find the container with id 9353ba0c6657dc1428c660f0d76bad875c4b9f7bdc2ce2b186c59a8dc396ee50 May 28 08:02:04.203907 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:04.203816 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jljsw" event={"ID":"5962f9ac-b4a6-472d-ba4c-dfc39932a8ca","Type":"ContainerStarted","Data":"1ff92377f0e9dd63b93b4ea19c13bfe8cabd6fa79f1135ab356f22a289ebd8ad"} May 28 08:02:04.203907 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:04.203861 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jljsw" event={"ID":"5962f9ac-b4a6-472d-ba4c-dfc39932a8ca","Type":"ContainerStarted","Data":"9353ba0c6657dc1428c660f0d76bad875c4b9f7bdc2ce2b186c59a8dc396ee50"} May 28 08:02:05.207838 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:05.207805 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jljsw" event={"ID":"5962f9ac-b4a6-472d-ba4c-dfc39932a8ca","Type":"ContainerStarted","Data":"2aa0aff4185e9f1f728ce6c421826299ee1887d9cc3cd6576e93688cc1dc7a89"} May 28 08:02:06.212053 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:06.212025 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jljsw" event={"ID":"5962f9ac-b4a6-472d-ba4c-dfc39932a8ca","Type":"ContainerStarted","Data":"b56e8c0d30504a4d70b72c5629a534482fd153adac5fa0f8473fbbb1e0db1ae3"} May 28 08:02:06.226997 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:06.226951 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-jljsw" podStartSLOduration=1.364047263 podStartE2EDuration="3.226936312s" podCreationTimestamp="2026-05-28 08:02:03 +0000 UTC" firstStartedPulling="2026-05-28 08:02:04.125516629 +0000 UTC m=+164.011962757" lastFinishedPulling="2026-05-28 08:02:05.988405682 +0000 UTC m=+165.874851806" observedRunningTime="2026-05-28 08:02:06.226681331 +0000 UTC m=+166.113127473" watchObservedRunningTime="2026-05-28 08:02:06.226936312 +0000 UTC m=+166.113382454" May 28 08:02:10.730215 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:10.730180 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z5j9k" May 28 08:02:12.136467 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:12.136434 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-k25kx"] May 28 08:02:12.140629 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:12.140609 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-k25kx" May 28 08:02:12.142576 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:12.142545 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" May 28 08:02:12.142671 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:12.142649 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-d7p7b\"" May 28 08:02:12.145859 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:12.145836 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-k25kx"] May 28 08:02:12.288646 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:12.288615 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e7a52ad6-1c8d-48b9-bfb6-6ecf2c697e78-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-k25kx\" (UID: \"e7a52ad6-1c8d-48b9-bfb6-6ecf2c697e78\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-k25kx" May 28 08:02:12.389556 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:12.389492 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e7a52ad6-1c8d-48b9-bfb6-6ecf2c697e78-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-k25kx\" (UID: \"e7a52ad6-1c8d-48b9-bfb6-6ecf2c697e78\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-k25kx" May 28 08:02:12.391808 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:12.391780 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e7a52ad6-1c8d-48b9-bfb6-6ecf2c697e78-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-k25kx\" (UID: \"e7a52ad6-1c8d-48b9-bfb6-6ecf2c697e78\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-k25kx" May 28 08:02:12.450768 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:12.450745 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-k25kx" May 28 08:02:12.568107 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:12.568080 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-k25kx"] May 28 08:02:12.571457 ip-10-0-139-133 kubenswrapper[2560]: W0528 08:02:12.571417 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7a52ad6_1c8d_48b9_bfb6_6ecf2c697e78.slice/crio-0c00bdcd2ed5635ab4ac1f9a17b8afce07b65b68d723d49ac8ed2a31608e454d WatchSource:0}: Error finding container 0c00bdcd2ed5635ab4ac1f9a17b8afce07b65b68d723d49ac8ed2a31608e454d: Status 404 returned error can't find the container with id 0c00bdcd2ed5635ab4ac1f9a17b8afce07b65b68d723d49ac8ed2a31608e454d May 28 08:02:13.042124 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:13.042097 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f46d7bcb7-ks98h"] May 28 08:02:13.044984 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:13.044965 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f46d7bcb7-ks98h" May 28 08:02:13.047083 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:13.047063 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" May 28 08:02:13.047250 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:13.047231 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" May 28 08:02:13.047325 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:13.047264 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-dfc4r\"" May 28 08:02:13.047366 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:13.047263 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" May 28 08:02:13.047858 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:13.047822 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" May 28 08:02:13.047950 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:13.047923 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" May 28 08:02:13.048008 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:13.047980 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" May 28 08:02:13.048057 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:13.048028 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" May 28 08:02:13.055278 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:13.055259 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f46d7bcb7-ks98h"] May 28 08:02:13.196197 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:13.196167 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/29a39155-7c9d-4586-b9a9-4100c8564934-oauth-serving-cert\") pod \"console-5f46d7bcb7-ks98h\" (UID: \"29a39155-7c9d-4586-b9a9-4100c8564934\") " pod="openshift-console/console-5f46d7bcb7-ks98h" May 28 08:02:13.196612 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:13.196202 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2xtm\" (UniqueName: \"kubernetes.io/projected/29a39155-7c9d-4586-b9a9-4100c8564934-kube-api-access-n2xtm\") pod \"console-5f46d7bcb7-ks98h\" (UID: \"29a39155-7c9d-4586-b9a9-4100c8564934\") " pod="openshift-console/console-5f46d7bcb7-ks98h" May 28 08:02:13.196612 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:13.196237 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/29a39155-7c9d-4586-b9a9-4100c8564934-console-oauth-config\") pod \"console-5f46d7bcb7-ks98h\" (UID: \"29a39155-7c9d-4586-b9a9-4100c8564934\") " pod="openshift-console/console-5f46d7bcb7-ks98h" May 28 08:02:13.196612 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:13.196291 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/29a39155-7c9d-4586-b9a9-4100c8564934-console-serving-cert\") pod \"console-5f46d7bcb7-ks98h\" (UID: \"29a39155-7c9d-4586-b9a9-4100c8564934\") " pod="openshift-console/console-5f46d7bcb7-ks98h" May 28 08:02:13.196612 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:13.196325 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/29a39155-7c9d-4586-b9a9-4100c8564934-console-config\") pod \"console-5f46d7bcb7-ks98h\" (UID: \"29a39155-7c9d-4586-b9a9-4100c8564934\") " pod="openshift-console/console-5f46d7bcb7-ks98h" May 28 08:02:13.196612 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:13.196353 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/29a39155-7c9d-4586-b9a9-4100c8564934-service-ca\") pod \"console-5f46d7bcb7-ks98h\" (UID: \"29a39155-7c9d-4586-b9a9-4100c8564934\") " pod="openshift-console/console-5f46d7bcb7-ks98h" May 28 08:02:13.205695 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:13.205676 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-88fmq" May 28 08:02:13.233871 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:13.233838 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-k25kx" event={"ID":"e7a52ad6-1c8d-48b9-bfb6-6ecf2c697e78","Type":"ContainerStarted","Data":"0c00bdcd2ed5635ab4ac1f9a17b8afce07b65b68d723d49ac8ed2a31608e454d"} May 28 08:02:13.297285 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:13.297244 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/29a39155-7c9d-4586-b9a9-4100c8564934-oauth-serving-cert\") pod \"console-5f46d7bcb7-ks98h\" (UID: \"29a39155-7c9d-4586-b9a9-4100c8564934\") " pod="openshift-console/console-5f46d7bcb7-ks98h" May 28 08:02:13.297435 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:13.297293 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n2xtm\" (UniqueName: \"kubernetes.io/projected/29a39155-7c9d-4586-b9a9-4100c8564934-kube-api-access-n2xtm\") pod \"console-5f46d7bcb7-ks98h\" (UID: \"29a39155-7c9d-4586-b9a9-4100c8564934\") " pod="openshift-console/console-5f46d7bcb7-ks98h" May 28 08:02:13.297435 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:13.297343 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/29a39155-7c9d-4586-b9a9-4100c8564934-console-oauth-config\") pod \"console-5f46d7bcb7-ks98h\" (UID: \"29a39155-7c9d-4586-b9a9-4100c8564934\") " pod="openshift-console/console-5f46d7bcb7-ks98h" May 28 08:02:13.297435 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:13.297376 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/29a39155-7c9d-4586-b9a9-4100c8564934-console-serving-cert\") pod \"console-5f46d7bcb7-ks98h\" (UID: \"29a39155-7c9d-4586-b9a9-4100c8564934\") " pod="openshift-console/console-5f46d7bcb7-ks98h" May 28 08:02:13.297435 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:13.297405 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/29a39155-7c9d-4586-b9a9-4100c8564934-console-config\") pod \"console-5f46d7bcb7-ks98h\" (UID: \"29a39155-7c9d-4586-b9a9-4100c8564934\") " pod="openshift-console/console-5f46d7bcb7-ks98h" May 28 08:02:13.297435 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:13.297433 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/29a39155-7c9d-4586-b9a9-4100c8564934-service-ca\") pod \"console-5f46d7bcb7-ks98h\" (UID: \"29a39155-7c9d-4586-b9a9-4100c8564934\") " pod="openshift-console/console-5f46d7bcb7-ks98h" May 28 08:02:13.298038 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:13.298011 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/29a39155-7c9d-4586-b9a9-4100c8564934-oauth-serving-cert\") pod \"console-5f46d7bcb7-ks98h\" (UID: \"29a39155-7c9d-4586-b9a9-4100c8564934\") " pod="openshift-console/console-5f46d7bcb7-ks98h" May 28 08:02:13.298235 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:13.298217 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/29a39155-7c9d-4586-b9a9-4100c8564934-service-ca\") pod \"console-5f46d7bcb7-ks98h\" (UID: \"29a39155-7c9d-4586-b9a9-4100c8564934\") " pod="openshift-console/console-5f46d7bcb7-ks98h" May 28 08:02:13.298318 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:13.298247 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/29a39155-7c9d-4586-b9a9-4100c8564934-console-config\") pod \"console-5f46d7bcb7-ks98h\" (UID: \"29a39155-7c9d-4586-b9a9-4100c8564934\") " pod="openshift-console/console-5f46d7bcb7-ks98h" May 28 08:02:13.300336 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:13.300316 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/29a39155-7c9d-4586-b9a9-4100c8564934-console-serving-cert\") pod \"console-5f46d7bcb7-ks98h\" (UID: \"29a39155-7c9d-4586-b9a9-4100c8564934\") " pod="openshift-console/console-5f46d7bcb7-ks98h" May 28 08:02:13.300501 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:13.300483 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/29a39155-7c9d-4586-b9a9-4100c8564934-console-oauth-config\") pod \"console-5f46d7bcb7-ks98h\" (UID: \"29a39155-7c9d-4586-b9a9-4100c8564934\") " pod="openshift-console/console-5f46d7bcb7-ks98h" May 28 08:02:13.304708 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:13.304691 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2xtm\" (UniqueName: \"kubernetes.io/projected/29a39155-7c9d-4586-b9a9-4100c8564934-kube-api-access-n2xtm\") pod \"console-5f46d7bcb7-ks98h\" (UID: \"29a39155-7c9d-4586-b9a9-4100c8564934\") " pod="openshift-console/console-5f46d7bcb7-ks98h" May 28 08:02:13.356281 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:13.356252 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f46d7bcb7-ks98h" May 28 08:02:13.692153 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:13.692129 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f46d7bcb7-ks98h"] May 28 08:02:13.695334 ip-10-0-139-133 kubenswrapper[2560]: W0528 08:02:13.695302 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29a39155_7c9d_4586_b9a9_4100c8564934.slice/crio-235e93a9c0efc8b30d535cbba60619f2e2ec57d41488da6657d42748ab8cd204 WatchSource:0}: Error finding container 235e93a9c0efc8b30d535cbba60619f2e2ec57d41488da6657d42748ab8cd204: Status 404 returned error can't find the container with id 235e93a9c0efc8b30d535cbba60619f2e2ec57d41488da6657d42748ab8cd204 May 28 08:02:13.719782 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:13.719751 2560 patch_prober.go:28] interesting pod/image-registry-8974698c9-jzf5f container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 28 08:02:13.719904 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:13.719806 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-8974698c9-jzf5f" podUID="64c31255-a020-4e2b-9a33-942aa1476d99" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 28 08:02:14.238756 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:14.238698 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-k25kx" event={"ID":"e7a52ad6-1c8d-48b9-bfb6-6ecf2c697e78","Type":"ContainerStarted","Data":"4884e54ed937faef541e6e4f84ec4cc04dcc711fc5694946053531d7669c02df"} May 28 08:02:14.239200 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:14.239088 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-k25kx" May 28 08:02:14.240409 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:14.240377 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f46d7bcb7-ks98h" event={"ID":"29a39155-7c9d-4586-b9a9-4100c8564934","Type":"ContainerStarted","Data":"235e93a9c0efc8b30d535cbba60619f2e2ec57d41488da6657d42748ab8cd204"} May 28 08:02:14.243998 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:14.243973 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-k25kx" May 28 08:02:14.253127 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:14.252904 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-k25kx" podStartSLOduration=1.207854781 podStartE2EDuration="2.252888127s" podCreationTimestamp="2026-05-28 08:02:12 +0000 UTC" firstStartedPulling="2026-05-28 08:02:12.573717868 +0000 UTC m=+172.460163988" lastFinishedPulling="2026-05-28 08:02:13.618751211 +0000 UTC m=+173.505197334" observedRunningTime="2026-05-28 08:02:14.252510751 +0000 UTC m=+174.138956895" watchObservedRunningTime="2026-05-28 08:02:14.252888127 +0000 UTC m=+174.139334269" May 28 08:02:15.198783 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:15.198748 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-fj7c6"] May 28 08:02:15.239659 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:15.239630 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-fj7c6"] May 28 08:02:15.240082 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:15.239766 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-fj7c6" May 28 08:02:15.242417 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:15.242370 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 28 08:02:15.242588 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:15.242370 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" May 28 08:02:15.242588 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:15.242373 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 28 08:02:15.243288 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:15.243260 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 28 08:02:15.243404 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:15.243304 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-6cb2t\"" May 28 08:02:15.243476 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:15.243457 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" May 28 08:02:15.415964 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:15.415937 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/252b1185-7763-4dfb-a085-3d39c277b38b-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-fj7c6\" (UID: \"252b1185-7763-4dfb-a085-3d39c277b38b\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-fj7c6" May 28 08:02:15.416114 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:15.415973 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/252b1185-7763-4dfb-a085-3d39c277b38b-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-fj7c6\" (UID: \"252b1185-7763-4dfb-a085-3d39c277b38b\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-fj7c6" May 28 08:02:15.416114 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:15.416067 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j84xj\" (UniqueName: \"kubernetes.io/projected/252b1185-7763-4dfb-a085-3d39c277b38b-kube-api-access-j84xj\") pod \"prometheus-operator-7779bbdd78-fj7c6\" (UID: \"252b1185-7763-4dfb-a085-3d39c277b38b\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-fj7c6" May 28 08:02:15.416114 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:15.416111 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/252b1185-7763-4dfb-a085-3d39c277b38b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-fj7c6\" (UID: \"252b1185-7763-4dfb-a085-3d39c277b38b\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-fj7c6" May 28 08:02:15.517128 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:15.517049 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/252b1185-7763-4dfb-a085-3d39c277b38b-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-fj7c6\" (UID: \"252b1185-7763-4dfb-a085-3d39c277b38b\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-fj7c6" May 28 08:02:15.517128 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:15.517095 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/252b1185-7763-4dfb-a085-3d39c277b38b-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-fj7c6\" (UID: \"252b1185-7763-4dfb-a085-3d39c277b38b\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-fj7c6" May 28 08:02:15.517335 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:15.517155 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j84xj\" (UniqueName: \"kubernetes.io/projected/252b1185-7763-4dfb-a085-3d39c277b38b-kube-api-access-j84xj\") pod \"prometheus-operator-7779bbdd78-fj7c6\" (UID: \"252b1185-7763-4dfb-a085-3d39c277b38b\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-fj7c6" May 28 08:02:15.517335 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:15.517191 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/252b1185-7763-4dfb-a085-3d39c277b38b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-fj7c6\" (UID: \"252b1185-7763-4dfb-a085-3d39c277b38b\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-fj7c6" May 28 08:02:15.517867 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:15.517821 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/252b1185-7763-4dfb-a085-3d39c277b38b-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-fj7c6\" (UID: \"252b1185-7763-4dfb-a085-3d39c277b38b\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-fj7c6" May 28 08:02:15.519866 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:15.519844 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/252b1185-7763-4dfb-a085-3d39c277b38b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-fj7c6\" (UID: \"252b1185-7763-4dfb-a085-3d39c277b38b\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-fj7c6" May 28 08:02:15.519985 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:15.519879 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/252b1185-7763-4dfb-a085-3d39c277b38b-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-fj7c6\" (UID: \"252b1185-7763-4dfb-a085-3d39c277b38b\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-fj7c6" May 28 08:02:15.525401 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:15.525359 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j84xj\" (UniqueName: \"kubernetes.io/projected/252b1185-7763-4dfb-a085-3d39c277b38b-kube-api-access-j84xj\") pod \"prometheus-operator-7779bbdd78-fj7c6\" (UID: \"252b1185-7763-4dfb-a085-3d39c277b38b\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-fj7c6" May 28 08:02:15.551298 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:15.551275 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-fj7c6" May 28 08:02:16.614013 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:16.613991 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-fj7c6"] May 28 08:02:16.616167 ip-10-0-139-133 kubenswrapper[2560]: W0528 08:02:16.616132 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod252b1185_7763_4dfb_a085_3d39c277b38b.slice/crio-298aaa9ae2f2f9af1f84ffdfc8d8acc87ce5108ac1d99ed22466f78e3f734443 WatchSource:0}: Error finding container 298aaa9ae2f2f9af1f84ffdfc8d8acc87ce5108ac1d99ed22466f78e3f734443: Status 404 returned error can't find the container with id 298aaa9ae2f2f9af1f84ffdfc8d8acc87ce5108ac1d99ed22466f78e3f734443 May 28 08:02:17.249442 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:17.249406 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f46d7bcb7-ks98h" event={"ID":"29a39155-7c9d-4586-b9a9-4100c8564934","Type":"ContainerStarted","Data":"f63dafb390357db3c6a5adfd0ca37d4806f32e1abe071859b5a73e0dcf2b3e1d"} May 28 08:02:17.250457 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:17.250434 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-fj7c6" event={"ID":"252b1185-7763-4dfb-a085-3d39c277b38b","Type":"ContainerStarted","Data":"298aaa9ae2f2f9af1f84ffdfc8d8acc87ce5108ac1d99ed22466f78e3f734443"} May 28 08:02:17.265738 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:17.265703 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-5f46d7bcb7-ks98h" podStartSLOduration=1.437165682 podStartE2EDuration="4.265692312s" podCreationTimestamp="2026-05-28 08:02:13 +0000 UTC" firstStartedPulling="2026-05-28 08:02:13.69720774 +0000 UTC m=+173.583653859" lastFinishedPulling="2026-05-28 08:02:16.52573437 +0000 UTC m=+176.412180489" observedRunningTime="2026-05-28 08:02:17.265268811 +0000 UTC m=+177.151714963" watchObservedRunningTime="2026-05-28 08:02:17.265692312 +0000 UTC m=+177.152138454" May 28 08:02:18.254376 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:18.254348 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-fj7c6" event={"ID":"252b1185-7763-4dfb-a085-3d39c277b38b","Type":"ContainerStarted","Data":"dec0c41f6277380496d52455ca4492979bfe08a47d57f2cefe2dbf2e463bc786"} May 28 08:02:19.258020 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:19.257984 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-fj7c6" event={"ID":"252b1185-7763-4dfb-a085-3d39c277b38b","Type":"ContainerStarted","Data":"96ff390ee01957e9e084effabc8d49e20b8d1d1c972b0b5ae1215171bd9f295b"} May 28 08:02:19.273618 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:19.273576 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7779bbdd78-fj7c6" podStartSLOduration=2.715106342 podStartE2EDuration="4.273549014s" podCreationTimestamp="2026-05-28 08:02:15 +0000 UTC" firstStartedPulling="2026-05-28 08:02:16.61798454 +0000 UTC m=+176.504430660" lastFinishedPulling="2026-05-28 08:02:18.176427199 +0000 UTC m=+178.062873332" observedRunningTime="2026-05-28 08:02:19.272653353 +0000 UTC m=+179.159099495" watchObservedRunningTime="2026-05-28 08:02:19.273549014 +0000 UTC m=+179.159995156" May 28 08:02:21.587804 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:21.587770 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-s5rl8"] May 28 08:02:21.590453 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:21.590431 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-hq5w7"] May 28 08:02:21.590611 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:21.590592 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-s5rl8" May 28 08:02:21.592372 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:21.592351 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hq5w7" May 28 08:02:21.593305 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:21.593284 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" May 28 08:02:21.595047 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:21.595032 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 28 08:02:21.595142 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:21.595050 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" May 28 08:02:21.595394 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:21.595376 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" May 28 08:02:21.595582 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:21.595552 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-bks6g\"" May 28 08:02:21.596172 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:21.596157 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 28 08:02:21.596273 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:21.596188 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-2rzqd\"" May 28 08:02:21.596528 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:21.596515 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 28 08:02:21.614039 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:21.614020 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-s5rl8"] May 28 08:02:21.666031 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:21.666005 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/19937927-46d3-457b-b9f4-119c9bebd1bd-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-s5rl8\" (UID: \"19937927-46d3-457b-b9f4-119c9bebd1bd\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-s5rl8" May 28 08:02:21.666031 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:21.666031 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/19937927-46d3-457b-b9f4-119c9bebd1bd-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-s5rl8\" (UID: \"19937927-46d3-457b-b9f4-119c9bebd1bd\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-s5rl8" May 28 08:02:21.666163 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:21.666056 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f3ef8cef-7a24-445a-97b0-f3e21e088bc0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hq5w7\" (UID: \"f3ef8cef-7a24-445a-97b0-f3e21e088bc0\") " pod="openshift-monitoring/node-exporter-hq5w7" May 28 08:02:21.666163 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:21.666075 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/19937927-46d3-457b-b9f4-119c9bebd1bd-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-s5rl8\" (UID: \"19937927-46d3-457b-b9f4-119c9bebd1bd\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-s5rl8" May 28 08:02:21.666163 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:21.666120 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2n94\" (UniqueName: \"kubernetes.io/projected/f3ef8cef-7a24-445a-97b0-f3e21e088bc0-kube-api-access-g2n94\") pod \"node-exporter-hq5w7\" (UID: \"f3ef8cef-7a24-445a-97b0-f3e21e088bc0\") " pod="openshift-monitoring/node-exporter-hq5w7" May 28 08:02:21.666265 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:21.666171 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f3ef8cef-7a24-445a-97b0-f3e21e088bc0-sys\") pod \"node-exporter-hq5w7\" (UID: \"f3ef8cef-7a24-445a-97b0-f3e21e088bc0\") " pod="openshift-monitoring/node-exporter-hq5w7" May 28 08:02:21.666265 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:21.666201 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f3ef8cef-7a24-445a-97b0-f3e21e088bc0-node-exporter-textfile\") pod \"node-exporter-hq5w7\" (UID: \"f3ef8cef-7a24-445a-97b0-f3e21e088bc0\") " pod="openshift-monitoring/node-exporter-hq5w7" May 28 08:02:21.666265 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:21.666226 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/19937927-46d3-457b-b9f4-119c9bebd1bd-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-s5rl8\" (UID: \"19937927-46d3-457b-b9f4-119c9bebd1bd\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-s5rl8" May 28 08:02:21.666265 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:21.666263 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pp49w\" (UniqueName: \"kubernetes.io/projected/19937927-46d3-457b-b9f4-119c9bebd1bd-kube-api-access-pp49w\") pod \"kube-state-metrics-54fd6bc5c4-s5rl8\" (UID: \"19937927-46d3-457b-b9f4-119c9bebd1bd\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-s5rl8" May 28 08:02:21.666396 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:21.666279 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f3ef8cef-7a24-445a-97b0-f3e21e088bc0-metrics-client-ca\") pod \"node-exporter-hq5w7\" (UID: \"f3ef8cef-7a24-445a-97b0-f3e21e088bc0\") " pod="openshift-monitoring/node-exporter-hq5w7" May 28 08:02:21.666396 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:21.666301 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/19937927-46d3-457b-b9f4-119c9bebd1bd-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-s5rl8\" (UID: \"19937927-46d3-457b-b9f4-119c9bebd1bd\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-s5rl8" May 28 08:02:21.666396 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:21.666326 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f3ef8cef-7a24-445a-97b0-f3e21e088bc0-node-exporter-tls\") pod \"node-exporter-hq5w7\" (UID: \"f3ef8cef-7a24-445a-97b0-f3e21e088bc0\") " pod="openshift-monitoring/node-exporter-hq5w7" May 28 08:02:21.666396 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:21.666347 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f3ef8cef-7a24-445a-97b0-f3e21e088bc0-node-exporter-wtmp\") pod \"node-exporter-hq5w7\" (UID: \"f3ef8cef-7a24-445a-97b0-f3e21e088bc0\") " pod="openshift-monitoring/node-exporter-hq5w7" May 28 08:02:21.666396 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:21.666365 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f3ef8cef-7a24-445a-97b0-f3e21e088bc0-node-exporter-accelerators-collector-config\") pod \"node-exporter-hq5w7\" (UID: \"f3ef8cef-7a24-445a-97b0-f3e21e088bc0\") " pod="openshift-monitoring/node-exporter-hq5w7" May 28 08:02:21.666396 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:21.666381 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f3ef8cef-7a24-445a-97b0-f3e21e088bc0-root\") pod \"node-exporter-hq5w7\" (UID: \"f3ef8cef-7a24-445a-97b0-f3e21e088bc0\") " pod="openshift-monitoring/node-exporter-hq5w7" May 28 08:02:21.766988 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:21.766960 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/19937927-46d3-457b-b9f4-119c9bebd1bd-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-s5rl8\" (UID: \"19937927-46d3-457b-b9f4-119c9bebd1bd\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-s5rl8" May 28 08:02:21.767119 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:21.767007 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pp49w\" (UniqueName: \"kubernetes.io/projected/19937927-46d3-457b-b9f4-119c9bebd1bd-kube-api-access-pp49w\") pod \"kube-state-metrics-54fd6bc5c4-s5rl8\" (UID: \"19937927-46d3-457b-b9f4-119c9bebd1bd\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-s5rl8" May 28 08:02:21.767119 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:21.767045 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f3ef8cef-7a24-445a-97b0-f3e21e088bc0-metrics-client-ca\") pod \"node-exporter-hq5w7\" (UID: \"f3ef8cef-7a24-445a-97b0-f3e21e088bc0\") " pod="openshift-monitoring/node-exporter-hq5w7" May 28 08:02:21.767119 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:21.767071 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/19937927-46d3-457b-b9f4-119c9bebd1bd-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-s5rl8\" (UID: \"19937927-46d3-457b-b9f4-119c9bebd1bd\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-s5rl8" May 28 08:02:21.767119 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:21.767097 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f3ef8cef-7a24-445a-97b0-f3e21e088bc0-node-exporter-tls\") pod \"node-exporter-hq5w7\" (UID: \"f3ef8cef-7a24-445a-97b0-f3e21e088bc0\") " pod="openshift-monitoring/node-exporter-hq5w7" May 28 08:02:21.767322 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:21.767119 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f3ef8cef-7a24-445a-97b0-f3e21e088bc0-node-exporter-wtmp\") pod \"node-exporter-hq5w7\" (UID: \"f3ef8cef-7a24-445a-97b0-f3e21e088bc0\") " pod="openshift-monitoring/node-exporter-hq5w7" May 28 08:02:21.767322 ip-10-0-139-133 kubenswrapper[2560]: E0528 08:02:21.767204 2560 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found May 28 08:02:21.767322 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:21.767261 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f3ef8cef-7a24-445a-97b0-f3e21e088bc0-node-exporter-wtmp\") pod \"node-exporter-hq5w7\" (UID: \"f3ef8cef-7a24-445a-97b0-f3e21e088bc0\") " pod="openshift-monitoring/node-exporter-hq5w7" May 28 08:02:21.767322 ip-10-0-139-133 kubenswrapper[2560]: E0528 08:02:21.767276 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3ef8cef-7a24-445a-97b0-f3e21e088bc0-node-exporter-tls podName:f3ef8cef-7a24-445a-97b0-f3e21e088bc0 nodeName:}" failed. No retries permitted until 2026-05-28 08:02:22.267253512 +0000 UTC m=+182.153699658 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/f3ef8cef-7a24-445a-97b0-f3e21e088bc0-node-exporter-tls") pod "node-exporter-hq5w7" (UID: "f3ef8cef-7a24-445a-97b0-f3e21e088bc0") : secret "node-exporter-tls" not found May 28 08:02:21.767322 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:21.767301 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f3ef8cef-7a24-445a-97b0-f3e21e088bc0-node-exporter-accelerators-collector-config\") pod \"node-exporter-hq5w7\" (UID: \"f3ef8cef-7a24-445a-97b0-f3e21e088bc0\") " pod="openshift-monitoring/node-exporter-hq5w7" May 28 08:02:21.767612 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:21.767336 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f3ef8cef-7a24-445a-97b0-f3e21e088bc0-root\") pod \"node-exporter-hq5w7\" (UID: \"f3ef8cef-7a24-445a-97b0-f3e21e088bc0\") " pod="openshift-monitoring/node-exporter-hq5w7" May 28 08:02:21.767612 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:21.767376 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/19937927-46d3-457b-b9f4-119c9bebd1bd-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-s5rl8\" (UID: \"19937927-46d3-457b-b9f4-119c9bebd1bd\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-s5rl8" May 28 08:02:21.767612 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:21.767407 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/19937927-46d3-457b-b9f4-119c9bebd1bd-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-s5rl8\" (UID: \"19937927-46d3-457b-b9f4-119c9bebd1bd\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-s5rl8" May 28 08:02:21.767612 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:21.767434 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f3ef8cef-7a24-445a-97b0-f3e21e088bc0-root\") pod \"node-exporter-hq5w7\" (UID: \"f3ef8cef-7a24-445a-97b0-f3e21e088bc0\") " pod="openshift-monitoring/node-exporter-hq5w7" May 28 08:02:21.767612 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:21.767456 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f3ef8cef-7a24-445a-97b0-f3e21e088bc0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hq5w7\" (UID: \"f3ef8cef-7a24-445a-97b0-f3e21e088bc0\") " pod="openshift-monitoring/node-exporter-hq5w7" May 28 08:02:21.767612 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:21.767493 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/19937927-46d3-457b-b9f4-119c9bebd1bd-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-s5rl8\" (UID: \"19937927-46d3-457b-b9f4-119c9bebd1bd\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-s5rl8" May 28 08:02:21.767612 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:21.767528 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g2n94\" (UniqueName: \"kubernetes.io/projected/f3ef8cef-7a24-445a-97b0-f3e21e088bc0-kube-api-access-g2n94\") pod \"node-exporter-hq5w7\" (UID: \"f3ef8cef-7a24-445a-97b0-f3e21e088bc0\") " pod="openshift-monitoring/node-exporter-hq5w7" May 28 08:02:21.767612 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:21.767596 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f3ef8cef-7a24-445a-97b0-f3e21e088bc0-sys\") pod \"node-exporter-hq5w7\" (UID: \"f3ef8cef-7a24-445a-97b0-f3e21e088bc0\") " pod="openshift-monitoring/node-exporter-hq5w7" May 28 08:02:21.767993 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:21.767646 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f3ef8cef-7a24-445a-97b0-f3e21e088bc0-node-exporter-textfile\") pod \"node-exporter-hq5w7\" (UID: \"f3ef8cef-7a24-445a-97b0-f3e21e088bc0\") " pod="openshift-monitoring/node-exporter-hq5w7" May 28 08:02:21.767993 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:21.767793 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f3ef8cef-7a24-445a-97b0-f3e21e088bc0-metrics-client-ca\") pod \"node-exporter-hq5w7\" (UID: \"f3ef8cef-7a24-445a-97b0-f3e21e088bc0\") " pod="openshift-monitoring/node-exporter-hq5w7" May 28 08:02:21.767993 ip-10-0-139-133 kubenswrapper[2560]: E0528 08:02:21.767531 2560 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found May 28 08:02:21.767993 ip-10-0-139-133 kubenswrapper[2560]: E0528 08:02:21.767881 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19937927-46d3-457b-b9f4-119c9bebd1bd-kube-state-metrics-tls podName:19937927-46d3-457b-b9f4-119c9bebd1bd nodeName:}" failed. No retries permitted until 2026-05-28 08:02:22.267860659 +0000 UTC m=+182.154306794 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/19937927-46d3-457b-b9f4-119c9bebd1bd-kube-state-metrics-tls") pod "kube-state-metrics-54fd6bc5c4-s5rl8" (UID: "19937927-46d3-457b-b9f4-119c9bebd1bd") : secret "kube-state-metrics-tls" not found May 28 08:02:21.767993 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:21.767881 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/19937927-46d3-457b-b9f4-119c9bebd1bd-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-s5rl8\" (UID: \"19937927-46d3-457b-b9f4-119c9bebd1bd\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-s5rl8" May 28 08:02:21.767993 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:21.767941 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f3ef8cef-7a24-445a-97b0-f3e21e088bc0-node-exporter-textfile\") pod \"node-exporter-hq5w7\" (UID: \"f3ef8cef-7a24-445a-97b0-f3e21e088bc0\") " pod="openshift-monitoring/node-exporter-hq5w7" May 28 08:02:21.767993 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:21.767947 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f3ef8cef-7a24-445a-97b0-f3e21e088bc0-sys\") pod \"node-exporter-hq5w7\" (UID: \"f3ef8cef-7a24-445a-97b0-f3e21e088bc0\") " pod="openshift-monitoring/node-exporter-hq5w7" May 28 08:02:21.767993 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:21.767936 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/19937927-46d3-457b-b9f4-119c9bebd1bd-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-s5rl8\" (UID: \"19937927-46d3-457b-b9f4-119c9bebd1bd\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-s5rl8" May 28 08:02:21.768314 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:21.768152 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f3ef8cef-7a24-445a-97b0-f3e21e088bc0-node-exporter-accelerators-collector-config\") pod \"node-exporter-hq5w7\" (UID: \"f3ef8cef-7a24-445a-97b0-f3e21e088bc0\") " pod="openshift-monitoring/node-exporter-hq5w7" May 28 08:02:21.768314 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:21.768188 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/19937927-46d3-457b-b9f4-119c9bebd1bd-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-s5rl8\" (UID: \"19937927-46d3-457b-b9f4-119c9bebd1bd\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-s5rl8" May 28 08:02:21.770082 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:21.770064 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/19937927-46d3-457b-b9f4-119c9bebd1bd-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-s5rl8\" (UID: \"19937927-46d3-457b-b9f4-119c9bebd1bd\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-s5rl8" May 28 08:02:21.770162 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:21.770072 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f3ef8cef-7a24-445a-97b0-f3e21e088bc0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hq5w7\" (UID: \"f3ef8cef-7a24-445a-97b0-f3e21e088bc0\") " pod="openshift-monitoring/node-exporter-hq5w7" May 28 08:02:21.777632 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:21.777613 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pp49w\" (UniqueName: \"kubernetes.io/projected/19937927-46d3-457b-b9f4-119c9bebd1bd-kube-api-access-pp49w\") pod \"kube-state-metrics-54fd6bc5c4-s5rl8\" (UID: \"19937927-46d3-457b-b9f4-119c9bebd1bd\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-s5rl8" May 28 08:02:21.778347 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:21.778325 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2n94\" (UniqueName: \"kubernetes.io/projected/f3ef8cef-7a24-445a-97b0-f3e21e088bc0-kube-api-access-g2n94\") pod \"node-exporter-hq5w7\" (UID: \"f3ef8cef-7a24-445a-97b0-f3e21e088bc0\") " pod="openshift-monitoring/node-exporter-hq5w7" May 28 08:02:22.269443 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:22.269413 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f3ef8cef-7a24-445a-97b0-f3e21e088bc0-node-exporter-tls\") pod \"node-exporter-hq5w7\" (UID: \"f3ef8cef-7a24-445a-97b0-f3e21e088bc0\") " pod="openshift-monitoring/node-exporter-hq5w7" May 28 08:02:22.269615 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:22.269453 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/19937927-46d3-457b-b9f4-119c9bebd1bd-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-s5rl8\" (UID: \"19937927-46d3-457b-b9f4-119c9bebd1bd\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-s5rl8" May 28 08:02:22.271778 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:22.271755 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f3ef8cef-7a24-445a-97b0-f3e21e088bc0-node-exporter-tls\") pod \"node-exporter-hq5w7\" (UID: \"f3ef8cef-7a24-445a-97b0-f3e21e088bc0\") " pod="openshift-monitoring/node-exporter-hq5w7" May 28 08:02:22.271909 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:22.271877 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/19937927-46d3-457b-b9f4-119c9bebd1bd-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-s5rl8\" (UID: \"19937927-46d3-457b-b9f4-119c9bebd1bd\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-s5rl8" May 28 08:02:22.500919 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:22.500890 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-s5rl8" May 28 08:02:22.505628 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:22.505603 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hq5w7" May 28 08:02:22.513917 ip-10-0-139-133 kubenswrapper[2560]: W0528 08:02:22.513891 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3ef8cef_7a24_445a_97b0_f3e21e088bc0.slice/crio-c1396d6a8d5aa797c0ef7238de3a9d57efd996b6c7848f49c6cc13a6cb1f3819 WatchSource:0}: Error finding container c1396d6a8d5aa797c0ef7238de3a9d57efd996b6c7848f49c6cc13a6cb1f3819: Status 404 returned error can't find the container with id c1396d6a8d5aa797c0ef7238de3a9d57efd996b6c7848f49c6cc13a6cb1f3819 May 28 08:02:22.635256 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:22.635226 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-s5rl8"] May 28 08:02:22.638395 ip-10-0-139-133 kubenswrapper[2560]: W0528 08:02:22.638368 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19937927_46d3_457b_b9f4_119c9bebd1bd.slice/crio-810c0ae6032bdcf2ed5850da01c2b2d333da980cad75e043069571ff5ecbe896 WatchSource:0}: Error finding container 810c0ae6032bdcf2ed5850da01c2b2d333da980cad75e043069571ff5ecbe896: Status 404 returned error can't find the container with id 810c0ae6032bdcf2ed5850da01c2b2d333da980cad75e043069571ff5ecbe896 May 28 08:02:23.271815 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:23.271778 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-s5rl8" event={"ID":"19937927-46d3-457b-b9f4-119c9bebd1bd","Type":"ContainerStarted","Data":"810c0ae6032bdcf2ed5850da01c2b2d333da980cad75e043069571ff5ecbe896"} May 28 08:02:23.273003 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:23.272978 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hq5w7" event={"ID":"f3ef8cef-7a24-445a-97b0-f3e21e088bc0","Type":"ContainerStarted","Data":"c1396d6a8d5aa797c0ef7238de3a9d57efd996b6c7848f49c6cc13a6cb1f3819"} May 28 08:02:23.357199 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:23.357156 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5f46d7bcb7-ks98h" May 28 08:02:23.357423 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:23.357213 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f46d7bcb7-ks98h" May 28 08:02:23.363614 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:23.363579 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5f46d7bcb7-ks98h" May 28 08:02:23.720399 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:23.720372 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-8974698c9-jzf5f" May 28 08:02:24.278670 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:24.278587 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-s5rl8" event={"ID":"19937927-46d3-457b-b9f4-119c9bebd1bd","Type":"ContainerStarted","Data":"38d980440ec8d966c5a3b173cf9f500f0b8ca0ae93a5d68df245edabd53eea90"} May 28 08:02:24.278670 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:24.278638 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-s5rl8" event={"ID":"19937927-46d3-457b-b9f4-119c9bebd1bd","Type":"ContainerStarted","Data":"6a3545c98c4748ecc66f6db06773ce659e1a16caaef810b2b8dd108f6dfd5d45"} May 28 08:02:24.278670 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:24.278653 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-s5rl8" event={"ID":"19937927-46d3-457b-b9f4-119c9bebd1bd","Type":"ContainerStarted","Data":"0cd184349aa4a2cdfb8b9d13f4b435377ca450531f478bb83eccccef8f0d46a2"} May 28 08:02:24.280354 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:24.280325 2560 generic.go:358] "Generic (PLEG): container finished" podID="f3ef8cef-7a24-445a-97b0-f3e21e088bc0" containerID="e3289f9d506220353d9e896149dce18b031f520f02886c8c128c67d03e8d1a7c" exitCode=0 May 28 08:02:24.280496 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:24.280416 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hq5w7" event={"ID":"f3ef8cef-7a24-445a-97b0-f3e21e088bc0","Type":"ContainerDied","Data":"e3289f9d506220353d9e896149dce18b031f520f02886c8c128c67d03e8d1a7c"} May 28 08:02:24.285381 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:24.285354 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5f46d7bcb7-ks98h" May 28 08:02:24.299811 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:24.299769 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-s5rl8" podStartSLOduration=1.976719139 podStartE2EDuration="3.299754761s" podCreationTimestamp="2026-05-28 08:02:21 +0000 UTC" firstStartedPulling="2026-05-28 08:02:22.640468756 +0000 UTC m=+182.526914876" lastFinishedPulling="2026-05-28 08:02:23.963504372 +0000 UTC m=+183.849950498" observedRunningTime="2026-05-28 08:02:24.298023555 +0000 UTC m=+184.184469698" watchObservedRunningTime="2026-05-28 08:02:24.299754761 +0000 UTC m=+184.186200903" May 28 08:02:25.286012 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:25.285973 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hq5w7" event={"ID":"f3ef8cef-7a24-445a-97b0-f3e21e088bc0","Type":"ContainerStarted","Data":"26f211440133ca0fd15b60218821bf2340c4b85385380bbee8de990173a1121d"} May 28 08:02:25.286012 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:25.286015 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hq5w7" event={"ID":"f3ef8cef-7a24-445a-97b0-f3e21e088bc0","Type":"ContainerStarted","Data":"8251aaa0059d61753177388d1451376df1c764635e4c097e29b39f0b5631c857"} May 28 08:02:25.305017 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:25.304979 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-hq5w7" podStartSLOduration=3.371179716 podStartE2EDuration="4.304967411s" podCreationTimestamp="2026-05-28 08:02:21 +0000 UTC" firstStartedPulling="2026-05-28 08:02:22.515485282 +0000 UTC m=+182.401931402" lastFinishedPulling="2026-05-28 08:02:23.449272936 +0000 UTC m=+183.335719097" observedRunningTime="2026-05-28 08:02:25.303556198 +0000 UTC m=+185.190002351" watchObservedRunningTime="2026-05-28 08:02:25.304967411 +0000 UTC m=+185.191413553" May 28 08:02:26.138862 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:26.138827 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7cd9b98b77-qvqs4"] May 28 08:02:26.140960 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:26.140941 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7cd9b98b77-qvqs4" May 28 08:02:26.143251 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:26.143229 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" May 28 08:02:26.143251 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:26.143229 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" May 28 08:02:26.143497 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:26.143288 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-h4925\"" May 28 08:02:26.143582 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:26.143532 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" May 28 08:02:26.144254 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:26.144233 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" May 28 08:02:26.144464 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:26.144449 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-b0t2b95b0pdho\"" May 28 08:02:26.148677 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:26.148657 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7cd9b98b77-qvqs4"] May 28 08:02:26.200591 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:26.200547 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59shv\" (UniqueName: \"kubernetes.io/projected/83f134e9-aca3-4db4-a5ce-2e120c9749b6-kube-api-access-59shv\") pod \"metrics-server-7cd9b98b77-qvqs4\" (UID: \"83f134e9-aca3-4db4-a5ce-2e120c9749b6\") " pod="openshift-monitoring/metrics-server-7cd9b98b77-qvqs4" May 28 08:02:26.200696 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:26.200606 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/83f134e9-aca3-4db4-a5ce-2e120c9749b6-audit-log\") pod \"metrics-server-7cd9b98b77-qvqs4\" (UID: \"83f134e9-aca3-4db4-a5ce-2e120c9749b6\") " pod="openshift-monitoring/metrics-server-7cd9b98b77-qvqs4" May 28 08:02:26.200696 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:26.200625 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/83f134e9-aca3-4db4-a5ce-2e120c9749b6-secret-metrics-server-client-certs\") pod \"metrics-server-7cd9b98b77-qvqs4\" (UID: \"83f134e9-aca3-4db4-a5ce-2e120c9749b6\") " pod="openshift-monitoring/metrics-server-7cd9b98b77-qvqs4" May 28 08:02:26.200696 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:26.200656 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/83f134e9-aca3-4db4-a5ce-2e120c9749b6-metrics-server-audit-profiles\") pod \"metrics-server-7cd9b98b77-qvqs4\" (UID: \"83f134e9-aca3-4db4-a5ce-2e120c9749b6\") " pod="openshift-monitoring/metrics-server-7cd9b98b77-qvqs4" May 28 08:02:26.200857 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:26.200705 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/83f134e9-aca3-4db4-a5ce-2e120c9749b6-client-ca-bundle\") pod \"metrics-server-7cd9b98b77-qvqs4\" (UID: \"83f134e9-aca3-4db4-a5ce-2e120c9749b6\") " pod="openshift-monitoring/metrics-server-7cd9b98b77-qvqs4" May 28 08:02:26.200857 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:26.200770 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83f134e9-aca3-4db4-a5ce-2e120c9749b6-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7cd9b98b77-qvqs4\" (UID: \"83f134e9-aca3-4db4-a5ce-2e120c9749b6\") " pod="openshift-monitoring/metrics-server-7cd9b98b77-qvqs4" May 28 08:02:26.200857 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:26.200824 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/83f134e9-aca3-4db4-a5ce-2e120c9749b6-secret-metrics-server-tls\") pod \"metrics-server-7cd9b98b77-qvqs4\" (UID: \"83f134e9-aca3-4db4-a5ce-2e120c9749b6\") " pod="openshift-monitoring/metrics-server-7cd9b98b77-qvqs4" May 28 08:02:26.301772 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:26.301746 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-59shv\" (UniqueName: \"kubernetes.io/projected/83f134e9-aca3-4db4-a5ce-2e120c9749b6-kube-api-access-59shv\") pod \"metrics-server-7cd9b98b77-qvqs4\" (UID: \"83f134e9-aca3-4db4-a5ce-2e120c9749b6\") " pod="openshift-monitoring/metrics-server-7cd9b98b77-qvqs4" May 28 08:02:26.302191 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:26.301790 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/83f134e9-aca3-4db4-a5ce-2e120c9749b6-audit-log\") pod \"metrics-server-7cd9b98b77-qvqs4\" (UID: \"83f134e9-aca3-4db4-a5ce-2e120c9749b6\") " pod="openshift-monitoring/metrics-server-7cd9b98b77-qvqs4" May 28 08:02:26.302191 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:26.301811 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/83f134e9-aca3-4db4-a5ce-2e120c9749b6-secret-metrics-server-client-certs\") pod \"metrics-server-7cd9b98b77-qvqs4\" (UID: \"83f134e9-aca3-4db4-a5ce-2e120c9749b6\") " pod="openshift-monitoring/metrics-server-7cd9b98b77-qvqs4" May 28 08:02:26.302191 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:26.301852 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/83f134e9-aca3-4db4-a5ce-2e120c9749b6-metrics-server-audit-profiles\") pod \"metrics-server-7cd9b98b77-qvqs4\" (UID: \"83f134e9-aca3-4db4-a5ce-2e120c9749b6\") " pod="openshift-monitoring/metrics-server-7cd9b98b77-qvqs4" May 28 08:02:26.302191 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:26.301903 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/83f134e9-aca3-4db4-a5ce-2e120c9749b6-client-ca-bundle\") pod \"metrics-server-7cd9b98b77-qvqs4\" (UID: \"83f134e9-aca3-4db4-a5ce-2e120c9749b6\") " pod="openshift-monitoring/metrics-server-7cd9b98b77-qvqs4" May 28 08:02:26.302191 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:26.301950 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83f134e9-aca3-4db4-a5ce-2e120c9749b6-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7cd9b98b77-qvqs4\" (UID: \"83f134e9-aca3-4db4-a5ce-2e120c9749b6\") " pod="openshift-monitoring/metrics-server-7cd9b98b77-qvqs4" May 28 08:02:26.302191 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:26.302006 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/83f134e9-aca3-4db4-a5ce-2e120c9749b6-secret-metrics-server-tls\") pod \"metrics-server-7cd9b98b77-qvqs4\" (UID: \"83f134e9-aca3-4db4-a5ce-2e120c9749b6\") " pod="openshift-monitoring/metrics-server-7cd9b98b77-qvqs4" May 28 08:02:26.302504 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:26.302406 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/83f134e9-aca3-4db4-a5ce-2e120c9749b6-audit-log\") pod \"metrics-server-7cd9b98b77-qvqs4\" (UID: \"83f134e9-aca3-4db4-a5ce-2e120c9749b6\") " pod="openshift-monitoring/metrics-server-7cd9b98b77-qvqs4" May 28 08:02:26.303007 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:26.302981 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83f134e9-aca3-4db4-a5ce-2e120c9749b6-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7cd9b98b77-qvqs4\" (UID: \"83f134e9-aca3-4db4-a5ce-2e120c9749b6\") " pod="openshift-monitoring/metrics-server-7cd9b98b77-qvqs4" May 28 08:02:26.303316 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:26.303289 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/83f134e9-aca3-4db4-a5ce-2e120c9749b6-metrics-server-audit-profiles\") pod \"metrics-server-7cd9b98b77-qvqs4\" (UID: \"83f134e9-aca3-4db4-a5ce-2e120c9749b6\") " pod="openshift-monitoring/metrics-server-7cd9b98b77-qvqs4" May 28 08:02:26.304855 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:26.304829 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/83f134e9-aca3-4db4-a5ce-2e120c9749b6-secret-metrics-server-tls\") pod \"metrics-server-7cd9b98b77-qvqs4\" (UID: \"83f134e9-aca3-4db4-a5ce-2e120c9749b6\") " pod="openshift-monitoring/metrics-server-7cd9b98b77-qvqs4" May 28 08:02:26.305146 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:26.305126 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/83f134e9-aca3-4db4-a5ce-2e120c9749b6-secret-metrics-server-client-certs\") pod \"metrics-server-7cd9b98b77-qvqs4\" (UID: \"83f134e9-aca3-4db4-a5ce-2e120c9749b6\") " pod="openshift-monitoring/metrics-server-7cd9b98b77-qvqs4" May 28 08:02:26.305196 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:26.305162 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/83f134e9-aca3-4db4-a5ce-2e120c9749b6-client-ca-bundle\") pod \"metrics-server-7cd9b98b77-qvqs4\" (UID: \"83f134e9-aca3-4db4-a5ce-2e120c9749b6\") " pod="openshift-monitoring/metrics-server-7cd9b98b77-qvqs4" May 28 08:02:26.312189 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:26.312168 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-59shv\" (UniqueName: \"kubernetes.io/projected/83f134e9-aca3-4db4-a5ce-2e120c9749b6-kube-api-access-59shv\") pod \"metrics-server-7cd9b98b77-qvqs4\" (UID: \"83f134e9-aca3-4db4-a5ce-2e120c9749b6\") " pod="openshift-monitoring/metrics-server-7cd9b98b77-qvqs4" May 28 08:02:26.332885 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:26.332862 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-tfbhm"] May 28 08:02:26.335596 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:26.335579 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-tfbhm" May 28 08:02:26.337753 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:26.337731 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" May 28 08:02:26.337858 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:26.337812 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-jzfl9\"" May 28 08:02:26.343541 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:26.343518 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-tfbhm"] May 28 08:02:26.403126 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:26.403065 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/93e7087e-c377-4dbd-b97d-fd8f8463e9cf-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-tfbhm\" (UID: \"93e7087e-c377-4dbd-b97d-fd8f8463e9cf\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-tfbhm" May 28 08:02:26.450094 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:26.450070 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7cd9b98b77-qvqs4" May 28 08:02:26.504226 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:26.504189 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/93e7087e-c377-4dbd-b97d-fd8f8463e9cf-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-tfbhm\" (UID: \"93e7087e-c377-4dbd-b97d-fd8f8463e9cf\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-tfbhm" May 28 08:02:26.504369 ip-10-0-139-133 kubenswrapper[2560]: E0528 08:02:26.504350 2560 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found May 28 08:02:26.504455 ip-10-0-139-133 kubenswrapper[2560]: E0528 08:02:26.504443 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93e7087e-c377-4dbd-b97d-fd8f8463e9cf-monitoring-plugin-cert podName:93e7087e-c377-4dbd-b97d-fd8f8463e9cf nodeName:}" failed. No retries permitted until 2026-05-28 08:02:27.004421425 +0000 UTC m=+186.890867562 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/93e7087e-c377-4dbd-b97d-fd8f8463e9cf-monitoring-plugin-cert") pod "monitoring-plugin-665c9c8584-tfbhm" (UID: "93e7087e-c377-4dbd-b97d-fd8f8463e9cf") : secret "monitoring-plugin-cert" not found May 28 08:02:26.572875 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:26.572779 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7cd9b98b77-qvqs4"] May 28 08:02:26.575514 ip-10-0-139-133 kubenswrapper[2560]: W0528 08:02:26.575476 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83f134e9_aca3_4db4_a5ce_2e120c9749b6.slice/crio-c999d4dd63a86c9f535e3db3b3ca6784061405a3085d63f75b99ee635f78e757 WatchSource:0}: Error finding container c999d4dd63a86c9f535e3db3b3ca6784061405a3085d63f75b99ee635f78e757: Status 404 returned error can't find the container with id c999d4dd63a86c9f535e3db3b3ca6784061405a3085d63f75b99ee635f78e757 May 28 08:02:27.009651 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:27.009616 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/93e7087e-c377-4dbd-b97d-fd8f8463e9cf-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-tfbhm\" (UID: \"93e7087e-c377-4dbd-b97d-fd8f8463e9cf\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-tfbhm" May 28 08:02:27.011843 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:27.011821 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/93e7087e-c377-4dbd-b97d-fd8f8463e9cf-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-tfbhm\" (UID: \"93e7087e-c377-4dbd-b97d-fd8f8463e9cf\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-tfbhm" May 28 08:02:27.245163 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:27.245136 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-tfbhm" May 28 08:02:27.294440 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:27.294408 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7cd9b98b77-qvqs4" event={"ID":"83f134e9-aca3-4db4-a5ce-2e120c9749b6","Type":"ContainerStarted","Data":"c999d4dd63a86c9f535e3db3b3ca6784061405a3085d63f75b99ee635f78e757"} May 28 08:02:27.370408 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:27.370374 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-tfbhm"] May 28 08:02:27.373403 ip-10-0-139-133 kubenswrapper[2560]: W0528 08:02:27.373368 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93e7087e_c377_4dbd_b97d_fd8f8463e9cf.slice/crio-49534d41678839d78347bb109c56c8613961f0a4d78c9f5dc8d4b3a5277f41f8 WatchSource:0}: Error finding container 49534d41678839d78347bb109c56c8613961f0a4d78c9f5dc8d4b3a5277f41f8: Status 404 returned error can't find the container with id 49534d41678839d78347bb109c56c8613961f0a4d78c9f5dc8d4b3a5277f41f8 May 28 08:02:27.760890 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:27.760851 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 28 08:02:27.766177 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:27.766137 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 28 08:02:27.768536 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:27.768509 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 28 08:02:27.768699 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:27.768644 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 28 08:02:27.768699 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:27.768660 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 28 08:02:27.769829 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:27.769438 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 28 08:02:27.769829 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:27.769522 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 28 08:02:27.770190 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:27.770171 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-sbktx\"" May 28 08:02:27.770398 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:27.770378 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-99nlbdnumf9cm\"" May 28 08:02:27.770503 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:27.770486 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 28 08:02:27.770721 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:27.770693 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 28 08:02:27.772357 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:27.770990 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 28 08:02:27.772704 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:27.771066 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 28 08:02:27.772817 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:27.771117 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 28 08:02:27.772951 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:27.771338 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 28 08:02:27.773070 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:27.772968 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 28 08:02:27.781009 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:27.780946 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 28 08:02:27.819390 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:27.818067 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/485ab764-14d8-47c0-83a8-77d22bc6cd88-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"485ab764-14d8-47c0-83a8-77d22bc6cd88\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:02:27.819390 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:27.818110 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/485ab764-14d8-47c0-83a8-77d22bc6cd88-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"485ab764-14d8-47c0-83a8-77d22bc6cd88\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:02:27.819390 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:27.818139 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/485ab764-14d8-47c0-83a8-77d22bc6cd88-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"485ab764-14d8-47c0-83a8-77d22bc6cd88\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:02:27.819390 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:27.818163 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/485ab764-14d8-47c0-83a8-77d22bc6cd88-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"485ab764-14d8-47c0-83a8-77d22bc6cd88\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:02:27.819390 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:27.818198 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/485ab764-14d8-47c0-83a8-77d22bc6cd88-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"485ab764-14d8-47c0-83a8-77d22bc6cd88\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:02:27.819390 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:27.818222 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/485ab764-14d8-47c0-83a8-77d22bc6cd88-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"485ab764-14d8-47c0-83a8-77d22bc6cd88\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:02:27.819390 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:27.818250 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/485ab764-14d8-47c0-83a8-77d22bc6cd88-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"485ab764-14d8-47c0-83a8-77d22bc6cd88\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:02:27.819390 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:27.818277 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6gnp\" (UniqueName: \"kubernetes.io/projected/485ab764-14d8-47c0-83a8-77d22bc6cd88-kube-api-access-t6gnp\") pod \"prometheus-k8s-0\" (UID: \"485ab764-14d8-47c0-83a8-77d22bc6cd88\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:02:27.819390 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:27.818350 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/485ab764-14d8-47c0-83a8-77d22bc6cd88-config-out\") pod \"prometheus-k8s-0\" (UID: \"485ab764-14d8-47c0-83a8-77d22bc6cd88\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:02:27.819390 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:27.818378 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/485ab764-14d8-47c0-83a8-77d22bc6cd88-web-config\") pod \"prometheus-k8s-0\" (UID: \"485ab764-14d8-47c0-83a8-77d22bc6cd88\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:02:27.819390 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:27.818419 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/485ab764-14d8-47c0-83a8-77d22bc6cd88-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"485ab764-14d8-47c0-83a8-77d22bc6cd88\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:02:27.819390 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:27.818447 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/485ab764-14d8-47c0-83a8-77d22bc6cd88-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"485ab764-14d8-47c0-83a8-77d22bc6cd88\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:02:27.819390 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:27.818473 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/485ab764-14d8-47c0-83a8-77d22bc6cd88-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"485ab764-14d8-47c0-83a8-77d22bc6cd88\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:02:27.819390 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:27.818504 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/485ab764-14d8-47c0-83a8-77d22bc6cd88-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"485ab764-14d8-47c0-83a8-77d22bc6cd88\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:02:27.819390 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:27.818532 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/485ab764-14d8-47c0-83a8-77d22bc6cd88-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"485ab764-14d8-47c0-83a8-77d22bc6cd88\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:02:27.819390 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:27.818554 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/485ab764-14d8-47c0-83a8-77d22bc6cd88-config\") pod \"prometheus-k8s-0\" (UID: \"485ab764-14d8-47c0-83a8-77d22bc6cd88\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:02:27.820230 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:27.818602 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/485ab764-14d8-47c0-83a8-77d22bc6cd88-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"485ab764-14d8-47c0-83a8-77d22bc6cd88\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:02:27.820230 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:27.818637 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/485ab764-14d8-47c0-83a8-77d22bc6cd88-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"485ab764-14d8-47c0-83a8-77d22bc6cd88\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:02:27.920024 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:27.919984 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/485ab764-14d8-47c0-83a8-77d22bc6cd88-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"485ab764-14d8-47c0-83a8-77d22bc6cd88\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:02:27.920309 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:27.920241 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/485ab764-14d8-47c0-83a8-77d22bc6cd88-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"485ab764-14d8-47c0-83a8-77d22bc6cd88\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:02:27.920427 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:27.920341 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/485ab764-14d8-47c0-83a8-77d22bc6cd88-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"485ab764-14d8-47c0-83a8-77d22bc6cd88\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:02:27.920427 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:27.920380 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/485ab764-14d8-47c0-83a8-77d22bc6cd88-config\") pod \"prometheus-k8s-0\" (UID: \"485ab764-14d8-47c0-83a8-77d22bc6cd88\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:02:27.920427 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:27.920407 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/485ab764-14d8-47c0-83a8-77d22bc6cd88-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"485ab764-14d8-47c0-83a8-77d22bc6cd88\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:02:27.920603 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:27.920449 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/485ab764-14d8-47c0-83a8-77d22bc6cd88-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"485ab764-14d8-47c0-83a8-77d22bc6cd88\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:02:27.920603 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:27.920485 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/485ab764-14d8-47c0-83a8-77d22bc6cd88-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"485ab764-14d8-47c0-83a8-77d22bc6cd88\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:02:27.920603 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:27.920514 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/485ab764-14d8-47c0-83a8-77d22bc6cd88-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"485ab764-14d8-47c0-83a8-77d22bc6cd88\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:02:27.920603 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:27.920542 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/485ab764-14d8-47c0-83a8-77d22bc6cd88-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"485ab764-14d8-47c0-83a8-77d22bc6cd88\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:02:27.920603 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:27.920595 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/485ab764-14d8-47c0-83a8-77d22bc6cd88-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"485ab764-14d8-47c0-83a8-77d22bc6cd88\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:02:27.920863 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:27.920637 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/485ab764-14d8-47c0-83a8-77d22bc6cd88-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"485ab764-14d8-47c0-83a8-77d22bc6cd88\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:02:27.920863 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:27.920665 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/485ab764-14d8-47c0-83a8-77d22bc6cd88-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"485ab764-14d8-47c0-83a8-77d22bc6cd88\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:02:27.920863 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:27.920714 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/485ab764-14d8-47c0-83a8-77d22bc6cd88-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"485ab764-14d8-47c0-83a8-77d22bc6cd88\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:02:27.920863 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:27.920745 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t6gnp\" (UniqueName: \"kubernetes.io/projected/485ab764-14d8-47c0-83a8-77d22bc6cd88-kube-api-access-t6gnp\") pod \"prometheus-k8s-0\" (UID: \"485ab764-14d8-47c0-83a8-77d22bc6cd88\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:02:27.920863 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:27.920823 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/485ab764-14d8-47c0-83a8-77d22bc6cd88-config-out\") pod \"prometheus-k8s-0\" (UID: \"485ab764-14d8-47c0-83a8-77d22bc6cd88\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:02:27.920863 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:27.920856 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/485ab764-14d8-47c0-83a8-77d22bc6cd88-web-config\") pod \"prometheus-k8s-0\" (UID: \"485ab764-14d8-47c0-83a8-77d22bc6cd88\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:02:27.921172 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:27.920908 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/485ab764-14d8-47c0-83a8-77d22bc6cd88-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"485ab764-14d8-47c0-83a8-77d22bc6cd88\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:02:27.921172 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:27.920944 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/485ab764-14d8-47c0-83a8-77d22bc6cd88-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"485ab764-14d8-47c0-83a8-77d22bc6cd88\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:02:27.921172 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:27.921063 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/485ab764-14d8-47c0-83a8-77d22bc6cd88-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"485ab764-14d8-47c0-83a8-77d22bc6cd88\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:02:27.921331 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:27.921311 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/485ab764-14d8-47c0-83a8-77d22bc6cd88-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"485ab764-14d8-47c0-83a8-77d22bc6cd88\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:02:27.923776 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:27.923752 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/485ab764-14d8-47c0-83a8-77d22bc6cd88-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"485ab764-14d8-47c0-83a8-77d22bc6cd88\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:02:27.924163 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:27.923994 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/485ab764-14d8-47c0-83a8-77d22bc6cd88-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"485ab764-14d8-47c0-83a8-77d22bc6cd88\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:02:27.924511 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:27.924489 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/485ab764-14d8-47c0-83a8-77d22bc6cd88-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"485ab764-14d8-47c0-83a8-77d22bc6cd88\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:02:27.924636 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:27.924506 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/485ab764-14d8-47c0-83a8-77d22bc6cd88-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"485ab764-14d8-47c0-83a8-77d22bc6cd88\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:02:27.925487 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:27.925444 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/485ab764-14d8-47c0-83a8-77d22bc6cd88-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"485ab764-14d8-47c0-83a8-77d22bc6cd88\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:02:27.928009 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:27.927964 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/485ab764-14d8-47c0-83a8-77d22bc6cd88-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"485ab764-14d8-47c0-83a8-77d22bc6cd88\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:02:27.928094 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:27.927965 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/485ab764-14d8-47c0-83a8-77d22bc6cd88-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"485ab764-14d8-47c0-83a8-77d22bc6cd88\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:02:27.930441 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:27.930396 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/485ab764-14d8-47c0-83a8-77d22bc6cd88-web-config\") pod \"prometheus-k8s-0\" (UID: \"485ab764-14d8-47c0-83a8-77d22bc6cd88\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:02:27.930944 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:27.930903 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/485ab764-14d8-47c0-83a8-77d22bc6cd88-config-out\") pod \"prometheus-k8s-0\" (UID: \"485ab764-14d8-47c0-83a8-77d22bc6cd88\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:02:27.931193 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:27.931172 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/485ab764-14d8-47c0-83a8-77d22bc6cd88-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"485ab764-14d8-47c0-83a8-77d22bc6cd88\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:02:27.931421 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:27.931395 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/485ab764-14d8-47c0-83a8-77d22bc6cd88-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"485ab764-14d8-47c0-83a8-77d22bc6cd88\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:02:27.931990 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:27.931967 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/485ab764-14d8-47c0-83a8-77d22bc6cd88-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"485ab764-14d8-47c0-83a8-77d22bc6cd88\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:02:27.932091 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:27.932017 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/485ab764-14d8-47c0-83a8-77d22bc6cd88-config\") pod \"prometheus-k8s-0\" (UID: \"485ab764-14d8-47c0-83a8-77d22bc6cd88\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:02:27.932647 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:27.932589 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/485ab764-14d8-47c0-83a8-77d22bc6cd88-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"485ab764-14d8-47c0-83a8-77d22bc6cd88\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:02:27.932756 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:27.932734 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6gnp\" (UniqueName: \"kubernetes.io/projected/485ab764-14d8-47c0-83a8-77d22bc6cd88-kube-api-access-t6gnp\") pod \"prometheus-k8s-0\" (UID: \"485ab764-14d8-47c0-83a8-77d22bc6cd88\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:02:27.934542 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:27.934520 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/485ab764-14d8-47c0-83a8-77d22bc6cd88-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"485ab764-14d8-47c0-83a8-77d22bc6cd88\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:02:28.080864 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:28.080795 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 28 08:02:28.305759 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:28.305717 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-tfbhm" event={"ID":"93e7087e-c377-4dbd-b97d-fd8f8463e9cf","Type":"ContainerStarted","Data":"49534d41678839d78347bb109c56c8613961f0a4d78c9f5dc8d4b3a5277f41f8"} May 28 08:02:28.497276 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:28.497213 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-66b6fc68b4-l9kgx"] May 28 08:02:28.500361 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:28.500337 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66b6fc68b4-l9kgx" May 28 08:02:28.507688 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:28.507664 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" May 28 08:02:28.510781 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:28.510753 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66b6fc68b4-l9kgx"] May 28 08:02:28.526342 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:28.526316 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f795adb5-f191-49c8-ac1a-103cf6280710-oauth-serving-cert\") pod \"console-66b6fc68b4-l9kgx\" (UID: \"f795adb5-f191-49c8-ac1a-103cf6280710\") " pod="openshift-console/console-66b6fc68b4-l9kgx" May 28 08:02:28.526440 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:28.526344 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lt8n2\" (UniqueName: \"kubernetes.io/projected/f795adb5-f191-49c8-ac1a-103cf6280710-kube-api-access-lt8n2\") pod \"console-66b6fc68b4-l9kgx\" (UID: \"f795adb5-f191-49c8-ac1a-103cf6280710\") " pod="openshift-console/console-66b6fc68b4-l9kgx" May 28 08:02:28.526440 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:28.526373 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f795adb5-f191-49c8-ac1a-103cf6280710-console-config\") pod \"console-66b6fc68b4-l9kgx\" (UID: \"f795adb5-f191-49c8-ac1a-103cf6280710\") " pod="openshift-console/console-66b6fc68b4-l9kgx" May 28 08:02:28.526574 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:28.526451 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f795adb5-f191-49c8-ac1a-103cf6280710-trusted-ca-bundle\") pod \"console-66b6fc68b4-l9kgx\" (UID: \"f795adb5-f191-49c8-ac1a-103cf6280710\") " pod="openshift-console/console-66b6fc68b4-l9kgx" May 28 08:02:28.526574 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:28.526483 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f795adb5-f191-49c8-ac1a-103cf6280710-console-oauth-config\") pod \"console-66b6fc68b4-l9kgx\" (UID: \"f795adb5-f191-49c8-ac1a-103cf6280710\") " pod="openshift-console/console-66b6fc68b4-l9kgx" May 28 08:02:28.526574 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:28.526520 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f795adb5-f191-49c8-ac1a-103cf6280710-console-serving-cert\") pod \"console-66b6fc68b4-l9kgx\" (UID: \"f795adb5-f191-49c8-ac1a-103cf6280710\") " pod="openshift-console/console-66b6fc68b4-l9kgx" May 28 08:02:28.526726 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:28.526623 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f795adb5-f191-49c8-ac1a-103cf6280710-service-ca\") pod \"console-66b6fc68b4-l9kgx\" (UID: \"f795adb5-f191-49c8-ac1a-103cf6280710\") " pod="openshift-console/console-66b6fc68b4-l9kgx" May 28 08:02:28.627399 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:28.627365 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f795adb5-f191-49c8-ac1a-103cf6280710-service-ca\") pod \"console-66b6fc68b4-l9kgx\" (UID: \"f795adb5-f191-49c8-ac1a-103cf6280710\") " pod="openshift-console/console-66b6fc68b4-l9kgx" May 28 08:02:28.627602 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:28.627415 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f795adb5-f191-49c8-ac1a-103cf6280710-oauth-serving-cert\") pod \"console-66b6fc68b4-l9kgx\" (UID: \"f795adb5-f191-49c8-ac1a-103cf6280710\") " pod="openshift-console/console-66b6fc68b4-l9kgx" May 28 08:02:28.627602 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:28.627439 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lt8n2\" (UniqueName: \"kubernetes.io/projected/f795adb5-f191-49c8-ac1a-103cf6280710-kube-api-access-lt8n2\") pod \"console-66b6fc68b4-l9kgx\" (UID: \"f795adb5-f191-49c8-ac1a-103cf6280710\") " pod="openshift-console/console-66b6fc68b4-l9kgx" May 28 08:02:28.627602 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:28.627486 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f795adb5-f191-49c8-ac1a-103cf6280710-console-config\") pod \"console-66b6fc68b4-l9kgx\" (UID: \"f795adb5-f191-49c8-ac1a-103cf6280710\") " pod="openshift-console/console-66b6fc68b4-l9kgx" May 28 08:02:28.627602 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:28.627520 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f795adb5-f191-49c8-ac1a-103cf6280710-trusted-ca-bundle\") pod \"console-66b6fc68b4-l9kgx\" (UID: \"f795adb5-f191-49c8-ac1a-103cf6280710\") " pod="openshift-console/console-66b6fc68b4-l9kgx" May 28 08:02:28.627602 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:28.627546 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f795adb5-f191-49c8-ac1a-103cf6280710-console-oauth-config\") pod \"console-66b6fc68b4-l9kgx\" (UID: \"f795adb5-f191-49c8-ac1a-103cf6280710\") " pod="openshift-console/console-66b6fc68b4-l9kgx" May 28 08:02:28.627867 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:28.627608 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f795adb5-f191-49c8-ac1a-103cf6280710-console-serving-cert\") pod \"console-66b6fc68b4-l9kgx\" (UID: \"f795adb5-f191-49c8-ac1a-103cf6280710\") " pod="openshift-console/console-66b6fc68b4-l9kgx" May 28 08:02:28.628288 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:28.628263 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f795adb5-f191-49c8-ac1a-103cf6280710-service-ca\") pod \"console-66b6fc68b4-l9kgx\" (UID: \"f795adb5-f191-49c8-ac1a-103cf6280710\") " pod="openshift-console/console-66b6fc68b4-l9kgx" May 28 08:02:28.628469 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:28.628441 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f795adb5-f191-49c8-ac1a-103cf6280710-console-config\") pod \"console-66b6fc68b4-l9kgx\" (UID: \"f795adb5-f191-49c8-ac1a-103cf6280710\") " pod="openshift-console/console-66b6fc68b4-l9kgx" May 28 08:02:28.628534 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:28.628488 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f795adb5-f191-49c8-ac1a-103cf6280710-oauth-serving-cert\") pod \"console-66b6fc68b4-l9kgx\" (UID: \"f795adb5-f191-49c8-ac1a-103cf6280710\") " pod="openshift-console/console-66b6fc68b4-l9kgx" May 28 08:02:28.628777 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:28.628731 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f795adb5-f191-49c8-ac1a-103cf6280710-trusted-ca-bundle\") pod \"console-66b6fc68b4-l9kgx\" (UID: \"f795adb5-f191-49c8-ac1a-103cf6280710\") " pod="openshift-console/console-66b6fc68b4-l9kgx" May 28 08:02:28.630433 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:28.630411 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f795adb5-f191-49c8-ac1a-103cf6280710-console-serving-cert\") pod \"console-66b6fc68b4-l9kgx\" (UID: \"f795adb5-f191-49c8-ac1a-103cf6280710\") " pod="openshift-console/console-66b6fc68b4-l9kgx" May 28 08:02:28.630613 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:28.630587 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f795adb5-f191-49c8-ac1a-103cf6280710-console-oauth-config\") pod \"console-66b6fc68b4-l9kgx\" (UID: \"f795adb5-f191-49c8-ac1a-103cf6280710\") " pod="openshift-console/console-66b6fc68b4-l9kgx" May 28 08:02:28.636068 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:28.636045 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lt8n2\" (UniqueName: \"kubernetes.io/projected/f795adb5-f191-49c8-ac1a-103cf6280710-kube-api-access-lt8n2\") pod \"console-66b6fc68b4-l9kgx\" (UID: \"f795adb5-f191-49c8-ac1a-103cf6280710\") " pod="openshift-console/console-66b6fc68b4-l9kgx" May 28 08:02:28.733657 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:28.733588 2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-8974698c9-jzf5f" podUID="64c31255-a020-4e2b-9a33-942aa1476d99" containerName="registry" containerID="cri-o://a8a06cc3cfd55894dac09b52bf17e8b91b8c081c8c50ff690d98f314a3b43067" gracePeriod=30 May 28 08:02:28.811260 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:28.811234 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66b6fc68b4-l9kgx" May 28 08:02:29.060991 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:29.060967 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8974698c9-jzf5f" May 28 08:02:29.083833 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:29.083807 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 28 08:02:29.089085 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:29.089062 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66b6fc68b4-l9kgx"] May 28 08:02:29.091407 ip-10-0-139-133 kubenswrapper[2560]: W0528 08:02:29.091380 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod485ab764_14d8_47c0_83a8_77d22bc6cd88.slice/crio-8b22bd2e04a7d852ee6d13b41afe0edcb05bb0e24fffa48b016c7a03a99a9ba3 WatchSource:0}: Error finding container 8b22bd2e04a7d852ee6d13b41afe0edcb05bb0e24fffa48b016c7a03a99a9ba3: Status 404 returned error can't find the container with id 8b22bd2e04a7d852ee6d13b41afe0edcb05bb0e24fffa48b016c7a03a99a9ba3 May 28 08:02:29.095279 ip-10-0-139-133 kubenswrapper[2560]: W0528 08:02:29.095259 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf795adb5_f191_49c8_ac1a_103cf6280710.slice/crio-5e7762c3f0a8adf668d814d0a68cd81323d492d2d27f51af39e35b277dddbce2 WatchSource:0}: Error finding container 5e7762c3f0a8adf668d814d0a68cd81323d492d2d27f51af39e35b277dddbce2: Status 404 returned error can't find the container with id 5e7762c3f0a8adf668d814d0a68cd81323d492d2d27f51af39e35b277dddbce2 May 28 08:02:29.132370 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:29.132349 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/64c31255-a020-4e2b-9a33-942aa1476d99-ca-trust-extracted\") pod \"64c31255-a020-4e2b-9a33-942aa1476d99\" (UID: \"64c31255-a020-4e2b-9a33-942aa1476d99\") " May 28 08:02:29.132470 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:29.132381 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/64c31255-a020-4e2b-9a33-942aa1476d99-trusted-ca\") pod \"64c31255-a020-4e2b-9a33-942aa1476d99\" (UID: \"64c31255-a020-4e2b-9a33-942aa1476d99\") " May 28 08:02:29.132470 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:29.132402 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/64c31255-a020-4e2b-9a33-942aa1476d99-bound-sa-token\") pod \"64c31255-a020-4e2b-9a33-942aa1476d99\" (UID: \"64c31255-a020-4e2b-9a33-942aa1476d99\") " May 28 08:02:29.132470 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:29.132432 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/64c31255-a020-4e2b-9a33-942aa1476d99-image-registry-private-configuration\") pod \"64c31255-a020-4e2b-9a33-942aa1476d99\" (UID: \"64c31255-a020-4e2b-9a33-942aa1476d99\") " May 28 08:02:29.132470 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:29.132457 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gs5m5\" (UniqueName: \"kubernetes.io/projected/64c31255-a020-4e2b-9a33-942aa1476d99-kube-api-access-gs5m5\") pod \"64c31255-a020-4e2b-9a33-942aa1476d99\" (UID: \"64c31255-a020-4e2b-9a33-942aa1476d99\") " May 28 08:02:29.132697 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:29.132525 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/64c31255-a020-4e2b-9a33-942aa1476d99-installation-pull-secrets\") pod \"64c31255-a020-4e2b-9a33-942aa1476d99\" (UID: \"64c31255-a020-4e2b-9a33-942aa1476d99\") " May 28 08:02:29.132697 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:29.132557 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/64c31255-a020-4e2b-9a33-942aa1476d99-registry-tls\") pod \"64c31255-a020-4e2b-9a33-942aa1476d99\" (UID: \"64c31255-a020-4e2b-9a33-942aa1476d99\") " May 28 08:02:29.132697 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:29.132637 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/64c31255-a020-4e2b-9a33-942aa1476d99-registry-certificates\") pod \"64c31255-a020-4e2b-9a33-942aa1476d99\" (UID: \"64c31255-a020-4e2b-9a33-942aa1476d99\") " May 28 08:02:29.132846 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:29.132804 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64c31255-a020-4e2b-9a33-942aa1476d99-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "64c31255-a020-4e2b-9a33-942aa1476d99" (UID: "64c31255-a020-4e2b-9a33-942aa1476d99"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 08:02:29.132904 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:29.132895 2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/64c31255-a020-4e2b-9a33-942aa1476d99-trusted-ca\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" May 28 08:02:29.133964 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:29.133173 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64c31255-a020-4e2b-9a33-942aa1476d99-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "64c31255-a020-4e2b-9a33-942aa1476d99" (UID: "64c31255-a020-4e2b-9a33-942aa1476d99"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 08:02:29.135248 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:29.135206 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64c31255-a020-4e2b-9a33-942aa1476d99-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "64c31255-a020-4e2b-9a33-942aa1476d99" (UID: "64c31255-a020-4e2b-9a33-942aa1476d99"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 08:02:29.135454 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:29.135421 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64c31255-a020-4e2b-9a33-942aa1476d99-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "64c31255-a020-4e2b-9a33-942aa1476d99" (UID: "64c31255-a020-4e2b-9a33-942aa1476d99"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 08:02:29.135701 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:29.135678 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64c31255-a020-4e2b-9a33-942aa1476d99-kube-api-access-gs5m5" (OuterVolumeSpecName: "kube-api-access-gs5m5") pod "64c31255-a020-4e2b-9a33-942aa1476d99" (UID: "64c31255-a020-4e2b-9a33-942aa1476d99"). InnerVolumeSpecName "kube-api-access-gs5m5". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 08:02:29.135864 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:29.135840 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64c31255-a020-4e2b-9a33-942aa1476d99-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "64c31255-a020-4e2b-9a33-942aa1476d99" (UID: "64c31255-a020-4e2b-9a33-942aa1476d99"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 08:02:29.135959 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:29.135940 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64c31255-a020-4e2b-9a33-942aa1476d99-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "64c31255-a020-4e2b-9a33-942aa1476d99" (UID: "64c31255-a020-4e2b-9a33-942aa1476d99"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 08:02:29.141430 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:29.141408 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64c31255-a020-4e2b-9a33-942aa1476d99-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "64c31255-a020-4e2b-9a33-942aa1476d99" (UID: "64c31255-a020-4e2b-9a33-942aa1476d99"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 08:02:29.233959 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:29.233928 2560 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/64c31255-a020-4e2b-9a33-942aa1476d99-installation-pull-secrets\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" May 28 08:02:29.233959 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:29.233957 2560 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/64c31255-a020-4e2b-9a33-942aa1476d99-registry-tls\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" May 28 08:02:29.233959 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:29.233966 2560 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/64c31255-a020-4e2b-9a33-942aa1476d99-registry-certificates\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" May 28 08:02:29.234172 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:29.233976 2560 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/64c31255-a020-4e2b-9a33-942aa1476d99-ca-trust-extracted\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" May 28 08:02:29.234172 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:29.233985 2560 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/64c31255-a020-4e2b-9a33-942aa1476d99-bound-sa-token\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" May 28 08:02:29.234172 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:29.233996 2560 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/64c31255-a020-4e2b-9a33-942aa1476d99-image-registry-private-configuration\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" May 28 08:02:29.234172 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:29.234005 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gs5m5\" (UniqueName: \"kubernetes.io/projected/64c31255-a020-4e2b-9a33-942aa1476d99-kube-api-access-gs5m5\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" May 28 08:02:29.309497 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:29.309469 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7cd9b98b77-qvqs4" event={"ID":"83f134e9-aca3-4db4-a5ce-2e120c9749b6","Type":"ContainerStarted","Data":"3a770bbf0010950de54f4dcd373365b6b6e3fa8ae8c136f9ac1916f759655fd7"} May 28 08:02:29.310641 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:29.310614 2560 generic.go:358] "Generic (PLEG): container finished" podID="64c31255-a020-4e2b-9a33-942aa1476d99" containerID="a8a06cc3cfd55894dac09b52bf17e8b91b8c081c8c50ff690d98f314a3b43067" exitCode=0 May 28 08:02:29.310747 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:29.310688 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8974698c9-jzf5f" event={"ID":"64c31255-a020-4e2b-9a33-942aa1476d99","Type":"ContainerDied","Data":"a8a06cc3cfd55894dac09b52bf17e8b91b8c081c8c50ff690d98f314a3b43067"} May 28 08:02:29.310747 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:29.310720 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8974698c9-jzf5f" May 28 08:02:29.310747 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:29.310726 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8974698c9-jzf5f" event={"ID":"64c31255-a020-4e2b-9a33-942aa1476d99","Type":"ContainerDied","Data":"3bde6002ac8fd45d2b64dd1809ddcbbea9982a68e0c5db758cab3d1d3e77cff0"} May 28 08:02:29.310923 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:29.310748 2560 scope.go:117] "RemoveContainer" containerID="a8a06cc3cfd55894dac09b52bf17e8b91b8c081c8c50ff690d98f314a3b43067" May 28 08:02:29.312360 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:29.312331 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66b6fc68b4-l9kgx" event={"ID":"f795adb5-f191-49c8-ac1a-103cf6280710","Type":"ContainerStarted","Data":"ad74d6740f28b0831f4d0b5d237c669df3ab2922e7c9d297640da211cf55ae9b"} May 28 08:02:29.312451 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:29.312365 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66b6fc68b4-l9kgx" event={"ID":"f795adb5-f191-49c8-ac1a-103cf6280710","Type":"ContainerStarted","Data":"5e7762c3f0a8adf668d814d0a68cd81323d492d2d27f51af39e35b277dddbce2"} May 28 08:02:29.313851 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:29.313824 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-tfbhm" event={"ID":"93e7087e-c377-4dbd-b97d-fd8f8463e9cf","Type":"ContainerStarted","Data":"7d4ac0239b92e26c25fcac35d9104a400bc45f568f633b1b12e9f5fc935bb476"} May 28 08:02:29.314076 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:29.314014 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-tfbhm" May 28 08:02:29.315024 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:29.315001 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"485ab764-14d8-47c0-83a8-77d22bc6cd88","Type":"ContainerStarted","Data":"8b22bd2e04a7d852ee6d13b41afe0edcb05bb0e24fffa48b016c7a03a99a9ba3"} May 28 08:02:29.319301 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:29.319280 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-tfbhm" May 28 08:02:29.320112 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:29.320097 2560 scope.go:117] "RemoveContainer" containerID="a8a06cc3cfd55894dac09b52bf17e8b91b8c081c8c50ff690d98f314a3b43067" May 28 08:02:29.320356 ip-10-0-139-133 kubenswrapper[2560]: E0528 08:02:29.320335 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8a06cc3cfd55894dac09b52bf17e8b91b8c081c8c50ff690d98f314a3b43067\": container with ID starting with a8a06cc3cfd55894dac09b52bf17e8b91b8c081c8c50ff690d98f314a3b43067 not found: ID does not exist" containerID="a8a06cc3cfd55894dac09b52bf17e8b91b8c081c8c50ff690d98f314a3b43067" May 28 08:02:29.320433 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:29.320360 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8a06cc3cfd55894dac09b52bf17e8b91b8c081c8c50ff690d98f314a3b43067"} err="failed to get container status \"a8a06cc3cfd55894dac09b52bf17e8b91b8c081c8c50ff690d98f314a3b43067\": rpc error: code = NotFound desc = could not find container \"a8a06cc3cfd55894dac09b52bf17e8b91b8c081c8c50ff690d98f314a3b43067\": container with ID starting with a8a06cc3cfd55894dac09b52bf17e8b91b8c081c8c50ff690d98f314a3b43067 not found: ID does not exist" May 28 08:02:29.328833 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:29.328798 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7cd9b98b77-qvqs4" podStartSLOduration=1.015348369 podStartE2EDuration="3.328787328s" podCreationTimestamp="2026-05-28 08:02:26 +0000 UTC" firstStartedPulling="2026-05-28 08:02:26.577346511 +0000 UTC m=+186.463792631" lastFinishedPulling="2026-05-28 08:02:28.890785468 +0000 UTC m=+188.777231590" observedRunningTime="2026-05-28 08:02:29.328107252 +0000 UTC m=+189.214553394" watchObservedRunningTime="2026-05-28 08:02:29.328787328 +0000 UTC m=+189.215233470" May 28 08:02:29.345292 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:29.345256 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-66b6fc68b4-l9kgx" podStartSLOduration=1.3452444780000001 podStartE2EDuration="1.345244478s" podCreationTimestamp="2026-05-28 08:02:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 08:02:29.344370109 +0000 UTC m=+189.230816249" watchObservedRunningTime="2026-05-28 08:02:29.345244478 +0000 UTC m=+189.231690620" May 28 08:02:29.359066 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:29.359028 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-665c9c8584-tfbhm" podStartSLOduration=1.844104909 podStartE2EDuration="3.359017634s" podCreationTimestamp="2026-05-28 08:02:26 +0000 UTC" firstStartedPulling="2026-05-28 08:02:27.375686367 +0000 UTC m=+187.262132487" lastFinishedPulling="2026-05-28 08:02:28.890599077 +0000 UTC m=+188.777045212" observedRunningTime="2026-05-28 08:02:29.358627844 +0000 UTC m=+189.245073989" watchObservedRunningTime="2026-05-28 08:02:29.359017634 +0000 UTC m=+189.245463821" May 28 08:02:29.373762 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:29.373740 2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8974698c9-jzf5f"] May 28 08:02:29.381970 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:29.381944 2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-8974698c9-jzf5f"] May 28 08:02:30.319339 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:30.319307 2560 generic.go:358] "Generic (PLEG): container finished" podID="485ab764-14d8-47c0-83a8-77d22bc6cd88" containerID="f659e4f589729f38a5b0190c0f6dee7129a5a39a06bbf94fd9a50efe9710723d" exitCode=0 May 28 08:02:30.319729 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:30.319391 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"485ab764-14d8-47c0-83a8-77d22bc6cd88","Type":"ContainerDied","Data":"f659e4f589729f38a5b0190c0f6dee7129a5a39a06bbf94fd9a50efe9710723d"} May 28 08:02:30.731292 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:30.731220 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64c31255-a020-4e2b-9a33-942aa1476d99" path="/var/lib/kubelet/pods/64c31255-a020-4e2b-9a33-942aa1476d99/volumes" May 28 08:02:32.531809 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:32.531770 2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66b6fc68b4-l9kgx"] May 28 08:02:32.559496 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:32.559468 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-6cf4f7d8d7-cgjdv"] May 28 08:02:32.559807 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:32.559794 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64c31255-a020-4e2b-9a33-942aa1476d99" containerName="registry" May 28 08:02:32.559854 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:32.559809 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="64c31255-a020-4e2b-9a33-942aa1476d99" containerName="registry" May 28 08:02:32.559891 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:32.559869 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="64c31255-a020-4e2b-9a33-942aa1476d99" containerName="registry" May 28 08:02:32.562652 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:32.562628 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cf4f7d8d7-cgjdv" May 28 08:02:32.570626 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:32.570597 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6cf4f7d8d7-cgjdv"] May 28 08:02:32.663547 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:32.663508 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1ffb9149-1613-4871-a279-20d2bf47bd07-oauth-serving-cert\") pod \"console-6cf4f7d8d7-cgjdv\" (UID: \"1ffb9149-1613-4871-a279-20d2bf47bd07\") " pod="openshift-console/console-6cf4f7d8d7-cgjdv" May 28 08:02:32.663746 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:32.663594 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1ffb9149-1613-4871-a279-20d2bf47bd07-service-ca\") pod \"console-6cf4f7d8d7-cgjdv\" (UID: \"1ffb9149-1613-4871-a279-20d2bf47bd07\") " pod="openshift-console/console-6cf4f7d8d7-cgjdv" May 28 08:02:32.663746 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:32.663646 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1ffb9149-1613-4871-a279-20d2bf47bd07-console-config\") pod \"console-6cf4f7d8d7-cgjdv\" (UID: \"1ffb9149-1613-4871-a279-20d2bf47bd07\") " pod="openshift-console/console-6cf4f7d8d7-cgjdv" May 28 08:02:32.663746 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:32.663672 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1ffb9149-1613-4871-a279-20d2bf47bd07-console-oauth-config\") pod \"console-6cf4f7d8d7-cgjdv\" (UID: \"1ffb9149-1613-4871-a279-20d2bf47bd07\") " pod="openshift-console/console-6cf4f7d8d7-cgjdv" May 28 08:02:32.663746 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:32.663716 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ffb9149-1613-4871-a279-20d2bf47bd07-trusted-ca-bundle\") pod \"console-6cf4f7d8d7-cgjdv\" (UID: \"1ffb9149-1613-4871-a279-20d2bf47bd07\") " pod="openshift-console/console-6cf4f7d8d7-cgjdv" May 28 08:02:32.663933 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:32.663786 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1ffb9149-1613-4871-a279-20d2bf47bd07-console-serving-cert\") pod \"console-6cf4f7d8d7-cgjdv\" (UID: \"1ffb9149-1613-4871-a279-20d2bf47bd07\") " pod="openshift-console/console-6cf4f7d8d7-cgjdv" May 28 08:02:32.663933 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:32.663817 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfbfh\" (UniqueName: \"kubernetes.io/projected/1ffb9149-1613-4871-a279-20d2bf47bd07-kube-api-access-nfbfh\") pod \"console-6cf4f7d8d7-cgjdv\" (UID: \"1ffb9149-1613-4871-a279-20d2bf47bd07\") " pod="openshift-console/console-6cf4f7d8d7-cgjdv" May 28 08:02:32.765184 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:32.765143 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1ffb9149-1613-4871-a279-20d2bf47bd07-oauth-serving-cert\") pod \"console-6cf4f7d8d7-cgjdv\" (UID: \"1ffb9149-1613-4871-a279-20d2bf47bd07\") " pod="openshift-console/console-6cf4f7d8d7-cgjdv" May 28 08:02:32.765363 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:32.765186 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1ffb9149-1613-4871-a279-20d2bf47bd07-service-ca\") pod \"console-6cf4f7d8d7-cgjdv\" (UID: \"1ffb9149-1613-4871-a279-20d2bf47bd07\") " pod="openshift-console/console-6cf4f7d8d7-cgjdv" May 28 08:02:32.765363 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:32.765219 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1ffb9149-1613-4871-a279-20d2bf47bd07-console-config\") pod \"console-6cf4f7d8d7-cgjdv\" (UID: \"1ffb9149-1613-4871-a279-20d2bf47bd07\") " pod="openshift-console/console-6cf4f7d8d7-cgjdv" May 28 08:02:32.765363 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:32.765246 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1ffb9149-1613-4871-a279-20d2bf47bd07-console-oauth-config\") pod \"console-6cf4f7d8d7-cgjdv\" (UID: \"1ffb9149-1613-4871-a279-20d2bf47bd07\") " pod="openshift-console/console-6cf4f7d8d7-cgjdv" May 28 08:02:32.765363 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:32.765270 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ffb9149-1613-4871-a279-20d2bf47bd07-trusted-ca-bundle\") pod \"console-6cf4f7d8d7-cgjdv\" (UID: \"1ffb9149-1613-4871-a279-20d2bf47bd07\") " pod="openshift-console/console-6cf4f7d8d7-cgjdv" May 28 08:02:32.765363 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:32.765311 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1ffb9149-1613-4871-a279-20d2bf47bd07-console-serving-cert\") pod \"console-6cf4f7d8d7-cgjdv\" (UID: \"1ffb9149-1613-4871-a279-20d2bf47bd07\") " pod="openshift-console/console-6cf4f7d8d7-cgjdv" May 28 08:02:32.765363 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:32.765334 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nfbfh\" (UniqueName: \"kubernetes.io/projected/1ffb9149-1613-4871-a279-20d2bf47bd07-kube-api-access-nfbfh\") pod \"console-6cf4f7d8d7-cgjdv\" (UID: \"1ffb9149-1613-4871-a279-20d2bf47bd07\") " pod="openshift-console/console-6cf4f7d8d7-cgjdv" May 28 08:02:32.766445 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:32.766385 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1ffb9149-1613-4871-a279-20d2bf47bd07-service-ca\") pod \"console-6cf4f7d8d7-cgjdv\" (UID: \"1ffb9149-1613-4871-a279-20d2bf47bd07\") " pod="openshift-console/console-6cf4f7d8d7-cgjdv" May 28 08:02:32.766616 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:32.766591 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1ffb9149-1613-4871-a279-20d2bf47bd07-oauth-serving-cert\") pod \"console-6cf4f7d8d7-cgjdv\" (UID: \"1ffb9149-1613-4871-a279-20d2bf47bd07\") " pod="openshift-console/console-6cf4f7d8d7-cgjdv" May 28 08:02:32.766705 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:32.766601 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1ffb9149-1613-4871-a279-20d2bf47bd07-console-config\") pod \"console-6cf4f7d8d7-cgjdv\" (UID: \"1ffb9149-1613-4871-a279-20d2bf47bd07\") " pod="openshift-console/console-6cf4f7d8d7-cgjdv" May 28 08:02:32.771520 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:32.768723 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1ffb9149-1613-4871-a279-20d2bf47bd07-console-oauth-config\") pod \"console-6cf4f7d8d7-cgjdv\" (UID: \"1ffb9149-1613-4871-a279-20d2bf47bd07\") " pod="openshift-console/console-6cf4f7d8d7-cgjdv" May 28 08:02:32.773053 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:32.773029 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1ffb9149-1613-4871-a279-20d2bf47bd07-console-serving-cert\") pod \"console-6cf4f7d8d7-cgjdv\" (UID: \"1ffb9149-1613-4871-a279-20d2bf47bd07\") " pod="openshift-console/console-6cf4f7d8d7-cgjdv" May 28 08:02:32.773174 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:32.773152 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ffb9149-1613-4871-a279-20d2bf47bd07-trusted-ca-bundle\") pod \"console-6cf4f7d8d7-cgjdv\" (UID: \"1ffb9149-1613-4871-a279-20d2bf47bd07\") " pod="openshift-console/console-6cf4f7d8d7-cgjdv" May 28 08:02:32.775032 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:32.775009 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfbfh\" (UniqueName: \"kubernetes.io/projected/1ffb9149-1613-4871-a279-20d2bf47bd07-kube-api-access-nfbfh\") pod \"console-6cf4f7d8d7-cgjdv\" (UID: \"1ffb9149-1613-4871-a279-20d2bf47bd07\") " pod="openshift-console/console-6cf4f7d8d7-cgjdv" May 28 08:02:32.872086 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:32.872037 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cf4f7d8d7-cgjdv" May 28 08:02:33.608751 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:33.608680 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6cf4f7d8d7-cgjdv"] May 28 08:02:33.611066 ip-10-0-139-133 kubenswrapper[2560]: W0528 08:02:33.611045 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ffb9149_1613_4871_a279_20d2bf47bd07.slice/crio-d24dc1f2b2e238dc942bfc18de1f8e5605af41f36399c480fd1ac2c9ea733349 WatchSource:0}: Error finding container d24dc1f2b2e238dc942bfc18de1f8e5605af41f36399c480fd1ac2c9ea733349: Status 404 returned error can't find the container with id d24dc1f2b2e238dc942bfc18de1f8e5605af41f36399c480fd1ac2c9ea733349 May 28 08:02:34.335434 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:34.335400 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"485ab764-14d8-47c0-83a8-77d22bc6cd88","Type":"ContainerStarted","Data":"6e170fc4575f167f4d44f292b2bd31ef22764a9d6270332c92dceb1119c03159"} May 28 08:02:34.335675 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:34.335440 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"485ab764-14d8-47c0-83a8-77d22bc6cd88","Type":"ContainerStarted","Data":"ce3abcc14cc49c839c7e3ddd78f0361a4390337a78d738536b7bd7c1a5c4567b"} May 28 08:02:34.336870 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:34.336844 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cf4f7d8d7-cgjdv" event={"ID":"1ffb9149-1613-4871-a279-20d2bf47bd07","Type":"ContainerStarted","Data":"e0937dcfb47657c6ef5f3e9cdd17c844579cb81b322b285d5111202659e86663"} May 28 08:02:34.337000 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:34.336876 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cf4f7d8d7-cgjdv" event={"ID":"1ffb9149-1613-4871-a279-20d2bf47bd07","Type":"ContainerStarted","Data":"d24dc1f2b2e238dc942bfc18de1f8e5605af41f36399c480fd1ac2c9ea733349"} May 28 08:02:34.356543 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:34.356503 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-6cf4f7d8d7-cgjdv" podStartSLOduration=2.356453907 podStartE2EDuration="2.356453907s" podCreationTimestamp="2026-05-28 08:02:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 08:02:34.355933321 +0000 UTC m=+194.242379484" watchObservedRunningTime="2026-05-28 08:02:34.356453907 +0000 UTC m=+194.242900053" May 28 08:02:36.345745 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:36.345704 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"485ab764-14d8-47c0-83a8-77d22bc6cd88","Type":"ContainerStarted","Data":"9a48cc0adfeee4e2c245b5d574de1d830a1a8d78d4ae6e0ccad8cf1f70df63bc"} May 28 08:02:36.345745 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:36.345750 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"485ab764-14d8-47c0-83a8-77d22bc6cd88","Type":"ContainerStarted","Data":"2a76d87005dfbe813c36db771a07ef163a69dff4ad70dd9f6e4e06de733f58e1"} May 28 08:02:36.346249 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:36.345763 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"485ab764-14d8-47c0-83a8-77d22bc6cd88","Type":"ContainerStarted","Data":"ab03c40af8fc5fc03a458875ea89e6ab6062ab247250327a7cf0c483dabb63fc"} May 28 08:02:36.346249 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:36.345777 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"485ab764-14d8-47c0-83a8-77d22bc6cd88","Type":"ContainerStarted","Data":"af6b81cf7fdcb02fa30fb1ff6777425f08687e934035304cc8a5b44b95f7afbf"} May 28 08:02:36.378968 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:36.378924 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.998602302 podStartE2EDuration="9.37891007s" podCreationTimestamp="2026-05-28 08:02:27 +0000 UTC" firstStartedPulling="2026-05-28 08:02:29.093556046 +0000 UTC m=+188.980002166" lastFinishedPulling="2026-05-28 08:02:35.473863799 +0000 UTC m=+195.360309934" observedRunningTime="2026-05-28 08:02:36.376008626 +0000 UTC m=+196.262454767" watchObservedRunningTime="2026-05-28 08:02:36.37891007 +0000 UTC m=+196.265356211" May 28 08:02:38.081202 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:38.081168 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 28 08:02:38.811987 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:38.811957 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-66b6fc68b4-l9kgx" May 28 08:02:42.872489 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:42.872453 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6cf4f7d8d7-cgjdv" May 28 08:02:42.872939 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:42.872519 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6cf4f7d8d7-cgjdv" May 28 08:02:42.877203 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:42.877183 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6cf4f7d8d7-cgjdv" May 28 08:02:43.369058 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:43.369031 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6cf4f7d8d7-cgjdv" May 28 08:02:43.412011 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:43.411978 2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f46d7bcb7-ks98h"] May 28 08:02:46.450327 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:46.450298 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7cd9b98b77-qvqs4" May 28 08:02:46.450733 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:46.450340 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7cd9b98b77-qvqs4" May 28 08:02:47.380021 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:47.379986 2560 generic.go:358] "Generic (PLEG): container finished" podID="7811826f-af04-4605-a732-f165273106d4" containerID="9332a717313f16aecf3fb8b5319d7224d1e8457e09fc3ae702740338a4d04ea1" exitCode=0 May 28 08:02:47.380170 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:47.380049 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-8mk4q" event={"ID":"7811826f-af04-4605-a732-f165273106d4","Type":"ContainerDied","Data":"9332a717313f16aecf3fb8b5319d7224d1e8457e09fc3ae702740338a4d04ea1"} May 28 08:02:47.380430 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:47.380413 2560 scope.go:117] "RemoveContainer" containerID="9332a717313f16aecf3fb8b5319d7224d1e8457e09fc3ae702740338a4d04ea1" May 28 08:02:48.384711 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:48.384681 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-8mk4q" event={"ID":"7811826f-af04-4605-a732-f165273106d4","Type":"ContainerStarted","Data":"359eaad0eaca36d915bfed4441e6e11de67eccfc7a4bfbec0906cdf15fb66bb7"} May 28 08:02:57.412548 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:57.412519 2560 generic.go:358] "Generic (PLEG): container finished" podID="c983dbdf-f0a8-4bb6-b8cc-0a759a317eb7" containerID="b70947cac77ab0e2ee72c3862ef909964279da0598105e90b43959540ed0a4a3" exitCode=0 May 28 08:02:57.412882 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:57.412593 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-449zx" event={"ID":"c983dbdf-f0a8-4bb6-b8cc-0a759a317eb7","Type":"ContainerDied","Data":"b70947cac77ab0e2ee72c3862ef909964279da0598105e90b43959540ed0a4a3"} May 28 08:02:57.412921 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:57.412891 2560 scope.go:117] "RemoveContainer" containerID="b70947cac77ab0e2ee72c3862ef909964279da0598105e90b43959540ed0a4a3" May 28 08:02:57.556094 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:57.556033 2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-66b6fc68b4-l9kgx" podUID="f795adb5-f191-49c8-ac1a-103cf6280710" containerName="console" containerID="cri-o://ad74d6740f28b0831f4d0b5d237c669df3ab2922e7c9d297640da211cf55ae9b" gracePeriod=15 May 28 08:02:57.798526 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:57.798501 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-66b6fc68b4-l9kgx_f795adb5-f191-49c8-ac1a-103cf6280710/console/0.log" May 28 08:02:57.798649 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:57.798617 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66b6fc68b4-l9kgx" May 28 08:02:57.880432 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:57.880411 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f795adb5-f191-49c8-ac1a-103cf6280710-console-serving-cert\") pod \"f795adb5-f191-49c8-ac1a-103cf6280710\" (UID: \"f795adb5-f191-49c8-ac1a-103cf6280710\") " May 28 08:02:57.880580 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:57.880440 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f795adb5-f191-49c8-ac1a-103cf6280710-trusted-ca-bundle\") pod \"f795adb5-f191-49c8-ac1a-103cf6280710\" (UID: \"f795adb5-f191-49c8-ac1a-103cf6280710\") " May 28 08:02:57.880580 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:57.880470 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f795adb5-f191-49c8-ac1a-103cf6280710-console-config\") pod \"f795adb5-f191-49c8-ac1a-103cf6280710\" (UID: \"f795adb5-f191-49c8-ac1a-103cf6280710\") " May 28 08:02:57.880580 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:57.880493 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f795adb5-f191-49c8-ac1a-103cf6280710-console-oauth-config\") pod \"f795adb5-f191-49c8-ac1a-103cf6280710\" (UID: \"f795adb5-f191-49c8-ac1a-103cf6280710\") " May 28 08:02:57.880580 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:57.880545 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f795adb5-f191-49c8-ac1a-103cf6280710-service-ca\") pod \"f795adb5-f191-49c8-ac1a-103cf6280710\" (UID: \"f795adb5-f191-49c8-ac1a-103cf6280710\") " May 28 08:02:57.880767 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:57.880636 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lt8n2\" (UniqueName: \"kubernetes.io/projected/f795adb5-f191-49c8-ac1a-103cf6280710-kube-api-access-lt8n2\") pod \"f795adb5-f191-49c8-ac1a-103cf6280710\" (UID: \"f795adb5-f191-49c8-ac1a-103cf6280710\") " May 28 08:02:57.880767 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:57.880673 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f795adb5-f191-49c8-ac1a-103cf6280710-oauth-serving-cert\") pod \"f795adb5-f191-49c8-ac1a-103cf6280710\" (UID: \"f795adb5-f191-49c8-ac1a-103cf6280710\") " May 28 08:02:57.880970 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:57.880906 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f795adb5-f191-49c8-ac1a-103cf6280710-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f795adb5-f191-49c8-ac1a-103cf6280710" (UID: "f795adb5-f191-49c8-ac1a-103cf6280710"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 08:02:57.881153 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:57.881124 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f795adb5-f191-49c8-ac1a-103cf6280710-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f795adb5-f191-49c8-ac1a-103cf6280710" (UID: "f795adb5-f191-49c8-ac1a-103cf6280710"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 08:02:57.881301 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:57.881260 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f795adb5-f191-49c8-ac1a-103cf6280710-console-config" (OuterVolumeSpecName: "console-config") pod "f795adb5-f191-49c8-ac1a-103cf6280710" (UID: "f795adb5-f191-49c8-ac1a-103cf6280710"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 08:02:57.881412 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:57.881334 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f795adb5-f191-49c8-ac1a-103cf6280710-service-ca" (OuterVolumeSpecName: "service-ca") pod "f795adb5-f191-49c8-ac1a-103cf6280710" (UID: "f795adb5-f191-49c8-ac1a-103cf6280710"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 08:02:57.882761 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:57.882741 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f795adb5-f191-49c8-ac1a-103cf6280710-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f795adb5-f191-49c8-ac1a-103cf6280710" (UID: "f795adb5-f191-49c8-ac1a-103cf6280710"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 08:02:57.883141 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:57.883124 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f795adb5-f191-49c8-ac1a-103cf6280710-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f795adb5-f191-49c8-ac1a-103cf6280710" (UID: "f795adb5-f191-49c8-ac1a-103cf6280710"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 08:02:57.883186 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:57.883143 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f795adb5-f191-49c8-ac1a-103cf6280710-kube-api-access-lt8n2" (OuterVolumeSpecName: "kube-api-access-lt8n2") pod "f795adb5-f191-49c8-ac1a-103cf6280710" (UID: "f795adb5-f191-49c8-ac1a-103cf6280710"). InnerVolumeSpecName "kube-api-access-lt8n2". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 08:02:57.981253 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:57.981228 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lt8n2\" (UniqueName: \"kubernetes.io/projected/f795adb5-f191-49c8-ac1a-103cf6280710-kube-api-access-lt8n2\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" May 28 08:02:57.981253 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:57.981251 2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f795adb5-f191-49c8-ac1a-103cf6280710-oauth-serving-cert\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" May 28 08:02:57.981378 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:57.981261 2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f795adb5-f191-49c8-ac1a-103cf6280710-console-serving-cert\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" May 28 08:02:57.981378 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:57.981269 2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f795adb5-f191-49c8-ac1a-103cf6280710-trusted-ca-bundle\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" May 28 08:02:57.981378 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:57.981279 2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f795adb5-f191-49c8-ac1a-103cf6280710-console-config\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" May 28 08:02:57.981378 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:57.981287 2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f795adb5-f191-49c8-ac1a-103cf6280710-console-oauth-config\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" May 28 08:02:57.981378 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:57.981295 2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f795adb5-f191-49c8-ac1a-103cf6280710-service-ca\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" May 28 08:02:58.350263 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:58.350235 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-88fmq_ec820620-b736-430c-831d-5d2b97e83d32/dns/0.log" May 28 08:02:58.416968 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:58.416944 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-66b6fc68b4-l9kgx_f795adb5-f191-49c8-ac1a-103cf6280710/console/0.log" May 28 08:02:58.417354 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:58.416979 2560 generic.go:358] "Generic (PLEG): container finished" podID="f795adb5-f191-49c8-ac1a-103cf6280710" containerID="ad74d6740f28b0831f4d0b5d237c669df3ab2922e7c9d297640da211cf55ae9b" exitCode=2 May 28 08:02:58.417354 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:58.417038 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66b6fc68b4-l9kgx" event={"ID":"f795adb5-f191-49c8-ac1a-103cf6280710","Type":"ContainerDied","Data":"ad74d6740f28b0831f4d0b5d237c669df3ab2922e7c9d297640da211cf55ae9b"} May 28 08:02:58.417354 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:58.417046 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66b6fc68b4-l9kgx" May 28 08:02:58.417354 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:58.417062 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66b6fc68b4-l9kgx" event={"ID":"f795adb5-f191-49c8-ac1a-103cf6280710","Type":"ContainerDied","Data":"5e7762c3f0a8adf668d814d0a68cd81323d492d2d27f51af39e35b277dddbce2"} May 28 08:02:58.417354 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:58.417081 2560 scope.go:117] "RemoveContainer" containerID="ad74d6740f28b0831f4d0b5d237c669df3ab2922e7c9d297640da211cf55ae9b" May 28 08:02:58.418962 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:58.418937 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-449zx" event={"ID":"c983dbdf-f0a8-4bb6-b8cc-0a759a317eb7","Type":"ContainerStarted","Data":"77a84ec786b5e01d3a7660e73ef902da7ab29c3fee109eed670bde1e65165b4a"} May 28 08:02:58.425649 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:58.425627 2560 scope.go:117] "RemoveContainer" containerID="ad74d6740f28b0831f4d0b5d237c669df3ab2922e7c9d297640da211cf55ae9b" May 28 08:02:58.425975 ip-10-0-139-133 kubenswrapper[2560]: E0528 08:02:58.425912 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad74d6740f28b0831f4d0b5d237c669df3ab2922e7c9d297640da211cf55ae9b\": container with ID starting with ad74d6740f28b0831f4d0b5d237c669df3ab2922e7c9d297640da211cf55ae9b not found: ID does not exist" containerID="ad74d6740f28b0831f4d0b5d237c669df3ab2922e7c9d297640da211cf55ae9b" May 28 08:02:58.425975 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:58.425948 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad74d6740f28b0831f4d0b5d237c669df3ab2922e7c9d297640da211cf55ae9b"} err="failed to get container status \"ad74d6740f28b0831f4d0b5d237c669df3ab2922e7c9d297640da211cf55ae9b\": rpc error: code = NotFound desc = could not find container \"ad74d6740f28b0831f4d0b5d237c669df3ab2922e7c9d297640da211cf55ae9b\": container with ID starting with ad74d6740f28b0831f4d0b5d237c669df3ab2922e7c9d297640da211cf55ae9b not found: ID does not exist" May 28 08:02:58.451171 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:58.451147 2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66b6fc68b4-l9kgx"] May 28 08:02:58.456683 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:58.456660 2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-66b6fc68b4-l9kgx"] May 28 08:02:58.548729 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:58.548708 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-88fmq_ec820620-b736-430c-831d-5d2b97e83d32/kube-rbac-proxy/0.log" May 28 08:02:58.732422 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:58.732389 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f795adb5-f191-49c8-ac1a-103cf6280710" path="/var/lib/kubelet/pods/f795adb5-f191-49c8-ac1a-103cf6280710/volumes" May 28 08:02:59.948480 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:02:59.948452 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xhm9j_8db07e49-d641-48b0-89e4-2f4bdf6999a5/dns-node-resolver/0.log" May 28 08:03:00.748355 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:00.748327 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qtd5f_b2d0b175-5e98-4b80-94e3-92a78b286c16/serve-healthcheck-canary/0.log" May 28 08:03:06.455692 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:06.455656 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7cd9b98b77-qvqs4" May 28 08:03:06.459489 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:06.459455 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7cd9b98b77-qvqs4" May 28 08:03:07.445169 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:07.445136 2560 generic.go:358] "Generic (PLEG): container finished" podID="1f418e03-845a-44f2-a3bd-5dcc46b6df6c" containerID="d11292a9fde602a6e83921a9dc8fac758ddd728eecdcaf561aa51ab5d9152d2f" exitCode=0 May 28 08:03:07.445339 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:07.445211 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-bxk8j" event={"ID":"1f418e03-845a-44f2-a3bd-5dcc46b6df6c","Type":"ContainerDied","Data":"d11292a9fde602a6e83921a9dc8fac758ddd728eecdcaf561aa51ab5d9152d2f"} May 28 08:03:07.445585 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:07.445555 2560 scope.go:117] "RemoveContainer" containerID="d11292a9fde602a6e83921a9dc8fac758ddd728eecdcaf561aa51ab5d9152d2f" May 28 08:03:08.431092 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:08.431049 2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-5f46d7bcb7-ks98h" podUID="29a39155-7c9d-4586-b9a9-4100c8564934" containerName="console" containerID="cri-o://f63dafb390357db3c6a5adfd0ca37d4806f32e1abe071859b5a73e0dcf2b3e1d" gracePeriod=15 May 28 08:03:08.449816 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:08.449793 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-bxk8j" event={"ID":"1f418e03-845a-44f2-a3bd-5dcc46b6df6c","Type":"ContainerStarted","Data":"0e8253045bb1246f4468a54201e85a4a9fab6eeb6641f9f27cd67a603f919468"} May 28 08:03:08.711866 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:08.711838 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5f46d7bcb7-ks98h_29a39155-7c9d-4586-b9a9-4100c8564934/console/0.log" May 28 08:03:08.711989 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:08.711919 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f46d7bcb7-ks98h" May 28 08:03:08.866814 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:08.866782 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n2xtm\" (UniqueName: \"kubernetes.io/projected/29a39155-7c9d-4586-b9a9-4100c8564934-kube-api-access-n2xtm\") pod \"29a39155-7c9d-4586-b9a9-4100c8564934\" (UID: \"29a39155-7c9d-4586-b9a9-4100c8564934\") " May 28 08:03:08.866967 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:08.866884 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/29a39155-7c9d-4586-b9a9-4100c8564934-service-ca\") pod \"29a39155-7c9d-4586-b9a9-4100c8564934\" (UID: \"29a39155-7c9d-4586-b9a9-4100c8564934\") " May 28 08:03:08.866967 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:08.866940 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/29a39155-7c9d-4586-b9a9-4100c8564934-oauth-serving-cert\") pod \"29a39155-7c9d-4586-b9a9-4100c8564934\" (UID: \"29a39155-7c9d-4586-b9a9-4100c8564934\") " May 28 08:03:08.867071 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:08.866986 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/29a39155-7c9d-4586-b9a9-4100c8564934-console-serving-cert\") pod \"29a39155-7c9d-4586-b9a9-4100c8564934\" (UID: \"29a39155-7c9d-4586-b9a9-4100c8564934\") " May 28 08:03:08.867071 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:08.867033 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/29a39155-7c9d-4586-b9a9-4100c8564934-console-oauth-config\") pod \"29a39155-7c9d-4586-b9a9-4100c8564934\" (UID: \"29a39155-7c9d-4586-b9a9-4100c8564934\") " May 28 08:03:08.867071 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:08.867063 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/29a39155-7c9d-4586-b9a9-4100c8564934-console-config\") pod \"29a39155-7c9d-4586-b9a9-4100c8564934\" (UID: \"29a39155-7c9d-4586-b9a9-4100c8564934\") " May 28 08:03:08.867277 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:08.867252 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29a39155-7c9d-4586-b9a9-4100c8564934-service-ca" (OuterVolumeSpecName: "service-ca") pod "29a39155-7c9d-4586-b9a9-4100c8564934" (UID: "29a39155-7c9d-4586-b9a9-4100c8564934"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 08:03:08.867360 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:08.867337 2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/29a39155-7c9d-4586-b9a9-4100c8564934-service-ca\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" May 28 08:03:08.867449 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:08.867326 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29a39155-7c9d-4586-b9a9-4100c8564934-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "29a39155-7c9d-4586-b9a9-4100c8564934" (UID: "29a39155-7c9d-4586-b9a9-4100c8564934"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 08:03:08.867532 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:08.867504 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29a39155-7c9d-4586-b9a9-4100c8564934-console-config" (OuterVolumeSpecName: "console-config") pod "29a39155-7c9d-4586-b9a9-4100c8564934" (UID: "29a39155-7c9d-4586-b9a9-4100c8564934"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 08:03:08.869322 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:08.869290 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29a39155-7c9d-4586-b9a9-4100c8564934-kube-api-access-n2xtm" (OuterVolumeSpecName: "kube-api-access-n2xtm") pod "29a39155-7c9d-4586-b9a9-4100c8564934" (UID: "29a39155-7c9d-4586-b9a9-4100c8564934"). InnerVolumeSpecName "kube-api-access-n2xtm". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 08:03:08.869521 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:08.869500 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/29a39155-7c9d-4586-b9a9-4100c8564934-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "29a39155-7c9d-4586-b9a9-4100c8564934" (UID: "29a39155-7c9d-4586-b9a9-4100c8564934"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 08:03:08.869636 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:08.869618 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/29a39155-7c9d-4586-b9a9-4100c8564934-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "29a39155-7c9d-4586-b9a9-4100c8564934" (UID: "29a39155-7c9d-4586-b9a9-4100c8564934"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 08:03:08.968520 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:08.968418 2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/29a39155-7c9d-4586-b9a9-4100c8564934-oauth-serving-cert\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" May 28 08:03:08.968520 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:08.968457 2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/29a39155-7c9d-4586-b9a9-4100c8564934-console-serving-cert\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" May 28 08:03:08.968520 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:08.968473 2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/29a39155-7c9d-4586-b9a9-4100c8564934-console-oauth-config\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" May 28 08:03:08.968520 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:08.968491 2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/29a39155-7c9d-4586-b9a9-4100c8564934-console-config\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" May 28 08:03:08.968520 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:08.968507 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n2xtm\" (UniqueName: \"kubernetes.io/projected/29a39155-7c9d-4586-b9a9-4100c8564934-kube-api-access-n2xtm\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" May 28 08:03:09.454908 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:09.454882 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5f46d7bcb7-ks98h_29a39155-7c9d-4586-b9a9-4100c8564934/console/0.log" May 28 08:03:09.455356 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:09.454920 2560 generic.go:358] "Generic (PLEG): container finished" podID="29a39155-7c9d-4586-b9a9-4100c8564934" containerID="f63dafb390357db3c6a5adfd0ca37d4806f32e1abe071859b5a73e0dcf2b3e1d" exitCode=2 May 28 08:03:09.455356 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:09.454952 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f46d7bcb7-ks98h" event={"ID":"29a39155-7c9d-4586-b9a9-4100c8564934","Type":"ContainerDied","Data":"f63dafb390357db3c6a5adfd0ca37d4806f32e1abe071859b5a73e0dcf2b3e1d"} May 28 08:03:09.455356 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:09.454995 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f46d7bcb7-ks98h" event={"ID":"29a39155-7c9d-4586-b9a9-4100c8564934","Type":"ContainerDied","Data":"235e93a9c0efc8b30d535cbba60619f2e2ec57d41488da6657d42748ab8cd204"} May 28 08:03:09.455356 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:09.455010 2560 scope.go:117] "RemoveContainer" containerID="f63dafb390357db3c6a5adfd0ca37d4806f32e1abe071859b5a73e0dcf2b3e1d" May 28 08:03:09.455356 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:09.455013 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f46d7bcb7-ks98h" May 28 08:03:09.464394 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:09.464377 2560 scope.go:117] "RemoveContainer" containerID="f63dafb390357db3c6a5adfd0ca37d4806f32e1abe071859b5a73e0dcf2b3e1d" May 28 08:03:09.464677 ip-10-0-139-133 kubenswrapper[2560]: E0528 08:03:09.464655 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f63dafb390357db3c6a5adfd0ca37d4806f32e1abe071859b5a73e0dcf2b3e1d\": container with ID starting with f63dafb390357db3c6a5adfd0ca37d4806f32e1abe071859b5a73e0dcf2b3e1d not found: ID does not exist" containerID="f63dafb390357db3c6a5adfd0ca37d4806f32e1abe071859b5a73e0dcf2b3e1d" May 28 08:03:09.464760 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:09.464683 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f63dafb390357db3c6a5adfd0ca37d4806f32e1abe071859b5a73e0dcf2b3e1d"} err="failed to get container status \"f63dafb390357db3c6a5adfd0ca37d4806f32e1abe071859b5a73e0dcf2b3e1d\": rpc error: code = NotFound desc = could not find container \"f63dafb390357db3c6a5adfd0ca37d4806f32e1abe071859b5a73e0dcf2b3e1d\": container with ID starting with f63dafb390357db3c6a5adfd0ca37d4806f32e1abe071859b5a73e0dcf2b3e1d not found: ID does not exist" May 28 08:03:09.475612 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:09.475552 2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f46d7bcb7-ks98h"] May 28 08:03:09.478816 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:09.478794 2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5f46d7bcb7-ks98h"] May 28 08:03:10.731289 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:10.731256 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29a39155-7c9d-4586-b9a9-4100c8564934" path="/var/lib/kubelet/pods/29a39155-7c9d-4586-b9a9-4100c8564934/volumes" May 28 08:03:28.081023 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:28.080991 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 28 08:03:28.099549 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:28.099526 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 28 08:03:28.529737 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:28.529669 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 28 08:03:31.538890 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:31.538814 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f2c94ed-4111-42f9-8ec1-7c96447b9c11-metrics-certs\") pod \"network-metrics-daemon-z5j9k\" (UID: \"5f2c94ed-4111-42f9-8ec1-7c96447b9c11\") " pod="openshift-multus/network-metrics-daemon-z5j9k" May 28 08:03:31.541070 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:31.541049 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f2c94ed-4111-42f9-8ec1-7c96447b9c11-metrics-certs\") pod \"network-metrics-daemon-z5j9k\" (UID: \"5f2c94ed-4111-42f9-8ec1-7c96447b9c11\") " pod="openshift-multus/network-metrics-daemon-z5j9k" May 28 08:03:31.732803 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:31.732775 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-q9jcs\"" May 28 08:03:31.741489 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:31.741469 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z5j9k" May 28 08:03:31.860391 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:31.860365 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-z5j9k"] May 28 08:03:31.862614 ip-10-0-139-133 kubenswrapper[2560]: W0528 08:03:31.862590 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f2c94ed_4111_42f9_8ec1_7c96447b9c11.slice/crio-cc029f24fa3a54d06b64d087389b386057434fe5cc021e696e6f046386829151 WatchSource:0}: Error finding container cc029f24fa3a54d06b64d087389b386057434fe5cc021e696e6f046386829151: Status 404 returned error can't find the container with id cc029f24fa3a54d06b64d087389b386057434fe5cc021e696e6f046386829151 May 28 08:03:32.528186 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:32.528139 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-z5j9k" event={"ID":"5f2c94ed-4111-42f9-8ec1-7c96447b9c11","Type":"ContainerStarted","Data":"cc029f24fa3a54d06b64d087389b386057434fe5cc021e696e6f046386829151"} May 28 08:03:33.532399 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:33.532371 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-z5j9k" event={"ID":"5f2c94ed-4111-42f9-8ec1-7c96447b9c11","Type":"ContainerStarted","Data":"426ad9d57c0465deada4143e8012edd4aa5cf73e23c831997359b7f63e7cd775"} May 28 08:03:33.532399 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:33.532404 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-z5j9k" event={"ID":"5f2c94ed-4111-42f9-8ec1-7c96447b9c11","Type":"ContainerStarted","Data":"f3f6dcd27dc33c0f07695c6e7f7f3d516c5661283287d1701ce8332d750f8b63"} May 28 08:03:33.547197 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:33.547153 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-z5j9k" podStartSLOduration=252.577640306 podStartE2EDuration="4m13.547135667s" podCreationTimestamp="2026-05-28 07:59:20 +0000 UTC" firstStartedPulling="2026-05-28 08:03:31.864278966 +0000 UTC m=+251.750725089" lastFinishedPulling="2026-05-28 08:03:32.833774318 +0000 UTC m=+252.720220450" observedRunningTime="2026-05-28 08:03:33.545763434 +0000 UTC m=+253.432209577" watchObservedRunningTime="2026-05-28 08:03:33.547135667 +0000 UTC m=+253.433581808" May 28 08:03:46.109394 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.109357 2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 28 08:03:46.109998 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.109964 2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="485ab764-14d8-47c0-83a8-77d22bc6cd88" containerName="prometheus" containerID="cri-o://ce3abcc14cc49c839c7e3ddd78f0361a4390337a78d738536b7bd7c1a5c4567b" gracePeriod=600 May 28 08:03:46.110649 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.110180 2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="485ab764-14d8-47c0-83a8-77d22bc6cd88" containerName="kube-rbac-proxy-thanos" containerID="cri-o://9a48cc0adfeee4e2c245b5d574de1d830a1a8d78d4ae6e0ccad8cf1f70df63bc" gracePeriod=600 May 28 08:03:46.111537 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.110401 2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="485ab764-14d8-47c0-83a8-77d22bc6cd88" containerName="thanos-sidecar" containerID="cri-o://af6b81cf7fdcb02fa30fb1ff6777425f08687e934035304cc8a5b44b95f7afbf" gracePeriod=600 May 28 08:03:46.111537 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.110429 2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="485ab764-14d8-47c0-83a8-77d22bc6cd88" containerName="kube-rbac-proxy" containerID="cri-o://2a76d87005dfbe813c36db771a07ef163a69dff4ad70dd9f6e4e06de733f58e1" gracePeriod=600 May 28 08:03:46.111537 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.110422 2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="485ab764-14d8-47c0-83a8-77d22bc6cd88" containerName="config-reloader" containerID="cri-o://6e170fc4575f167f4d44f292b2bd31ef22764a9d6270332c92dceb1119c03159" gracePeriod=600 May 28 08:03:46.111728 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.110477 2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="485ab764-14d8-47c0-83a8-77d22bc6cd88" containerName="kube-rbac-proxy-web" containerID="cri-o://ab03c40af8fc5fc03a458875ea89e6ab6062ab247250327a7cf0c483dabb63fc" gracePeriod=600 May 28 08:03:46.373817 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.373547 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 28 08:03:46.460293 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.460262 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/485ab764-14d8-47c0-83a8-77d22bc6cd88-thanos-prometheus-http-client-file\") pod \"485ab764-14d8-47c0-83a8-77d22bc6cd88\" (UID: \"485ab764-14d8-47c0-83a8-77d22bc6cd88\") " May 28 08:03:46.460477 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.460309 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/485ab764-14d8-47c0-83a8-77d22bc6cd88-tls-assets\") pod \"485ab764-14d8-47c0-83a8-77d22bc6cd88\" (UID: \"485ab764-14d8-47c0-83a8-77d22bc6cd88\") " May 28 08:03:46.460477 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.460327 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/485ab764-14d8-47c0-83a8-77d22bc6cd88-configmap-kubelet-serving-ca-bundle\") pod \"485ab764-14d8-47c0-83a8-77d22bc6cd88\" (UID: \"485ab764-14d8-47c0-83a8-77d22bc6cd88\") " May 28 08:03:46.460477 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.460360 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/485ab764-14d8-47c0-83a8-77d22bc6cd88-prometheus-k8s-rulefiles-0\") pod \"485ab764-14d8-47c0-83a8-77d22bc6cd88\" (UID: \"485ab764-14d8-47c0-83a8-77d22bc6cd88\") " May 28 08:03:46.460477 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.460382 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/485ab764-14d8-47c0-83a8-77d22bc6cd88-secret-grpc-tls\") pod \"485ab764-14d8-47c0-83a8-77d22bc6cd88\" (UID: \"485ab764-14d8-47c0-83a8-77d22bc6cd88\") " May 28 08:03:46.460477 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.460401 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/485ab764-14d8-47c0-83a8-77d22bc6cd88-secret-metrics-client-certs\") pod \"485ab764-14d8-47c0-83a8-77d22bc6cd88\" (UID: \"485ab764-14d8-47c0-83a8-77d22bc6cd88\") " May 28 08:03:46.460477 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.460437 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/485ab764-14d8-47c0-83a8-77d22bc6cd88-config-out\") pod \"485ab764-14d8-47c0-83a8-77d22bc6cd88\" (UID: \"485ab764-14d8-47c0-83a8-77d22bc6cd88\") " May 28 08:03:46.460477 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.460475 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/485ab764-14d8-47c0-83a8-77d22bc6cd88-prometheus-k8s-db\") pod \"485ab764-14d8-47c0-83a8-77d22bc6cd88\" (UID: \"485ab764-14d8-47c0-83a8-77d22bc6cd88\") " May 28 08:03:46.460786 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.460501 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/485ab764-14d8-47c0-83a8-77d22bc6cd88-secret-kube-rbac-proxy\") pod \"485ab764-14d8-47c0-83a8-77d22bc6cd88\" (UID: \"485ab764-14d8-47c0-83a8-77d22bc6cd88\") " May 28 08:03:46.460786 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.460534 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/485ab764-14d8-47c0-83a8-77d22bc6cd88-prometheus-trusted-ca-bundle\") pod \"485ab764-14d8-47c0-83a8-77d22bc6cd88\" (UID: \"485ab764-14d8-47c0-83a8-77d22bc6cd88\") " May 28 08:03:46.460786 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.460602 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/485ab764-14d8-47c0-83a8-77d22bc6cd88-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"485ab764-14d8-47c0-83a8-77d22bc6cd88\" (UID: \"485ab764-14d8-47c0-83a8-77d22bc6cd88\") " May 28 08:03:46.460786 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.460633 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t6gnp\" (UniqueName: \"kubernetes.io/projected/485ab764-14d8-47c0-83a8-77d22bc6cd88-kube-api-access-t6gnp\") pod \"485ab764-14d8-47c0-83a8-77d22bc6cd88\" (UID: \"485ab764-14d8-47c0-83a8-77d22bc6cd88\") " May 28 08:03:46.460786 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.460658 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/485ab764-14d8-47c0-83a8-77d22bc6cd88-configmap-serving-certs-ca-bundle\") pod \"485ab764-14d8-47c0-83a8-77d22bc6cd88\" (UID: \"485ab764-14d8-47c0-83a8-77d22bc6cd88\") " May 28 08:03:46.460786 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.460683 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/485ab764-14d8-47c0-83a8-77d22bc6cd88-config\") pod \"485ab764-14d8-47c0-83a8-77d22bc6cd88\" (UID: \"485ab764-14d8-47c0-83a8-77d22bc6cd88\") " May 28 08:03:46.460786 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.460715 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/485ab764-14d8-47c0-83a8-77d22bc6cd88-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"485ab764-14d8-47c0-83a8-77d22bc6cd88\" (UID: \"485ab764-14d8-47c0-83a8-77d22bc6cd88\") " May 28 08:03:46.460786 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.460751 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/485ab764-14d8-47c0-83a8-77d22bc6cd88-configmap-metrics-client-ca\") pod \"485ab764-14d8-47c0-83a8-77d22bc6cd88\" (UID: \"485ab764-14d8-47c0-83a8-77d22bc6cd88\") " May 28 08:03:46.460786 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.460745 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/485ab764-14d8-47c0-83a8-77d22bc6cd88-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "485ab764-14d8-47c0-83a8-77d22bc6cd88" (UID: "485ab764-14d8-47c0-83a8-77d22bc6cd88"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 08:03:46.460786 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.460777 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/485ab764-14d8-47c0-83a8-77d22bc6cd88-secret-prometheus-k8s-tls\") pod \"485ab764-14d8-47c0-83a8-77d22bc6cd88\" (UID: \"485ab764-14d8-47c0-83a8-77d22bc6cd88\") " May 28 08:03:46.461255 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.460802 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/485ab764-14d8-47c0-83a8-77d22bc6cd88-web-config\") pod \"485ab764-14d8-47c0-83a8-77d22bc6cd88\" (UID: \"485ab764-14d8-47c0-83a8-77d22bc6cd88\") " May 28 08:03:46.461255 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.461070 2560 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/485ab764-14d8-47c0-83a8-77d22bc6cd88-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" May 28 08:03:46.462140 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.461472 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/485ab764-14d8-47c0-83a8-77d22bc6cd88-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "485ab764-14d8-47c0-83a8-77d22bc6cd88" (UID: "485ab764-14d8-47c0-83a8-77d22bc6cd88"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 08:03:46.462140 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.461763 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/485ab764-14d8-47c0-83a8-77d22bc6cd88-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "485ab764-14d8-47c0-83a8-77d22bc6cd88" (UID: "485ab764-14d8-47c0-83a8-77d22bc6cd88"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 08:03:46.462140 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.461802 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/485ab764-14d8-47c0-83a8-77d22bc6cd88-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "485ab764-14d8-47c0-83a8-77d22bc6cd88" (UID: "485ab764-14d8-47c0-83a8-77d22bc6cd88"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 08:03:46.462140 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.462092 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/485ab764-14d8-47c0-83a8-77d22bc6cd88-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "485ab764-14d8-47c0-83a8-77d22bc6cd88" (UID: "485ab764-14d8-47c0-83a8-77d22bc6cd88"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 08:03:46.462423 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.462175 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/485ab764-14d8-47c0-83a8-77d22bc6cd88-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "485ab764-14d8-47c0-83a8-77d22bc6cd88" (UID: "485ab764-14d8-47c0-83a8-77d22bc6cd88"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 08:03:46.463506 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.463469 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/485ab764-14d8-47c0-83a8-77d22bc6cd88-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "485ab764-14d8-47c0-83a8-77d22bc6cd88" (UID: "485ab764-14d8-47c0-83a8-77d22bc6cd88"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 08:03:46.464579 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.464536 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/485ab764-14d8-47c0-83a8-77d22bc6cd88-config" (OuterVolumeSpecName: "config") pod "485ab764-14d8-47c0-83a8-77d22bc6cd88" (UID: "485ab764-14d8-47c0-83a8-77d22bc6cd88"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 08:03:46.464717 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.464683 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/485ab764-14d8-47c0-83a8-77d22bc6cd88-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "485ab764-14d8-47c0-83a8-77d22bc6cd88" (UID: "485ab764-14d8-47c0-83a8-77d22bc6cd88"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 08:03:46.464915 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.464776 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/485ab764-14d8-47c0-83a8-77d22bc6cd88-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "485ab764-14d8-47c0-83a8-77d22bc6cd88" (UID: "485ab764-14d8-47c0-83a8-77d22bc6cd88"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 08:03:46.464915 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.464803 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/485ab764-14d8-47c0-83a8-77d22bc6cd88-config-out" (OuterVolumeSpecName: "config-out") pod "485ab764-14d8-47c0-83a8-77d22bc6cd88" (UID: "485ab764-14d8-47c0-83a8-77d22bc6cd88"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 08:03:46.464915 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.464809 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/485ab764-14d8-47c0-83a8-77d22bc6cd88-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "485ab764-14d8-47c0-83a8-77d22bc6cd88" (UID: "485ab764-14d8-47c0-83a8-77d22bc6cd88"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 08:03:46.464915 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.464884 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/485ab764-14d8-47c0-83a8-77d22bc6cd88-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "485ab764-14d8-47c0-83a8-77d22bc6cd88" (UID: "485ab764-14d8-47c0-83a8-77d22bc6cd88"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 08:03:46.465254 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.465233 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/485ab764-14d8-47c0-83a8-77d22bc6cd88-kube-api-access-t6gnp" (OuterVolumeSpecName: "kube-api-access-t6gnp") pod "485ab764-14d8-47c0-83a8-77d22bc6cd88" (UID: "485ab764-14d8-47c0-83a8-77d22bc6cd88"). InnerVolumeSpecName "kube-api-access-t6gnp". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 08:03:46.465432 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.465415 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/485ab764-14d8-47c0-83a8-77d22bc6cd88-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "485ab764-14d8-47c0-83a8-77d22bc6cd88" (UID: "485ab764-14d8-47c0-83a8-77d22bc6cd88"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 08:03:46.465509 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.465486 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/485ab764-14d8-47c0-83a8-77d22bc6cd88-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "485ab764-14d8-47c0-83a8-77d22bc6cd88" (UID: "485ab764-14d8-47c0-83a8-77d22bc6cd88"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 08:03:46.466102 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.466087 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/485ab764-14d8-47c0-83a8-77d22bc6cd88-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "485ab764-14d8-47c0-83a8-77d22bc6cd88" (UID: "485ab764-14d8-47c0-83a8-77d22bc6cd88"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 08:03:46.474492 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.474469 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/485ab764-14d8-47c0-83a8-77d22bc6cd88-web-config" (OuterVolumeSpecName: "web-config") pod "485ab764-14d8-47c0-83a8-77d22bc6cd88" (UID: "485ab764-14d8-47c0-83a8-77d22bc6cd88"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 08:03:46.561702 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.561676 2560 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/485ab764-14d8-47c0-83a8-77d22bc6cd88-thanos-prometheus-http-client-file\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" May 28 08:03:46.561702 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.561701 2560 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/485ab764-14d8-47c0-83a8-77d22bc6cd88-tls-assets\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" May 28 08:03:46.561702 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.561711 2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/485ab764-14d8-47c0-83a8-77d22bc6cd88-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" May 28 08:03:46.561900 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.561720 2560 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/485ab764-14d8-47c0-83a8-77d22bc6cd88-secret-grpc-tls\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" May 28 08:03:46.561900 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.561731 2560 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/485ab764-14d8-47c0-83a8-77d22bc6cd88-secret-metrics-client-certs\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" May 28 08:03:46.561900 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.561740 2560 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/485ab764-14d8-47c0-83a8-77d22bc6cd88-config-out\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" May 28 08:03:46.561900 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.561749 2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/485ab764-14d8-47c0-83a8-77d22bc6cd88-prometheus-k8s-db\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" May 28 08:03:46.561900 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.561758 2560 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/485ab764-14d8-47c0-83a8-77d22bc6cd88-secret-kube-rbac-proxy\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" May 28 08:03:46.561900 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.561766 2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/485ab764-14d8-47c0-83a8-77d22bc6cd88-prometheus-trusted-ca-bundle\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" May 28 08:03:46.561900 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.561776 2560 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/485ab764-14d8-47c0-83a8-77d22bc6cd88-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" May 28 08:03:46.561900 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.561786 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t6gnp\" (UniqueName: \"kubernetes.io/projected/485ab764-14d8-47c0-83a8-77d22bc6cd88-kube-api-access-t6gnp\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" May 28 08:03:46.561900 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.561795 2560 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/485ab764-14d8-47c0-83a8-77d22bc6cd88-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" May 28 08:03:46.561900 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.561804 2560 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/485ab764-14d8-47c0-83a8-77d22bc6cd88-config\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" May 28 08:03:46.561900 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.561812 2560 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/485ab764-14d8-47c0-83a8-77d22bc6cd88-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" May 28 08:03:46.561900 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.561821 2560 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/485ab764-14d8-47c0-83a8-77d22bc6cd88-configmap-metrics-client-ca\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" May 28 08:03:46.561900 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.561830 2560 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/485ab764-14d8-47c0-83a8-77d22bc6cd88-secret-prometheus-k8s-tls\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" May 28 08:03:46.561900 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.561839 2560 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/485ab764-14d8-47c0-83a8-77d22bc6cd88-web-config\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" May 28 08:03:46.572361 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.572336 2560 generic.go:358] "Generic (PLEG): container finished" podID="485ab764-14d8-47c0-83a8-77d22bc6cd88" containerID="9a48cc0adfeee4e2c245b5d574de1d830a1a8d78d4ae6e0ccad8cf1f70df63bc" exitCode=0 May 28 08:03:46.572361 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.572358 2560 generic.go:358] "Generic (PLEG): container finished" podID="485ab764-14d8-47c0-83a8-77d22bc6cd88" containerID="2a76d87005dfbe813c36db771a07ef163a69dff4ad70dd9f6e4e06de733f58e1" exitCode=0 May 28 08:03:46.572525 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.572367 2560 generic.go:358] "Generic (PLEG): container finished" podID="485ab764-14d8-47c0-83a8-77d22bc6cd88" containerID="ab03c40af8fc5fc03a458875ea89e6ab6062ab247250327a7cf0c483dabb63fc" exitCode=0 May 28 08:03:46.572525 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.572376 2560 generic.go:358] "Generic (PLEG): container finished" podID="485ab764-14d8-47c0-83a8-77d22bc6cd88" containerID="af6b81cf7fdcb02fa30fb1ff6777425f08687e934035304cc8a5b44b95f7afbf" exitCode=0 May 28 08:03:46.572525 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.572383 2560 generic.go:358] "Generic (PLEG): container finished" podID="485ab764-14d8-47c0-83a8-77d22bc6cd88" containerID="6e170fc4575f167f4d44f292b2bd31ef22764a9d6270332c92dceb1119c03159" exitCode=0 May 28 08:03:46.572525 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.572391 2560 generic.go:358] "Generic (PLEG): container finished" podID="485ab764-14d8-47c0-83a8-77d22bc6cd88" containerID="ce3abcc14cc49c839c7e3ddd78f0361a4390337a78d738536b7bd7c1a5c4567b" exitCode=0 May 28 08:03:46.572525 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.572415 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"485ab764-14d8-47c0-83a8-77d22bc6cd88","Type":"ContainerDied","Data":"9a48cc0adfeee4e2c245b5d574de1d830a1a8d78d4ae6e0ccad8cf1f70df63bc"} May 28 08:03:46.572525 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.572446 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 28 08:03:46.572525 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.572457 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"485ab764-14d8-47c0-83a8-77d22bc6cd88","Type":"ContainerDied","Data":"2a76d87005dfbe813c36db771a07ef163a69dff4ad70dd9f6e4e06de733f58e1"} May 28 08:03:46.572525 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.572473 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"485ab764-14d8-47c0-83a8-77d22bc6cd88","Type":"ContainerDied","Data":"ab03c40af8fc5fc03a458875ea89e6ab6062ab247250327a7cf0c483dabb63fc"} May 28 08:03:46.572525 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.572489 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"485ab764-14d8-47c0-83a8-77d22bc6cd88","Type":"ContainerDied","Data":"af6b81cf7fdcb02fa30fb1ff6777425f08687e934035304cc8a5b44b95f7afbf"} May 28 08:03:46.572525 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.572502 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"485ab764-14d8-47c0-83a8-77d22bc6cd88","Type":"ContainerDied","Data":"6e170fc4575f167f4d44f292b2bd31ef22764a9d6270332c92dceb1119c03159"} May 28 08:03:46.572525 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.572515 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"485ab764-14d8-47c0-83a8-77d22bc6cd88","Type":"ContainerDied","Data":"ce3abcc14cc49c839c7e3ddd78f0361a4390337a78d738536b7bd7c1a5c4567b"} May 28 08:03:46.572525 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.572524 2560 scope.go:117] "RemoveContainer" containerID="9a48cc0adfeee4e2c245b5d574de1d830a1a8d78d4ae6e0ccad8cf1f70df63bc" May 28 08:03:46.572989 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.572528 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"485ab764-14d8-47c0-83a8-77d22bc6cd88","Type":"ContainerDied","Data":"8b22bd2e04a7d852ee6d13b41afe0edcb05bb0e24fffa48b016c7a03a99a9ba3"} May 28 08:03:46.580160 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.579981 2560 scope.go:117] "RemoveContainer" containerID="2a76d87005dfbe813c36db771a07ef163a69dff4ad70dd9f6e4e06de733f58e1" May 28 08:03:46.586667 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.586650 2560 scope.go:117] "RemoveContainer" containerID="ab03c40af8fc5fc03a458875ea89e6ab6062ab247250327a7cf0c483dabb63fc" May 28 08:03:46.592995 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.592977 2560 scope.go:117] "RemoveContainer" containerID="af6b81cf7fdcb02fa30fb1ff6777425f08687e934035304cc8a5b44b95f7afbf" May 28 08:03:46.594996 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.594977 2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 28 08:03:46.598510 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.598478 2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 28 08:03:46.600103 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.600086 2560 scope.go:117] "RemoveContainer" containerID="6e170fc4575f167f4d44f292b2bd31ef22764a9d6270332c92dceb1119c03159" May 28 08:03:46.606351 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.606336 2560 scope.go:117] "RemoveContainer" containerID="ce3abcc14cc49c839c7e3ddd78f0361a4390337a78d738536b7bd7c1a5c4567b" May 28 08:03:46.612834 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.612819 2560 scope.go:117] "RemoveContainer" containerID="f659e4f589729f38a5b0190c0f6dee7129a5a39a06bbf94fd9a50efe9710723d" May 28 08:03:46.618791 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.618772 2560 scope.go:117] "RemoveContainer" containerID="9a48cc0adfeee4e2c245b5d574de1d830a1a8d78d4ae6e0ccad8cf1f70df63bc" May 28 08:03:46.619037 ip-10-0-139-133 kubenswrapper[2560]: E0528 08:03:46.619020 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a48cc0adfeee4e2c245b5d574de1d830a1a8d78d4ae6e0ccad8cf1f70df63bc\": container with ID starting with 9a48cc0adfeee4e2c245b5d574de1d830a1a8d78d4ae6e0ccad8cf1f70df63bc not found: ID does not exist" containerID="9a48cc0adfeee4e2c245b5d574de1d830a1a8d78d4ae6e0ccad8cf1f70df63bc" May 28 08:03:46.619086 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.619043 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a48cc0adfeee4e2c245b5d574de1d830a1a8d78d4ae6e0ccad8cf1f70df63bc"} err="failed to get container status \"9a48cc0adfeee4e2c245b5d574de1d830a1a8d78d4ae6e0ccad8cf1f70df63bc\": rpc error: code = NotFound desc = could not find container \"9a48cc0adfeee4e2c245b5d574de1d830a1a8d78d4ae6e0ccad8cf1f70df63bc\": container with ID starting with 9a48cc0adfeee4e2c245b5d574de1d830a1a8d78d4ae6e0ccad8cf1f70df63bc not found: ID does not exist" May 28 08:03:46.619086 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.619062 2560 scope.go:117] "RemoveContainer" containerID="2a76d87005dfbe813c36db771a07ef163a69dff4ad70dd9f6e4e06de733f58e1" May 28 08:03:46.619344 ip-10-0-139-133 kubenswrapper[2560]: E0528 08:03:46.619317 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a76d87005dfbe813c36db771a07ef163a69dff4ad70dd9f6e4e06de733f58e1\": container with ID starting with 2a76d87005dfbe813c36db771a07ef163a69dff4ad70dd9f6e4e06de733f58e1 not found: ID does not exist" containerID="2a76d87005dfbe813c36db771a07ef163a69dff4ad70dd9f6e4e06de733f58e1" May 28 08:03:46.619501 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.619350 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a76d87005dfbe813c36db771a07ef163a69dff4ad70dd9f6e4e06de733f58e1"} err="failed to get container status \"2a76d87005dfbe813c36db771a07ef163a69dff4ad70dd9f6e4e06de733f58e1\": rpc error: code = NotFound desc = could not find container \"2a76d87005dfbe813c36db771a07ef163a69dff4ad70dd9f6e4e06de733f58e1\": container with ID starting with 2a76d87005dfbe813c36db771a07ef163a69dff4ad70dd9f6e4e06de733f58e1 not found: ID does not exist" May 28 08:03:46.619501 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.619367 2560 scope.go:117] "RemoveContainer" containerID="ab03c40af8fc5fc03a458875ea89e6ab6062ab247250327a7cf0c483dabb63fc" May 28 08:03:46.620281 ip-10-0-139-133 kubenswrapper[2560]: E0528 08:03:46.620248 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab03c40af8fc5fc03a458875ea89e6ab6062ab247250327a7cf0c483dabb63fc\": container with ID starting with ab03c40af8fc5fc03a458875ea89e6ab6062ab247250327a7cf0c483dabb63fc not found: ID does not exist" containerID="ab03c40af8fc5fc03a458875ea89e6ab6062ab247250327a7cf0c483dabb63fc" May 28 08:03:46.620370 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.620277 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab03c40af8fc5fc03a458875ea89e6ab6062ab247250327a7cf0c483dabb63fc"} err="failed to get container status \"ab03c40af8fc5fc03a458875ea89e6ab6062ab247250327a7cf0c483dabb63fc\": rpc error: code = NotFound desc = could not find container \"ab03c40af8fc5fc03a458875ea89e6ab6062ab247250327a7cf0c483dabb63fc\": container with ID starting with ab03c40af8fc5fc03a458875ea89e6ab6062ab247250327a7cf0c483dabb63fc not found: ID does not exist" May 28 08:03:46.620370 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.620299 2560 scope.go:117] "RemoveContainer" containerID="af6b81cf7fdcb02fa30fb1ff6777425f08687e934035304cc8a5b44b95f7afbf" May 28 08:03:46.620605 ip-10-0-139-133 kubenswrapper[2560]: E0528 08:03:46.620585 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af6b81cf7fdcb02fa30fb1ff6777425f08687e934035304cc8a5b44b95f7afbf\": container with ID starting with af6b81cf7fdcb02fa30fb1ff6777425f08687e934035304cc8a5b44b95f7afbf not found: ID does not exist" containerID="af6b81cf7fdcb02fa30fb1ff6777425f08687e934035304cc8a5b44b95f7afbf" May 28 08:03:46.620708 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.620608 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af6b81cf7fdcb02fa30fb1ff6777425f08687e934035304cc8a5b44b95f7afbf"} err="failed to get container status \"af6b81cf7fdcb02fa30fb1ff6777425f08687e934035304cc8a5b44b95f7afbf\": rpc error: code = NotFound desc = could not find container \"af6b81cf7fdcb02fa30fb1ff6777425f08687e934035304cc8a5b44b95f7afbf\": container with ID starting with af6b81cf7fdcb02fa30fb1ff6777425f08687e934035304cc8a5b44b95f7afbf not found: ID does not exist" May 28 08:03:46.620708 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.620624 2560 scope.go:117] "RemoveContainer" containerID="6e170fc4575f167f4d44f292b2bd31ef22764a9d6270332c92dceb1119c03159" May 28 08:03:46.620906 ip-10-0-139-133 kubenswrapper[2560]: E0528 08:03:46.620886 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e170fc4575f167f4d44f292b2bd31ef22764a9d6270332c92dceb1119c03159\": container with ID starting with 6e170fc4575f167f4d44f292b2bd31ef22764a9d6270332c92dceb1119c03159 not found: ID does not exist" containerID="6e170fc4575f167f4d44f292b2bd31ef22764a9d6270332c92dceb1119c03159" May 28 08:03:46.620952 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.620910 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e170fc4575f167f4d44f292b2bd31ef22764a9d6270332c92dceb1119c03159"} err="failed to get container status \"6e170fc4575f167f4d44f292b2bd31ef22764a9d6270332c92dceb1119c03159\": rpc error: code = NotFound desc = could not find container \"6e170fc4575f167f4d44f292b2bd31ef22764a9d6270332c92dceb1119c03159\": container with ID starting with 6e170fc4575f167f4d44f292b2bd31ef22764a9d6270332c92dceb1119c03159 not found: ID does not exist" May 28 08:03:46.620952 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.620922 2560 scope.go:117] "RemoveContainer" containerID="ce3abcc14cc49c839c7e3ddd78f0361a4390337a78d738536b7bd7c1a5c4567b" May 28 08:03:46.621138 ip-10-0-139-133 kubenswrapper[2560]: E0528 08:03:46.621114 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce3abcc14cc49c839c7e3ddd78f0361a4390337a78d738536b7bd7c1a5c4567b\": container with ID starting with ce3abcc14cc49c839c7e3ddd78f0361a4390337a78d738536b7bd7c1a5c4567b not found: ID does not exist" containerID="ce3abcc14cc49c839c7e3ddd78f0361a4390337a78d738536b7bd7c1a5c4567b" May 28 08:03:46.621191 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.621139 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce3abcc14cc49c839c7e3ddd78f0361a4390337a78d738536b7bd7c1a5c4567b"} err="failed to get container status \"ce3abcc14cc49c839c7e3ddd78f0361a4390337a78d738536b7bd7c1a5c4567b\": rpc error: code = NotFound desc = could not find container \"ce3abcc14cc49c839c7e3ddd78f0361a4390337a78d738536b7bd7c1a5c4567b\": container with ID starting with ce3abcc14cc49c839c7e3ddd78f0361a4390337a78d738536b7bd7c1a5c4567b not found: ID does not exist" May 28 08:03:46.621191 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.621151 2560 scope.go:117] "RemoveContainer" containerID="f659e4f589729f38a5b0190c0f6dee7129a5a39a06bbf94fd9a50efe9710723d" May 28 08:03:46.621377 ip-10-0-139-133 kubenswrapper[2560]: E0528 08:03:46.621352 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f659e4f589729f38a5b0190c0f6dee7129a5a39a06bbf94fd9a50efe9710723d\": container with ID starting with f659e4f589729f38a5b0190c0f6dee7129a5a39a06bbf94fd9a50efe9710723d not found: ID does not exist" containerID="f659e4f589729f38a5b0190c0f6dee7129a5a39a06bbf94fd9a50efe9710723d" May 28 08:03:46.621377 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.621370 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f659e4f589729f38a5b0190c0f6dee7129a5a39a06bbf94fd9a50efe9710723d"} err="failed to get container status \"f659e4f589729f38a5b0190c0f6dee7129a5a39a06bbf94fd9a50efe9710723d\": rpc error: code = NotFound desc = could not find container \"f659e4f589729f38a5b0190c0f6dee7129a5a39a06bbf94fd9a50efe9710723d\": container with ID starting with f659e4f589729f38a5b0190c0f6dee7129a5a39a06bbf94fd9a50efe9710723d not found: ID does not exist" May 28 08:03:46.621469 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.621385 2560 scope.go:117] "RemoveContainer" containerID="9a48cc0adfeee4e2c245b5d574de1d830a1a8d78d4ae6e0ccad8cf1f70df63bc" May 28 08:03:46.621469 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.621426 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 28 08:03:46.621675 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.621650 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a48cc0adfeee4e2c245b5d574de1d830a1a8d78d4ae6e0ccad8cf1f70df63bc"} err="failed to get container status \"9a48cc0adfeee4e2c245b5d574de1d830a1a8d78d4ae6e0ccad8cf1f70df63bc\": rpc error: code = NotFound desc = could not find container \"9a48cc0adfeee4e2c245b5d574de1d830a1a8d78d4ae6e0ccad8cf1f70df63bc\": container with ID starting with 9a48cc0adfeee4e2c245b5d574de1d830a1a8d78d4ae6e0ccad8cf1f70df63bc not found: ID does not exist" May 28 08:03:46.621738 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.621676 2560 scope.go:117] "RemoveContainer" containerID="2a76d87005dfbe813c36db771a07ef163a69dff4ad70dd9f6e4e06de733f58e1" May 28 08:03:46.621782 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.621761 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f795adb5-f191-49c8-ac1a-103cf6280710" containerName="console" May 28 08:03:46.621782 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.621774 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f795adb5-f191-49c8-ac1a-103cf6280710" containerName="console" May 28 08:03:46.621865 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.621783 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="485ab764-14d8-47c0-83a8-77d22bc6cd88" containerName="thanos-sidecar" May 28 08:03:46.621865 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.621790 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="485ab764-14d8-47c0-83a8-77d22bc6cd88" containerName="thanos-sidecar" May 28 08:03:46.621865 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.621800 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="485ab764-14d8-47c0-83a8-77d22bc6cd88" containerName="init-config-reloader" May 28 08:03:46.621865 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.621806 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="485ab764-14d8-47c0-83a8-77d22bc6cd88" containerName="init-config-reloader" May 28 08:03:46.621865 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.621811 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="485ab764-14d8-47c0-83a8-77d22bc6cd88" containerName="prometheus" May 28 08:03:46.621865 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.621818 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="485ab764-14d8-47c0-83a8-77d22bc6cd88" containerName="prometheus" May 28 08:03:46.621865 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.621832 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="485ab764-14d8-47c0-83a8-77d22bc6cd88" containerName="kube-rbac-proxy-web" May 28 08:03:46.621865 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.621838 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="485ab764-14d8-47c0-83a8-77d22bc6cd88" containerName="kube-rbac-proxy-web" May 28 08:03:46.621865 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.621846 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="485ab764-14d8-47c0-83a8-77d22bc6cd88" containerName="kube-rbac-proxy-thanos" May 28 08:03:46.621865 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.621855 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="485ab764-14d8-47c0-83a8-77d22bc6cd88" containerName="kube-rbac-proxy-thanos" May 28 08:03:46.621865 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.621863 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29a39155-7c9d-4586-b9a9-4100c8564934" containerName="console" May 28 08:03:46.622240 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.621871 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="29a39155-7c9d-4586-b9a9-4100c8564934" containerName="console" May 28 08:03:46.622240 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.621880 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="485ab764-14d8-47c0-83a8-77d22bc6cd88" containerName="config-reloader" May 28 08:03:46.622240 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.621887 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="485ab764-14d8-47c0-83a8-77d22bc6cd88" containerName="config-reloader" May 28 08:03:46.622240 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.621902 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="485ab764-14d8-47c0-83a8-77d22bc6cd88" containerName="kube-rbac-proxy" May 28 08:03:46.622240 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.621910 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="485ab764-14d8-47c0-83a8-77d22bc6cd88" containerName="kube-rbac-proxy" May 28 08:03:46.622240 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.621934 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a76d87005dfbe813c36db771a07ef163a69dff4ad70dd9f6e4e06de733f58e1"} err="failed to get container status \"2a76d87005dfbe813c36db771a07ef163a69dff4ad70dd9f6e4e06de733f58e1\": rpc error: code = NotFound desc = could not find container \"2a76d87005dfbe813c36db771a07ef163a69dff4ad70dd9f6e4e06de733f58e1\": container with ID starting with 2a76d87005dfbe813c36db771a07ef163a69dff4ad70dd9f6e4e06de733f58e1 not found: ID does not exist" May 28 08:03:46.622240 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.621947 2560 scope.go:117] "RemoveContainer" containerID="ab03c40af8fc5fc03a458875ea89e6ab6062ab247250327a7cf0c483dabb63fc" May 28 08:03:46.622240 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.621961 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="485ab764-14d8-47c0-83a8-77d22bc6cd88" containerName="thanos-sidecar" May 28 08:03:46.622240 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.621971 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="f795adb5-f191-49c8-ac1a-103cf6280710" containerName="console" May 28 08:03:46.622240 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.621978 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="29a39155-7c9d-4586-b9a9-4100c8564934" containerName="console" May 28 08:03:46.622240 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.621984 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="485ab764-14d8-47c0-83a8-77d22bc6cd88" containerName="config-reloader" May 28 08:03:46.622240 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.621990 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="485ab764-14d8-47c0-83a8-77d22bc6cd88" containerName="kube-rbac-proxy" May 28 08:03:46.622240 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.621996 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="485ab764-14d8-47c0-83a8-77d22bc6cd88" containerName="kube-rbac-proxy-thanos" May 28 08:03:46.622240 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.622004 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="485ab764-14d8-47c0-83a8-77d22bc6cd88" containerName="kube-rbac-proxy-web" May 28 08:03:46.622240 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.622012 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="485ab764-14d8-47c0-83a8-77d22bc6cd88" containerName="prometheus" May 28 08:03:46.622240 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.622156 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab03c40af8fc5fc03a458875ea89e6ab6062ab247250327a7cf0c483dabb63fc"} err="failed to get container status \"ab03c40af8fc5fc03a458875ea89e6ab6062ab247250327a7cf0c483dabb63fc\": rpc error: code = NotFound desc = could not find container \"ab03c40af8fc5fc03a458875ea89e6ab6062ab247250327a7cf0c483dabb63fc\": container with ID starting with ab03c40af8fc5fc03a458875ea89e6ab6062ab247250327a7cf0c483dabb63fc not found: ID does not exist" May 28 08:03:46.622240 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.622172 2560 scope.go:117] "RemoveContainer" containerID="af6b81cf7fdcb02fa30fb1ff6777425f08687e934035304cc8a5b44b95f7afbf" May 28 08:03:46.624991 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.623176 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af6b81cf7fdcb02fa30fb1ff6777425f08687e934035304cc8a5b44b95f7afbf"} err="failed to get container status \"af6b81cf7fdcb02fa30fb1ff6777425f08687e934035304cc8a5b44b95f7afbf\": rpc error: code = NotFound desc = could not find container \"af6b81cf7fdcb02fa30fb1ff6777425f08687e934035304cc8a5b44b95f7afbf\": container with ID starting with af6b81cf7fdcb02fa30fb1ff6777425f08687e934035304cc8a5b44b95f7afbf not found: ID does not exist" May 28 08:03:46.624991 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.623198 2560 scope.go:117] "RemoveContainer" containerID="6e170fc4575f167f4d44f292b2bd31ef22764a9d6270332c92dceb1119c03159" May 28 08:03:46.624991 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.623957 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e170fc4575f167f4d44f292b2bd31ef22764a9d6270332c92dceb1119c03159"} err="failed to get container status \"6e170fc4575f167f4d44f292b2bd31ef22764a9d6270332c92dceb1119c03159\": rpc error: code = NotFound desc = could not find container \"6e170fc4575f167f4d44f292b2bd31ef22764a9d6270332c92dceb1119c03159\": container with ID starting with 6e170fc4575f167f4d44f292b2bd31ef22764a9d6270332c92dceb1119c03159 not found: ID does not exist" May 28 08:03:46.624991 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.623978 2560 scope.go:117] "RemoveContainer" containerID="ce3abcc14cc49c839c7e3ddd78f0361a4390337a78d738536b7bd7c1a5c4567b" May 28 08:03:46.624991 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.624315 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce3abcc14cc49c839c7e3ddd78f0361a4390337a78d738536b7bd7c1a5c4567b"} err="failed to get container status \"ce3abcc14cc49c839c7e3ddd78f0361a4390337a78d738536b7bd7c1a5c4567b\": rpc error: code = NotFound desc = could not find container \"ce3abcc14cc49c839c7e3ddd78f0361a4390337a78d738536b7bd7c1a5c4567b\": container with ID starting with ce3abcc14cc49c839c7e3ddd78f0361a4390337a78d738536b7bd7c1a5c4567b not found: ID does not exist" May 28 08:03:46.624991 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.624336 2560 scope.go:117] "RemoveContainer" containerID="f659e4f589729f38a5b0190c0f6dee7129a5a39a06bbf94fd9a50efe9710723d" May 28 08:03:46.625513 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.625479 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f659e4f589729f38a5b0190c0f6dee7129a5a39a06bbf94fd9a50efe9710723d"} err="failed to get container status \"f659e4f589729f38a5b0190c0f6dee7129a5a39a06bbf94fd9a50efe9710723d\": rpc error: code = NotFound desc = could not find container \"f659e4f589729f38a5b0190c0f6dee7129a5a39a06bbf94fd9a50efe9710723d\": container with ID starting with f659e4f589729f38a5b0190c0f6dee7129a5a39a06bbf94fd9a50efe9710723d not found: ID does not exist" May 28 08:03:46.625513 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.625509 2560 scope.go:117] "RemoveContainer" containerID="9a48cc0adfeee4e2c245b5d574de1d830a1a8d78d4ae6e0ccad8cf1f70df63bc" May 28 08:03:46.625945 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.625927 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a48cc0adfeee4e2c245b5d574de1d830a1a8d78d4ae6e0ccad8cf1f70df63bc"} err="failed to get container status \"9a48cc0adfeee4e2c245b5d574de1d830a1a8d78d4ae6e0ccad8cf1f70df63bc\": rpc error: code = NotFound desc = could not find container \"9a48cc0adfeee4e2c245b5d574de1d830a1a8d78d4ae6e0ccad8cf1f70df63bc\": container with ID starting with 9a48cc0adfeee4e2c245b5d574de1d830a1a8d78d4ae6e0ccad8cf1f70df63bc not found: ID does not exist" May 28 08:03:46.625996 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.625945 2560 scope.go:117] "RemoveContainer" containerID="2a76d87005dfbe813c36db771a07ef163a69dff4ad70dd9f6e4e06de733f58e1" May 28 08:03:46.626186 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.626169 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a76d87005dfbe813c36db771a07ef163a69dff4ad70dd9f6e4e06de733f58e1"} err="failed to get container status \"2a76d87005dfbe813c36db771a07ef163a69dff4ad70dd9f6e4e06de733f58e1\": rpc error: code = NotFound desc = could not find container \"2a76d87005dfbe813c36db771a07ef163a69dff4ad70dd9f6e4e06de733f58e1\": container with ID starting with 2a76d87005dfbe813c36db771a07ef163a69dff4ad70dd9f6e4e06de733f58e1 not found: ID does not exist" May 28 08:03:46.626241 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.626189 2560 scope.go:117] "RemoveContainer" containerID="ab03c40af8fc5fc03a458875ea89e6ab6062ab247250327a7cf0c483dabb63fc" May 28 08:03:46.626401 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.626386 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab03c40af8fc5fc03a458875ea89e6ab6062ab247250327a7cf0c483dabb63fc"} err="failed to get container status \"ab03c40af8fc5fc03a458875ea89e6ab6062ab247250327a7cf0c483dabb63fc\": rpc error: code = NotFound desc = could not find container \"ab03c40af8fc5fc03a458875ea89e6ab6062ab247250327a7cf0c483dabb63fc\": container with ID starting with ab03c40af8fc5fc03a458875ea89e6ab6062ab247250327a7cf0c483dabb63fc not found: ID does not exist" May 28 08:03:46.626442 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.626402 2560 scope.go:117] "RemoveContainer" containerID="af6b81cf7fdcb02fa30fb1ff6777425f08687e934035304cc8a5b44b95f7afbf" May 28 08:03:46.626636 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.626615 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af6b81cf7fdcb02fa30fb1ff6777425f08687e934035304cc8a5b44b95f7afbf"} err="failed to get container status \"af6b81cf7fdcb02fa30fb1ff6777425f08687e934035304cc8a5b44b95f7afbf\": rpc error: code = NotFound desc = could not find container \"af6b81cf7fdcb02fa30fb1ff6777425f08687e934035304cc8a5b44b95f7afbf\": container with ID starting with af6b81cf7fdcb02fa30fb1ff6777425f08687e934035304cc8a5b44b95f7afbf not found: ID does not exist" May 28 08:03:46.626703 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.626637 2560 scope.go:117] "RemoveContainer" containerID="6e170fc4575f167f4d44f292b2bd31ef22764a9d6270332c92dceb1119c03159" May 28 08:03:46.626969 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.626944 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e170fc4575f167f4d44f292b2bd31ef22764a9d6270332c92dceb1119c03159"} err="failed to get container status \"6e170fc4575f167f4d44f292b2bd31ef22764a9d6270332c92dceb1119c03159\": rpc error: code = NotFound desc = could not find container \"6e170fc4575f167f4d44f292b2bd31ef22764a9d6270332c92dceb1119c03159\": container with ID starting with 6e170fc4575f167f4d44f292b2bd31ef22764a9d6270332c92dceb1119c03159 not found: ID does not exist" May 28 08:03:46.627048 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.626970 2560 scope.go:117] "RemoveContainer" containerID="ce3abcc14cc49c839c7e3ddd78f0361a4390337a78d738536b7bd7c1a5c4567b" May 28 08:03:46.627240 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.627208 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce3abcc14cc49c839c7e3ddd78f0361a4390337a78d738536b7bd7c1a5c4567b"} err="failed to get container status \"ce3abcc14cc49c839c7e3ddd78f0361a4390337a78d738536b7bd7c1a5c4567b\": rpc error: code = NotFound desc = could not find container \"ce3abcc14cc49c839c7e3ddd78f0361a4390337a78d738536b7bd7c1a5c4567b\": container with ID starting with ce3abcc14cc49c839c7e3ddd78f0361a4390337a78d738536b7bd7c1a5c4567b not found: ID does not exist" May 28 08:03:46.627240 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.627224 2560 scope.go:117] "RemoveContainer" containerID="f659e4f589729f38a5b0190c0f6dee7129a5a39a06bbf94fd9a50efe9710723d" May 28 08:03:46.629296 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.627695 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f659e4f589729f38a5b0190c0f6dee7129a5a39a06bbf94fd9a50efe9710723d"} err="failed to get container status \"f659e4f589729f38a5b0190c0f6dee7129a5a39a06bbf94fd9a50efe9710723d\": rpc error: code = NotFound desc = could not find container \"f659e4f589729f38a5b0190c0f6dee7129a5a39a06bbf94fd9a50efe9710723d\": container with ID starting with f659e4f589729f38a5b0190c0f6dee7129a5a39a06bbf94fd9a50efe9710723d not found: ID does not exist" May 28 08:03:46.629296 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.627719 2560 scope.go:117] "RemoveContainer" containerID="9a48cc0adfeee4e2c245b5d574de1d830a1a8d78d4ae6e0ccad8cf1f70df63bc" May 28 08:03:46.629296 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.628020 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a48cc0adfeee4e2c245b5d574de1d830a1a8d78d4ae6e0ccad8cf1f70df63bc"} err="failed to get container status \"9a48cc0adfeee4e2c245b5d574de1d830a1a8d78d4ae6e0ccad8cf1f70df63bc\": rpc error: code = NotFound desc = could not find container \"9a48cc0adfeee4e2c245b5d574de1d830a1a8d78d4ae6e0ccad8cf1f70df63bc\": container with ID starting with 9a48cc0adfeee4e2c245b5d574de1d830a1a8d78d4ae6e0ccad8cf1f70df63bc not found: ID does not exist" May 28 08:03:46.629296 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.628039 2560 scope.go:117] "RemoveContainer" containerID="2a76d87005dfbe813c36db771a07ef163a69dff4ad70dd9f6e4e06de733f58e1" May 28 08:03:46.629296 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.628286 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a76d87005dfbe813c36db771a07ef163a69dff4ad70dd9f6e4e06de733f58e1"} err="failed to get container status \"2a76d87005dfbe813c36db771a07ef163a69dff4ad70dd9f6e4e06de733f58e1\": rpc error: code = NotFound desc = could not find container \"2a76d87005dfbe813c36db771a07ef163a69dff4ad70dd9f6e4e06de733f58e1\": container with ID starting with 2a76d87005dfbe813c36db771a07ef163a69dff4ad70dd9f6e4e06de733f58e1 not found: ID does not exist" May 28 08:03:46.629296 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.628322 2560 scope.go:117] "RemoveContainer" containerID="ab03c40af8fc5fc03a458875ea89e6ab6062ab247250327a7cf0c483dabb63fc" May 28 08:03:46.629296 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.628590 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab03c40af8fc5fc03a458875ea89e6ab6062ab247250327a7cf0c483dabb63fc"} err="failed to get container status \"ab03c40af8fc5fc03a458875ea89e6ab6062ab247250327a7cf0c483dabb63fc\": rpc error: code = NotFound desc = could not find container \"ab03c40af8fc5fc03a458875ea89e6ab6062ab247250327a7cf0c483dabb63fc\": container with ID starting with ab03c40af8fc5fc03a458875ea89e6ab6062ab247250327a7cf0c483dabb63fc not found: ID does not exist" May 28 08:03:46.629296 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.628610 2560 scope.go:117] "RemoveContainer" containerID="af6b81cf7fdcb02fa30fb1ff6777425f08687e934035304cc8a5b44b95f7afbf" May 28 08:03:46.629296 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.628849 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af6b81cf7fdcb02fa30fb1ff6777425f08687e934035304cc8a5b44b95f7afbf"} err="failed to get container status \"af6b81cf7fdcb02fa30fb1ff6777425f08687e934035304cc8a5b44b95f7afbf\": rpc error: code = NotFound desc = could not find container \"af6b81cf7fdcb02fa30fb1ff6777425f08687e934035304cc8a5b44b95f7afbf\": container with ID starting with af6b81cf7fdcb02fa30fb1ff6777425f08687e934035304cc8a5b44b95f7afbf not found: ID does not exist" May 28 08:03:46.629296 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.628870 2560 scope.go:117] "RemoveContainer" containerID="6e170fc4575f167f4d44f292b2bd31ef22764a9d6270332c92dceb1119c03159" May 28 08:03:46.629296 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.629101 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e170fc4575f167f4d44f292b2bd31ef22764a9d6270332c92dceb1119c03159"} err="failed to get container status \"6e170fc4575f167f4d44f292b2bd31ef22764a9d6270332c92dceb1119c03159\": rpc error: code = NotFound desc = could not find container \"6e170fc4575f167f4d44f292b2bd31ef22764a9d6270332c92dceb1119c03159\": container with ID starting with 6e170fc4575f167f4d44f292b2bd31ef22764a9d6270332c92dceb1119c03159 not found: ID does not exist" May 28 08:03:46.629296 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.629119 2560 scope.go:117] "RemoveContainer" containerID="ce3abcc14cc49c839c7e3ddd78f0361a4390337a78d738536b7bd7c1a5c4567b" May 28 08:03:46.629924 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.629383 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce3abcc14cc49c839c7e3ddd78f0361a4390337a78d738536b7bd7c1a5c4567b"} err="failed to get container status \"ce3abcc14cc49c839c7e3ddd78f0361a4390337a78d738536b7bd7c1a5c4567b\": rpc error: code = NotFound desc = could not find container \"ce3abcc14cc49c839c7e3ddd78f0361a4390337a78d738536b7bd7c1a5c4567b\": container with ID starting with ce3abcc14cc49c839c7e3ddd78f0361a4390337a78d738536b7bd7c1a5c4567b not found: ID does not exist" May 28 08:03:46.629924 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.629408 2560 scope.go:117] "RemoveContainer" containerID="f659e4f589729f38a5b0190c0f6dee7129a5a39a06bbf94fd9a50efe9710723d" May 28 08:03:46.629924 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.629457 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 28 08:03:46.629924 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.629735 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f659e4f589729f38a5b0190c0f6dee7129a5a39a06bbf94fd9a50efe9710723d"} err="failed to get container status \"f659e4f589729f38a5b0190c0f6dee7129a5a39a06bbf94fd9a50efe9710723d\": rpc error: code = NotFound desc = could not find container \"f659e4f589729f38a5b0190c0f6dee7129a5a39a06bbf94fd9a50efe9710723d\": container with ID starting with f659e4f589729f38a5b0190c0f6dee7129a5a39a06bbf94fd9a50efe9710723d not found: ID does not exist" May 28 08:03:46.629924 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.629757 2560 scope.go:117] "RemoveContainer" containerID="9a48cc0adfeee4e2c245b5d574de1d830a1a8d78d4ae6e0ccad8cf1f70df63bc" May 28 08:03:46.630244 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.630225 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a48cc0adfeee4e2c245b5d574de1d830a1a8d78d4ae6e0ccad8cf1f70df63bc"} err="failed to get container status \"9a48cc0adfeee4e2c245b5d574de1d830a1a8d78d4ae6e0ccad8cf1f70df63bc\": rpc error: code = NotFound desc = could not find container \"9a48cc0adfeee4e2c245b5d574de1d830a1a8d78d4ae6e0ccad8cf1f70df63bc\": container with ID starting with 9a48cc0adfeee4e2c245b5d574de1d830a1a8d78d4ae6e0ccad8cf1f70df63bc not found: ID does not exist" May 28 08:03:46.630289 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.630245 2560 scope.go:117] "RemoveContainer" containerID="2a76d87005dfbe813c36db771a07ef163a69dff4ad70dd9f6e4e06de733f58e1" May 28 08:03:46.630447 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.630430 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a76d87005dfbe813c36db771a07ef163a69dff4ad70dd9f6e4e06de733f58e1"} err="failed to get container status \"2a76d87005dfbe813c36db771a07ef163a69dff4ad70dd9f6e4e06de733f58e1\": rpc error: code = NotFound desc = could not find container \"2a76d87005dfbe813c36db771a07ef163a69dff4ad70dd9f6e4e06de733f58e1\": container with ID starting with 2a76d87005dfbe813c36db771a07ef163a69dff4ad70dd9f6e4e06de733f58e1 not found: ID does not exist" May 28 08:03:46.630492 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.630447 2560 scope.go:117] "RemoveContainer" containerID="ab03c40af8fc5fc03a458875ea89e6ab6062ab247250327a7cf0c483dabb63fc" May 28 08:03:46.630731 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.630705 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab03c40af8fc5fc03a458875ea89e6ab6062ab247250327a7cf0c483dabb63fc"} err="failed to get container status \"ab03c40af8fc5fc03a458875ea89e6ab6062ab247250327a7cf0c483dabb63fc\": rpc error: code = NotFound desc = could not find container \"ab03c40af8fc5fc03a458875ea89e6ab6062ab247250327a7cf0c483dabb63fc\": container with ID starting with ab03c40af8fc5fc03a458875ea89e6ab6062ab247250327a7cf0c483dabb63fc not found: ID does not exist" May 28 08:03:46.630790 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.630736 2560 scope.go:117] "RemoveContainer" containerID="af6b81cf7fdcb02fa30fb1ff6777425f08687e934035304cc8a5b44b95f7afbf" May 28 08:03:46.630983 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.630962 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af6b81cf7fdcb02fa30fb1ff6777425f08687e934035304cc8a5b44b95f7afbf"} err="failed to get container status \"af6b81cf7fdcb02fa30fb1ff6777425f08687e934035304cc8a5b44b95f7afbf\": rpc error: code = NotFound desc = could not find container \"af6b81cf7fdcb02fa30fb1ff6777425f08687e934035304cc8a5b44b95f7afbf\": container with ID starting with af6b81cf7fdcb02fa30fb1ff6777425f08687e934035304cc8a5b44b95f7afbf not found: ID does not exist" May 28 08:03:46.631023 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.630985 2560 scope.go:117] "RemoveContainer" containerID="6e170fc4575f167f4d44f292b2bd31ef22764a9d6270332c92dceb1119c03159" May 28 08:03:46.631203 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.631182 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e170fc4575f167f4d44f292b2bd31ef22764a9d6270332c92dceb1119c03159"} err="failed to get container status \"6e170fc4575f167f4d44f292b2bd31ef22764a9d6270332c92dceb1119c03159\": rpc error: code = NotFound desc = could not find container \"6e170fc4575f167f4d44f292b2bd31ef22764a9d6270332c92dceb1119c03159\": container with ID starting with 6e170fc4575f167f4d44f292b2bd31ef22764a9d6270332c92dceb1119c03159 not found: ID does not exist" May 28 08:03:46.631275 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.631204 2560 scope.go:117] "RemoveContainer" containerID="ce3abcc14cc49c839c7e3ddd78f0361a4390337a78d738536b7bd7c1a5c4567b" May 28 08:03:46.631428 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.631406 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce3abcc14cc49c839c7e3ddd78f0361a4390337a78d738536b7bd7c1a5c4567b"} err="failed to get container status \"ce3abcc14cc49c839c7e3ddd78f0361a4390337a78d738536b7bd7c1a5c4567b\": rpc error: code = NotFound desc = could not find container \"ce3abcc14cc49c839c7e3ddd78f0361a4390337a78d738536b7bd7c1a5c4567b\": container with ID starting with ce3abcc14cc49c839c7e3ddd78f0361a4390337a78d738536b7bd7c1a5c4567b not found: ID does not exist" May 28 08:03:46.631495 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.631430 2560 scope.go:117] "RemoveContainer" containerID="f659e4f589729f38a5b0190c0f6dee7129a5a39a06bbf94fd9a50efe9710723d" May 28 08:03:46.631653 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.631625 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f659e4f589729f38a5b0190c0f6dee7129a5a39a06bbf94fd9a50efe9710723d"} err="failed to get container status \"f659e4f589729f38a5b0190c0f6dee7129a5a39a06bbf94fd9a50efe9710723d\": rpc error: code = NotFound desc = could not find container \"f659e4f589729f38a5b0190c0f6dee7129a5a39a06bbf94fd9a50efe9710723d\": container with ID starting with f659e4f589729f38a5b0190c0f6dee7129a5a39a06bbf94fd9a50efe9710723d not found: ID does not exist" May 28 08:03:46.631653 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.631653 2560 scope.go:117] "RemoveContainer" containerID="9a48cc0adfeee4e2c245b5d574de1d830a1a8d78d4ae6e0ccad8cf1f70df63bc" May 28 08:03:46.631803 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.631775 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 28 08:03:46.631858 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.631774 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 28 08:03:46.631858 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.631837 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 28 08:03:46.631957 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.631865 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a48cc0adfeee4e2c245b5d574de1d830a1a8d78d4ae6e0ccad8cf1f70df63bc"} err="failed to get container status \"9a48cc0adfeee4e2c245b5d574de1d830a1a8d78d4ae6e0ccad8cf1f70df63bc\": rpc error: code = NotFound desc = could not find container \"9a48cc0adfeee4e2c245b5d574de1d830a1a8d78d4ae6e0ccad8cf1f70df63bc\": container with ID starting with 9a48cc0adfeee4e2c245b5d574de1d830a1a8d78d4ae6e0ccad8cf1f70df63bc not found: ID does not exist" May 28 08:03:46.631957 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.631885 2560 scope.go:117] "RemoveContainer" containerID="2a76d87005dfbe813c36db771a07ef163a69dff4ad70dd9f6e4e06de733f58e1" May 28 08:03:46.631957 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.631920 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 28 08:03:46.632092 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.632060 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 28 08:03:46.632143 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.632128 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 28 08:03:46.632190 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.632176 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-99nlbdnumf9cm\"" May 28 08:03:46.632231 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.632135 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 28 08:03:46.632272 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.632223 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 28 08:03:46.632303 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.632276 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-sbktx\"" May 28 08:03:46.632474 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.632452 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a76d87005dfbe813c36db771a07ef163a69dff4ad70dd9f6e4e06de733f58e1"} err="failed to get container status \"2a76d87005dfbe813c36db771a07ef163a69dff4ad70dd9f6e4e06de733f58e1\": rpc error: code = NotFound desc = could not find container \"2a76d87005dfbe813c36db771a07ef163a69dff4ad70dd9f6e4e06de733f58e1\": container with ID starting with 2a76d87005dfbe813c36db771a07ef163a69dff4ad70dd9f6e4e06de733f58e1 not found: ID does not exist" May 28 08:03:46.632474 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.632474 2560 scope.go:117] "RemoveContainer" containerID="ab03c40af8fc5fc03a458875ea89e6ab6062ab247250327a7cf0c483dabb63fc" May 28 08:03:46.632738 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.632532 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 28 08:03:46.632738 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.632602 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 28 08:03:46.632738 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.632707 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab03c40af8fc5fc03a458875ea89e6ab6062ab247250327a7cf0c483dabb63fc"} err="failed to get container status \"ab03c40af8fc5fc03a458875ea89e6ab6062ab247250327a7cf0c483dabb63fc\": rpc error: code = NotFound desc = could not find container \"ab03c40af8fc5fc03a458875ea89e6ab6062ab247250327a7cf0c483dabb63fc\": container with ID starting with ab03c40af8fc5fc03a458875ea89e6ab6062ab247250327a7cf0c483dabb63fc not found: ID does not exist" May 28 08:03:46.632738 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.632732 2560 scope.go:117] "RemoveContainer" containerID="af6b81cf7fdcb02fa30fb1ff6777425f08687e934035304cc8a5b44b95f7afbf" May 28 08:03:46.633029 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.633005 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af6b81cf7fdcb02fa30fb1ff6777425f08687e934035304cc8a5b44b95f7afbf"} err="failed to get container status \"af6b81cf7fdcb02fa30fb1ff6777425f08687e934035304cc8a5b44b95f7afbf\": rpc error: code = NotFound desc = could not find container \"af6b81cf7fdcb02fa30fb1ff6777425f08687e934035304cc8a5b44b95f7afbf\": container with ID starting with af6b81cf7fdcb02fa30fb1ff6777425f08687e934035304cc8a5b44b95f7afbf not found: ID does not exist" May 28 08:03:46.633092 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.633032 2560 scope.go:117] "RemoveContainer" containerID="6e170fc4575f167f4d44f292b2bd31ef22764a9d6270332c92dceb1119c03159" May 28 08:03:46.633295 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.633274 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e170fc4575f167f4d44f292b2bd31ef22764a9d6270332c92dceb1119c03159"} err="failed to get container status \"6e170fc4575f167f4d44f292b2bd31ef22764a9d6270332c92dceb1119c03159\": rpc error: code = NotFound desc = could not find container \"6e170fc4575f167f4d44f292b2bd31ef22764a9d6270332c92dceb1119c03159\": container with ID starting with 6e170fc4575f167f4d44f292b2bd31ef22764a9d6270332c92dceb1119c03159 not found: ID does not exist" May 28 08:03:46.633372 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.633295 2560 scope.go:117] "RemoveContainer" containerID="ce3abcc14cc49c839c7e3ddd78f0361a4390337a78d738536b7bd7c1a5c4567b" May 28 08:03:46.633518 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.633496 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce3abcc14cc49c839c7e3ddd78f0361a4390337a78d738536b7bd7c1a5c4567b"} err="failed to get container status \"ce3abcc14cc49c839c7e3ddd78f0361a4390337a78d738536b7bd7c1a5c4567b\": rpc error: code = NotFound desc = could not find container \"ce3abcc14cc49c839c7e3ddd78f0361a4390337a78d738536b7bd7c1a5c4567b\": container with ID starting with ce3abcc14cc49c839c7e3ddd78f0361a4390337a78d738536b7bd7c1a5c4567b not found: ID does not exist" May 28 08:03:46.633518 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.633518 2560 scope.go:117] "RemoveContainer" containerID="f659e4f589729f38a5b0190c0f6dee7129a5a39a06bbf94fd9a50efe9710723d" May 28 08:03:46.633748 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.633730 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f659e4f589729f38a5b0190c0f6dee7129a5a39a06bbf94fd9a50efe9710723d"} err="failed to get container status \"f659e4f589729f38a5b0190c0f6dee7129a5a39a06bbf94fd9a50efe9710723d\": rpc error: code = NotFound desc = could not find container \"f659e4f589729f38a5b0190c0f6dee7129a5a39a06bbf94fd9a50efe9710723d\": container with ID starting with f659e4f589729f38a5b0190c0f6dee7129a5a39a06bbf94fd9a50efe9710723d not found: ID does not exist" May 28 08:03:46.641124 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.636269 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 28 08:03:46.641124 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.639744 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 28 08:03:46.643945 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.643492 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 28 08:03:46.732211 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.732185 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="485ab764-14d8-47c0-83a8-77d22bc6cd88" path="/var/lib/kubelet/pods/485ab764-14d8-47c0-83a8-77d22bc6cd88/volumes" May 28 08:03:46.762841 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.762819 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2a26dd41-9d5a-4974-9ef7-438881784adf-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2a26dd41-9d5a-4974-9ef7-438881784adf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:03:46.762931 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.762851 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2a26dd41-9d5a-4974-9ef7-438881784adf-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2a26dd41-9d5a-4974-9ef7-438881784adf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:03:46.762931 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.762870 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2a26dd41-9d5a-4974-9ef7-438881784adf-web-config\") pod \"prometheus-k8s-0\" (UID: \"2a26dd41-9d5a-4974-9ef7-438881784adf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:03:46.763004 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.762930 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5b22d\" (UniqueName: \"kubernetes.io/projected/2a26dd41-9d5a-4974-9ef7-438881784adf-kube-api-access-5b22d\") pod \"prometheus-k8s-0\" (UID: \"2a26dd41-9d5a-4974-9ef7-438881784adf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:03:46.763004 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.762968 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a26dd41-9d5a-4974-9ef7-438881784adf-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2a26dd41-9d5a-4974-9ef7-438881784adf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:03:46.763004 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.762988 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2a26dd41-9d5a-4974-9ef7-438881784adf-config\") pod \"prometheus-k8s-0\" (UID: \"2a26dd41-9d5a-4974-9ef7-438881784adf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:03:46.763108 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.763008 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2a26dd41-9d5a-4974-9ef7-438881784adf-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2a26dd41-9d5a-4974-9ef7-438881784adf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:03:46.763108 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.763025 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2a26dd41-9d5a-4974-9ef7-438881784adf-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2a26dd41-9d5a-4974-9ef7-438881784adf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:03:46.763108 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.763101 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a26dd41-9d5a-4974-9ef7-438881784adf-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2a26dd41-9d5a-4974-9ef7-438881784adf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:03:46.763208 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.763126 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a26dd41-9d5a-4974-9ef7-438881784adf-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2a26dd41-9d5a-4974-9ef7-438881784adf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:03:46.763208 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.763151 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2a26dd41-9d5a-4974-9ef7-438881784adf-config-out\") pod \"prometheus-k8s-0\" (UID: \"2a26dd41-9d5a-4974-9ef7-438881784adf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:03:46.763208 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.763166 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2a26dd41-9d5a-4974-9ef7-438881784adf-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2a26dd41-9d5a-4974-9ef7-438881784adf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:03:46.763309 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.763221 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2a26dd41-9d5a-4974-9ef7-438881784adf-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2a26dd41-9d5a-4974-9ef7-438881784adf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:03:46.763309 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.763258 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2a26dd41-9d5a-4974-9ef7-438881784adf-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2a26dd41-9d5a-4974-9ef7-438881784adf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:03:46.763309 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.763283 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2a26dd41-9d5a-4974-9ef7-438881784adf-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2a26dd41-9d5a-4974-9ef7-438881784adf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:03:46.763309 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.763300 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2a26dd41-9d5a-4974-9ef7-438881784adf-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2a26dd41-9d5a-4974-9ef7-438881784adf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:03:46.763437 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.763319 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a26dd41-9d5a-4974-9ef7-438881784adf-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2a26dd41-9d5a-4974-9ef7-438881784adf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:03:46.763437 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.763347 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2a26dd41-9d5a-4974-9ef7-438881784adf-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2a26dd41-9d5a-4974-9ef7-438881784adf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:03:46.864378 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.864314 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2a26dd41-9d5a-4974-9ef7-438881784adf-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2a26dd41-9d5a-4974-9ef7-438881784adf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:03:46.864378 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.864344 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2a26dd41-9d5a-4974-9ef7-438881784adf-web-config\") pod \"prometheus-k8s-0\" (UID: \"2a26dd41-9d5a-4974-9ef7-438881784adf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:03:46.864532 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.864380 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5b22d\" (UniqueName: \"kubernetes.io/projected/2a26dd41-9d5a-4974-9ef7-438881784adf-kube-api-access-5b22d\") pod \"prometheus-k8s-0\" (UID: \"2a26dd41-9d5a-4974-9ef7-438881784adf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:03:46.864532 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.864407 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a26dd41-9d5a-4974-9ef7-438881784adf-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2a26dd41-9d5a-4974-9ef7-438881784adf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:03:46.864532 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.864433 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2a26dd41-9d5a-4974-9ef7-438881784adf-config\") pod \"prometheus-k8s-0\" (UID: \"2a26dd41-9d5a-4974-9ef7-438881784adf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:03:46.864532 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.864460 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2a26dd41-9d5a-4974-9ef7-438881784adf-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2a26dd41-9d5a-4974-9ef7-438881784adf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:03:46.864532 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.864486 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2a26dd41-9d5a-4974-9ef7-438881784adf-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2a26dd41-9d5a-4974-9ef7-438881784adf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:03:46.864532 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.864520 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a26dd41-9d5a-4974-9ef7-438881784adf-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2a26dd41-9d5a-4974-9ef7-438881784adf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:03:46.864840 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.864549 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a26dd41-9d5a-4974-9ef7-438881784adf-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2a26dd41-9d5a-4974-9ef7-438881784adf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:03:46.864840 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.864602 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2a26dd41-9d5a-4974-9ef7-438881784adf-config-out\") pod \"prometheus-k8s-0\" (UID: \"2a26dd41-9d5a-4974-9ef7-438881784adf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:03:46.864840 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.864624 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2a26dd41-9d5a-4974-9ef7-438881784adf-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2a26dd41-9d5a-4974-9ef7-438881784adf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:03:46.864840 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.864652 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2a26dd41-9d5a-4974-9ef7-438881784adf-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2a26dd41-9d5a-4974-9ef7-438881784adf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:03:46.864840 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.864680 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2a26dd41-9d5a-4974-9ef7-438881784adf-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2a26dd41-9d5a-4974-9ef7-438881784adf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:03:46.864840 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.864711 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2a26dd41-9d5a-4974-9ef7-438881784adf-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2a26dd41-9d5a-4974-9ef7-438881784adf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:03:46.864840 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.864740 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2a26dd41-9d5a-4974-9ef7-438881784adf-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2a26dd41-9d5a-4974-9ef7-438881784adf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:03:46.864840 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.864768 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a26dd41-9d5a-4974-9ef7-438881784adf-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2a26dd41-9d5a-4974-9ef7-438881784adf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:03:46.864840 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.864802 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2a26dd41-9d5a-4974-9ef7-438881784adf-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2a26dd41-9d5a-4974-9ef7-438881784adf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:03:46.865261 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.864850 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2a26dd41-9d5a-4974-9ef7-438881784adf-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2a26dd41-9d5a-4974-9ef7-438881784adf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:03:46.865320 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.865283 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a26dd41-9d5a-4974-9ef7-438881784adf-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2a26dd41-9d5a-4974-9ef7-438881784adf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:03:46.866375 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.865963 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a26dd41-9d5a-4974-9ef7-438881784adf-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2a26dd41-9d5a-4974-9ef7-438881784adf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:03:46.866375 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.866060 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a26dd41-9d5a-4974-9ef7-438881784adf-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2a26dd41-9d5a-4974-9ef7-438881784adf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:03:46.867468 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.867442 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2a26dd41-9d5a-4974-9ef7-438881784adf-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2a26dd41-9d5a-4974-9ef7-438881784adf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:03:46.867597 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.867548 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2a26dd41-9d5a-4974-9ef7-438881784adf-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2a26dd41-9d5a-4974-9ef7-438881784adf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:03:46.867669 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.867615 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/2a26dd41-9d5a-4974-9ef7-438881784adf-config\") pod \"prometheus-k8s-0\" (UID: \"2a26dd41-9d5a-4974-9ef7-438881784adf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:03:46.867851 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.867828 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2a26dd41-9d5a-4974-9ef7-438881784adf-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2a26dd41-9d5a-4974-9ef7-438881784adf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:03:46.868265 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.868243 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2a26dd41-9d5a-4974-9ef7-438881784adf-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2a26dd41-9d5a-4974-9ef7-438881784adf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:03:46.868444 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.868336 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2a26dd41-9d5a-4974-9ef7-438881784adf-web-config\") pod \"prometheus-k8s-0\" (UID: \"2a26dd41-9d5a-4974-9ef7-438881784adf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:03:46.868576 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.868533 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2a26dd41-9d5a-4974-9ef7-438881784adf-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2a26dd41-9d5a-4974-9ef7-438881784adf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:03:46.868977 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.868960 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2a26dd41-9d5a-4974-9ef7-438881784adf-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2a26dd41-9d5a-4974-9ef7-438881784adf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:03:46.869071 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.868999 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a26dd41-9d5a-4974-9ef7-438881784adf-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2a26dd41-9d5a-4974-9ef7-438881784adf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:03:46.869116 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.869082 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2a26dd41-9d5a-4974-9ef7-438881784adf-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2a26dd41-9d5a-4974-9ef7-438881784adf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:03:46.869786 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.869762 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2a26dd41-9d5a-4974-9ef7-438881784adf-config-out\") pod \"prometheus-k8s-0\" (UID: \"2a26dd41-9d5a-4974-9ef7-438881784adf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:03:46.870058 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.870038 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2a26dd41-9d5a-4974-9ef7-438881784adf-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2a26dd41-9d5a-4974-9ef7-438881784adf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:03:46.870142 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.870071 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2a26dd41-9d5a-4974-9ef7-438881784adf-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2a26dd41-9d5a-4974-9ef7-438881784adf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:03:46.870656 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.870638 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2a26dd41-9d5a-4974-9ef7-438881784adf-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2a26dd41-9d5a-4974-9ef7-438881784adf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:03:46.871597 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.871573 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5b22d\" (UniqueName: \"kubernetes.io/projected/2a26dd41-9d5a-4974-9ef7-438881784adf-kube-api-access-5b22d\") pod \"prometheus-k8s-0\" (UID: \"2a26dd41-9d5a-4974-9ef7-438881784adf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 08:03:46.944891 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:46.944863 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 28 08:03:47.090597 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:47.090557 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 28 08:03:47.092177 ip-10-0-139-133 kubenswrapper[2560]: W0528 08:03:47.092149 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a26dd41_9d5a_4974_9ef7_438881784adf.slice/crio-202b1132c2828b71c795338a260dc205e4071078df7f5322f35a9f180cba188f WatchSource:0}: Error finding container 202b1132c2828b71c795338a260dc205e4071078df7f5322f35a9f180cba188f: Status 404 returned error can't find the container with id 202b1132c2828b71c795338a260dc205e4071078df7f5322f35a9f180cba188f May 28 08:03:47.576507 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:47.576474 2560 generic.go:358] "Generic (PLEG): container finished" podID="2a26dd41-9d5a-4974-9ef7-438881784adf" containerID="bb76aca9fd316c3f99bf8ebaa9dffa9e6a1d329dba1cb172e5cdda673a08fd1e" exitCode=0 May 28 08:03:47.576905 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:47.576578 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2a26dd41-9d5a-4974-9ef7-438881784adf","Type":"ContainerDied","Data":"bb76aca9fd316c3f99bf8ebaa9dffa9e6a1d329dba1cb172e5cdda673a08fd1e"} May 28 08:03:47.576905 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:47.576611 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2a26dd41-9d5a-4974-9ef7-438881784adf","Type":"ContainerStarted","Data":"202b1132c2828b71c795338a260dc205e4071078df7f5322f35a9f180cba188f"} May 28 08:03:48.583028 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:48.582992 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2a26dd41-9d5a-4974-9ef7-438881784adf","Type":"ContainerStarted","Data":"6d8ea4b3be51ae40329dae661f153cc88515b9aa7db768b204430e471d13906f"} May 28 08:03:48.583028 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:48.583032 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2a26dd41-9d5a-4974-9ef7-438881784adf","Type":"ContainerStarted","Data":"4d02bd5cebb9799dfc3162972cf44a8306cdd13ccba6f79e42da82793d10ebeb"} May 28 08:03:48.583489 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:48.583046 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2a26dd41-9d5a-4974-9ef7-438881784adf","Type":"ContainerStarted","Data":"735d4e85f4b28b731212fd1e86d42e2d40aa1f0c176e9a94023cf8f957aace98"} May 28 08:03:48.583489 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:48.583057 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2a26dd41-9d5a-4974-9ef7-438881784adf","Type":"ContainerStarted","Data":"de35cf1d50fb61883894d2230f7d994dd02a26e674f2b112eb2499836a17587f"} May 28 08:03:48.583489 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:48.583068 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2a26dd41-9d5a-4974-9ef7-438881784adf","Type":"ContainerStarted","Data":"67d50481dc603a2bdf90f46f2954ebe1368eae8836b38601a30369eae7fd1f0a"} May 28 08:03:48.583489 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:48.583079 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2a26dd41-9d5a-4974-9ef7-438881784adf","Type":"ContainerStarted","Data":"39571c989ce33a755243683702bce7978c4391b07d0cda3f781981dccf683097"} May 28 08:03:48.608669 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:48.608616 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.608591083 podStartE2EDuration="2.608591083s" podCreationTimestamp="2026-05-28 08:03:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 08:03:48.606918594 +0000 UTC m=+268.493364762" watchObservedRunningTime="2026-05-28 08:03:48.608591083 +0000 UTC m=+268.495037227" May 28 08:03:51.945377 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:51.945344 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 28 08:03:55.122421 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:03:55.122382 2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6cf4f7d8d7-cgjdv"] May 28 08:04:20.141377 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:04:20.141321 2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-6cf4f7d8d7-cgjdv" podUID="1ffb9149-1613-4871-a279-20d2bf47bd07" containerName="console" containerID="cri-o://e0937dcfb47657c6ef5f3e9cdd17c844579cb81b322b285d5111202659e86663" gracePeriod=15 May 28 08:04:20.390520 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:04:20.390496 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6cf4f7d8d7-cgjdv_1ffb9149-1613-4871-a279-20d2bf47bd07/console/0.log" May 28 08:04:20.390639 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:04:20.390573 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cf4f7d8d7-cgjdv" May 28 08:04:20.449519 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:04:20.449447 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1ffb9149-1613-4871-a279-20d2bf47bd07-oauth-serving-cert\") pod \"1ffb9149-1613-4871-a279-20d2bf47bd07\" (UID: \"1ffb9149-1613-4871-a279-20d2bf47bd07\") " May 28 08:04:20.449519 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:04:20.449481 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1ffb9149-1613-4871-a279-20d2bf47bd07-service-ca\") pod \"1ffb9149-1613-4871-a279-20d2bf47bd07\" (UID: \"1ffb9149-1613-4871-a279-20d2bf47bd07\") " May 28 08:04:20.449519 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:04:20.449505 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nfbfh\" (UniqueName: \"kubernetes.io/projected/1ffb9149-1613-4871-a279-20d2bf47bd07-kube-api-access-nfbfh\") pod \"1ffb9149-1613-4871-a279-20d2bf47bd07\" (UID: \"1ffb9149-1613-4871-a279-20d2bf47bd07\") " May 28 08:04:20.449752 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:04:20.449633 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1ffb9149-1613-4871-a279-20d2bf47bd07-console-config\") pod \"1ffb9149-1613-4871-a279-20d2bf47bd07\" (UID: \"1ffb9149-1613-4871-a279-20d2bf47bd07\") " May 28 08:04:20.449752 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:04:20.449675 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ffb9149-1613-4871-a279-20d2bf47bd07-trusted-ca-bundle\") pod \"1ffb9149-1613-4871-a279-20d2bf47bd07\" (UID: \"1ffb9149-1613-4871-a279-20d2bf47bd07\") " May 28 08:04:20.449752 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:04:20.449718 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1ffb9149-1613-4871-a279-20d2bf47bd07-console-serving-cert\") pod \"1ffb9149-1613-4871-a279-20d2bf47bd07\" (UID: \"1ffb9149-1613-4871-a279-20d2bf47bd07\") " May 28 08:04:20.449899 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:04:20.449753 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1ffb9149-1613-4871-a279-20d2bf47bd07-console-oauth-config\") pod \"1ffb9149-1613-4871-a279-20d2bf47bd07\" (UID: \"1ffb9149-1613-4871-a279-20d2bf47bd07\") " May 28 08:04:20.449956 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:04:20.449908 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ffb9149-1613-4871-a279-20d2bf47bd07-service-ca" (OuterVolumeSpecName: "service-ca") pod "1ffb9149-1613-4871-a279-20d2bf47bd07" (UID: "1ffb9149-1613-4871-a279-20d2bf47bd07"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 08:04:20.450091 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:04:20.450066 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ffb9149-1613-4871-a279-20d2bf47bd07-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1ffb9149-1613-4871-a279-20d2bf47bd07" (UID: "1ffb9149-1613-4871-a279-20d2bf47bd07"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 08:04:20.450162 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:04:20.450080 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ffb9149-1613-4871-a279-20d2bf47bd07-console-config" (OuterVolumeSpecName: "console-config") pod "1ffb9149-1613-4871-a279-20d2bf47bd07" (UID: "1ffb9149-1613-4871-a279-20d2bf47bd07"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 08:04:20.450162 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:04:20.450128 2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1ffb9149-1613-4871-a279-20d2bf47bd07-service-ca\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" May 28 08:04:20.450162 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:04:20.450143 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ffb9149-1613-4871-a279-20d2bf47bd07-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1ffb9149-1613-4871-a279-20d2bf47bd07" (UID: "1ffb9149-1613-4871-a279-20d2bf47bd07"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 08:04:20.451641 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:04:20.451606 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ffb9149-1613-4871-a279-20d2bf47bd07-kube-api-access-nfbfh" (OuterVolumeSpecName: "kube-api-access-nfbfh") pod "1ffb9149-1613-4871-a279-20d2bf47bd07" (UID: "1ffb9149-1613-4871-a279-20d2bf47bd07"). InnerVolumeSpecName "kube-api-access-nfbfh". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 08:04:20.451871 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:04:20.451845 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ffb9149-1613-4871-a279-20d2bf47bd07-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1ffb9149-1613-4871-a279-20d2bf47bd07" (UID: "1ffb9149-1613-4871-a279-20d2bf47bd07"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 08:04:20.451871 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:04:20.451862 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ffb9149-1613-4871-a279-20d2bf47bd07-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1ffb9149-1613-4871-a279-20d2bf47bd07" (UID: "1ffb9149-1613-4871-a279-20d2bf47bd07"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 08:04:20.550865 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:04:20.550836 2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1ffb9149-1613-4871-a279-20d2bf47bd07-oauth-serving-cert\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" May 28 08:04:20.550865 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:04:20.550862 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nfbfh\" (UniqueName: \"kubernetes.io/projected/1ffb9149-1613-4871-a279-20d2bf47bd07-kube-api-access-nfbfh\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" May 28 08:04:20.550865 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:04:20.550873 2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1ffb9149-1613-4871-a279-20d2bf47bd07-console-config\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" May 28 08:04:20.551081 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:04:20.550882 2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ffb9149-1613-4871-a279-20d2bf47bd07-trusted-ca-bundle\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" May 28 08:04:20.551081 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:04:20.550891 2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1ffb9149-1613-4871-a279-20d2bf47bd07-console-serving-cert\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" May 28 08:04:20.551081 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:04:20.550900 2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1ffb9149-1613-4871-a279-20d2bf47bd07-console-oauth-config\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" May 28 08:04:20.604417 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:04:20.604388 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6cf4f7d8d7-cgjdv_1ffb9149-1613-4871-a279-20d2bf47bd07/console/0.log" May 28 08:04:20.604589 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:04:20.604393 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6cf4f7d8d7-cgjdv_1ffb9149-1613-4871-a279-20d2bf47bd07/console/0.log" May 28 08:04:20.614754 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:04:20.614733 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2llls_092140cb-eea8-44c1-89f5-d8dd56d7d10a/ovn-acl-logging/0.log" May 28 08:04:20.615029 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:04:20.615009 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2llls_092140cb-eea8-44c1-89f5-d8dd56d7d10a/ovn-acl-logging/0.log" May 28 08:04:20.620138 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:04:20.620112 2560 kubelet.go:1628] "Image garbage collection succeeded" May 28 08:04:20.683010 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:04:20.682878 2560 generic.go:358] "Generic (PLEG): container finished" podID="1ffb9149-1613-4871-a279-20d2bf47bd07" containerID="e0937dcfb47657c6ef5f3e9cdd17c844579cb81b322b285d5111202659e86663" exitCode=2 May 28 08:04:20.683010 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:04:20.682935 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cf4f7d8d7-cgjdv" May 28 08:04:20.683010 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:04:20.682967 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cf4f7d8d7-cgjdv" event={"ID":"1ffb9149-1613-4871-a279-20d2bf47bd07","Type":"ContainerDied","Data":"e0937dcfb47657c6ef5f3e9cdd17c844579cb81b322b285d5111202659e86663"} May 28 08:04:20.683010 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:04:20.682994 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cf4f7d8d7-cgjdv" event={"ID":"1ffb9149-1613-4871-a279-20d2bf47bd07","Type":"ContainerDied","Data":"d24dc1f2b2e238dc942bfc18de1f8e5605af41f36399c480fd1ac2c9ea733349"} May 28 08:04:20.698240 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:04:20.683009 2560 scope.go:117] "RemoveContainer" containerID="e0937dcfb47657c6ef5f3e9cdd17c844579cb81b322b285d5111202659e86663" May 28 08:04:20.698240 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:04:20.691747 2560 scope.go:117] "RemoveContainer" containerID="e0937dcfb47657c6ef5f3e9cdd17c844579cb81b322b285d5111202659e86663" May 28 08:04:20.698240 ip-10-0-139-133 kubenswrapper[2560]: E0528 08:04:20.691981 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0937dcfb47657c6ef5f3e9cdd17c844579cb81b322b285d5111202659e86663\": container with ID starting with e0937dcfb47657c6ef5f3e9cdd17c844579cb81b322b285d5111202659e86663 not found: ID does not exist" containerID="e0937dcfb47657c6ef5f3e9cdd17c844579cb81b322b285d5111202659e86663" May 28 08:04:20.698240 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:04:20.692001 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0937dcfb47657c6ef5f3e9cdd17c844579cb81b322b285d5111202659e86663"} err="failed to get container status \"e0937dcfb47657c6ef5f3e9cdd17c844579cb81b322b285d5111202659e86663\": rpc error: code = NotFound desc = could not find container \"e0937dcfb47657c6ef5f3e9cdd17c844579cb81b322b285d5111202659e86663\": container with ID starting with e0937dcfb47657c6ef5f3e9cdd17c844579cb81b322b285d5111202659e86663 not found: ID does not exist" May 28 08:04:20.710287 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:04:20.710203 2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6cf4f7d8d7-cgjdv"] May 28 08:04:20.715172 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:04:20.715149 2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6cf4f7d8d7-cgjdv"] May 28 08:04:20.732475 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:04:20.732441 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ffb9149-1613-4871-a279-20d2bf47bd07" path="/var/lib/kubelet/pods/1ffb9149-1613-4871-a279-20d2bf47bd07/volumes" May 28 08:04:46.945355 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:04:46.945328 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 28 08:04:46.959834 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:04:46.959807 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 28 08:04:47.775025 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:04:47.775000 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 28 08:07:09.602019 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:07:09.601984 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-qz6rg"] May 28 08:07:09.602487 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:07:09.602308 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ffb9149-1613-4871-a279-20d2bf47bd07" containerName="console" May 28 08:07:09.602487 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:07:09.602320 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ffb9149-1613-4871-a279-20d2bf47bd07" containerName="console" May 28 08:07:09.602487 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:07:09.602373 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="1ffb9149-1613-4871-a279-20d2bf47bd07" containerName="console" May 28 08:07:09.605170 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:07:09.605154 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qz6rg" May 28 08:07:09.607329 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:07:09.607307 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 28 08:07:09.616695 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:07:09.616670 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qz6rg"] May 28 08:07:09.734491 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:07:09.734453 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e847c3c7-bd70-461f-ab5a-1d9dff548b07-dbus\") pod \"global-pull-secret-syncer-qz6rg\" (UID: \"e847c3c7-bd70-461f-ab5a-1d9dff548b07\") " pod="kube-system/global-pull-secret-syncer-qz6rg" May 28 08:07:09.734699 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:07:09.734505 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e847c3c7-bd70-461f-ab5a-1d9dff548b07-original-pull-secret\") pod \"global-pull-secret-syncer-qz6rg\" (UID: \"e847c3c7-bd70-461f-ab5a-1d9dff548b07\") " pod="kube-system/global-pull-secret-syncer-qz6rg" May 28 08:07:09.734699 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:07:09.734624 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e847c3c7-bd70-461f-ab5a-1d9dff548b07-kubelet-config\") pod \"global-pull-secret-syncer-qz6rg\" (UID: \"e847c3c7-bd70-461f-ab5a-1d9dff548b07\") " pod="kube-system/global-pull-secret-syncer-qz6rg" May 28 08:07:09.835900 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:07:09.835862 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e847c3c7-bd70-461f-ab5a-1d9dff548b07-original-pull-secret\") pod \"global-pull-secret-syncer-qz6rg\" (UID: \"e847c3c7-bd70-461f-ab5a-1d9dff548b07\") " pod="kube-system/global-pull-secret-syncer-qz6rg" May 28 08:07:09.836061 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:07:09.835950 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e847c3c7-bd70-461f-ab5a-1d9dff548b07-kubelet-config\") pod \"global-pull-secret-syncer-qz6rg\" (UID: \"e847c3c7-bd70-461f-ab5a-1d9dff548b07\") " pod="kube-system/global-pull-secret-syncer-qz6rg" May 28 08:07:09.836061 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:07:09.835999 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e847c3c7-bd70-461f-ab5a-1d9dff548b07-dbus\") pod \"global-pull-secret-syncer-qz6rg\" (UID: \"e847c3c7-bd70-461f-ab5a-1d9dff548b07\") " pod="kube-system/global-pull-secret-syncer-qz6rg" May 28 08:07:09.836136 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:07:09.836078 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e847c3c7-bd70-461f-ab5a-1d9dff548b07-kubelet-config\") pod \"global-pull-secret-syncer-qz6rg\" (UID: \"e847c3c7-bd70-461f-ab5a-1d9dff548b07\") " pod="kube-system/global-pull-secret-syncer-qz6rg" May 28 08:07:09.836171 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:07:09.836158 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e847c3c7-bd70-461f-ab5a-1d9dff548b07-dbus\") pod \"global-pull-secret-syncer-qz6rg\" (UID: \"e847c3c7-bd70-461f-ab5a-1d9dff548b07\") " pod="kube-system/global-pull-secret-syncer-qz6rg" May 28 08:07:09.838244 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:07:09.838223 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e847c3c7-bd70-461f-ab5a-1d9dff548b07-original-pull-secret\") pod \"global-pull-secret-syncer-qz6rg\" (UID: \"e847c3c7-bd70-461f-ab5a-1d9dff548b07\") " pod="kube-system/global-pull-secret-syncer-qz6rg" May 28 08:07:09.914325 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:07:09.914229 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qz6rg" May 28 08:07:10.037080 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:07:10.037049 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qz6rg"] May 28 08:07:10.039746 ip-10-0-139-133 kubenswrapper[2560]: W0528 08:07:10.039712 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode847c3c7_bd70_461f_ab5a_1d9dff548b07.slice/crio-fc25b656a951c3e769ee12dd73880c5085de8d967122b55f45110bea496c98d0 WatchSource:0}: Error finding container fc25b656a951c3e769ee12dd73880c5085de8d967122b55f45110bea496c98d0: Status 404 returned error can't find the container with id fc25b656a951c3e769ee12dd73880c5085de8d967122b55f45110bea496c98d0 May 28 08:07:10.041169 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:07:10.041152 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 28 08:07:10.152857 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:07:10.152824 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qz6rg" event={"ID":"e847c3c7-bd70-461f-ab5a-1d9dff548b07","Type":"ContainerStarted","Data":"fc25b656a951c3e769ee12dd73880c5085de8d967122b55f45110bea496c98d0"} May 28 08:07:17.179336 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:07:17.179252 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qz6rg" event={"ID":"e847c3c7-bd70-461f-ab5a-1d9dff548b07","Type":"ContainerStarted","Data":"6e57e796544f35ef5e4d3e2e7401468e8118d8e63e8b04052d75588082022bd9"} May 28 08:07:17.193475 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:07:17.193430 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-qz6rg" podStartSLOduration=1.307629456 podStartE2EDuration="8.193416496s" podCreationTimestamp="2026-05-28 08:07:09 +0000 UTC" firstStartedPulling="2026-05-28 08:07:10.041276651 +0000 UTC m=+469.927722772" lastFinishedPulling="2026-05-28 08:07:16.927063681 +0000 UTC m=+476.813509812" observedRunningTime="2026-05-28 08:07:17.19200543 +0000 UTC m=+477.078451571" watchObservedRunningTime="2026-05-28 08:07:17.193416496 +0000 UTC m=+477.079862638" May 28 08:09:20.635208 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:09:20.635177 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2llls_092140cb-eea8-44c1-89f5-d8dd56d7d10a/ovn-acl-logging/0.log" May 28 08:09:20.637455 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:09:20.637435 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2llls_092140cb-eea8-44c1-89f5-d8dd56d7d10a/ovn-acl-logging/0.log" May 28 08:14:20.654988 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:14:20.654958 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2llls_092140cb-eea8-44c1-89f5-d8dd56d7d10a/ovn-acl-logging/0.log" May 28 08:14:20.658318 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:14:20.658300 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2llls_092140cb-eea8-44c1-89f5-d8dd56d7d10a/ovn-acl-logging/0.log" May 28 08:14:55.786105 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:14:55.786073 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/redis-854544c579-lkvwx"] May 28 08:14:55.788219 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:14:55.788204 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-854544c579-lkvwx" May 28 08:14:55.791256 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:14:55.791234 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" May 28 08:14:55.791392 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:14:55.791239 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"default-dockercfg-j6l7s\"" May 28 08:14:55.791392 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:14:55.791255 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" May 28 08:14:55.794791 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:14:55.794762 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-854544c579-lkvwx"] May 28 08:14:55.800985 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:14:55.800959 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7kl9\" (UniqueName: \"kubernetes.io/projected/c4748603-4629-4ed5-93a2-89863b928dd3-kube-api-access-x7kl9\") pod \"redis-854544c579-lkvwx\" (UID: \"c4748603-4629-4ed5-93a2-89863b928dd3\") " pod="test-ns-feast/redis-854544c579-lkvwx" May 28 08:14:55.902082 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:14:55.902058 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x7kl9\" (UniqueName: \"kubernetes.io/projected/c4748603-4629-4ed5-93a2-89863b928dd3-kube-api-access-x7kl9\") pod \"redis-854544c579-lkvwx\" (UID: \"c4748603-4629-4ed5-93a2-89863b928dd3\") " pod="test-ns-feast/redis-854544c579-lkvwx" May 28 08:14:55.909350 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:14:55.909322 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7kl9\" (UniqueName: \"kubernetes.io/projected/c4748603-4629-4ed5-93a2-89863b928dd3-kube-api-access-x7kl9\") pod \"redis-854544c579-lkvwx\" (UID: \"c4748603-4629-4ed5-93a2-89863b928dd3\") " pod="test-ns-feast/redis-854544c579-lkvwx" May 28 08:14:56.115383 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:14:56.115361 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-854544c579-lkvwx" May 28 08:14:56.236415 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:14:56.236359 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-854544c579-lkvwx"] May 28 08:14:56.238652 ip-10-0-139-133 kubenswrapper[2560]: W0528 08:14:56.238625 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc4748603_4629_4ed5_93a2_89863b928dd3.slice/crio-518c00010363e6f8a7d49de5fabffac0688529e83d91166c413088506da9bfce WatchSource:0}: Error finding container 518c00010363e6f8a7d49de5fabffac0688529e83d91166c413088506da9bfce: Status 404 returned error can't find the container with id 518c00010363e6f8a7d49de5fabffac0688529e83d91166c413088506da9bfce May 28 08:14:56.240367 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:14:56.240349 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 28 08:14:56.468632 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:14:56.468550 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-854544c579-lkvwx" event={"ID":"c4748603-4629-4ed5-93a2-89863b928dd3","Type":"ContainerStarted","Data":"518c00010363e6f8a7d49de5fabffac0688529e83d91166c413088506da9bfce"} May 28 08:14:58.476356 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:14:58.476318 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-854544c579-lkvwx" event={"ID":"c4748603-4629-4ed5-93a2-89863b928dd3","Type":"ContainerStarted","Data":"7b50dddf94d0f8078ef6146b5f34d6577d83b4ae4082ab899f70fe84e38769e3"} May 28 08:14:58.490609 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:14:58.490548 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/redis-854544c579-lkvwx" podStartSLOduration=2.055469909 podStartE2EDuration="3.490534172s" podCreationTimestamp="2026-05-28 08:14:55 +0000 UTC" firstStartedPulling="2026-05-28 08:14:56.240473605 +0000 UTC m=+936.126919726" lastFinishedPulling="2026-05-28 08:14:57.675537868 +0000 UTC m=+937.561983989" observedRunningTime="2026-05-28 08:14:58.489169213 +0000 UTC m=+938.375615363" watchObservedRunningTime="2026-05-28 08:14:58.490534172 +0000 UTC m=+938.376980314" May 28 08:16:31.796761 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:16:31.796727 2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-854544c579-lkvwx"] May 28 08:16:31.797227 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:16:31.796919 2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/redis-854544c579-lkvwx" podUID="c4748603-4629-4ed5-93a2-89863b928dd3" containerName="redis" containerID="cri-o://7b50dddf94d0f8078ef6146b5f34d6577d83b4ae4082ab899f70fe84e38769e3" gracePeriod=30 May 28 08:16:32.031321 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:16:32.031299 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-854544c579-lkvwx" May 28 08:16:32.106263 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:16:32.106203 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x7kl9\" (UniqueName: \"kubernetes.io/projected/c4748603-4629-4ed5-93a2-89863b928dd3-kube-api-access-x7kl9\") pod \"c4748603-4629-4ed5-93a2-89863b928dd3\" (UID: \"c4748603-4629-4ed5-93a2-89863b928dd3\") " May 28 08:16:32.108193 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:16:32.108163 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4748603-4629-4ed5-93a2-89863b928dd3-kube-api-access-x7kl9" (OuterVolumeSpecName: "kube-api-access-x7kl9") pod "c4748603-4629-4ed5-93a2-89863b928dd3" (UID: "c4748603-4629-4ed5-93a2-89863b928dd3"). InnerVolumeSpecName "kube-api-access-x7kl9". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 08:16:32.207733 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:16:32.207704 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x7kl9\" (UniqueName: \"kubernetes.io/projected/c4748603-4629-4ed5-93a2-89863b928dd3-kube-api-access-x7kl9\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" May 28 08:16:32.744801 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:16:32.744771 2560 generic.go:358] "Generic (PLEG): container finished" podID="c4748603-4629-4ed5-93a2-89863b928dd3" containerID="7b50dddf94d0f8078ef6146b5f34d6577d83b4ae4082ab899f70fe84e38769e3" exitCode=0 May 28 08:16:32.744951 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:16:32.744817 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-854544c579-lkvwx" May 28 08:16:32.744951 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:16:32.744834 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-854544c579-lkvwx" event={"ID":"c4748603-4629-4ed5-93a2-89863b928dd3","Type":"ContainerDied","Data":"7b50dddf94d0f8078ef6146b5f34d6577d83b4ae4082ab899f70fe84e38769e3"} May 28 08:16:32.744951 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:16:32.744863 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-854544c579-lkvwx" event={"ID":"c4748603-4629-4ed5-93a2-89863b928dd3","Type":"ContainerDied","Data":"518c00010363e6f8a7d49de5fabffac0688529e83d91166c413088506da9bfce"} May 28 08:16:32.744951 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:16:32.744879 2560 scope.go:117] "RemoveContainer" containerID="7b50dddf94d0f8078ef6146b5f34d6577d83b4ae4082ab899f70fe84e38769e3" May 28 08:16:32.752280 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:16:32.752264 2560 scope.go:117] "RemoveContainer" containerID="7b50dddf94d0f8078ef6146b5f34d6577d83b4ae4082ab899f70fe84e38769e3" May 28 08:16:32.752524 ip-10-0-139-133 kubenswrapper[2560]: E0528 08:16:32.752508 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b50dddf94d0f8078ef6146b5f34d6577d83b4ae4082ab899f70fe84e38769e3\": container with ID starting with 7b50dddf94d0f8078ef6146b5f34d6577d83b4ae4082ab899f70fe84e38769e3 not found: ID does not exist" containerID="7b50dddf94d0f8078ef6146b5f34d6577d83b4ae4082ab899f70fe84e38769e3" May 28 08:16:32.752584 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:16:32.752534 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b50dddf94d0f8078ef6146b5f34d6577d83b4ae4082ab899f70fe84e38769e3"} err="failed to get container status \"7b50dddf94d0f8078ef6146b5f34d6577d83b4ae4082ab899f70fe84e38769e3\": rpc error: code = NotFound desc = could not find container \"7b50dddf94d0f8078ef6146b5f34d6577d83b4ae4082ab899f70fe84e38769e3\": container with ID starting with 7b50dddf94d0f8078ef6146b5f34d6577d83b4ae4082ab899f70fe84e38769e3 not found: ID does not exist" May 28 08:16:32.757697 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:16:32.757677 2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-854544c579-lkvwx"] May 28 08:16:32.759803 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:16:32.759785 2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/redis-854544c579-lkvwx"] May 28 08:16:34.733735 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:16:34.731739 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4748603-4629-4ed5-93a2-89863b928dd3" path="/var/lib/kubelet/pods/c4748603-4629-4ed5-93a2-89863b928dd3/volumes" May 28 08:19:20.676908 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:19:20.676881 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2llls_092140cb-eea8-44c1-89f5-d8dd56d7d10a/ovn-acl-logging/0.log" May 28 08:19:20.680732 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:19:20.680711 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2llls_092140cb-eea8-44c1-89f5-d8dd56d7d10a/ovn-acl-logging/0.log" May 28 08:24:20.697948 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:24:20.697916 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2llls_092140cb-eea8-44c1-89f5-d8dd56d7d10a/ovn-acl-logging/0.log" May 28 08:24:20.701499 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:24:20.701480 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2llls_092140cb-eea8-44c1-89f5-d8dd56d7d10a/ovn-acl-logging/0.log" May 28 08:29:20.718699 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:29:20.718668 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2llls_092140cb-eea8-44c1-89f5-d8dd56d7d10a/ovn-acl-logging/0.log" May 28 08:29:20.723230 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:29:20.723211 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2llls_092140cb-eea8-44c1-89f5-d8dd56d7d10a/ovn-acl-logging/0.log" May 28 08:32:48.320495 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:32:48.320465 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-qz6rg_e847c3c7-bd70-461f-ab5a-1d9dff548b07/global-pull-secret-syncer/0.log" May 28 08:32:48.412906 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:32:48.412875 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-h2fkd_724affe7-1ef8-4aa8-8828-b3de728946da/konnectivity-agent/0.log" May 28 08:32:48.507205 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:32:48.507175 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-133.ec2.internal_a235c96c5df75d6e3bfc1abeabef5111/haproxy/0.log" May 28 08:32:51.823117 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:32:51.823038 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-s5rl8_19937927-46d3-457b-b9f4-119c9bebd1bd/kube-state-metrics/0.log" May 28 08:32:51.845771 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:32:51.845743 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-s5rl8_19937927-46d3-457b-b9f4-119c9bebd1bd/kube-rbac-proxy-main/0.log" May 28 08:32:51.871441 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:32:51.871419 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-s5rl8_19937927-46d3-457b-b9f4-119c9bebd1bd/kube-rbac-proxy-self/0.log" May 28 08:32:51.900774 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:32:51.900738 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7cd9b98b77-qvqs4_83f134e9-aca3-4db4-a5ce-2e120c9749b6/metrics-server/0.log" May 28 08:32:51.931828 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:32:51.931807 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-665c9c8584-tfbhm_93e7087e-c377-4dbd-b97d-fd8f8463e9cf/monitoring-plugin/0.log" May 28 08:32:52.041866 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:32:52.041839 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hq5w7_f3ef8cef-7a24-445a-97b0-f3e21e088bc0/node-exporter/0.log" May 28 08:32:52.065000 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:32:52.064976 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hq5w7_f3ef8cef-7a24-445a-97b0-f3e21e088bc0/kube-rbac-proxy/0.log" May 28 08:32:52.087192 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:32:52.087137 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hq5w7_f3ef8cef-7a24-445a-97b0-f3e21e088bc0/init-textfile/0.log" May 28 08:32:52.268521 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:32:52.268494 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2a26dd41-9d5a-4974-9ef7-438881784adf/prometheus/0.log" May 28 08:32:52.292850 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:32:52.292822 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2a26dd41-9d5a-4974-9ef7-438881784adf/config-reloader/0.log" May 28 08:32:52.312712 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:32:52.312690 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2a26dd41-9d5a-4974-9ef7-438881784adf/thanos-sidecar/0.log" May 28 08:32:52.337949 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:32:52.337899 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2a26dd41-9d5a-4974-9ef7-438881784adf/kube-rbac-proxy-web/0.log" May 28 08:32:52.360235 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:32:52.360219 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2a26dd41-9d5a-4974-9ef7-438881784adf/kube-rbac-proxy/0.log" May 28 08:32:52.379686 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:32:52.379661 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2a26dd41-9d5a-4974-9ef7-438881784adf/kube-rbac-proxy-thanos/0.log" May 28 08:32:52.400264 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:32:52.400246 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2a26dd41-9d5a-4974-9ef7-438881784adf/init-config-reloader/0.log" May 28 08:32:52.426060 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:32:52.426036 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-fj7c6_252b1185-7763-4dfb-a085-3d39c277b38b/prometheus-operator/0.log" May 28 08:32:52.444332 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:32:52.444311 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-fj7c6_252b1185-7763-4dfb-a085-3d39c277b38b/kube-rbac-proxy/0.log" May 28 08:32:52.467555 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:32:52.467528 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6c4bbc67b7-k25kx_e7a52ad6-1c8d-48b9-bfb6-6ecf2c697e78/prometheus-operator-admission-webhook/0.log" May 28 08:32:54.876918 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:32:54.876879 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-j9p4l/perf-node-gather-daemonset-gbnk4"] May 28 08:32:54.877290 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:32:54.877220 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4748603-4629-4ed5-93a2-89863b928dd3" containerName="redis" May 28 08:32:54.877290 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:32:54.877231 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4748603-4629-4ed5-93a2-89863b928dd3" containerName="redis" May 28 08:32:54.877290 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:32:54.877286 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="c4748603-4629-4ed5-93a2-89863b928dd3" containerName="redis" May 28 08:32:54.880435 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:32:54.880419 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-j9p4l/perf-node-gather-daemonset-gbnk4" May 28 08:32:54.883237 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:32:54.883218 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-j9p4l\"/\"openshift-service-ca.crt\"" May 28 08:32:54.883354 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:32:54.883244 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-j9p4l\"/\"default-dockercfg-6mk6k\"" May 28 08:32:54.884050 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:32:54.884033 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-j9p4l\"/\"kube-root-ca.crt\"" May 28 08:32:54.893870 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:32:54.893845 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-j9p4l/perf-node-gather-daemonset-gbnk4"] May 28 08:32:54.983490 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:32:54.983458 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a4246cf8-61f4-4fd4-8d81-c4148b572ab6-proc\") pod \"perf-node-gather-daemonset-gbnk4\" (UID: \"a4246cf8-61f4-4fd4-8d81-c4148b572ab6\") " pod="openshift-must-gather-j9p4l/perf-node-gather-daemonset-gbnk4" May 28 08:32:54.983490 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:32:54.983492 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a4246cf8-61f4-4fd4-8d81-c4148b572ab6-podres\") pod \"perf-node-gather-daemonset-gbnk4\" (UID: \"a4246cf8-61f4-4fd4-8d81-c4148b572ab6\") " pod="openshift-must-gather-j9p4l/perf-node-gather-daemonset-gbnk4" May 28 08:32:54.983705 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:32:54.983516 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a4246cf8-61f4-4fd4-8d81-c4148b572ab6-sys\") pod \"perf-node-gather-daemonset-gbnk4\" (UID: \"a4246cf8-61f4-4fd4-8d81-c4148b572ab6\") " pod="openshift-must-gather-j9p4l/perf-node-gather-daemonset-gbnk4" May 28 08:32:54.983705 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:32:54.983534 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9c2q5\" (UniqueName: \"kubernetes.io/projected/a4246cf8-61f4-4fd4-8d81-c4148b572ab6-kube-api-access-9c2q5\") pod \"perf-node-gather-daemonset-gbnk4\" (UID: \"a4246cf8-61f4-4fd4-8d81-c4148b572ab6\") " pod="openshift-must-gather-j9p4l/perf-node-gather-daemonset-gbnk4" May 28 08:32:54.983705 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:32:54.983616 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a4246cf8-61f4-4fd4-8d81-c4148b572ab6-lib-modules\") pod \"perf-node-gather-daemonset-gbnk4\" (UID: \"a4246cf8-61f4-4fd4-8d81-c4148b572ab6\") " pod="openshift-must-gather-j9p4l/perf-node-gather-daemonset-gbnk4" May 28 08:32:55.084552 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:32:55.084512 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a4246cf8-61f4-4fd4-8d81-c4148b572ab6-proc\") pod \"perf-node-gather-daemonset-gbnk4\" (UID: \"a4246cf8-61f4-4fd4-8d81-c4148b572ab6\") " pod="openshift-must-gather-j9p4l/perf-node-gather-daemonset-gbnk4" May 28 08:32:55.084552 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:32:55.084580 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a4246cf8-61f4-4fd4-8d81-c4148b572ab6-podres\") pod \"perf-node-gather-daemonset-gbnk4\" (UID: \"a4246cf8-61f4-4fd4-8d81-c4148b572ab6\") " pod="openshift-must-gather-j9p4l/perf-node-gather-daemonset-gbnk4" May 28 08:32:55.084824 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:32:55.084616 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a4246cf8-61f4-4fd4-8d81-c4148b572ab6-sys\") pod \"perf-node-gather-daemonset-gbnk4\" (UID: \"a4246cf8-61f4-4fd4-8d81-c4148b572ab6\") " pod="openshift-must-gather-j9p4l/perf-node-gather-daemonset-gbnk4" May 28 08:32:55.084824 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:32:55.084642 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9c2q5\" (UniqueName: \"kubernetes.io/projected/a4246cf8-61f4-4fd4-8d81-c4148b572ab6-kube-api-access-9c2q5\") pod \"perf-node-gather-daemonset-gbnk4\" (UID: \"a4246cf8-61f4-4fd4-8d81-c4148b572ab6\") " pod="openshift-must-gather-j9p4l/perf-node-gather-daemonset-gbnk4" May 28 08:32:55.084824 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:32:55.084643 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a4246cf8-61f4-4fd4-8d81-c4148b572ab6-proc\") pod \"perf-node-gather-daemonset-gbnk4\" (UID: \"a4246cf8-61f4-4fd4-8d81-c4148b572ab6\") " pod="openshift-must-gather-j9p4l/perf-node-gather-daemonset-gbnk4" May 28 08:32:55.084824 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:32:55.084704 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a4246cf8-61f4-4fd4-8d81-c4148b572ab6-lib-modules\") pod \"perf-node-gather-daemonset-gbnk4\" (UID: \"a4246cf8-61f4-4fd4-8d81-c4148b572ab6\") " pod="openshift-must-gather-j9p4l/perf-node-gather-daemonset-gbnk4" May 28 08:32:55.084824 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:32:55.084727 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a4246cf8-61f4-4fd4-8d81-c4148b572ab6-sys\") pod \"perf-node-gather-daemonset-gbnk4\" (UID: \"a4246cf8-61f4-4fd4-8d81-c4148b572ab6\") " pod="openshift-must-gather-j9p4l/perf-node-gather-daemonset-gbnk4" May 28 08:32:55.084824 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:32:55.084771 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a4246cf8-61f4-4fd4-8d81-c4148b572ab6-podres\") pod \"perf-node-gather-daemonset-gbnk4\" (UID: \"a4246cf8-61f4-4fd4-8d81-c4148b572ab6\") " pod="openshift-must-gather-j9p4l/perf-node-gather-daemonset-gbnk4" May 28 08:32:55.084824 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:32:55.084824 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a4246cf8-61f4-4fd4-8d81-c4148b572ab6-lib-modules\") pod \"perf-node-gather-daemonset-gbnk4\" (UID: \"a4246cf8-61f4-4fd4-8d81-c4148b572ab6\") " pod="openshift-must-gather-j9p4l/perf-node-gather-daemonset-gbnk4" May 28 08:32:55.091901 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:32:55.091876 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9c2q5\" (UniqueName: \"kubernetes.io/projected/a4246cf8-61f4-4fd4-8d81-c4148b572ab6-kube-api-access-9c2q5\") pod \"perf-node-gather-daemonset-gbnk4\" (UID: \"a4246cf8-61f4-4fd4-8d81-c4148b572ab6\") " pod="openshift-must-gather-j9p4l/perf-node-gather-daemonset-gbnk4" May 28 08:32:55.189756 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:32:55.189677 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-j9p4l/perf-node-gather-daemonset-gbnk4" May 28 08:32:55.309135 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:32:55.309104 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-j9p4l/perf-node-gather-daemonset-gbnk4"] May 28 08:32:55.312027 ip-10-0-139-133 kubenswrapper[2560]: W0528 08:32:55.311999 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda4246cf8_61f4_4fd4_8d81_c4148b572ab6.slice/crio-2e34a136ceb0d9884f950726c23bae41951b5ae8fde82ce18e3f95bbb4f7c220 WatchSource:0}: Error finding container 2e34a136ceb0d9884f950726c23bae41951b5ae8fde82ce18e3f95bbb4f7c220: Status 404 returned error can't find the container with id 2e34a136ceb0d9884f950726c23bae41951b5ae8fde82ce18e3f95bbb4f7c220 May 28 08:32:55.313592 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:32:55.313557 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 28 08:32:55.494457 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:32:55.494373 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-j9p4l/perf-node-gather-daemonset-gbnk4" event={"ID":"a4246cf8-61f4-4fd4-8d81-c4148b572ab6","Type":"ContainerStarted","Data":"1606b6d68e95f19b46d4acbe836e46eec8fcb041a2854c10f77dcacbd7848e08"} May 28 08:32:55.494457 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:32:55.494408 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-j9p4l/perf-node-gather-daemonset-gbnk4" event={"ID":"a4246cf8-61f4-4fd4-8d81-c4148b572ab6","Type":"ContainerStarted","Data":"2e34a136ceb0d9884f950726c23bae41951b5ae8fde82ce18e3f95bbb4f7c220"} May 28 08:32:55.494676 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:32:55.494574 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-j9p4l/perf-node-gather-daemonset-gbnk4" May 28 08:32:55.507996 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:32:55.507924 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-j9p4l/perf-node-gather-daemonset-gbnk4" podStartSLOduration=1.507882817 podStartE2EDuration="1.507882817s" podCreationTimestamp="2026-05-28 08:32:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 08:32:55.507871744 +0000 UTC m=+2015.394317888" watchObservedRunningTime="2026-05-28 08:32:55.507882817 +0000 UTC m=+2015.394328958" May 28 08:32:55.588642 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:32:55.588622 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-88fmq_ec820620-b736-430c-831d-5d2b97e83d32/dns/0.log" May 28 08:32:55.608321 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:32:55.608296 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-88fmq_ec820620-b736-430c-831d-5d2b97e83d32/kube-rbac-proxy/0.log" May 28 08:32:55.745541 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:32:55.745469 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xhm9j_8db07e49-d641-48b0-89e4-2f4bdf6999a5/dns-node-resolver/0.log" May 28 08:32:56.131263 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:32:56.131242 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ctxgq_04a96139-4274-4e69-bb7b-18e9e99ba9e4/node-ca/0.log" May 28 08:32:57.105458 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:32:57.105432 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qtd5f_b2d0b175-5e98-4b80-94e3-92a78b286c16/serve-healthcheck-canary/0.log" May 28 08:32:57.415935 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:32:57.415856 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-449zx_c983dbdf-f0a8-4bb6-b8cc-0a759a317eb7/insights-operator/0.log" May 28 08:32:57.416373 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:32:57.416242 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-449zx_c983dbdf-f0a8-4bb6-b8cc-0a759a317eb7/insights-operator/1.log" May 28 08:32:57.433413 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:32:57.433388 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jljsw_5962f9ac-b4a6-472d-ba4c-dfc39932a8ca/kube-rbac-proxy/0.log" May 28 08:32:57.452053 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:32:57.452037 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jljsw_5962f9ac-b4a6-472d-ba4c-dfc39932a8ca/exporter/0.log" May 28 08:32:57.471827 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:32:57.471807 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jljsw_5962f9ac-b4a6-472d-ba4c-dfc39932a8ca/extractor/0.log" May 28 08:33:01.483971 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:33:01.483939 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-rt2wl_98fa889b-5b1e-4744-b209-41126bf0c184/migrator/0.log" May 28 08:33:01.502426 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:33:01.502403 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-rt2wl_98fa889b-5b1e-4744-b209-41126bf0c184/graceful-termination/0.log" May 28 08:33:01.506715 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:33:01.506693 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-j9p4l/perf-node-gather-daemonset-gbnk4" May 28 08:33:01.787598 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:33:01.787501 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-8mk4q_7811826f-af04-4605-a732-f165273106d4/kube-storage-version-migrator-operator/1.log" May 28 08:33:01.788263 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:33:01.788244 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-8mk4q_7811826f-af04-4605-a732-f165273106d4/kube-storage-version-migrator-operator/0.log" May 28 08:33:02.537279 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:33:02.537251 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dxbtn_4a2444a9-55c7-4ce5-b8e7-d394e0855f26/kube-multus-additional-cni-plugins/0.log" May 28 08:33:02.556362 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:33:02.556339 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dxbtn_4a2444a9-55c7-4ce5-b8e7-d394e0855f26/egress-router-binary-copy/0.log" May 28 08:33:02.577487 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:33:02.577468 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dxbtn_4a2444a9-55c7-4ce5-b8e7-d394e0855f26/cni-plugins/0.log" May 28 08:33:02.602336 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:33:02.602320 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dxbtn_4a2444a9-55c7-4ce5-b8e7-d394e0855f26/bond-cni-plugin/0.log" May 28 08:33:02.621514 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:33:02.621496 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dxbtn_4a2444a9-55c7-4ce5-b8e7-d394e0855f26/routeoverride-cni/0.log" May 28 08:33:02.639601 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:33:02.639582 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dxbtn_4a2444a9-55c7-4ce5-b8e7-d394e0855f26/whereabouts-cni-bincopy/0.log" May 28 08:33:02.658025 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:33:02.658000 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dxbtn_4a2444a9-55c7-4ce5-b8e7-d394e0855f26/whereabouts-cni/0.log" May 28 08:33:03.004938 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:33:03.004909 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-ldhht_632fd718-6604-42a2-aca2-e24e53bfdbb3/kube-multus/0.log" May 28 08:33:03.158401 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:33:03.158376 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-z5j9k_5f2c94ed-4111-42f9-8ec1-7c96447b9c11/network-metrics-daemon/0.log" May 28 08:33:03.177248 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:33:03.177226 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-z5j9k_5f2c94ed-4111-42f9-8ec1-7c96447b9c11/kube-rbac-proxy/0.log" May 28 08:33:04.011017 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:33:04.010991 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2llls_092140cb-eea8-44c1-89f5-d8dd56d7d10a/ovn-controller/0.log" May 28 08:33:04.030447 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:33:04.030385 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2llls_092140cb-eea8-44c1-89f5-d8dd56d7d10a/ovn-acl-logging/0.log" May 28 08:33:04.039310 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:33:04.039291 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2llls_092140cb-eea8-44c1-89f5-d8dd56d7d10a/ovn-acl-logging/1.log" May 28 08:33:04.056942 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:33:04.056896 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2llls_092140cb-eea8-44c1-89f5-d8dd56d7d10a/kube-rbac-proxy-node/0.log" May 28 08:33:04.077119 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:33:04.077102 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2llls_092140cb-eea8-44c1-89f5-d8dd56d7d10a/kube-rbac-proxy-ovn-metrics/0.log" May 28 08:33:04.093550 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:33:04.093535 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2llls_092140cb-eea8-44c1-89f5-d8dd56d7d10a/northd/0.log" May 28 08:33:04.112551 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:33:04.112535 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2llls_092140cb-eea8-44c1-89f5-d8dd56d7d10a/nbdb/0.log" May 28 08:33:04.134157 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:33:04.134139 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2llls_092140cb-eea8-44c1-89f5-d8dd56d7d10a/sbdb/0.log" May 28 08:33:04.226552 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:33:04.226525 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2llls_092140cb-eea8-44c1-89f5-d8dd56d7d10a/ovnkube-controller/0.log" May 28 08:33:05.689133 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:33:05.689095 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-7f44b6dd87-b4xhl_36db01f6-3d08-43ca-9b7e-350cf7afc74b/check-endpoints/0.log" May 28 08:33:05.760190 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:33:05.760119 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-w9gt5_8802231b-bd91-4690-9379-4e802d4d8853/network-check-target-container/0.log" May 28 08:33:06.582251 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:33:06.582224 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-z4fbh_23b33b50-4b8f-45d5-a5e7-362bdb2a04ea/iptables-alerter/0.log" May 28 08:33:07.129437 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:33:07.129415 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-lm42d_1826661e-2068-4391-9044-b01ffe8dbeac/tuned/0.log" May 28 08:33:08.672261 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:33:08.672228 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-697587599-d8zp5_88dbb2bd-a657-41b0-ba0b-cc35ee5caea0/cluster-samples-operator/0.log" May 28 08:33:08.686501 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:33:08.686480 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-697587599-d8zp5_88dbb2bd-a657-41b0-ba0b-cc35ee5caea0/cluster-samples-operator-watch/0.log" May 28 08:33:09.497394 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:33:09.497360 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-57b5b68b8-bxk8j_1f418e03-845a-44f2-a3bd-5dcc46b6df6c/service-ca-operator/1.log" May 28 08:33:09.498153 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:33:09.498132 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-57b5b68b8-bxk8j_1f418e03-845a-44f2-a3bd-5dcc46b6df6c/service-ca-operator/0.log" May 28 08:33:10.247132 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:33:10.247107 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-n95hd_f5b72cf0-375b-4d9b-af04-706c6348e6d1/csi-driver/0.log" May 28 08:33:10.265805 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:33:10.265786 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-n95hd_f5b72cf0-375b-4d9b-af04-706c6348e6d1/csi-node-driver-registrar/0.log" May 28 08:33:10.283765 ip-10-0-139-133 kubenswrapper[2560]: I0528 08:33:10.283747 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-n95hd_f5b72cf0-375b-4d9b-af04-706c6348e6d1/csi-liveness-probe/0.log"