May 28 22:59:51.776116 ip-10-0-132-11 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory May 28 22:59:51.776128 ip-10-0-132-11 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory May 28 22:59:51.776135 ip-10-0-132-11 systemd[1]: kubelet.service: Failed with result 'resources'. May 28 22:59:51.776575 ip-10-0-132-11 systemd[1]: Failed to start Kubernetes Kubelet. May 28 23:00:01.927454 ip-10-0-132-11 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. May 28 23:00:01.927475 ip-10-0-132-11 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 10b74412d7ca4ff0a2eebe75e5c637f3 -- May 28 23:02:22.271327 ip-10-0-132-11 systemd[1]: Starting Kubernetes Kubelet... May 28 23:02:22.742301 ip-10-0-132-11 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 28 23:02:22.742301 ip-10-0-132-11 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 28 23:02:22.742301 ip-10-0-132-11 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 28 23:02:22.742301 ip-10-0-132-11 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 28 23:02:22.742301 ip-10-0-132-11 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 28 23:02:22.744362 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.744222 2577 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 28 23:02:22.749822 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.749807 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 28 23:02:22.749822 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.749822 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 28 23:02:22.749886 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.749826 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 28 23:02:22.749886 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.749830 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 28 23:02:22.749886 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.749833 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 28 23:02:22.749886 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.749836 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 28 23:02:22.749886 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.749839 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 28 23:02:22.749886 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.749842 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 28 23:02:22.749886 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.749845 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 28 23:02:22.749886 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.749848 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 28 23:02:22.749886 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.749852 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 28 23:02:22.749886 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.749855 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 28 23:02:22.749886 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.749858 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 28 23:02:22.749886 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.749861 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 28 23:02:22.749886 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.749863 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 28 23:02:22.749886 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.749866 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 28 23:02:22.749886 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.749868 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages May 28 23:02:22.749886 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.749871 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 28 23:02:22.749886 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.749874 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 28 23:02:22.749886 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.749876 2577 feature_gate.go:328] unrecognized feature gate: Example May 28 23:02:22.749886 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.749879 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 28 23:02:22.749886 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.749882 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 28 23:02:22.750382 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.749885 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 28 23:02:22.750382 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.749887 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 28 23:02:22.750382 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.749890 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 28 23:02:22.750382 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.749893 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 28 23:02:22.750382 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.749896 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 28 23:02:22.750382 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.749899 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 28 23:02:22.750382 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.749902 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 28 23:02:22.750382 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.749904 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 28 23:02:22.750382 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.749907 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 28 23:02:22.750382 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.749910 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 28 23:02:22.750382 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.749912 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 28 23:02:22.750382 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.749915 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 28 23:02:22.750382 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.749917 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 28 23:02:22.750382 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.749920 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 28 23:02:22.750382 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.749922 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 28 23:02:22.750382 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.749925 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 28 23:02:22.750382 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.749928 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 28 23:02:22.750382 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.749930 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 28 23:02:22.750382 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.749933 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 28 23:02:22.750382 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.749935 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 28 23:02:22.750909 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.749938 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 28 23:02:22.750909 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.749940 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 28 23:02:22.750909 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.749943 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 28 23:02:22.750909 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.749945 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 28 23:02:22.750909 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.749950 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 28 23:02:22.750909 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.749954 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 28 23:02:22.750909 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.749956 2577 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 28 23:02:22.750909 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.749959 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 28 23:02:22.750909 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.749962 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 28 23:02:22.750909 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.749964 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 28 23:02:22.750909 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.749966 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 28 23:02:22.750909 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.749969 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability May 28 23:02:22.750909 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.749971 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores May 28 23:02:22.750909 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.749975 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 28 23:02:22.750909 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.749978 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 28 23:02:22.750909 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.749980 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 28 23:02:22.750909 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.749984 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 28 23:02:22.750909 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.749987 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 28 23:02:22.750909 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.749989 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 28 23:02:22.750909 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.749992 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 28 23:02:22.751418 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.749994 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 28 23:02:22.751418 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.749996 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 28 23:02:22.751418 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.749999 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 28 23:02:22.751418 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750002 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 28 23:02:22.751418 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750004 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 28 23:02:22.751418 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750007 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 28 23:02:22.751418 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750009 2577 feature_gate.go:328] unrecognized feature gate: Example2 May 28 23:02:22.751418 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750013 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 28 23:02:22.751418 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750017 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 28 23:02:22.751418 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750019 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 28 23:02:22.751418 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750029 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 28 23:02:22.751418 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750032 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 28 23:02:22.751418 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750034 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 28 23:02:22.751418 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750037 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 28 23:02:22.751418 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750040 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 28 23:02:22.751418 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750042 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 28 23:02:22.751418 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750045 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 28 23:02:22.751418 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750048 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 28 23:02:22.751418 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750050 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 28 23:02:22.751885 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750053 2577 feature_gate.go:328] unrecognized feature gate: DualReplica May 28 23:02:22.751885 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750055 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 28 23:02:22.751885 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750059 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 28 23:02:22.751885 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750061 2577 feature_gate.go:328] unrecognized feature gate: NewOLM May 28 23:02:22.751885 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750075 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 28 23:02:22.751885 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750509 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 28 23:02:22.751885 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750517 2577 feature_gate.go:328] unrecognized feature gate: Example May 28 23:02:22.751885 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750520 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 28 23:02:22.751885 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750524 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 28 23:02:22.751885 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750526 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 28 23:02:22.751885 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750529 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 28 23:02:22.751885 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750532 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 28 23:02:22.751885 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750534 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 28 23:02:22.751885 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750537 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 28 23:02:22.751885 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750541 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 28 23:02:22.751885 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750544 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 28 23:02:22.751885 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750547 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 28 23:02:22.751885 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750550 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 28 23:02:22.751885 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750552 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 28 23:02:22.752362 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750555 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 28 23:02:22.752362 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750558 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 28 23:02:22.752362 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750560 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 28 23:02:22.752362 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750563 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability May 28 23:02:22.752362 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750572 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 28 23:02:22.752362 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750575 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 28 23:02:22.752362 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750577 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 28 23:02:22.752362 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750580 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 28 23:02:22.752362 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750582 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 28 23:02:22.752362 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750585 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores May 28 23:02:22.752362 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750588 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 28 23:02:22.752362 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750590 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 28 23:02:22.752362 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750593 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 28 23:02:22.752362 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750595 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 28 23:02:22.752362 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750598 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 28 23:02:22.752362 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750601 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 28 23:02:22.752362 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750603 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 28 23:02:22.752362 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750606 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 28 23:02:22.752362 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750610 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 28 23:02:22.752362 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750612 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 28 23:02:22.752893 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750615 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 28 23:02:22.752893 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750618 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 28 23:02:22.752893 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750620 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 28 23:02:22.752893 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750623 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 28 23:02:22.752893 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750625 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 28 23:02:22.752893 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750628 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 28 23:02:22.752893 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750630 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 28 23:02:22.752893 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750633 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 28 23:02:22.752893 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750635 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 28 23:02:22.752893 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750638 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 28 23:02:22.752893 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750640 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 28 23:02:22.752893 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750643 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 28 23:02:22.752893 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750645 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 28 23:02:22.752893 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750648 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 28 23:02:22.752893 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750651 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 28 23:02:22.752893 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750653 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 28 23:02:22.752893 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750656 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 28 23:02:22.752893 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750664 2577 feature_gate.go:328] unrecognized feature gate: NewOLM May 28 23:02:22.752893 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750666 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 28 23:02:22.752893 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750669 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 28 23:02:22.753416 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750671 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 28 23:02:22.753416 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750674 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 28 23:02:22.753416 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750676 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 28 23:02:22.753416 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750679 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 28 23:02:22.753416 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750681 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 28 23:02:22.753416 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750684 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 28 23:02:22.753416 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750686 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 28 23:02:22.753416 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750690 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 28 23:02:22.753416 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750694 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 28 23:02:22.753416 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750698 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages May 28 23:02:22.753416 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750701 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 28 23:02:22.753416 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750704 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 28 23:02:22.753416 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750706 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 28 23:02:22.753416 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750709 2577 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 28 23:02:22.753416 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750712 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 28 23:02:22.753416 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750715 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 28 23:02:22.753416 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750718 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 28 23:02:22.753416 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750720 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 28 23:02:22.753416 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750723 2577 feature_gate.go:328] unrecognized feature gate: Example2 May 28 23:02:22.753892 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750726 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 28 23:02:22.753892 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750728 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 28 23:02:22.753892 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750731 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 28 23:02:22.753892 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750738 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 28 23:02:22.753892 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750740 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 28 23:02:22.753892 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750743 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 28 23:02:22.753892 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750746 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 28 23:02:22.753892 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750748 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 28 23:02:22.753892 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750750 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 28 23:02:22.753892 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750753 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 28 23:02:22.753892 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750756 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 28 23:02:22.753892 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750763 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 28 23:02:22.753892 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.750766 2577 feature_gate.go:328] unrecognized feature gate: DualReplica May 28 23:02:22.753892 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751561 2577 flags.go:64] FLAG: --address="0.0.0.0" May 28 23:02:22.753892 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751570 2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 28 23:02:22.753892 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751581 2577 flags.go:64] FLAG: --anonymous-auth="true" May 28 23:02:22.753892 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751585 2577 flags.go:64] FLAG: --application-metrics-count-limit="100" May 28 23:02:22.753892 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751590 2577 flags.go:64] FLAG: --authentication-token-webhook="false" May 28 23:02:22.753892 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751593 2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 28 23:02:22.753892 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751597 2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 28 23:02:22.753892 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751602 2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 28 23:02:22.754409 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751605 2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 28 23:02:22.754409 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751608 2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 28 23:02:22.754409 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751612 2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 28 23:02:22.754409 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751616 2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 28 23:02:22.754409 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751619 2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 28 23:02:22.754409 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751622 2577 flags.go:64] FLAG: --cgroup-root="" May 28 23:02:22.754409 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751625 2577 flags.go:64] FLAG: --cgroups-per-qos="true" May 28 23:02:22.754409 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751628 2577 flags.go:64] FLAG: --client-ca-file="" May 28 23:02:22.754409 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751631 2577 flags.go:64] FLAG: --cloud-config="" May 28 23:02:22.754409 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751634 2577 flags.go:64] FLAG: --cloud-provider="external" May 28 23:02:22.754409 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751637 2577 flags.go:64] FLAG: --cluster-dns="[]" May 28 23:02:22.754409 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751643 2577 flags.go:64] FLAG: --cluster-domain="" May 28 23:02:22.754409 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751646 2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 28 23:02:22.754409 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751649 2577 flags.go:64] FLAG: --config-dir="" May 28 23:02:22.754409 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751652 2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 28 23:02:22.754409 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751655 2577 flags.go:64] FLAG: --container-log-max-files="5" May 28 23:02:22.754409 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751659 2577 flags.go:64] FLAG: --container-log-max-size="10Mi" May 28 23:02:22.754409 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751662 2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 28 23:02:22.754409 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751665 2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 28 23:02:22.754409 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751668 2577 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 28 23:02:22.754409 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751671 2577 flags.go:64] FLAG: --contention-profiling="false" May 28 23:02:22.754409 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751675 2577 flags.go:64] FLAG: --cpu-cfs-quota="true" May 28 23:02:22.754409 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751678 2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 28 23:02:22.754409 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751686 2577 flags.go:64] FLAG: --cpu-manager-policy="none" May 28 23:02:22.754409 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751689 2577 flags.go:64] FLAG: --cpu-manager-policy-options="" May 28 23:02:22.755013 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751694 2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 28 23:02:22.755013 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751696 2577 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 28 23:02:22.755013 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751699 2577 flags.go:64] FLAG: --enable-debugging-handlers="true" May 28 23:02:22.755013 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751702 2577 flags.go:64] FLAG: --enable-load-reader="false" May 28 23:02:22.755013 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751705 2577 flags.go:64] FLAG: --enable-server="true" May 28 23:02:22.755013 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751708 2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 28 23:02:22.755013 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751715 2577 flags.go:64] FLAG: --event-burst="100" May 28 23:02:22.755013 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751718 2577 flags.go:64] FLAG: --event-qps="50" May 28 23:02:22.755013 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751725 2577 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 28 23:02:22.755013 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751729 2577 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 28 23:02:22.755013 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751732 2577 flags.go:64] FLAG: --eviction-hard="" May 28 23:02:22.755013 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751736 2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 28 23:02:22.755013 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751739 2577 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 28 23:02:22.755013 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751742 2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 28 23:02:22.755013 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751745 2577 flags.go:64] FLAG: --eviction-soft="" May 28 23:02:22.755013 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751747 2577 flags.go:64] FLAG: --eviction-soft-grace-period="" May 28 23:02:22.755013 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751750 2577 flags.go:64] FLAG: --exit-on-lock-contention="false" May 28 23:02:22.755013 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751753 2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 28 23:02:22.755013 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751756 2577 flags.go:64] FLAG: --experimental-mounter-path="" May 28 23:02:22.755013 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751759 2577 flags.go:64] FLAG: --fail-cgroupv1="false" May 28 23:02:22.755013 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751762 2577 flags.go:64] FLAG: --fail-swap-on="true" May 28 23:02:22.755013 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751765 2577 flags.go:64] FLAG: --feature-gates="" May 28 23:02:22.755013 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751769 2577 flags.go:64] FLAG: --file-check-frequency="20s" May 28 23:02:22.755013 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751772 2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 28 23:02:22.755013 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751775 2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 28 23:02:22.755642 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751778 2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 28 23:02:22.755642 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751781 2577 flags.go:64] FLAG: --healthz-port="10248" May 28 23:02:22.755642 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751785 2577 flags.go:64] FLAG: --help="false" May 28 23:02:22.755642 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751788 2577 flags.go:64] FLAG: --hostname-override="ip-10-0-132-11.ec2.internal" May 28 23:02:22.755642 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751791 2577 flags.go:64] FLAG: --housekeeping-interval="10s" May 28 23:02:22.755642 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751794 2577 flags.go:64] FLAG: --http-check-frequency="20s" May 28 23:02:22.755642 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751802 2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 28 23:02:22.755642 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751806 2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 28 23:02:22.755642 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751809 2577 flags.go:64] FLAG: --image-gc-high-threshold="85" May 28 23:02:22.755642 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751812 2577 flags.go:64] FLAG: --image-gc-low-threshold="80" May 28 23:02:22.755642 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751815 2577 flags.go:64] FLAG: --image-service-endpoint="" May 28 23:02:22.755642 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751818 2577 flags.go:64] FLAG: --kernel-memcg-notification="false" May 28 23:02:22.755642 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751821 2577 flags.go:64] FLAG: --kube-api-burst="100" May 28 23:02:22.755642 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751824 2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 28 23:02:22.755642 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751827 2577 flags.go:64] FLAG: --kube-api-qps="50" May 28 23:02:22.755642 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751831 2577 flags.go:64] FLAG: --kube-reserved="" May 28 23:02:22.755642 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751835 2577 flags.go:64] FLAG: --kube-reserved-cgroup="" May 28 23:02:22.755642 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751838 2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 28 23:02:22.755642 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751841 2577 flags.go:64] FLAG: --kubelet-cgroups="" May 28 23:02:22.755642 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751844 2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 28 23:02:22.755642 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751847 2577 flags.go:64] FLAG: --lock-file="" May 28 23:02:22.755642 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751850 2577 flags.go:64] FLAG: --log-cadvisor-usage="false" May 28 23:02:22.755642 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751853 2577 flags.go:64] FLAG: --log-flush-frequency="5s" May 28 23:02:22.755642 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751856 2577 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 28 23:02:22.756235 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751861 2577 flags.go:64] FLAG: --log-json-split-stream="false" May 28 23:02:22.756235 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751864 2577 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 28 23:02:22.756235 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751867 2577 flags.go:64] FLAG: --log-text-split-stream="false" May 28 23:02:22.756235 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751870 2577 flags.go:64] FLAG: --logging-format="text" May 28 23:02:22.756235 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751873 2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 28 23:02:22.756235 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751877 2577 flags.go:64] FLAG: --make-iptables-util-chains="true" May 28 23:02:22.756235 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751879 2577 flags.go:64] FLAG: --manifest-url="" May 28 23:02:22.756235 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751883 2577 flags.go:64] FLAG: --manifest-url-header="" May 28 23:02:22.756235 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751887 2577 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 28 23:02:22.756235 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751890 2577 flags.go:64] FLAG: --max-open-files="1000000" May 28 23:02:22.756235 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751894 2577 flags.go:64] FLAG: --max-pods="110" May 28 23:02:22.756235 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751898 2577 flags.go:64] FLAG: --maximum-dead-containers="-1" May 28 23:02:22.756235 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751901 2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 28 23:02:22.756235 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751903 2577 flags.go:64] FLAG: --memory-manager-policy="None" May 28 23:02:22.756235 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751906 2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 28 23:02:22.756235 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751915 2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 28 23:02:22.756235 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751918 2577 flags.go:64] FLAG: --node-ip="0.0.0.0" May 28 23:02:22.756235 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751921 2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 28 23:02:22.756235 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751928 2577 flags.go:64] FLAG: --node-status-max-images="50" May 28 23:02:22.756235 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751931 2577 flags.go:64] FLAG: --node-status-update-frequency="10s" May 28 23:02:22.756235 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751934 2577 flags.go:64] FLAG: --oom-score-adj="-999" May 28 23:02:22.756235 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751937 2577 flags.go:64] FLAG: --pod-cidr="" May 28 23:02:22.756235 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751939 2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 28 23:02:22.756819 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751945 2577 flags.go:64] FLAG: --pod-manifest-path="" May 28 23:02:22.756819 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751951 2577 flags.go:64] FLAG: --pod-max-pids="-1" May 28 23:02:22.756819 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751954 2577 flags.go:64] FLAG: --pods-per-core="0" May 28 23:02:22.756819 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751957 2577 flags.go:64] FLAG: --port="10250" May 28 23:02:22.756819 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751960 2577 flags.go:64] FLAG: --protect-kernel-defaults="false" May 28 23:02:22.756819 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751963 2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0339d9b3c6cb6b01b" May 28 23:02:22.756819 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751966 2577 flags.go:64] FLAG: --qos-reserved="" May 28 23:02:22.756819 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751969 2577 flags.go:64] FLAG: --read-only-port="10255" May 28 23:02:22.756819 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751972 2577 flags.go:64] FLAG: --register-node="true" May 28 23:02:22.756819 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751975 2577 flags.go:64] FLAG: --register-schedulable="true" May 28 23:02:22.756819 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751978 2577 flags.go:64] FLAG: --register-with-taints="" May 28 23:02:22.756819 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751982 2577 flags.go:64] FLAG: --registry-burst="10" May 28 23:02:22.756819 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751985 2577 flags.go:64] FLAG: --registry-qps="5" May 28 23:02:22.756819 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751988 2577 flags.go:64] FLAG: --reserved-cpus="" May 28 23:02:22.756819 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751991 2577 flags.go:64] FLAG: --reserved-memory="" May 28 23:02:22.756819 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.751997 2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 28 23:02:22.756819 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.752000 2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 28 23:02:22.756819 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.752003 2577 flags.go:64] FLAG: --rotate-certificates="false" May 28 23:02:22.756819 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.752006 2577 flags.go:64] FLAG: --rotate-server-certificates="false" May 28 23:02:22.756819 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.752008 2577 flags.go:64] FLAG: --runonce="false" May 28 23:02:22.756819 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.752011 2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 28 23:02:22.756819 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.752014 2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 28 23:02:22.756819 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.752017 2577 flags.go:64] FLAG: --seccomp-default="false" May 28 23:02:22.756819 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.752020 2577 flags.go:64] FLAG: --serialize-image-pulls="true" May 28 23:02:22.756819 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.752023 2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 28 23:02:22.756819 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.752038 2577 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 28 23:02:22.757458 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.752041 2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 28 23:02:22.757458 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.752044 2577 flags.go:64] FLAG: --storage-driver-password="root" May 28 23:02:22.757458 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.752047 2577 flags.go:64] FLAG: --storage-driver-secure="false" May 28 23:02:22.757458 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.752050 2577 flags.go:64] FLAG: --storage-driver-table="stats" May 28 23:02:22.757458 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.752053 2577 flags.go:64] FLAG: --storage-driver-user="root" May 28 23:02:22.757458 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.752056 2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 28 23:02:22.757458 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.752059 2577 flags.go:64] FLAG: --sync-frequency="1m0s" May 28 23:02:22.757458 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.752079 2577 flags.go:64] FLAG: --system-cgroups="" May 28 23:02:22.757458 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.752082 2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 28 23:02:22.757458 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.752087 2577 flags.go:64] FLAG: --system-reserved-cgroup="" May 28 23:02:22.757458 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.752090 2577 flags.go:64] FLAG: --tls-cert-file="" May 28 23:02:22.757458 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.752093 2577 flags.go:64] FLAG: --tls-cipher-suites="[]" May 28 23:02:22.757458 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.752100 2577 flags.go:64] FLAG: --tls-min-version="" May 28 23:02:22.757458 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.752103 2577 flags.go:64] FLAG: --tls-private-key-file="" May 28 23:02:22.757458 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.752106 2577 flags.go:64] FLAG: --topology-manager-policy="none" May 28 23:02:22.757458 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.752108 2577 flags.go:64] FLAG: --topology-manager-policy-options="" May 28 23:02:22.757458 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.752111 2577 flags.go:64] FLAG: --topology-manager-scope="container" May 28 23:02:22.757458 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.752114 2577 flags.go:64] FLAG: --v="2" May 28 23:02:22.757458 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.752128 2577 flags.go:64] FLAG: --version="false" May 28 23:02:22.757458 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.752132 2577 flags.go:64] FLAG: --vmodule="" May 28 23:02:22.757458 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.752136 2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 28 23:02:22.757458 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.752139 2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 28 23:02:22.757458 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752256 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 28 23:02:22.757458 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752260 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 28 23:02:22.758064 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752263 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 28 23:02:22.758064 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752266 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 28 23:02:22.758064 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752269 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 28 23:02:22.758064 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752272 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 28 23:02:22.758064 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752275 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores May 28 23:02:22.758064 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752278 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 28 23:02:22.758064 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752281 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 28 23:02:22.758064 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752284 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 28 23:02:22.758064 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752292 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 28 23:02:22.758064 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752295 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 28 23:02:22.758064 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752297 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 28 23:02:22.758064 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752300 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 28 23:02:22.758064 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752303 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 28 23:02:22.758064 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752306 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 28 23:02:22.758064 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752309 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 28 23:02:22.758064 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752315 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 28 23:02:22.758064 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752318 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 28 23:02:22.758064 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752321 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 28 23:02:22.758064 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752323 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 28 23:02:22.758554 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752326 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 28 23:02:22.758554 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752329 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 28 23:02:22.758554 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752331 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 28 23:02:22.758554 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752335 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 28 23:02:22.758554 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752338 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 28 23:02:22.758554 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752341 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 28 23:02:22.758554 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752344 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 28 23:02:22.758554 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752347 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 28 23:02:22.758554 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752349 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 28 23:02:22.758554 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752352 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 28 23:02:22.758554 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752355 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 28 23:02:22.758554 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752357 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 28 23:02:22.758554 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752360 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 28 23:02:22.758554 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752362 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 28 23:02:22.758554 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752365 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability May 28 23:02:22.758554 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752368 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 28 23:02:22.758554 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752371 2577 feature_gate.go:328] unrecognized feature gate: NewOLM May 28 23:02:22.758554 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752373 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 28 23:02:22.758554 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752376 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 28 23:02:22.758554 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752379 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 28 23:02:22.759110 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752381 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 28 23:02:22.759110 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752384 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 28 23:02:22.759110 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752388 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 28 23:02:22.759110 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752390 2577 feature_gate.go:328] unrecognized feature gate: DualReplica May 28 23:02:22.759110 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752393 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 28 23:02:22.759110 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752395 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 28 23:02:22.759110 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752398 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 28 23:02:22.759110 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752401 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 28 23:02:22.759110 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752405 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 28 23:02:22.759110 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752408 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 28 23:02:22.759110 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752410 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 28 23:02:22.759110 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752413 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 28 23:02:22.759110 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752415 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 28 23:02:22.759110 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752418 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 28 23:02:22.759110 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752420 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 28 23:02:22.759110 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752423 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 28 23:02:22.759110 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752425 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 28 23:02:22.759110 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752427 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 28 23:02:22.759110 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752430 2577 feature_gate.go:328] unrecognized feature gate: Example2 May 28 23:02:22.759110 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752432 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 28 23:02:22.759610 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752435 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 28 23:02:22.759610 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752437 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 28 23:02:22.759610 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752440 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages May 28 23:02:22.759610 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752442 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 28 23:02:22.759610 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752445 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 28 23:02:22.759610 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752447 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 28 23:02:22.759610 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752450 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 28 23:02:22.759610 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752453 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 28 23:02:22.759610 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752455 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 28 23:02:22.759610 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752458 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 28 23:02:22.759610 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752469 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 28 23:02:22.759610 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752472 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 28 23:02:22.759610 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752476 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 28 23:02:22.759610 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752478 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 28 23:02:22.759610 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752481 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 28 23:02:22.759610 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752484 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 28 23:02:22.759610 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752487 2577 feature_gate.go:328] unrecognized feature gate: Example May 28 23:02:22.759610 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752489 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 28 23:02:22.759610 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752492 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 28 23:02:22.759610 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752495 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 28 23:02:22.760114 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752499 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 28 23:02:22.760114 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752501 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 28 23:02:22.760114 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752504 2577 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 28 23:02:22.760114 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752507 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 28 23:02:22.760114 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.752509 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 28 23:02:22.760114 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.753352 2577 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 28 23:02:22.761133 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.761114 2577 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 28 23:02:22.761174 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.761134 2577 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 28 23:02:22.761206 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761185 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 28 23:02:22.761206 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761191 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 28 23:02:22.761206 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761194 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 28 23:02:22.761206 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761197 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 28 23:02:22.761206 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761200 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 28 23:02:22.761206 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761203 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 28 23:02:22.761206 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761206 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 28 23:02:22.761206 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761209 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 28 23:02:22.761407 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761212 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 28 23:02:22.761407 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761214 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 28 23:02:22.761407 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761217 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 28 23:02:22.761407 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761219 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 28 23:02:22.761407 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761222 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 28 23:02:22.761407 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761225 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 28 23:02:22.761407 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761228 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 28 23:02:22.761407 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761231 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 28 23:02:22.761407 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761233 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 28 23:02:22.761407 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761236 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 28 23:02:22.761407 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761238 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 28 23:02:22.761407 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761241 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 28 23:02:22.761407 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761244 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 28 23:02:22.761407 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761247 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 28 23:02:22.761407 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761249 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 28 23:02:22.761407 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761252 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 28 23:02:22.761407 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761254 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 28 23:02:22.761407 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761257 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 28 23:02:22.761407 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761260 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 28 23:02:22.761907 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761262 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 28 23:02:22.761907 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761265 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 28 23:02:22.761907 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761267 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 28 23:02:22.761907 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761270 2577 feature_gate.go:328] unrecognized feature gate: Example May 28 23:02:22.761907 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761273 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 28 23:02:22.761907 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761276 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 28 23:02:22.761907 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761279 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 28 23:02:22.761907 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761282 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 28 23:02:22.761907 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761284 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 28 23:02:22.761907 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761287 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 28 23:02:22.761907 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761290 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 28 23:02:22.761907 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761293 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores May 28 23:02:22.761907 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761295 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 28 23:02:22.761907 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761298 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 28 23:02:22.761907 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761302 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 28 23:02:22.761907 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761306 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 28 23:02:22.761907 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761309 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 28 23:02:22.761907 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761312 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 28 23:02:22.761907 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761314 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 28 23:02:22.762482 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761317 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 28 23:02:22.762482 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761320 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 28 23:02:22.762482 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761323 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 28 23:02:22.762482 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761325 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 28 23:02:22.762482 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761328 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 28 23:02:22.762482 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761331 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 28 23:02:22.762482 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761335 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 28 23:02:22.762482 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761337 2577 feature_gate.go:328] unrecognized feature gate: Example2 May 28 23:02:22.762482 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761340 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 28 23:02:22.762482 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761343 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 28 23:02:22.762482 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761345 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 28 23:02:22.762482 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761348 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 28 23:02:22.762482 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761350 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 28 23:02:22.762482 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761353 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 28 23:02:22.762482 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761356 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 28 23:02:22.762482 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761358 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 28 23:02:22.762482 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761362 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 28 23:02:22.762482 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761367 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 28 23:02:22.762482 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761370 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 28 23:02:22.762947 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761373 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 28 23:02:22.762947 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761376 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 28 23:02:22.762947 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761379 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 28 23:02:22.762947 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761382 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 28 23:02:22.762947 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761385 2577 feature_gate.go:328] unrecognized feature gate: NewOLM May 28 23:02:22.762947 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761388 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 28 23:02:22.762947 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761391 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 28 23:02:22.762947 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761393 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 28 23:02:22.762947 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761396 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 28 23:02:22.762947 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761399 2577 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 28 23:02:22.762947 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761401 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 28 23:02:22.762947 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761404 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 28 23:02:22.762947 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761406 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 28 23:02:22.762947 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761409 2577 feature_gate.go:328] unrecognized feature gate: DualReplica May 28 23:02:22.762947 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761412 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 28 23:02:22.762947 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761414 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 28 23:02:22.762947 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761417 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 28 23:02:22.762947 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761420 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 28 23:02:22.762947 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761423 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability May 28 23:02:22.762947 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761425 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 28 23:02:22.762947 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761433 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages May 28 23:02:22.763489 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.761438 2577 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 28 23:02:22.763489 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761541 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 28 23:02:22.763489 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761546 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 28 23:02:22.763489 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761549 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 28 23:02:22.763489 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761552 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 28 23:02:22.763489 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761555 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 28 23:02:22.763489 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761557 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 28 23:02:22.763489 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761560 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 28 23:02:22.763489 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761562 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages May 28 23:02:22.763489 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761565 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 28 23:02:22.763489 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761569 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 28 23:02:22.763489 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761572 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 28 23:02:22.763489 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761574 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 28 23:02:22.763489 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761577 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 28 23:02:22.763489 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761579 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 28 23:02:22.763874 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761582 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 28 23:02:22.763874 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761585 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 28 23:02:22.763874 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761587 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 28 23:02:22.763874 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761590 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 28 23:02:22.763874 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761592 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 28 23:02:22.763874 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761595 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 28 23:02:22.763874 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761598 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 28 23:02:22.763874 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761601 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 28 23:02:22.763874 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761603 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 28 23:02:22.763874 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761606 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 28 23:02:22.763874 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761608 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 28 23:02:22.763874 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761611 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 28 23:02:22.763874 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761615 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 28 23:02:22.763874 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761618 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 28 23:02:22.763874 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761621 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 28 23:02:22.763874 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761624 2577 feature_gate.go:328] unrecognized feature gate: Example May 28 23:02:22.763874 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761627 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 28 23:02:22.763874 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761637 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 28 23:02:22.763874 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761640 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 28 23:02:22.764354 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761642 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 28 23:02:22.764354 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761645 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 28 23:02:22.764354 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761647 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 28 23:02:22.764354 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761650 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 28 23:02:22.764354 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761652 2577 feature_gate.go:328] unrecognized feature gate: DualReplica May 28 23:02:22.764354 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761655 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 28 23:02:22.764354 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761658 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 28 23:02:22.764354 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761661 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 28 23:02:22.764354 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761665 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 28 23:02:22.764354 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761667 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 28 23:02:22.764354 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761670 2577 feature_gate.go:328] unrecognized feature gate: Example2 May 28 23:02:22.764354 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761672 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 28 23:02:22.764354 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761675 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 28 23:02:22.764354 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761677 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 28 23:02:22.764354 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761680 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 28 23:02:22.764354 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761682 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 28 23:02:22.764354 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761685 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 28 23:02:22.764354 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761687 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 28 23:02:22.764354 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761690 2577 feature_gate.go:328] unrecognized feature gate: NewOLM May 28 23:02:22.764354 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761692 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 28 23:02:22.764851 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761695 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 28 23:02:22.764851 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761697 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability May 28 23:02:22.764851 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761699 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 28 23:02:22.764851 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761702 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 28 23:02:22.764851 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761705 2577 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 28 23:02:22.764851 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761707 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 28 23:02:22.764851 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761710 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 28 23:02:22.764851 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761712 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 28 23:02:22.764851 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761715 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 28 23:02:22.764851 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761717 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 28 23:02:22.764851 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761720 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 28 23:02:22.764851 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761723 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 28 23:02:22.764851 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761726 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 28 23:02:22.764851 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761728 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 28 23:02:22.764851 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761731 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 28 23:02:22.764851 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761733 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 28 23:02:22.764851 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761736 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 28 23:02:22.764851 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761738 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 28 23:02:22.764851 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761740 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 28 23:02:22.764851 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761743 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 28 23:02:22.765415 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761746 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 28 23:02:22.765415 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761749 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 28 23:02:22.765415 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761751 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 28 23:02:22.765415 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761753 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 28 23:02:22.765415 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761756 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 28 23:02:22.765415 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761759 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 28 23:02:22.765415 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761761 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores May 28 23:02:22.765415 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761764 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 28 23:02:22.765415 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761766 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 28 23:02:22.765415 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761769 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 28 23:02:22.765415 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761771 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 28 23:02:22.765415 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761774 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 28 23:02:22.765415 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:22.761776 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 28 23:02:22.765415 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.761781 2577 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 28 23:02:22.765415 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.762682 2577 server.go:962] "Client rotation is on, will bootstrap in background" May 28 23:02:22.765828 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.764961 2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 28 23:02:22.766091 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.766078 2577 server.go:1019] "Starting client certificate rotation" May 28 23:02:22.766217 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.766198 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 28 23:02:22.766271 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.766247 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 28 23:02:22.794924 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.794902 2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 28 23:02:22.796944 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.796923 2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 28 23:02:22.811987 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.811968 2577 log.go:25] "Validated CRI v1 runtime API" May 28 23:02:22.817804 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.817788 2577 log.go:25] "Validated CRI v1 image API" May 28 23:02:22.820210 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.820196 2577 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 28 23:02:22.822807 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.822788 2577 fs.go:135] Filesystem UUIDs: map[41ccc70e-46cd-4244-854e-44f935da0016:/dev/nvme0n1p3 61caa830-f910-4a0a-b23e-ee0ec306c66d:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] May 28 23:02:22.822860 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.822809 2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 28 23:02:22.827519 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.827392 2577 manager.go:217] Machine: {Timestamp:2026-05-28 23:02:22.826847717 +0000 UTC m=+0.434661669 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3093676 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20ef8e3ee8794e6ca7978f4faf641e SystemUUID:ec20ef8e-3ee8-794e-6ca7-978f4faf641e BootID:10b74412-d7ca-4ff0-a2ee-be75e5c637f3 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:a1:4b:5e:5c:7f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:a1:4b:5e:5c:7f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:7e:fc:39:32:04:ac Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 28 23:02:22.828409 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.828398 2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 28 23:02:22.828513 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.828493 2577 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 28 23:02:22.830810 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.830794 2577 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 28 23:02:22.832420 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.832392 2577 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 28 23:02:22.832561 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.832423 2577 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-11.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 28 23:02:22.832615 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.832570 2577 topology_manager.go:138] "Creating topology manager with none policy" May 28 23:02:22.832615 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.832578 2577 container_manager_linux.go:306] "Creating device plugin manager" May 28 23:02:22.832615 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.832586 2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 28 23:02:22.833593 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.833583 2577 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 28 23:02:22.835229 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.835219 2577 state_mem.go:36] "Initialized new in-memory state store" May 28 23:02:22.835341 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.835332 2577 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 28 23:02:22.838062 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.838053 2577 kubelet.go:491] "Attempting to sync node with API server" May 28 23:02:22.838104 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.838083 2577 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 28 23:02:22.838104 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.838094 2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 28 23:02:22.838104 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.838103 2577 kubelet.go:397] "Adding apiserver pod source" May 28 23:02:22.838217 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.838111 2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 28 23:02:22.839362 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.839349 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 28 23:02:22.839404 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.839369 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 28 23:02:22.842766 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.842752 2577 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 28 23:02:22.844864 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.844849 2577 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 28 23:02:22.846374 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.846362 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 28 23:02:22.846432 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.846378 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 28 23:02:22.846432 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.846384 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 28 23:02:22.846432 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.846390 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 28 23:02:22.846432 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.846398 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 28 23:02:22.846432 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.846404 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 28 23:02:22.846432 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.846410 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 28 23:02:22.846432 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.846417 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 28 23:02:22.846432 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.846424 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 28 23:02:22.846432 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.846429 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 28 23:02:22.846663 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.846443 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 28 23:02:22.846663 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.846449 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 28 23:02:22.847301 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.847290 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 28 23:02:22.847335 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.847302 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 28 23:02:22.851726 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.851703 2577 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 28 23:02:22.851811 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.851766 2577 server.go:1295] "Started kubelet" May 28 23:02:22.851890 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.851863 2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 28 23:02:22.851939 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.851878 2577 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 28 23:02:22.851971 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.851942 2577 server_v1.go:47] "podresources" method="list" useActivePods=true May 28 23:02:22.852516 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:22.852486 2577 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 28 23:02:22.852612 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:22.852563 2577 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-11.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 28 23:02:22.852570 ip-10-0-132-11 systemd[1]: Started Kubernetes Kubelet. May 28 23:02:22.853224 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.852980 2577 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-11.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 28 23:02:22.853854 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.853837 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fvgq4" May 28 23:02:22.854287 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.854264 2577 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 28 23:02:22.856402 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.856388 2577 server.go:317] "Adding debug handlers to kubelet server" May 28 23:02:22.861152 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:22.860112 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-11.ec2.internal.18b3dd11018dbcc0 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-11.ec2.internal,UID:ip-10-0-132-11.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-11.ec2.internal,},FirstTimestamp:2026-05-28 23:02:22.851726528 +0000 UTC m=+0.459540487,LastTimestamp:2026-05-28 23:02:22.851726528 +0000 UTC m=+0.459540487,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-11.ec2.internal,}" May 28 23:02:22.862301 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.862281 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 28 23:02:22.862741 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.862724 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fvgq4" May 28 23:02:22.862975 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.862963 2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 28 23:02:22.863057 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.863044 2577 volume_manager.go:295] "The desired_state_of_world populator starts" May 28 23:02:22.863057 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.863057 2577 volume_manager.go:297] "Starting Kubelet Volume Manager" May 28 23:02:22.863171 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.863162 2577 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 28 23:02:22.863219 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.863213 2577 reconstruct.go:97] "Volume reconstruction finished" May 28 23:02:22.863219 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.863218 2577 reconciler.go:26] "Reconciler: start to sync state" May 28 23:02:22.863873 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:22.863849 2577 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 28 23:02:22.863964 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:22.863946 2577 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-11.ec2.internal\" not found" May 28 23:02:22.864057 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.864042 2577 factory.go:55] Registering systemd factory May 28 23:02:22.864137 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.864061 2577 factory.go:223] Registration of the systemd container factory successfully May 28 23:02:22.864294 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.864283 2577 factory.go:153] Registering CRI-O factory May 28 23:02:22.864351 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.864297 2577 factory.go:223] Registration of the crio container factory successfully May 28 23:02:22.864351 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.864345 2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 28 23:02:22.864442 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.864363 2577 factory.go:103] Registering Raw factory May 28 23:02:22.864442 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.864378 2577 manager.go:1196] Started watching for new ooms in manager May 28 23:02:22.864943 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.864929 2577 manager.go:319] Starting recovery of all containers May 28 23:02:22.874398 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.874377 2577 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 28 23:02:22.875144 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.874991 2577 manager.go:324] Recovery completed May 28 23:02:22.876469 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:22.876445 2577 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-132-11.ec2.internal\" not found" node="ip-10-0-132-11.ec2.internal" May 28 23:02:22.876655 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:22.876640 2577 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory May 28 23:02:22.879435 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.879423 2577 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 23:02:22.881247 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.881134 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-11.ec2.internal" event="NodeHasSufficientMemory" May 28 23:02:22.881247 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.881162 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-11.ec2.internal" event="NodeHasNoDiskPressure" May 28 23:02:22.881247 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.881175 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-11.ec2.internal" event="NodeHasSufficientPID" May 28 23:02:22.881636 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.881623 2577 cpu_manager.go:222] "Starting CPU manager" policy="none" May 28 23:02:22.881636 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.881634 2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 28 23:02:22.881712 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.881648 2577 state_mem.go:36] "Initialized new in-memory state store" May 28 23:02:22.885256 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.885244 2577 policy_none.go:49] "None policy: Start" May 28 23:02:22.885305 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.885261 2577 memory_manager.go:186] "Starting memorymanager" policy="None" May 28 23:02:22.885305 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.885270 2577 state_mem.go:35] "Initializing new in-memory state store" May 28 23:02:22.942445 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.927577 2577 manager.go:341] "Starting Device Plugin manager" May 28 23:02:22.942445 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:22.927604 2577 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 28 23:02:22.942445 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.927612 2577 server.go:85] "Starting device plugin registration server" May 28 23:02:22.942445 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.927825 2577 eviction_manager.go:189] "Eviction manager: starting control loop" May 28 23:02:22.942445 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.927837 2577 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 28 23:02:22.942445 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.927921 2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 28 23:02:22.942445 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.928022 2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 28 23:02:22.942445 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.928031 2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 28 23:02:22.942445 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:22.928557 2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 28 23:02:22.942445 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:22.928594 2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-11.ec2.internal\" not found" May 28 23:02:22.991005 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.990975 2577 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 28 23:02:22.992143 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.992121 2577 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 28 23:02:22.992143 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.992143 2577 status_manager.go:230] "Starting to sync pod status with apiserver" May 28 23:02:22.992279 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.992159 2577 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 28 23:02:22.992279 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.992167 2577 kubelet.go:2451] "Starting kubelet main sync loop" May 28 23:02:22.992279 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:22.992206 2577 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 28 23:02:22.997781 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:22.997738 2577 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 28 23:02:23.028663 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:23.028641 2577 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 23:02:23.029385 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:23.029360 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-11.ec2.internal" event="NodeHasSufficientMemory" May 28 23:02:23.029489 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:23.029396 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-11.ec2.internal" event="NodeHasNoDiskPressure" May 28 23:02:23.029489 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:23.029411 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-11.ec2.internal" event="NodeHasSufficientPID" May 28 23:02:23.029489 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:23.029438 2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-11.ec2.internal" May 28 23:02:23.038727 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:23.038710 2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-11.ec2.internal" May 28 23:02:23.038788 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:23.038731 2577 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-11.ec2.internal\": node \"ip-10-0-132-11.ec2.internal\" not found" May 28 23:02:23.057182 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:23.057159 2577 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-11.ec2.internal\" not found" May 28 23:02:23.092413 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:23.092382 2577 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-11.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-11.ec2.internal"] May 28 23:02:23.092501 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:23.092469 2577 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 23:02:23.093270 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:23.093256 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-11.ec2.internal" event="NodeHasSufficientMemory" May 28 23:02:23.093337 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:23.093282 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-11.ec2.internal" event="NodeHasNoDiskPressure" May 28 23:02:23.093337 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:23.093292 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-11.ec2.internal" event="NodeHasSufficientPID" May 28 23:02:23.094380 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:23.094368 2577 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 23:02:23.094537 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:23.094524 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-11.ec2.internal" May 28 23:02:23.094576 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:23.094551 2577 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 23:02:23.095047 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:23.095033 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-11.ec2.internal" event="NodeHasSufficientMemory" May 28 23:02:23.095133 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:23.095034 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-11.ec2.internal" event="NodeHasSufficientMemory" May 28 23:02:23.095133 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:23.095096 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-11.ec2.internal" event="NodeHasNoDiskPressure" May 28 23:02:23.095133 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:23.095108 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-11.ec2.internal" event="NodeHasSufficientPID" May 28 23:02:23.095133 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:23.095059 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-11.ec2.internal" event="NodeHasNoDiskPressure" May 28 23:02:23.095306 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:23.095146 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-11.ec2.internal" event="NodeHasSufficientPID" May 28 23:02:23.096028 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:23.096015 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-11.ec2.internal" May 28 23:02:23.096090 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:23.096046 2577 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 23:02:23.096671 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:23.096652 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-11.ec2.internal" event="NodeHasSufficientMemory" May 28 23:02:23.096738 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:23.096674 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-11.ec2.internal" event="NodeHasNoDiskPressure" May 28 23:02:23.096738 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:23.096685 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-11.ec2.internal" event="NodeHasSufficientPID" May 28 23:02:23.126627 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:23.126610 2577 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-11.ec2.internal\" not found" node="ip-10-0-132-11.ec2.internal" May 28 23:02:23.131100 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:23.131085 2577 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-11.ec2.internal\" not found" node="ip-10-0-132-11.ec2.internal" May 28 23:02:23.158119 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:23.158100 2577 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-11.ec2.internal\" not found" May 28 23:02:23.165000 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:23.164983 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/71527fc8142ac3b5ee8b35036b2415d4-config\") pod \"kube-apiserver-proxy-ip-10-0-132-11.ec2.internal\" (UID: \"71527fc8142ac3b5ee8b35036b2415d4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-11.ec2.internal" May 28 23:02:23.165091 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:23.165011 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/222cdd22a86854a0e1ef952ab116e101-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-11.ec2.internal\" (UID: \"222cdd22a86854a0e1ef952ab116e101\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-11.ec2.internal" May 28 23:02:23.165091 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:23.165029 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/222cdd22a86854a0e1ef952ab116e101-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-11.ec2.internal\" (UID: \"222cdd22a86854a0e1ef952ab116e101\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-11.ec2.internal" May 28 23:02:23.259130 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:23.259062 2577 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-11.ec2.internal\" not found" May 28 23:02:23.265329 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:23.265309 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/71527fc8142ac3b5ee8b35036b2415d4-config\") pod \"kube-apiserver-proxy-ip-10-0-132-11.ec2.internal\" (UID: \"71527fc8142ac3b5ee8b35036b2415d4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-11.ec2.internal" May 28 23:02:23.265399 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:23.265374 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/71527fc8142ac3b5ee8b35036b2415d4-config\") pod \"kube-apiserver-proxy-ip-10-0-132-11.ec2.internal\" (UID: \"71527fc8142ac3b5ee8b35036b2415d4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-11.ec2.internal" May 28 23:02:23.265439 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:23.265395 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/222cdd22a86854a0e1ef952ab116e101-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-11.ec2.internal\" (UID: \"222cdd22a86854a0e1ef952ab116e101\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-11.ec2.internal" May 28 23:02:23.265439 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:23.265420 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/222cdd22a86854a0e1ef952ab116e101-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-11.ec2.internal\" (UID: \"222cdd22a86854a0e1ef952ab116e101\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-11.ec2.internal" May 28 23:02:23.265511 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:23.265440 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/222cdd22a86854a0e1ef952ab116e101-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-11.ec2.internal\" (UID: \"222cdd22a86854a0e1ef952ab116e101\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-11.ec2.internal" May 28 23:02:23.265511 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:23.265453 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/222cdd22a86854a0e1ef952ab116e101-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-11.ec2.internal\" (UID: \"222cdd22a86854a0e1ef952ab116e101\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-11.ec2.internal" May 28 23:02:23.359691 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:23.359648 2577 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-11.ec2.internal\" not found" May 28 23:02:23.429151 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:23.429112 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-11.ec2.internal" May 28 23:02:23.432744 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:23.432722 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-11.ec2.internal" May 28 23:02:23.460223 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:23.460194 2577 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-11.ec2.internal\" not found" May 28 23:02:23.560842 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:23.560757 2577 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-11.ec2.internal\" not found" May 28 23:02:23.661253 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:23.661230 2577 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-11.ec2.internal\" not found" May 28 23:02:23.691296 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:23.691268 2577 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 28 23:02:23.761989 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:23.761958 2577 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-11.ec2.internal\" not found" May 28 23:02:23.766261 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:23.766243 2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 28 23:02:23.766386 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:23.766368 2577 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 28 23:02:23.766431 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:23.766406 2577 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 28 23:02:23.766431 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:23.766406 2577 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 28 23:02:23.862246 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:23.862189 2577 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-11.ec2.internal\" not found" May 28 23:02:23.863297 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:23.863281 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 28 23:02:23.864625 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:23.864590 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-27 22:57:22 +0000 UTC" deadline="2028-01-09 06:57:45.641844606 +0000 UTC" May 28 23:02:23.864708 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:23.864624 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14167h55m21.777223162s" May 28 23:02:23.875848 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:23.875827 2577 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 28 23:02:23.896162 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:23.896140 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-qw97w" May 28 23:02:23.904872 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:23.904854 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-qw97w" May 28 23:02:23.963157 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:23.963124 2577 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-11.ec2.internal\" not found" May 28 23:02:24.009997 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:24.009967 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod222cdd22a86854a0e1ef952ab116e101.slice/crio-8ceb722124cf51d9695e92e84e2983cc282a692d1a8e8d97927b4dddf3b733e0 WatchSource:0}: Error finding container 8ceb722124cf51d9695e92e84e2983cc282a692d1a8e8d97927b4dddf3b733e0: Status 404 returned error can't find the container with id 8ceb722124cf51d9695e92e84e2983cc282a692d1a8e8d97927b4dddf3b733e0 May 28 23:02:24.010195 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:24.010175 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71527fc8142ac3b5ee8b35036b2415d4.slice/crio-66034a1969f82177610c877e99750f73b5b4bbc49ee78bc8935ba176e1395c1d WatchSource:0}: Error finding container 66034a1969f82177610c877e99750f73b5b4bbc49ee78bc8935ba176e1395c1d: Status 404 returned error can't find the container with id 66034a1969f82177610c877e99750f73b5b4bbc49ee78bc8935ba176e1395c1d May 28 23:02:24.013216 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.013201 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 28 23:02:24.044658 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.044633 2577 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 28 23:02:24.063575 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.063552 2577 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-11.ec2.internal" May 28 23:02:24.077245 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.077223 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 28 23:02:24.078345 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.078332 2577 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-11.ec2.internal" May 28 23:02:24.089470 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.089453 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 28 23:02:24.620525 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.620433 2577 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 28 23:02:24.838934 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.838889 2577 apiserver.go:52] "Watching apiserver" May 28 23:02:24.845996 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.845971 2577 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 28 23:02:24.846416 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.846388 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-sqr58","kube-system/konnectivity-agent-7kqkf","kube-system/kube-apiserver-proxy-ip-10-0-132-11.ec2.internal","openshift-dns/node-resolver-z4cgj","openshift-image-registry/node-ca-bwx9g","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-11.ec2.internal","openshift-network-operator/iptables-alerter-l6rfz","openshift-ovn-kubernetes/ovnkube-node-qmfbw","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s55jg","openshift-cluster-node-tuning-operator/tuned-sgcw7","openshift-multus/multus-additional-cni-plugins-d7zts","openshift-multus/multus-mrdc2","openshift-multus/network-metrics-daemon-t5bp9"] May 28 23:02:24.849373 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.849354 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-l6rfz" May 28 23:02:24.851689 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.851666 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7kqkf" May 28 23:02:24.851957 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.851938 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 28 23:02:24.852132 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.852112 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 28 23:02:24.852238 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.852176 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 28 23:02:24.852238 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.852216 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-9bhbq\"" May 28 23:02:24.853545 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.853524 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 28 23:02:24.853827 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.853809 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-z4cgj" May 28 23:02:24.853923 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.853872 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 28 23:02:24.854399 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.854382 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6dtnj\"" May 28 23:02:24.855732 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.855714 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 28 23:02:24.855978 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.855961 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bwx9g" May 28 23:02:24.856169 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.855961 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-fj5pj\"" May 28 23:02:24.856236 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.856187 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 28 23:02:24.858443 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.858051 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 28 23:02:24.858443 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.858154 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 28 23:02:24.858443 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.858261 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 28 23:02:24.858610 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.858457 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zmkgv\"" May 28 23:02:24.860350 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.860330 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqr58" May 28 23:02:24.860441 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:24.860401 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqr58" podUID="3022003a-db31-40b3-8099-98f3eadcfa26" May 28 23:02:24.862681 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.862659 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qmfbw" May 28 23:02:24.864953 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.864884 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s55jg" May 28 23:02:24.865456 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.865434 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 28 23:02:24.867012 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.865835 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 28 23:02:24.867012 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.866059 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sgcw7" May 28 23:02:24.867012 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.866128 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 28 23:02:24.867012 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.866790 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 28 23:02:24.867012 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.866797 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 28 23:02:24.867325 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.867221 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 28 23:02:24.867325 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.867222 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-bfthc\"" May 28 23:02:24.869577 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.869188 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-d7zts" May 28 23:02:24.870134 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.869978 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8nq9w\"" May 28 23:02:24.870229 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.870201 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 28 23:02:24.870743 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.870469 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 28 23:02:24.870743 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.870483 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 28 23:02:24.870743 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.870553 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-xtr4d\"" May 28 23:02:24.870743 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.870473 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 28 23:02:24.870957 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.870912 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 28 23:02:24.871647 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.871482 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 28 23:02:24.871990 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.871847 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 28 23:02:24.872240 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.872223 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mrdc2" May 28 23:02:24.872373 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.872353 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 28 23:02:24.872743 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.872724 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 28 23:02:24.872836 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.872787 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 28 23:02:24.872895 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.872861 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-9nr5f\"" May 28 23:02:24.873053 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.873033 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmh8v\" (UniqueName: \"kubernetes.io/projected/f9743c1b-af51-440b-8793-1e65a2d4fd11-kube-api-access-kmh8v\") pod \"node-ca-bwx9g\" (UID: \"f9743c1b-af51-440b-8793-1e65a2d4fd11\") " pod="openshift-image-registry/node-ca-bwx9g" May 28 23:02:24.873143 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.873085 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8a66522a-9cb1-482c-b7b3-30d4d8979674-lib-modules\") pod \"tuned-sgcw7\" (UID: \"8a66522a-9cb1-482c-b7b3-30d4d8979674\") " pod="openshift-cluster-node-tuning-operator/tuned-sgcw7" May 28 23:02:24.873199 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.873146 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a66522a-9cb1-482c-b7b3-30d4d8979674-var-lib-kubelet\") pod \"tuned-sgcw7\" (UID: \"8a66522a-9cb1-482c-b7b3-30d4d8979674\") " pod="openshift-cluster-node-tuning-operator/tuned-sgcw7" May 28 23:02:24.873199 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.873176 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8a66522a-9cb1-482c-b7b3-30d4d8979674-etc-tuned\") pod \"tuned-sgcw7\" (UID: \"8a66522a-9cb1-482c-b7b3-30d4d8979674\") " pod="openshift-cluster-node-tuning-operator/tuned-sgcw7" May 28 23:02:24.873303 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.873201 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/01e7d2d5-dde5-4ff0-8ca5-213e5621be3b-ovnkube-config\") pod \"ovnkube-node-qmfbw\" (UID: \"01e7d2d5-dde5-4ff0-8ca5-213e5621be3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmfbw" May 28 23:02:24.873303 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.873258 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f9743c1b-af51-440b-8793-1e65a2d4fd11-serviceca\") pod \"node-ca-bwx9g\" (UID: \"f9743c1b-af51-440b-8793-1e65a2d4fd11\") " pod="openshift-image-registry/node-ca-bwx9g" May 28 23:02:24.873303 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.873284 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8a66522a-9cb1-482c-b7b3-30d4d8979674-etc-sysctl-d\") pod \"tuned-sgcw7\" (UID: \"8a66522a-9cb1-482c-b7b3-30d4d8979674\") " pod="openshift-cluster-node-tuning-operator/tuned-sgcw7" May 28 23:02:24.873447 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.873307 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8a66522a-9cb1-482c-b7b3-30d4d8979674-tmp\") pod \"tuned-sgcw7\" (UID: \"8a66522a-9cb1-482c-b7b3-30d4d8979674\") " pod="openshift-cluster-node-tuning-operator/tuned-sgcw7" May 28 23:02:24.873447 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.873346 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmgnr\" (UniqueName: \"kubernetes.io/projected/8a66522a-9cb1-482c-b7b3-30d4d8979674-kube-api-access-mmgnr\") pod \"tuned-sgcw7\" (UID: \"8a66522a-9cb1-482c-b7b3-30d4d8979674\") " pod="openshift-cluster-node-tuning-operator/tuned-sgcw7" May 28 23:02:24.873447 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.873403 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xl4xs\" (UniqueName: \"kubernetes.io/projected/3022003a-db31-40b3-8099-98f3eadcfa26-kube-api-access-xl4xs\") pod \"network-check-target-sqr58\" (UID: \"3022003a-db31-40b3-8099-98f3eadcfa26\") " pod="openshift-network-diagnostics/network-check-target-sqr58" May 28 23:02:24.873447 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.873431 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/01e7d2d5-dde5-4ff0-8ca5-213e5621be3b-run-openvswitch\") pod \"ovnkube-node-qmfbw\" (UID: \"01e7d2d5-dde5-4ff0-8ca5-213e5621be3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmfbw" May 28 23:02:24.873631 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.873459 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01e7d2d5-dde5-4ff0-8ca5-213e5621be3b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qmfbw\" (UID: \"01e7d2d5-dde5-4ff0-8ca5-213e5621be3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmfbw" May 28 23:02:24.873631 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.873484 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8a66522a-9cb1-482c-b7b3-30d4d8979674-sys\") pod \"tuned-sgcw7\" (UID: \"8a66522a-9cb1-482c-b7b3-30d4d8979674\") " pod="openshift-cluster-node-tuning-operator/tuned-sgcw7" May 28 23:02:24.873631 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.873507 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/01e7d2d5-dde5-4ff0-8ca5-213e5621be3b-host-kubelet\") pod \"ovnkube-node-qmfbw\" (UID: \"01e7d2d5-dde5-4ff0-8ca5-213e5621be3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmfbw" May 28 23:02:24.873631 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.873528 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01e7d2d5-dde5-4ff0-8ca5-213e5621be3b-host-run-ovn-kubernetes\") pod \"ovnkube-node-qmfbw\" (UID: \"01e7d2d5-dde5-4ff0-8ca5-213e5621be3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmfbw" May 28 23:02:24.873631 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.873560 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/01e7d2d5-dde5-4ff0-8ca5-213e5621be3b-host-cni-netd\") pod \"ovnkube-node-qmfbw\" (UID: \"01e7d2d5-dde5-4ff0-8ca5-213e5621be3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmfbw" May 28 23:02:24.873631 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.873592 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/01e7d2d5-dde5-4ff0-8ca5-213e5621be3b-ovn-node-metrics-cert\") pod \"ovnkube-node-qmfbw\" (UID: \"01e7d2d5-dde5-4ff0-8ca5-213e5621be3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmfbw" May 28 23:02:24.873631 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.873622 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/01e7d2d5-dde5-4ff0-8ca5-213e5621be3b-ovnkube-script-lib\") pod \"ovnkube-node-qmfbw\" (UID: \"01e7d2d5-dde5-4ff0-8ca5-213e5621be3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmfbw" May 28 23:02:24.873966 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.873682 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/027f1b95-7fce-400b-88a6-a6471274a1fa-kubelet-dir\") pod \"aws-ebs-csi-driver-node-s55jg\" (UID: \"027f1b95-7fce-400b-88a6-a6471274a1fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s55jg" May 28 23:02:24.873966 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.873721 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/027f1b95-7fce-400b-88a6-a6471274a1fa-etc-selinux\") pod \"aws-ebs-csi-driver-node-s55jg\" (UID: \"027f1b95-7fce-400b-88a6-a6471274a1fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s55jg" May 28 23:02:24.873966 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.873757 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f9743c1b-af51-440b-8793-1e65a2d4fd11-host\") pod \"node-ca-bwx9g\" (UID: \"f9743c1b-af51-440b-8793-1e65a2d4fd11\") " pod="openshift-image-registry/node-ca-bwx9g" May 28 23:02:24.873966 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.873786 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8a66522a-9cb1-482c-b7b3-30d4d8979674-etc-sysconfig\") pod \"tuned-sgcw7\" (UID: \"8a66522a-9cb1-482c-b7b3-30d4d8979674\") " pod="openshift-cluster-node-tuning-operator/tuned-sgcw7" May 28 23:02:24.873966 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.873830 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zh6nx\" (UniqueName: \"kubernetes.io/projected/592a71ae-ae07-4ca8-971a-b9eb27b1781c-kube-api-access-zh6nx\") pod \"iptables-alerter-l6rfz\" (UID: \"592a71ae-ae07-4ca8-971a-b9eb27b1781c\") " pod="openshift-network-operator/iptables-alerter-l6rfz" May 28 23:02:24.873966 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.873881 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/01e7d2d5-dde5-4ff0-8ca5-213e5621be3b-host-run-netns\") pod \"ovnkube-node-qmfbw\" (UID: \"01e7d2d5-dde5-4ff0-8ca5-213e5621be3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmfbw" May 28 23:02:24.873966 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.873907 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/027f1b95-7fce-400b-88a6-a6471274a1fa-socket-dir\") pod \"aws-ebs-csi-driver-node-s55jg\" (UID: \"027f1b95-7fce-400b-88a6-a6471274a1fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s55jg" May 28 23:02:24.873966 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.873931 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/027f1b95-7fce-400b-88a6-a6471274a1fa-registration-dir\") pod \"aws-ebs-csi-driver-node-s55jg\" (UID: \"027f1b95-7fce-400b-88a6-a6471274a1fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s55jg" May 28 23:02:24.874350 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.873980 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8a66522a-9cb1-482c-b7b3-30d4d8979674-etc-modprobe-d\") pod \"tuned-sgcw7\" (UID: \"8a66522a-9cb1-482c-b7b3-30d4d8979674\") " pod="openshift-cluster-node-tuning-operator/tuned-sgcw7" May 28 23:02:24.874350 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.874003 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8a66522a-9cb1-482c-b7b3-30d4d8979674-etc-kubernetes\") pod \"tuned-sgcw7\" (UID: \"8a66522a-9cb1-482c-b7b3-30d4d8979674\") " pod="openshift-cluster-node-tuning-operator/tuned-sgcw7" May 28 23:02:24.874350 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.874029 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8a66522a-9cb1-482c-b7b3-30d4d8979674-host\") pod \"tuned-sgcw7\" (UID: \"8a66522a-9cb1-482c-b7b3-30d4d8979674\") " pod="openshift-cluster-node-tuning-operator/tuned-sgcw7" May 28 23:02:24.874350 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.874054 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/592a71ae-ae07-4ca8-971a-b9eb27b1781c-iptables-alerter-script\") pod \"iptables-alerter-l6rfz\" (UID: \"592a71ae-ae07-4ca8-971a-b9eb27b1781c\") " pod="openshift-network-operator/iptables-alerter-l6rfz" May 28 23:02:24.874350 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.874165 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/01e7d2d5-dde5-4ff0-8ca5-213e5621be3b-systemd-units\") pod \"ovnkube-node-qmfbw\" (UID: \"01e7d2d5-dde5-4ff0-8ca5-213e5621be3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmfbw" May 28 23:02:24.874350 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.874188 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/01e7d2d5-dde5-4ff0-8ca5-213e5621be3b-host-slash\") pod \"ovnkube-node-qmfbw\" (UID: \"01e7d2d5-dde5-4ff0-8ca5-213e5621be3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmfbw" May 28 23:02:24.874350 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.874275 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/01e7d2d5-dde5-4ff0-8ca5-213e5621be3b-env-overrides\") pod \"ovnkube-node-qmfbw\" (UID: \"01e7d2d5-dde5-4ff0-8ca5-213e5621be3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmfbw" May 28 23:02:24.874350 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.874301 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ad23651-ba0a-4be3-9b1f-7accceb0a40f-tmp-dir\") pod \"node-resolver-z4cgj\" (UID: \"7ad23651-ba0a-4be3-9b1f-7accceb0a40f\") " pod="openshift-dns/node-resolver-z4cgj" May 28 23:02:24.874350 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.874328 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8a66522a-9cb1-482c-b7b3-30d4d8979674-etc-sysctl-conf\") pod \"tuned-sgcw7\" (UID: \"8a66522a-9cb1-482c-b7b3-30d4d8979674\") " pod="openshift-cluster-node-tuning-operator/tuned-sgcw7" May 28 23:02:24.874679 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.874353 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/01e7d2d5-dde5-4ff0-8ca5-213e5621be3b-var-lib-openvswitch\") pod \"ovnkube-node-qmfbw\" (UID: \"01e7d2d5-dde5-4ff0-8ca5-213e5621be3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmfbw" May 28 23:02:24.874679 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.874377 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/01e7d2d5-dde5-4ff0-8ca5-213e5621be3b-run-ovn\") pod \"ovnkube-node-qmfbw\" (UID: \"01e7d2d5-dde5-4ff0-8ca5-213e5621be3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmfbw" May 28 23:02:24.874679 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.874392 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 28 23:02:24.874679 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.874397 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/01e7d2d5-dde5-4ff0-8ca5-213e5621be3b-host-cni-bin\") pod \"ovnkube-node-qmfbw\" (UID: \"01e7d2d5-dde5-4ff0-8ca5-213e5621be3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmfbw" May 28 23:02:24.874679 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.874419 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-wvj2f\"" May 28 23:02:24.874679 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.874423 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tj5xx\" (UniqueName: \"kubernetes.io/projected/01e7d2d5-dde5-4ff0-8ca5-213e5621be3b-kube-api-access-tj5xx\") pod \"ovnkube-node-qmfbw\" (UID: \"01e7d2d5-dde5-4ff0-8ca5-213e5621be3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmfbw" May 28 23:02:24.874679 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.874445 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/027f1b95-7fce-400b-88a6-a6471274a1fa-sys-fs\") pod \"aws-ebs-csi-driver-node-s55jg\" (UID: \"027f1b95-7fce-400b-88a6-a6471274a1fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s55jg" May 28 23:02:24.874679 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.874494 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66p2b\" (UniqueName: \"kubernetes.io/projected/027f1b95-7fce-400b-88a6-a6471274a1fa-kube-api-access-66p2b\") pod \"aws-ebs-csi-driver-node-s55jg\" (UID: \"027f1b95-7fce-400b-88a6-a6471274a1fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s55jg" May 28 23:02:24.874679 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.874519 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8a66522a-9cb1-482c-b7b3-30d4d8979674-etc-systemd\") pod \"tuned-sgcw7\" (UID: \"8a66522a-9cb1-482c-b7b3-30d4d8979674\") " pod="openshift-cluster-node-tuning-operator/tuned-sgcw7" May 28 23:02:24.874679 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.874539 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8a66522a-9cb1-482c-b7b3-30d4d8979674-run\") pod \"tuned-sgcw7\" (UID: \"8a66522a-9cb1-482c-b7b3-30d4d8979674\") " pod="openshift-cluster-node-tuning-operator/tuned-sgcw7" May 28 23:02:24.874679 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.874552 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/592a71ae-ae07-4ca8-971a-b9eb27b1781c-host-slash\") pod \"iptables-alerter-l6rfz\" (UID: \"592a71ae-ae07-4ca8-971a-b9eb27b1781c\") " pod="openshift-network-operator/iptables-alerter-l6rfz" May 28 23:02:24.874679 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.874567 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/01e7d2d5-dde5-4ff0-8ca5-213e5621be3b-run-systemd\") pod \"ovnkube-node-qmfbw\" (UID: \"01e7d2d5-dde5-4ff0-8ca5-213e5621be3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmfbw" May 28 23:02:24.874679 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.874600 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/01e7d2d5-dde5-4ff0-8ca5-213e5621be3b-node-log\") pod \"ovnkube-node-qmfbw\" (UID: \"01e7d2d5-dde5-4ff0-8ca5-213e5621be3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmfbw" May 28 23:02:24.874679 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.874627 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/01e7d2d5-dde5-4ff0-8ca5-213e5621be3b-log-socket\") pod \"ovnkube-node-qmfbw\" (UID: \"01e7d2d5-dde5-4ff0-8ca5-213e5621be3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmfbw" May 28 23:02:24.874679 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.874651 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a7a1f983-74bf-44d3-a389-cf8d534f9102-agent-certs\") pod \"konnectivity-agent-7kqkf\" (UID: \"a7a1f983-74bf-44d3-a389-cf8d534f9102\") " pod="kube-system/konnectivity-agent-7kqkf" May 28 23:02:24.875330 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.874683 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a7a1f983-74bf-44d3-a389-cf8d534f9102-konnectivity-ca\") pod \"konnectivity-agent-7kqkf\" (UID: \"a7a1f983-74bf-44d3-a389-cf8d534f9102\") " pod="kube-system/konnectivity-agent-7kqkf" May 28 23:02:24.875330 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.874708 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/01e7d2d5-dde5-4ff0-8ca5-213e5621be3b-etc-openvswitch\") pod \"ovnkube-node-qmfbw\" (UID: \"01e7d2d5-dde5-4ff0-8ca5-213e5621be3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmfbw" May 28 23:02:24.875330 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.874738 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/027f1b95-7fce-400b-88a6-a6471274a1fa-device-dir\") pod \"aws-ebs-csi-driver-node-s55jg\" (UID: \"027f1b95-7fce-400b-88a6-a6471274a1fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s55jg" May 28 23:02:24.875330 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.874759 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7ad23651-ba0a-4be3-9b1f-7accceb0a40f-hosts-file\") pod \"node-resolver-z4cgj\" (UID: \"7ad23651-ba0a-4be3-9b1f-7accceb0a40f\") " pod="openshift-dns/node-resolver-z4cgj" May 28 23:02:24.875330 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.874781 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7bx7\" (UniqueName: \"kubernetes.io/projected/7ad23651-ba0a-4be3-9b1f-7accceb0a40f-kube-api-access-h7bx7\") pod \"node-resolver-z4cgj\" (UID: \"7ad23651-ba0a-4be3-9b1f-7accceb0a40f\") " pod="openshift-dns/node-resolver-z4cgj" May 28 23:02:24.875760 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.875733 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t5bp9" May 28 23:02:24.876168 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:24.876145 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t5bp9" podUID="d8e6e54a-9204-40ab-8c10-ded8a2cdb95d" May 28 23:02:24.905539 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.905462 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-27 22:57:23 +0000 UTC" deadline="2028-03-15 06:35:34.852522676 +0000 UTC" May 28 23:02:24.905539 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.905487 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15751h33m9.947038108s" May 28 23:02:24.964519 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.964497 2577 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 28 23:02:24.975555 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.975528 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zh6nx\" (UniqueName: \"kubernetes.io/projected/592a71ae-ae07-4ca8-971a-b9eb27b1781c-kube-api-access-zh6nx\") pod \"iptables-alerter-l6rfz\" (UID: \"592a71ae-ae07-4ca8-971a-b9eb27b1781c\") " pod="openshift-network-operator/iptables-alerter-l6rfz" May 28 23:02:24.975675 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.975568 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/027f1b95-7fce-400b-88a6-a6471274a1fa-registration-dir\") pod \"aws-ebs-csi-driver-node-s55jg\" (UID: \"027f1b95-7fce-400b-88a6-a6471274a1fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s55jg" May 28 23:02:24.975675 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.975595 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b8de4c18-8e9c-46a2-9454-9276c4405615-multus-cni-dir\") pod \"multus-mrdc2\" (UID: \"b8de4c18-8e9c-46a2-9454-9276c4405615\") " pod="openshift-multus/multus-mrdc2" May 28 23:02:24.975675 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.975620 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b8de4c18-8e9c-46a2-9454-9276c4405615-host-run-k8s-cni-cncf-io\") pod \"multus-mrdc2\" (UID: \"b8de4c18-8e9c-46a2-9454-9276c4405615\") " pod="openshift-multus/multus-mrdc2" May 28 23:02:24.975675 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.975647 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8a66522a-9cb1-482c-b7b3-30d4d8979674-etc-kubernetes\") pod \"tuned-sgcw7\" (UID: \"8a66522a-9cb1-482c-b7b3-30d4d8979674\") " pod="openshift-cluster-node-tuning-operator/tuned-sgcw7" May 28 23:02:24.975860 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.975670 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/027f1b95-7fce-400b-88a6-a6471274a1fa-registration-dir\") pod \"aws-ebs-csi-driver-node-s55jg\" (UID: \"027f1b95-7fce-400b-88a6-a6471274a1fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s55jg" May 28 23:02:24.975860 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.975694 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ad23651-ba0a-4be3-9b1f-7accceb0a40f-tmp-dir\") pod \"node-resolver-z4cgj\" (UID: \"7ad23651-ba0a-4be3-9b1f-7accceb0a40f\") " pod="openshift-dns/node-resolver-z4cgj" May 28 23:02:24.975860 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.975767 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8a66522a-9cb1-482c-b7b3-30d4d8979674-etc-kubernetes\") pod \"tuned-sgcw7\" (UID: \"8a66522a-9cb1-482c-b7b3-30d4d8979674\") " pod="openshift-cluster-node-tuning-operator/tuned-sgcw7" May 28 23:02:24.975860 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.975770 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b8de4c18-8e9c-46a2-9454-9276c4405615-host-run-netns\") pod \"multus-mrdc2\" (UID: \"b8de4c18-8e9c-46a2-9454-9276c4405615\") " pod="openshift-multus/multus-mrdc2" May 28 23:02:24.975860 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.975802 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b8de4c18-8e9c-46a2-9454-9276c4405615-host-var-lib-kubelet\") pod \"multus-mrdc2\" (UID: \"b8de4c18-8e9c-46a2-9454-9276c4405615\") " pod="openshift-multus/multus-mrdc2" May 28 23:02:24.975860 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.975825 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b8de4c18-8e9c-46a2-9454-9276c4405615-multus-conf-dir\") pod \"multus-mrdc2\" (UID: \"b8de4c18-8e9c-46a2-9454-9276c4405615\") " pod="openshift-multus/multus-mrdc2" May 28 23:02:24.976147 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.975866 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b8de4c18-8e9c-46a2-9454-9276c4405615-etc-kubernetes\") pod \"multus-mrdc2\" (UID: \"b8de4c18-8e9c-46a2-9454-9276c4405615\") " pod="openshift-multus/multus-mrdc2" May 28 23:02:24.976147 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.975892 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8a66522a-9cb1-482c-b7b3-30d4d8979674-etc-sysctl-conf\") pod \"tuned-sgcw7\" (UID: \"8a66522a-9cb1-482c-b7b3-30d4d8979674\") " pod="openshift-cluster-node-tuning-operator/tuned-sgcw7" May 28 23:02:24.976147 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.975910 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/01e7d2d5-dde5-4ff0-8ca5-213e5621be3b-var-lib-openvswitch\") pod \"ovnkube-node-qmfbw\" (UID: \"01e7d2d5-dde5-4ff0-8ca5-213e5621be3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmfbw" May 28 23:02:24.976147 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.975956 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/01e7d2d5-dde5-4ff0-8ca5-213e5621be3b-var-lib-openvswitch\") pod \"ovnkube-node-qmfbw\" (UID: \"01e7d2d5-dde5-4ff0-8ca5-213e5621be3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmfbw" May 28 23:02:24.976147 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.975954 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/01e7d2d5-dde5-4ff0-8ca5-213e5621be3b-run-ovn\") pod \"ovnkube-node-qmfbw\" (UID: \"01e7d2d5-dde5-4ff0-8ca5-213e5621be3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmfbw" May 28 23:02:24.976147 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.975992 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/01e7d2d5-dde5-4ff0-8ca5-213e5621be3b-host-cni-bin\") pod \"ovnkube-node-qmfbw\" (UID: \"01e7d2d5-dde5-4ff0-8ca5-213e5621be3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmfbw" May 28 23:02:24.976147 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.976019 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tj5xx\" (UniqueName: \"kubernetes.io/projected/01e7d2d5-dde5-4ff0-8ca5-213e5621be3b-kube-api-access-tj5xx\") pod \"ovnkube-node-qmfbw\" (UID: \"01e7d2d5-dde5-4ff0-8ca5-213e5621be3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmfbw" May 28 23:02:24.976147 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.976033 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ad23651-ba0a-4be3-9b1f-7accceb0a40f-tmp-dir\") pod \"node-resolver-z4cgj\" (UID: \"7ad23651-ba0a-4be3-9b1f-7accceb0a40f\") " pod="openshift-dns/node-resolver-z4cgj" May 28 23:02:24.976147 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.976043 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/027f1b95-7fce-400b-88a6-a6471274a1fa-sys-fs\") pod \"aws-ebs-csi-driver-node-s55jg\" (UID: \"027f1b95-7fce-400b-88a6-a6471274a1fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s55jg" May 28 23:02:24.976147 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.976052 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8a66522a-9cb1-482c-b7b3-30d4d8979674-etc-sysctl-conf\") pod \"tuned-sgcw7\" (UID: \"8a66522a-9cb1-482c-b7b3-30d4d8979674\") " pod="openshift-cluster-node-tuning-operator/tuned-sgcw7" May 28 23:02:24.976147 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.976092 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-66p2b\" (UniqueName: \"kubernetes.io/projected/027f1b95-7fce-400b-88a6-a6471274a1fa-kube-api-access-66p2b\") pod \"aws-ebs-csi-driver-node-s55jg\" (UID: \"027f1b95-7fce-400b-88a6-a6471274a1fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s55jg" May 28 23:02:24.976147 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.976096 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/01e7d2d5-dde5-4ff0-8ca5-213e5621be3b-host-cni-bin\") pod \"ovnkube-node-qmfbw\" (UID: \"01e7d2d5-dde5-4ff0-8ca5-213e5621be3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmfbw" May 28 23:02:24.976147 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.976107 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/01e7d2d5-dde5-4ff0-8ca5-213e5621be3b-run-ovn\") pod \"ovnkube-node-qmfbw\" (UID: \"01e7d2d5-dde5-4ff0-8ca5-213e5621be3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmfbw" May 28 23:02:24.976147 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.976128 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/027f1b95-7fce-400b-88a6-a6471274a1fa-sys-fs\") pod \"aws-ebs-csi-driver-node-s55jg\" (UID: \"027f1b95-7fce-400b-88a6-a6471274a1fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s55jg" May 28 23:02:24.976743 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.976168 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8a66522a-9cb1-482c-b7b3-30d4d8979674-etc-systemd\") pod \"tuned-sgcw7\" (UID: \"8a66522a-9cb1-482c-b7b3-30d4d8979674\") " pod="openshift-cluster-node-tuning-operator/tuned-sgcw7" May 28 23:02:24.976743 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.976285 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/592a71ae-ae07-4ca8-971a-b9eb27b1781c-host-slash\") pod \"iptables-alerter-l6rfz\" (UID: \"592a71ae-ae07-4ca8-971a-b9eb27b1781c\") " pod="openshift-network-operator/iptables-alerter-l6rfz" May 28 23:02:24.976743 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.976308 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8a66522a-9cb1-482c-b7b3-30d4d8979674-etc-systemd\") pod \"tuned-sgcw7\" (UID: \"8a66522a-9cb1-482c-b7b3-30d4d8979674\") " pod="openshift-cluster-node-tuning-operator/tuned-sgcw7" May 28 23:02:24.976743 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.976373 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/01e7d2d5-dde5-4ff0-8ca5-213e5621be3b-run-systemd\") pod \"ovnkube-node-qmfbw\" (UID: \"01e7d2d5-dde5-4ff0-8ca5-213e5621be3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmfbw" May 28 23:02:24.976743 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.976386 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/592a71ae-ae07-4ca8-971a-b9eb27b1781c-host-slash\") pod \"iptables-alerter-l6rfz\" (UID: \"592a71ae-ae07-4ca8-971a-b9eb27b1781c\") " pod="openshift-network-operator/iptables-alerter-l6rfz" May 28 23:02:24.976743 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.976442 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/01e7d2d5-dde5-4ff0-8ca5-213e5621be3b-run-systemd\") pod \"ovnkube-node-qmfbw\" (UID: \"01e7d2d5-dde5-4ff0-8ca5-213e5621be3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmfbw" May 28 23:02:24.976743 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.976453 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/01e7d2d5-dde5-4ff0-8ca5-213e5621be3b-node-log\") pod \"ovnkube-node-qmfbw\" (UID: \"01e7d2d5-dde5-4ff0-8ca5-213e5621be3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmfbw" May 28 23:02:24.976743 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.976496 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/01e7d2d5-dde5-4ff0-8ca5-213e5621be3b-log-socket\") pod \"ovnkube-node-qmfbw\" (UID: \"01e7d2d5-dde5-4ff0-8ca5-213e5621be3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmfbw" May 28 23:02:24.976743 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.976521 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a7a1f983-74bf-44d3-a389-cf8d534f9102-konnectivity-ca\") pod \"konnectivity-agent-7kqkf\" (UID: \"a7a1f983-74bf-44d3-a389-cf8d534f9102\") " pod="kube-system/konnectivity-agent-7kqkf" May 28 23:02:24.976743 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.976544 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7ad23651-ba0a-4be3-9b1f-7accceb0a40f-hosts-file\") pod \"node-resolver-z4cgj\" (UID: \"7ad23651-ba0a-4be3-9b1f-7accceb0a40f\") " pod="openshift-dns/node-resolver-z4cgj" May 28 23:02:24.976743 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.976565 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/01e7d2d5-dde5-4ff0-8ca5-213e5621be3b-node-log\") pod \"ovnkube-node-qmfbw\" (UID: \"01e7d2d5-dde5-4ff0-8ca5-213e5621be3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmfbw" May 28 23:02:24.976743 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.976566 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/01e7d2d5-dde5-4ff0-8ca5-213e5621be3b-log-socket\") pod \"ovnkube-node-qmfbw\" (UID: \"01e7d2d5-dde5-4ff0-8ca5-213e5621be3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmfbw" May 28 23:02:24.976743 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.976586 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b8de4c18-8e9c-46a2-9454-9276c4405615-system-cni-dir\") pod \"multus-mrdc2\" (UID: \"b8de4c18-8e9c-46a2-9454-9276c4405615\") " pod="openshift-multus/multus-mrdc2" May 28 23:02:24.976743 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.976612 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/01e7d2d5-dde5-4ff0-8ca5-213e5621be3b-etc-openvswitch\") pod \"ovnkube-node-qmfbw\" (UID: \"01e7d2d5-dde5-4ff0-8ca5-213e5621be3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmfbw" May 28 23:02:24.976743 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.976623 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7ad23651-ba0a-4be3-9b1f-7accceb0a40f-hosts-file\") pod \"node-resolver-z4cgj\" (UID: \"7ad23651-ba0a-4be3-9b1f-7accceb0a40f\") " pod="openshift-dns/node-resolver-z4cgj" May 28 23:02:24.976743 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.976628 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/027f1b95-7fce-400b-88a6-a6471274a1fa-device-dir\") pod \"aws-ebs-csi-driver-node-s55jg\" (UID: \"027f1b95-7fce-400b-88a6-a6471274a1fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s55jg" May 28 23:02:24.976743 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.976675 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/027f1b95-7fce-400b-88a6-a6471274a1fa-device-dir\") pod \"aws-ebs-csi-driver-node-s55jg\" (UID: \"027f1b95-7fce-400b-88a6-a6471274a1fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s55jg" May 28 23:02:24.976743 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.976707 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/01e7d2d5-dde5-4ff0-8ca5-213e5621be3b-etc-openvswitch\") pod \"ovnkube-node-qmfbw\" (UID: \"01e7d2d5-dde5-4ff0-8ca5-213e5621be3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmfbw" May 28 23:02:24.977531 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.976743 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h7bx7\" (UniqueName: \"kubernetes.io/projected/7ad23651-ba0a-4be3-9b1f-7accceb0a40f-kube-api-access-h7bx7\") pod \"node-resolver-z4cgj\" (UID: \"7ad23651-ba0a-4be3-9b1f-7accceb0a40f\") " pod="openshift-dns/node-resolver-z4cgj" May 28 23:02:24.977531 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.976778 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8e6e54a-9204-40ab-8c10-ded8a2cdb95d-metrics-certs\") pod \"network-metrics-daemon-t5bp9\" (UID: \"d8e6e54a-9204-40ab-8c10-ded8a2cdb95d\") " pod="openshift-multus/network-metrics-daemon-t5bp9" May 28 23:02:24.977531 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.976808 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mw27f\" (UniqueName: \"kubernetes.io/projected/43a1feb4-04fe-4605-99e9-0be12579d524-kube-api-access-mw27f\") pod \"multus-additional-cni-plugins-d7zts\" (UID: \"43a1feb4-04fe-4605-99e9-0be12579d524\") " pod="openshift-multus/multus-additional-cni-plugins-d7zts" May 28 23:02:24.977531 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.976833 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b8de4c18-8e9c-46a2-9454-9276c4405615-multus-daemon-config\") pod \"multus-mrdc2\" (UID: \"b8de4c18-8e9c-46a2-9454-9276c4405615\") " pod="openshift-multus/multus-mrdc2" May 28 23:02:24.977531 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.976860 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kmh8v\" (UniqueName: \"kubernetes.io/projected/f9743c1b-af51-440b-8793-1e65a2d4fd11-kube-api-access-kmh8v\") pod \"node-ca-bwx9g\" (UID: \"f9743c1b-af51-440b-8793-1e65a2d4fd11\") " pod="openshift-image-registry/node-ca-bwx9g" May 28 23:02:24.977531 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.976886 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jt674\" (UniqueName: \"kubernetes.io/projected/d8e6e54a-9204-40ab-8c10-ded8a2cdb95d-kube-api-access-jt674\") pod \"network-metrics-daemon-t5bp9\" (UID: \"d8e6e54a-9204-40ab-8c10-ded8a2cdb95d\") " pod="openshift-multus/network-metrics-daemon-t5bp9" May 28 23:02:24.977531 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.976911 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/43a1feb4-04fe-4605-99e9-0be12579d524-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-d7zts\" (UID: \"43a1feb4-04fe-4605-99e9-0be12579d524\") " pod="openshift-multus/multus-additional-cni-plugins-d7zts" May 28 23:02:24.977531 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.976942 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xl4xs\" (UniqueName: \"kubernetes.io/projected/3022003a-db31-40b3-8099-98f3eadcfa26-kube-api-access-xl4xs\") pod \"network-check-target-sqr58\" (UID: \"3022003a-db31-40b3-8099-98f3eadcfa26\") " pod="openshift-network-diagnostics/network-check-target-sqr58" May 28 23:02:24.977531 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.976969 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/01e7d2d5-dde5-4ff0-8ca5-213e5621be3b-run-openvswitch\") pod \"ovnkube-node-qmfbw\" (UID: \"01e7d2d5-dde5-4ff0-8ca5-213e5621be3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmfbw" May 28 23:02:24.977531 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.977014 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8a66522a-9cb1-482c-b7b3-30d4d8979674-sys\") pod \"tuned-sgcw7\" (UID: \"8a66522a-9cb1-482c-b7b3-30d4d8979674\") " pod="openshift-cluster-node-tuning-operator/tuned-sgcw7" May 28 23:02:24.977531 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.977019 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/01e7d2d5-dde5-4ff0-8ca5-213e5621be3b-run-openvswitch\") pod \"ovnkube-node-qmfbw\" (UID: \"01e7d2d5-dde5-4ff0-8ca5-213e5621be3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmfbw" May 28 23:02:24.977531 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.977038 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/01e7d2d5-dde5-4ff0-8ca5-213e5621be3b-host-kubelet\") pod \"ovnkube-node-qmfbw\" (UID: \"01e7d2d5-dde5-4ff0-8ca5-213e5621be3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmfbw" May 28 23:02:24.977531 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.977012 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a7a1f983-74bf-44d3-a389-cf8d534f9102-konnectivity-ca\") pod \"konnectivity-agent-7kqkf\" (UID: \"a7a1f983-74bf-44d3-a389-cf8d534f9102\") " pod="kube-system/konnectivity-agent-7kqkf" May 28 23:02:24.977531 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.977082 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8a66522a-9cb1-482c-b7b3-30d4d8979674-sys\") pod \"tuned-sgcw7\" (UID: \"8a66522a-9cb1-482c-b7b3-30d4d8979674\") " pod="openshift-cluster-node-tuning-operator/tuned-sgcw7" May 28 23:02:24.977531 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.977064 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01e7d2d5-dde5-4ff0-8ca5-213e5621be3b-host-run-ovn-kubernetes\") pod \"ovnkube-node-qmfbw\" (UID: \"01e7d2d5-dde5-4ff0-8ca5-213e5621be3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmfbw" May 28 23:02:24.977531 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.977115 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01e7d2d5-dde5-4ff0-8ca5-213e5621be3b-host-run-ovn-kubernetes\") pod \"ovnkube-node-qmfbw\" (UID: \"01e7d2d5-dde5-4ff0-8ca5-213e5621be3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmfbw" May 28 23:02:24.977531 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.977121 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/01e7d2d5-dde5-4ff0-8ca5-213e5621be3b-host-kubelet\") pod \"ovnkube-node-qmfbw\" (UID: \"01e7d2d5-dde5-4ff0-8ca5-213e5621be3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmfbw" May 28 23:02:24.978314 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.977122 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b8de4c18-8e9c-46a2-9454-9276c4405615-os-release\") pod \"multus-mrdc2\" (UID: \"b8de4c18-8e9c-46a2-9454-9276c4405615\") " pod="openshift-multus/multus-mrdc2" May 28 23:02:24.978314 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.977192 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f9743c1b-af51-440b-8793-1e65a2d4fd11-host\") pod \"node-ca-bwx9g\" (UID: \"f9743c1b-af51-440b-8793-1e65a2d4fd11\") " pod="openshift-image-registry/node-ca-bwx9g" May 28 23:02:24.978314 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.977223 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8a66522a-9cb1-482c-b7b3-30d4d8979674-etc-sysconfig\") pod \"tuned-sgcw7\" (UID: \"8a66522a-9cb1-482c-b7b3-30d4d8979674\") " pod="openshift-cluster-node-tuning-operator/tuned-sgcw7" May 28 23:02:24.978314 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.977247 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/01e7d2d5-dde5-4ff0-8ca5-213e5621be3b-host-run-netns\") pod \"ovnkube-node-qmfbw\" (UID: \"01e7d2d5-dde5-4ff0-8ca5-213e5621be3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmfbw" May 28 23:02:24.978314 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.977272 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/027f1b95-7fce-400b-88a6-a6471274a1fa-socket-dir\") pod \"aws-ebs-csi-driver-node-s55jg\" (UID: \"027f1b95-7fce-400b-88a6-a6471274a1fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s55jg" May 28 23:02:24.978314 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.977299 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f9743c1b-af51-440b-8793-1e65a2d4fd11-host\") pod \"node-ca-bwx9g\" (UID: \"f9743c1b-af51-440b-8793-1e65a2d4fd11\") " pod="openshift-image-registry/node-ca-bwx9g" May 28 23:02:24.978314 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.977300 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/43a1feb4-04fe-4605-99e9-0be12579d524-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-d7zts\" (UID: \"43a1feb4-04fe-4605-99e9-0be12579d524\") " pod="openshift-multus/multus-additional-cni-plugins-d7zts" May 28 23:02:24.978314 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.977316 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/01e7d2d5-dde5-4ff0-8ca5-213e5621be3b-host-run-netns\") pod \"ovnkube-node-qmfbw\" (UID: \"01e7d2d5-dde5-4ff0-8ca5-213e5621be3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmfbw" May 28 23:02:24.978314 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.977324 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8a66522a-9cb1-482c-b7b3-30d4d8979674-etc-sysconfig\") pod \"tuned-sgcw7\" (UID: \"8a66522a-9cb1-482c-b7b3-30d4d8979674\") " pod="openshift-cluster-node-tuning-operator/tuned-sgcw7" May 28 23:02:24.978314 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.977354 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b8de4c18-8e9c-46a2-9454-9276c4405615-host-var-lib-cni-multus\") pod \"multus-mrdc2\" (UID: \"b8de4c18-8e9c-46a2-9454-9276c4405615\") " pod="openshift-multus/multus-mrdc2" May 28 23:02:24.978314 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.977374 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b8de4c18-8e9c-46a2-9454-9276c4405615-hostroot\") pod \"multus-mrdc2\" (UID: \"b8de4c18-8e9c-46a2-9454-9276c4405615\") " pod="openshift-multus/multus-mrdc2" May 28 23:02:24.978314 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.977386 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/027f1b95-7fce-400b-88a6-a6471274a1fa-socket-dir\") pod \"aws-ebs-csi-driver-node-s55jg\" (UID: \"027f1b95-7fce-400b-88a6-a6471274a1fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s55jg" May 28 23:02:24.978314 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.977416 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8a66522a-9cb1-482c-b7b3-30d4d8979674-etc-modprobe-d\") pod \"tuned-sgcw7\" (UID: \"8a66522a-9cb1-482c-b7b3-30d4d8979674\") " pod="openshift-cluster-node-tuning-operator/tuned-sgcw7" May 28 23:02:24.978314 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.977436 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8a66522a-9cb1-482c-b7b3-30d4d8979674-host\") pod \"tuned-sgcw7\" (UID: \"8a66522a-9cb1-482c-b7b3-30d4d8979674\") " pod="openshift-cluster-node-tuning-operator/tuned-sgcw7" May 28 23:02:24.978314 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.977462 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/592a71ae-ae07-4ca8-971a-b9eb27b1781c-iptables-alerter-script\") pod \"iptables-alerter-l6rfz\" (UID: \"592a71ae-ae07-4ca8-971a-b9eb27b1781c\") " pod="openshift-network-operator/iptables-alerter-l6rfz" May 28 23:02:24.978314 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.977490 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/01e7d2d5-dde5-4ff0-8ca5-213e5621be3b-systemd-units\") pod \"ovnkube-node-qmfbw\" (UID: \"01e7d2d5-dde5-4ff0-8ca5-213e5621be3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmfbw" May 28 23:02:24.978314 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.977509 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8a66522a-9cb1-482c-b7b3-30d4d8979674-host\") pod \"tuned-sgcw7\" (UID: \"8a66522a-9cb1-482c-b7b3-30d4d8979674\") " pod="openshift-cluster-node-tuning-operator/tuned-sgcw7" May 28 23:02:24.979062 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.977513 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/01e7d2d5-dde5-4ff0-8ca5-213e5621be3b-host-slash\") pod \"ovnkube-node-qmfbw\" (UID: \"01e7d2d5-dde5-4ff0-8ca5-213e5621be3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmfbw" May 28 23:02:24.979062 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.977537 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/01e7d2d5-dde5-4ff0-8ca5-213e5621be3b-env-overrides\") pod \"ovnkube-node-qmfbw\" (UID: \"01e7d2d5-dde5-4ff0-8ca5-213e5621be3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmfbw" May 28 23:02:24.979062 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.977564 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/43a1feb4-04fe-4605-99e9-0be12579d524-tuning-conf-dir\") pod \"multus-additional-cni-plugins-d7zts\" (UID: \"43a1feb4-04fe-4605-99e9-0be12579d524\") " pod="openshift-multus/multus-additional-cni-plugins-d7zts" May 28 23:02:24.979062 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.977566 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8a66522a-9cb1-482c-b7b3-30d4d8979674-etc-modprobe-d\") pod \"tuned-sgcw7\" (UID: \"8a66522a-9cb1-482c-b7b3-30d4d8979674\") " pod="openshift-cluster-node-tuning-operator/tuned-sgcw7" May 28 23:02:24.979062 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.977583 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b8de4c18-8e9c-46a2-9454-9276c4405615-cni-binary-copy\") pod \"multus-mrdc2\" (UID: \"b8de4c18-8e9c-46a2-9454-9276c4405615\") " pod="openshift-multus/multus-mrdc2" May 28 23:02:24.979062 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.977569 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/01e7d2d5-dde5-4ff0-8ca5-213e5621be3b-systemd-units\") pod \"ovnkube-node-qmfbw\" (UID: \"01e7d2d5-dde5-4ff0-8ca5-213e5621be3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmfbw" May 28 23:02:24.979062 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.977592 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/01e7d2d5-dde5-4ff0-8ca5-213e5621be3b-host-slash\") pod \"ovnkube-node-qmfbw\" (UID: \"01e7d2d5-dde5-4ff0-8ca5-213e5621be3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmfbw" May 28 23:02:24.979062 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.977598 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b8de4c18-8e9c-46a2-9454-9276c4405615-host-var-lib-cni-bin\") pod \"multus-mrdc2\" (UID: \"b8de4c18-8e9c-46a2-9454-9276c4405615\") " pod="openshift-multus/multus-mrdc2" May 28 23:02:24.979062 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.977638 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8a66522a-9cb1-482c-b7b3-30d4d8979674-run\") pod \"tuned-sgcw7\" (UID: \"8a66522a-9cb1-482c-b7b3-30d4d8979674\") " pod="openshift-cluster-node-tuning-operator/tuned-sgcw7" May 28 23:02:24.979062 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.977684 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8a66522a-9cb1-482c-b7b3-30d4d8979674-run\") pod \"tuned-sgcw7\" (UID: \"8a66522a-9cb1-482c-b7b3-30d4d8979674\") " pod="openshift-cluster-node-tuning-operator/tuned-sgcw7" May 28 23:02:24.979062 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.977692 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a7a1f983-74bf-44d3-a389-cf8d534f9102-agent-certs\") pod \"konnectivity-agent-7kqkf\" (UID: \"a7a1f983-74bf-44d3-a389-cf8d534f9102\") " pod="kube-system/konnectivity-agent-7kqkf" May 28 23:02:24.979062 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.977711 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b8de4c18-8e9c-46a2-9454-9276c4405615-host-run-multus-certs\") pod \"multus-mrdc2\" (UID: \"b8de4c18-8e9c-46a2-9454-9276c4405615\") " pod="openshift-multus/multus-mrdc2" May 28 23:02:24.979062 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.977741 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/43a1feb4-04fe-4605-99e9-0be12579d524-cnibin\") pod \"multus-additional-cni-plugins-d7zts\" (UID: \"43a1feb4-04fe-4605-99e9-0be12579d524\") " pod="openshift-multus/multus-additional-cni-plugins-d7zts" May 28 23:02:24.979062 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.977763 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/43a1feb4-04fe-4605-99e9-0be12579d524-cni-binary-copy\") pod \"multus-additional-cni-plugins-d7zts\" (UID: \"43a1feb4-04fe-4605-99e9-0be12579d524\") " pod="openshift-multus/multus-additional-cni-plugins-d7zts" May 28 23:02:24.979062 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.977779 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8a66522a-9cb1-482c-b7b3-30d4d8979674-lib-modules\") pod \"tuned-sgcw7\" (UID: \"8a66522a-9cb1-482c-b7b3-30d4d8979674\") " pod="openshift-cluster-node-tuning-operator/tuned-sgcw7" May 28 23:02:24.979062 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.977793 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a66522a-9cb1-482c-b7b3-30d4d8979674-var-lib-kubelet\") pod \"tuned-sgcw7\" (UID: \"8a66522a-9cb1-482c-b7b3-30d4d8979674\") " pod="openshift-cluster-node-tuning-operator/tuned-sgcw7" May 28 23:02:24.979062 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.977809 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8a66522a-9cb1-482c-b7b3-30d4d8979674-etc-tuned\") pod \"tuned-sgcw7\" (UID: \"8a66522a-9cb1-482c-b7b3-30d4d8979674\") " pod="openshift-cluster-node-tuning-operator/tuned-sgcw7" May 28 23:02:24.979877 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.977825 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/01e7d2d5-dde5-4ff0-8ca5-213e5621be3b-ovnkube-config\") pod \"ovnkube-node-qmfbw\" (UID: \"01e7d2d5-dde5-4ff0-8ca5-213e5621be3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmfbw" May 28 23:02:24.979877 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.977842 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/43a1feb4-04fe-4605-99e9-0be12579d524-system-cni-dir\") pod \"multus-additional-cni-plugins-d7zts\" (UID: \"43a1feb4-04fe-4605-99e9-0be12579d524\") " pod="openshift-multus/multus-additional-cni-plugins-d7zts" May 28 23:02:24.979877 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.977857 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b8de4c18-8e9c-46a2-9454-9276c4405615-cnibin\") pod \"multus-mrdc2\" (UID: \"b8de4c18-8e9c-46a2-9454-9276c4405615\") " pod="openshift-multus/multus-mrdc2" May 28 23:02:24.979877 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.977873 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b8de4c18-8e9c-46a2-9454-9276c4405615-multus-socket-dir-parent\") pod \"multus-mrdc2\" (UID: \"b8de4c18-8e9c-46a2-9454-9276c4405615\") " pod="openshift-multus/multus-mrdc2" May 28 23:02:24.979877 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.977891 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f9743c1b-af51-440b-8793-1e65a2d4fd11-serviceca\") pod \"node-ca-bwx9g\" (UID: \"f9743c1b-af51-440b-8793-1e65a2d4fd11\") " pod="openshift-image-registry/node-ca-bwx9g" May 28 23:02:24.979877 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.977905 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8a66522a-9cb1-482c-b7b3-30d4d8979674-etc-sysctl-d\") pod \"tuned-sgcw7\" (UID: \"8a66522a-9cb1-482c-b7b3-30d4d8979674\") " pod="openshift-cluster-node-tuning-operator/tuned-sgcw7" May 28 23:02:24.979877 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.977919 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8a66522a-9cb1-482c-b7b3-30d4d8979674-tmp\") pod \"tuned-sgcw7\" (UID: \"8a66522a-9cb1-482c-b7b3-30d4d8979674\") " pod="openshift-cluster-node-tuning-operator/tuned-sgcw7" May 28 23:02:24.979877 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.977939 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mmgnr\" (UniqueName: \"kubernetes.io/projected/8a66522a-9cb1-482c-b7b3-30d4d8979674-kube-api-access-mmgnr\") pod \"tuned-sgcw7\" (UID: \"8a66522a-9cb1-482c-b7b3-30d4d8979674\") " pod="openshift-cluster-node-tuning-operator/tuned-sgcw7" May 28 23:02:24.979877 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.977957 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01e7d2d5-dde5-4ff0-8ca5-213e5621be3b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qmfbw\" (UID: \"01e7d2d5-dde5-4ff0-8ca5-213e5621be3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmfbw" May 28 23:02:24.979877 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.977974 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/027f1b95-7fce-400b-88a6-a6471274a1fa-kubelet-dir\") pod \"aws-ebs-csi-driver-node-s55jg\" (UID: \"027f1b95-7fce-400b-88a6-a6471274a1fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s55jg" May 28 23:02:24.979877 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.977989 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/027f1b95-7fce-400b-88a6-a6471274a1fa-etc-selinux\") pod \"aws-ebs-csi-driver-node-s55jg\" (UID: \"027f1b95-7fce-400b-88a6-a6471274a1fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s55jg" May 28 23:02:24.979877 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.978005 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/43a1feb4-04fe-4605-99e9-0be12579d524-os-release\") pod \"multus-additional-cni-plugins-d7zts\" (UID: \"43a1feb4-04fe-4605-99e9-0be12579d524\") " pod="openshift-multus/multus-additional-cni-plugins-d7zts" May 28 23:02:24.979877 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.978022 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/01e7d2d5-dde5-4ff0-8ca5-213e5621be3b-host-cni-netd\") pod \"ovnkube-node-qmfbw\" (UID: \"01e7d2d5-dde5-4ff0-8ca5-213e5621be3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmfbw" May 28 23:02:24.979877 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.978038 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/01e7d2d5-dde5-4ff0-8ca5-213e5621be3b-ovn-node-metrics-cert\") pod \"ovnkube-node-qmfbw\" (UID: \"01e7d2d5-dde5-4ff0-8ca5-213e5621be3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmfbw" May 28 23:02:24.979877 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.978053 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/01e7d2d5-dde5-4ff0-8ca5-213e5621be3b-ovnkube-script-lib\") pod \"ovnkube-node-qmfbw\" (UID: \"01e7d2d5-dde5-4ff0-8ca5-213e5621be3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmfbw" May 28 23:02:24.979877 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.978084 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzbdr\" (UniqueName: \"kubernetes.io/projected/b8de4c18-8e9c-46a2-9454-9276c4405615-kube-api-access-rzbdr\") pod \"multus-mrdc2\" (UID: \"b8de4c18-8e9c-46a2-9454-9276c4405615\") " pod="openshift-multus/multus-mrdc2" May 28 23:02:24.979877 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.978111 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/592a71ae-ae07-4ca8-971a-b9eb27b1781c-iptables-alerter-script\") pod \"iptables-alerter-l6rfz\" (UID: \"592a71ae-ae07-4ca8-971a-b9eb27b1781c\") " pod="openshift-network-operator/iptables-alerter-l6rfz" May 28 23:02:24.980636 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.978124 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a66522a-9cb1-482c-b7b3-30d4d8979674-var-lib-kubelet\") pod \"tuned-sgcw7\" (UID: \"8a66522a-9cb1-482c-b7b3-30d4d8979674\") " pod="openshift-cluster-node-tuning-operator/tuned-sgcw7" May 28 23:02:24.980636 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.978080 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8a66522a-9cb1-482c-b7b3-30d4d8979674-lib-modules\") pod \"tuned-sgcw7\" (UID: \"8a66522a-9cb1-482c-b7b3-30d4d8979674\") " pod="openshift-cluster-node-tuning-operator/tuned-sgcw7" May 28 23:02:24.980636 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.978155 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8a66522a-9cb1-482c-b7b3-30d4d8979674-etc-sysctl-d\") pod \"tuned-sgcw7\" (UID: \"8a66522a-9cb1-482c-b7b3-30d4d8979674\") " pod="openshift-cluster-node-tuning-operator/tuned-sgcw7" May 28 23:02:24.980636 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.978205 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/027f1b95-7fce-400b-88a6-a6471274a1fa-kubelet-dir\") pod \"aws-ebs-csi-driver-node-s55jg\" (UID: \"027f1b95-7fce-400b-88a6-a6471274a1fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s55jg" May 28 23:02:24.980636 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.978269 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/027f1b95-7fce-400b-88a6-a6471274a1fa-etc-selinux\") pod \"aws-ebs-csi-driver-node-s55jg\" (UID: \"027f1b95-7fce-400b-88a6-a6471274a1fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s55jg" May 28 23:02:24.980636 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.978016 2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 28 23:02:24.980636 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.978323 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/01e7d2d5-dde5-4ff0-8ca5-213e5621be3b-host-cni-netd\") pod \"ovnkube-node-qmfbw\" (UID: \"01e7d2d5-dde5-4ff0-8ca5-213e5621be3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmfbw" May 28 23:02:24.980636 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.978476 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/01e7d2d5-dde5-4ff0-8ca5-213e5621be3b-env-overrides\") pod \"ovnkube-node-qmfbw\" (UID: \"01e7d2d5-dde5-4ff0-8ca5-213e5621be3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmfbw" May 28 23:02:24.980636 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.978552 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/01e7d2d5-dde5-4ff0-8ca5-213e5621be3b-ovnkube-config\") pod \"ovnkube-node-qmfbw\" (UID: \"01e7d2d5-dde5-4ff0-8ca5-213e5621be3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmfbw" May 28 23:02:24.980636 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.978621 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01e7d2d5-dde5-4ff0-8ca5-213e5621be3b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qmfbw\" (UID: \"01e7d2d5-dde5-4ff0-8ca5-213e5621be3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmfbw" May 28 23:02:24.980636 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.978750 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f9743c1b-af51-440b-8793-1e65a2d4fd11-serviceca\") pod \"node-ca-bwx9g\" (UID: \"f9743c1b-af51-440b-8793-1e65a2d4fd11\") " pod="openshift-image-registry/node-ca-bwx9g" May 28 23:02:24.980636 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.978873 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/01e7d2d5-dde5-4ff0-8ca5-213e5621be3b-ovnkube-script-lib\") pod \"ovnkube-node-qmfbw\" (UID: \"01e7d2d5-dde5-4ff0-8ca5-213e5621be3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmfbw" May 28 23:02:24.981868 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.981830 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8a66522a-9cb1-482c-b7b3-30d4d8979674-tmp\") pod \"tuned-sgcw7\" (UID: \"8a66522a-9cb1-482c-b7b3-30d4d8979674\") " pod="openshift-cluster-node-tuning-operator/tuned-sgcw7" May 28 23:02:24.982199 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.982176 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/01e7d2d5-dde5-4ff0-8ca5-213e5621be3b-ovn-node-metrics-cert\") pod \"ovnkube-node-qmfbw\" (UID: \"01e7d2d5-dde5-4ff0-8ca5-213e5621be3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmfbw" May 28 23:02:24.982389 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.982207 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8a66522a-9cb1-482c-b7b3-30d4d8979674-etc-tuned\") pod \"tuned-sgcw7\" (UID: \"8a66522a-9cb1-482c-b7b3-30d4d8979674\") " pod="openshift-cluster-node-tuning-operator/tuned-sgcw7" May 28 23:02:24.984122 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.982612 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a7a1f983-74bf-44d3-a389-cf8d534f9102-agent-certs\") pod \"konnectivity-agent-7kqkf\" (UID: \"a7a1f983-74bf-44d3-a389-cf8d534f9102\") " pod="kube-system/konnectivity-agent-7kqkf" May 28 23:02:24.985959 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:24.985451 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 23:02:24.985959 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:24.985474 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 23:02:24.985959 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:24.985487 2577 projected.go:194] Error preparing data for projected volume kube-api-access-xl4xs for pod openshift-network-diagnostics/network-check-target-sqr58: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 23:02:24.985959 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:24.985595 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3022003a-db31-40b3-8099-98f3eadcfa26-kube-api-access-xl4xs podName:3022003a-db31-40b3-8099-98f3eadcfa26 nodeName:}" failed. No retries permitted until 2026-05-28 23:02:25.485523821 +0000 UTC m=+3.093337778 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-xl4xs" (UniqueName: "kubernetes.io/projected/3022003a-db31-40b3-8099-98f3eadcfa26-kube-api-access-xl4xs") pod "network-check-target-sqr58" (UID: "3022003a-db31-40b3-8099-98f3eadcfa26") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 23:02:24.986766 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.986715 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmh8v\" (UniqueName: \"kubernetes.io/projected/f9743c1b-af51-440b-8793-1e65a2d4fd11-kube-api-access-kmh8v\") pod \"node-ca-bwx9g\" (UID: \"f9743c1b-af51-440b-8793-1e65a2d4fd11\") " pod="openshift-image-registry/node-ca-bwx9g" May 28 23:02:24.987241 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.987215 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-66p2b\" (UniqueName: \"kubernetes.io/projected/027f1b95-7fce-400b-88a6-a6471274a1fa-kube-api-access-66p2b\") pod \"aws-ebs-csi-driver-node-s55jg\" (UID: \"027f1b95-7fce-400b-88a6-a6471274a1fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s55jg" May 28 23:02:24.988481 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.988423 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmgnr\" (UniqueName: \"kubernetes.io/projected/8a66522a-9cb1-482c-b7b3-30d4d8979674-kube-api-access-mmgnr\") pod \"tuned-sgcw7\" (UID: \"8a66522a-9cb1-482c-b7b3-30d4d8979674\") " pod="openshift-cluster-node-tuning-operator/tuned-sgcw7" May 28 23:02:24.988481 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.988432 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tj5xx\" (UniqueName: \"kubernetes.io/projected/01e7d2d5-dde5-4ff0-8ca5-213e5621be3b-kube-api-access-tj5xx\") pod \"ovnkube-node-qmfbw\" (UID: \"01e7d2d5-dde5-4ff0-8ca5-213e5621be3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmfbw" May 28 23:02:24.988837 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.988793 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zh6nx\" (UniqueName: \"kubernetes.io/projected/592a71ae-ae07-4ca8-971a-b9eb27b1781c-kube-api-access-zh6nx\") pod \"iptables-alerter-l6rfz\" (UID: \"592a71ae-ae07-4ca8-971a-b9eb27b1781c\") " pod="openshift-network-operator/iptables-alerter-l6rfz" May 28 23:02:24.990268 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.990250 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7bx7\" (UniqueName: \"kubernetes.io/projected/7ad23651-ba0a-4be3-9b1f-7accceb0a40f-kube-api-access-h7bx7\") pod \"node-resolver-z4cgj\" (UID: \"7ad23651-ba0a-4be3-9b1f-7accceb0a40f\") " pod="openshift-dns/node-resolver-z4cgj" May 28 23:02:24.996337 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.996296 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-11.ec2.internal" event={"ID":"71527fc8142ac3b5ee8b35036b2415d4","Type":"ContainerStarted","Data":"66034a1969f82177610c877e99750f73b5b4bbc49ee78bc8935ba176e1395c1d"} May 28 23:02:24.997312 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:24.997285 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-11.ec2.internal" event={"ID":"222cdd22a86854a0e1ef952ab116e101","Type":"ContainerStarted","Data":"8ceb722124cf51d9695e92e84e2983cc282a692d1a8e8d97927b4dddf3b733e0"} May 28 23:02:25.078485 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:25.078457 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b8de4c18-8e9c-46a2-9454-9276c4405615-system-cni-dir\") pod \"multus-mrdc2\" (UID: \"b8de4c18-8e9c-46a2-9454-9276c4405615\") " pod="openshift-multus/multus-mrdc2" May 28 23:02:25.078485 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:25.078489 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8e6e54a-9204-40ab-8c10-ded8a2cdb95d-metrics-certs\") pod \"network-metrics-daemon-t5bp9\" (UID: \"d8e6e54a-9204-40ab-8c10-ded8a2cdb95d\") " pod="openshift-multus/network-metrics-daemon-t5bp9" May 28 23:02:25.078695 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:25.078511 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mw27f\" (UniqueName: \"kubernetes.io/projected/43a1feb4-04fe-4605-99e9-0be12579d524-kube-api-access-mw27f\") pod \"multus-additional-cni-plugins-d7zts\" (UID: \"43a1feb4-04fe-4605-99e9-0be12579d524\") " pod="openshift-multus/multus-additional-cni-plugins-d7zts" May 28 23:02:25.078695 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:25.078532 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b8de4c18-8e9c-46a2-9454-9276c4405615-multus-daemon-config\") pod \"multus-mrdc2\" (UID: \"b8de4c18-8e9c-46a2-9454-9276c4405615\") " pod="openshift-multus/multus-mrdc2" May 28 23:02:25.078695 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:25.078547 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jt674\" (UniqueName: \"kubernetes.io/projected/d8e6e54a-9204-40ab-8c10-ded8a2cdb95d-kube-api-access-jt674\") pod \"network-metrics-daemon-t5bp9\" (UID: \"d8e6e54a-9204-40ab-8c10-ded8a2cdb95d\") " pod="openshift-multus/network-metrics-daemon-t5bp9" May 28 23:02:25.078695 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:25.078564 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/43a1feb4-04fe-4605-99e9-0be12579d524-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-d7zts\" (UID: \"43a1feb4-04fe-4605-99e9-0be12579d524\") " pod="openshift-multus/multus-additional-cni-plugins-d7zts" May 28 23:02:25.078695 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:25.078599 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b8de4c18-8e9c-46a2-9454-9276c4405615-system-cni-dir\") pod \"multus-mrdc2\" (UID: \"b8de4c18-8e9c-46a2-9454-9276c4405615\") " pod="openshift-multus/multus-mrdc2" May 28 23:02:25.078695 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:25.078647 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 23:02:25.078983 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:25.078742 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8e6e54a-9204-40ab-8c10-ded8a2cdb95d-metrics-certs podName:d8e6e54a-9204-40ab-8c10-ded8a2cdb95d nodeName:}" failed. No retries permitted until 2026-05-28 23:02:25.578720042 +0000 UTC m=+3.186534006 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d8e6e54a-9204-40ab-8c10-ded8a2cdb95d-metrics-certs") pod "network-metrics-daemon-t5bp9" (UID: "d8e6e54a-9204-40ab-8c10-ded8a2cdb95d") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 23:02:25.078983 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:25.078773 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b8de4c18-8e9c-46a2-9454-9276c4405615-os-release\") pod \"multus-mrdc2\" (UID: \"b8de4c18-8e9c-46a2-9454-9276c4405615\") " pod="openshift-multus/multus-mrdc2" May 28 23:02:25.078983 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:25.078816 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/43a1feb4-04fe-4605-99e9-0be12579d524-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-d7zts\" (UID: \"43a1feb4-04fe-4605-99e9-0be12579d524\") " pod="openshift-multus/multus-additional-cni-plugins-d7zts" May 28 23:02:25.078983 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:25.078846 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b8de4c18-8e9c-46a2-9454-9276c4405615-host-var-lib-cni-multus\") pod \"multus-mrdc2\" (UID: \"b8de4c18-8e9c-46a2-9454-9276c4405615\") " pod="openshift-multus/multus-mrdc2" May 28 23:02:25.078983 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:25.078871 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b8de4c18-8e9c-46a2-9454-9276c4405615-hostroot\") pod \"multus-mrdc2\" (UID: \"b8de4c18-8e9c-46a2-9454-9276c4405615\") " pod="openshift-multus/multus-mrdc2" May 28 23:02:25.078983 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:25.078886 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b8de4c18-8e9c-46a2-9454-9276c4405615-os-release\") pod \"multus-mrdc2\" (UID: \"b8de4c18-8e9c-46a2-9454-9276c4405615\") " pod="openshift-multus/multus-mrdc2" May 28 23:02:25.078983 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:25.078906 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/43a1feb4-04fe-4605-99e9-0be12579d524-tuning-conf-dir\") pod \"multus-additional-cni-plugins-d7zts\" (UID: \"43a1feb4-04fe-4605-99e9-0be12579d524\") " pod="openshift-multus/multus-additional-cni-plugins-d7zts" May 28 23:02:25.078983 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:25.078934 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b8de4c18-8e9c-46a2-9454-9276c4405615-cni-binary-copy\") pod \"multus-mrdc2\" (UID: \"b8de4c18-8e9c-46a2-9454-9276c4405615\") " pod="openshift-multus/multus-mrdc2" May 28 23:02:25.078983 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:25.078939 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b8de4c18-8e9c-46a2-9454-9276c4405615-host-var-lib-cni-multus\") pod \"multus-mrdc2\" (UID: \"b8de4c18-8e9c-46a2-9454-9276c4405615\") " pod="openshift-multus/multus-mrdc2" May 28 23:02:25.079418 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:25.078977 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b8de4c18-8e9c-46a2-9454-9276c4405615-hostroot\") pod \"multus-mrdc2\" (UID: \"b8de4c18-8e9c-46a2-9454-9276c4405615\") " pod="openshift-multus/multus-mrdc2" May 28 23:02:25.079418 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:25.079022 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b8de4c18-8e9c-46a2-9454-9276c4405615-host-var-lib-cni-bin\") pod \"multus-mrdc2\" (UID: \"b8de4c18-8e9c-46a2-9454-9276c4405615\") " pod="openshift-multus/multus-mrdc2" May 28 23:02:25.079418 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:25.079054 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b8de4c18-8e9c-46a2-9454-9276c4405615-host-run-multus-certs\") pod \"multus-mrdc2\" (UID: \"b8de4c18-8e9c-46a2-9454-9276c4405615\") " pod="openshift-multus/multus-mrdc2" May 28 23:02:25.079418 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:25.079060 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/43a1feb4-04fe-4605-99e9-0be12579d524-tuning-conf-dir\") pod \"multus-additional-cni-plugins-d7zts\" (UID: \"43a1feb4-04fe-4605-99e9-0be12579d524\") " pod="openshift-multus/multus-additional-cni-plugins-d7zts" May 28 23:02:25.079418 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:25.079099 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/43a1feb4-04fe-4605-99e9-0be12579d524-cnibin\") pod \"multus-additional-cni-plugins-d7zts\" (UID: \"43a1feb4-04fe-4605-99e9-0be12579d524\") " pod="openshift-multus/multus-additional-cni-plugins-d7zts" May 28 23:02:25.079418 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:25.079115 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b8de4c18-8e9c-46a2-9454-9276c4405615-multus-daemon-config\") pod \"multus-mrdc2\" (UID: \"b8de4c18-8e9c-46a2-9454-9276c4405615\") " pod="openshift-multus/multus-mrdc2" May 28 23:02:25.079418 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:25.079126 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/43a1feb4-04fe-4605-99e9-0be12579d524-cni-binary-copy\") pod \"multus-additional-cni-plugins-d7zts\" (UID: \"43a1feb4-04fe-4605-99e9-0be12579d524\") " pod="openshift-multus/multus-additional-cni-plugins-d7zts" May 28 23:02:25.079418 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:25.079132 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b8de4c18-8e9c-46a2-9454-9276c4405615-host-var-lib-cni-bin\") pod \"multus-mrdc2\" (UID: \"b8de4c18-8e9c-46a2-9454-9276c4405615\") " pod="openshift-multus/multus-mrdc2" May 28 23:02:25.079418 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:25.079155 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/43a1feb4-04fe-4605-99e9-0be12579d524-system-cni-dir\") pod \"multus-additional-cni-plugins-d7zts\" (UID: \"43a1feb4-04fe-4605-99e9-0be12579d524\") " pod="openshift-multus/multus-additional-cni-plugins-d7zts" May 28 23:02:25.079418 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:25.079168 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b8de4c18-8e9c-46a2-9454-9276c4405615-host-run-multus-certs\") pod \"multus-mrdc2\" (UID: \"b8de4c18-8e9c-46a2-9454-9276c4405615\") " pod="openshift-multus/multus-mrdc2" May 28 23:02:25.079418 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:25.079174 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/43a1feb4-04fe-4605-99e9-0be12579d524-cnibin\") pod \"multus-additional-cni-plugins-d7zts\" (UID: \"43a1feb4-04fe-4605-99e9-0be12579d524\") " pod="openshift-multus/multus-additional-cni-plugins-d7zts" May 28 23:02:25.079418 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:25.079179 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b8de4c18-8e9c-46a2-9454-9276c4405615-cnibin\") pod \"multus-mrdc2\" (UID: \"b8de4c18-8e9c-46a2-9454-9276c4405615\") " pod="openshift-multus/multus-mrdc2" May 28 23:02:25.079418 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:25.079211 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b8de4c18-8e9c-46a2-9454-9276c4405615-multus-socket-dir-parent\") pod \"multus-mrdc2\" (UID: \"b8de4c18-8e9c-46a2-9454-9276c4405615\") " pod="openshift-multus/multus-mrdc2" May 28 23:02:25.079418 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:25.079224 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b8de4c18-8e9c-46a2-9454-9276c4405615-cnibin\") pod \"multus-mrdc2\" (UID: \"b8de4c18-8e9c-46a2-9454-9276c4405615\") " pod="openshift-multus/multus-mrdc2" May 28 23:02:25.079418 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:25.079214 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/43a1feb4-04fe-4605-99e9-0be12579d524-system-cni-dir\") pod \"multus-additional-cni-plugins-d7zts\" (UID: \"43a1feb4-04fe-4605-99e9-0be12579d524\") " pod="openshift-multus/multus-additional-cni-plugins-d7zts" May 28 23:02:25.079418 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:25.079253 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/43a1feb4-04fe-4605-99e9-0be12579d524-os-release\") pod \"multus-additional-cni-plugins-d7zts\" (UID: \"43a1feb4-04fe-4605-99e9-0be12579d524\") " pod="openshift-multus/multus-additional-cni-plugins-d7zts" May 28 23:02:25.079418 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:25.079282 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rzbdr\" (UniqueName: \"kubernetes.io/projected/b8de4c18-8e9c-46a2-9454-9276c4405615-kube-api-access-rzbdr\") pod \"multus-mrdc2\" (UID: \"b8de4c18-8e9c-46a2-9454-9276c4405615\") " pod="openshift-multus/multus-mrdc2" May 28 23:02:25.079418 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:25.079301 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b8de4c18-8e9c-46a2-9454-9276c4405615-multus-cni-dir\") pod \"multus-mrdc2\" (UID: \"b8de4c18-8e9c-46a2-9454-9276c4405615\") " pod="openshift-multus/multus-mrdc2" May 28 23:02:25.080142 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:25.079331 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/43a1feb4-04fe-4605-99e9-0be12579d524-os-release\") pod \"multus-additional-cni-plugins-d7zts\" (UID: \"43a1feb4-04fe-4605-99e9-0be12579d524\") " pod="openshift-multus/multus-additional-cni-plugins-d7zts" May 28 23:02:25.080142 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:25.079280 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b8de4c18-8e9c-46a2-9454-9276c4405615-multus-socket-dir-parent\") pod \"multus-mrdc2\" (UID: \"b8de4c18-8e9c-46a2-9454-9276c4405615\") " pod="openshift-multus/multus-mrdc2" May 28 23:02:25.080142 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:25.079342 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b8de4c18-8e9c-46a2-9454-9276c4405615-host-run-k8s-cni-cncf-io\") pod \"multus-mrdc2\" (UID: \"b8de4c18-8e9c-46a2-9454-9276c4405615\") " pod="openshift-multus/multus-mrdc2" May 28 23:02:25.080142 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:25.079371 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b8de4c18-8e9c-46a2-9454-9276c4405615-host-run-k8s-cni-cncf-io\") pod \"multus-mrdc2\" (UID: \"b8de4c18-8e9c-46a2-9454-9276c4405615\") " pod="openshift-multus/multus-mrdc2" May 28 23:02:25.080142 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:25.079406 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b8de4c18-8e9c-46a2-9454-9276c4405615-host-run-netns\") pod \"multus-mrdc2\" (UID: \"b8de4c18-8e9c-46a2-9454-9276c4405615\") " pod="openshift-multus/multus-mrdc2" May 28 23:02:25.080142 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:25.079440 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b8de4c18-8e9c-46a2-9454-9276c4405615-host-var-lib-kubelet\") pod \"multus-mrdc2\" (UID: \"b8de4c18-8e9c-46a2-9454-9276c4405615\") " pod="openshift-multus/multus-mrdc2" May 28 23:02:25.080142 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:25.079466 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b8de4c18-8e9c-46a2-9454-9276c4405615-multus-cni-dir\") pod \"multus-mrdc2\" (UID: \"b8de4c18-8e9c-46a2-9454-9276c4405615\") " pod="openshift-multus/multus-mrdc2" May 28 23:02:25.080142 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:25.079468 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b8de4c18-8e9c-46a2-9454-9276c4405615-multus-conf-dir\") pod \"multus-mrdc2\" (UID: \"b8de4c18-8e9c-46a2-9454-9276c4405615\") " pod="openshift-multus/multus-mrdc2" May 28 23:02:25.080142 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:25.079510 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b8de4c18-8e9c-46a2-9454-9276c4405615-etc-kubernetes\") pod \"multus-mrdc2\" (UID: \"b8de4c18-8e9c-46a2-9454-9276c4405615\") " pod="openshift-multus/multus-mrdc2" May 28 23:02:25.080142 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:25.079512 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b8de4c18-8e9c-46a2-9454-9276c4405615-multus-conf-dir\") pod \"multus-mrdc2\" (UID: \"b8de4c18-8e9c-46a2-9454-9276c4405615\") " pod="openshift-multus/multus-mrdc2" May 28 23:02:25.080142 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:25.079547 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b8de4c18-8e9c-46a2-9454-9276c4405615-etc-kubernetes\") pod \"multus-mrdc2\" (UID: \"b8de4c18-8e9c-46a2-9454-9276c4405615\") " pod="openshift-multus/multus-mrdc2" May 28 23:02:25.080142 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:25.079583 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b8de4c18-8e9c-46a2-9454-9276c4405615-host-run-netns\") pod \"multus-mrdc2\" (UID: \"b8de4c18-8e9c-46a2-9454-9276c4405615\") " pod="openshift-multus/multus-mrdc2" May 28 23:02:25.080142 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:25.079617 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b8de4c18-8e9c-46a2-9454-9276c4405615-host-var-lib-kubelet\") pod \"multus-mrdc2\" (UID: \"b8de4c18-8e9c-46a2-9454-9276c4405615\") " pod="openshift-multus/multus-mrdc2" May 28 23:02:25.080142 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:25.079691 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/43a1feb4-04fe-4605-99e9-0be12579d524-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-d7zts\" (UID: \"43a1feb4-04fe-4605-99e9-0be12579d524\") " pod="openshift-multus/multus-additional-cni-plugins-d7zts" May 28 23:02:25.080142 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:25.079860 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/43a1feb4-04fe-4605-99e9-0be12579d524-cni-binary-copy\") pod \"multus-additional-cni-plugins-d7zts\" (UID: \"43a1feb4-04fe-4605-99e9-0be12579d524\") " pod="openshift-multus/multus-additional-cni-plugins-d7zts" May 28 23:02:25.080142 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:25.079862 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/43a1feb4-04fe-4605-99e9-0be12579d524-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-d7zts\" (UID: \"43a1feb4-04fe-4605-99e9-0be12579d524\") " pod="openshift-multus/multus-additional-cni-plugins-d7zts" May 28 23:02:25.080652 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:25.080190 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b8de4c18-8e9c-46a2-9454-9276c4405615-cni-binary-copy\") pod \"multus-mrdc2\" (UID: \"b8de4c18-8e9c-46a2-9454-9276c4405615\") " pod="openshift-multus/multus-mrdc2" May 28 23:02:25.087120 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:25.087087 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mw27f\" (UniqueName: \"kubernetes.io/projected/43a1feb4-04fe-4605-99e9-0be12579d524-kube-api-access-mw27f\") pod \"multus-additional-cni-plugins-d7zts\" (UID: \"43a1feb4-04fe-4605-99e9-0be12579d524\") " pod="openshift-multus/multus-additional-cni-plugins-d7zts" May 28 23:02:25.087535 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:25.087511 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jt674\" (UniqueName: \"kubernetes.io/projected/d8e6e54a-9204-40ab-8c10-ded8a2cdb95d-kube-api-access-jt674\") pod \"network-metrics-daemon-t5bp9\" (UID: \"d8e6e54a-9204-40ab-8c10-ded8a2cdb95d\") " pod="openshift-multus/network-metrics-daemon-t5bp9" May 28 23:02:25.087663 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:25.087646 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzbdr\" (UniqueName: \"kubernetes.io/projected/b8de4c18-8e9c-46a2-9454-9276c4405615-kube-api-access-rzbdr\") pod \"multus-mrdc2\" (UID: \"b8de4c18-8e9c-46a2-9454-9276c4405615\") " pod="openshift-multus/multus-mrdc2" May 28 23:02:25.163653 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:25.163586 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-l6rfz" May 28 23:02:25.173541 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:25.173516 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7kqkf" May 28 23:02:25.182281 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:25.182259 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-z4cgj" May 28 23:02:25.186693 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:25.186669 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bwx9g" May 28 23:02:25.194294 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:25.194275 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qmfbw" May 28 23:02:25.202916 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:25.202893 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s55jg" May 28 23:02:25.208365 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:25.208344 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sgcw7" May 28 23:02:25.214894 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:25.214875 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-d7zts" May 28 23:02:25.219496 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:25.219480 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mrdc2" May 28 23:02:25.289133 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:25.289110 2577 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 28 23:02:25.582745 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:25.582676 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8e6e54a-9204-40ab-8c10-ded8a2cdb95d-metrics-certs\") pod \"network-metrics-daemon-t5bp9\" (UID: \"d8e6e54a-9204-40ab-8c10-ded8a2cdb95d\") " pod="openshift-multus/network-metrics-daemon-t5bp9" May 28 23:02:25.582745 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:25.582716 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xl4xs\" (UniqueName: \"kubernetes.io/projected/3022003a-db31-40b3-8099-98f3eadcfa26-kube-api-access-xl4xs\") pod \"network-check-target-sqr58\" (UID: \"3022003a-db31-40b3-8099-98f3eadcfa26\") " pod="openshift-network-diagnostics/network-check-target-sqr58" May 28 23:02:25.582900 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:25.582817 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 23:02:25.582900 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:25.582881 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8e6e54a-9204-40ab-8c10-ded8a2cdb95d-metrics-certs podName:d8e6e54a-9204-40ab-8c10-ded8a2cdb95d nodeName:}" failed. No retries permitted until 2026-05-28 23:02:26.582864627 +0000 UTC m=+4.190678566 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d8e6e54a-9204-40ab-8c10-ded8a2cdb95d-metrics-certs") pod "network-metrics-daemon-t5bp9" (UID: "d8e6e54a-9204-40ab-8c10-ded8a2cdb95d") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 23:02:25.582963 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:25.582822 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 23:02:25.582963 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:25.582917 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 23:02:25.582963 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:25.582931 2577 projected.go:194] Error preparing data for projected volume kube-api-access-xl4xs for pod openshift-network-diagnostics/network-check-target-sqr58: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 23:02:25.583055 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:25.582975 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3022003a-db31-40b3-8099-98f3eadcfa26-kube-api-access-xl4xs podName:3022003a-db31-40b3-8099-98f3eadcfa26 nodeName:}" failed. No retries permitted until 2026-05-28 23:02:26.582962938 +0000 UTC m=+4.190776878 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-xl4xs" (UniqueName: "kubernetes.io/projected/3022003a-db31-40b3-8099-98f3eadcfa26-kube-api-access-xl4xs") pod "network-check-target-sqr58" (UID: "3022003a-db31-40b3-8099-98f3eadcfa26") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 23:02:25.610888 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:25.610861 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod027f1b95_7fce_400b_88a6_a6471274a1fa.slice/crio-8b726a598784f7340aac0d2855773c72674a6c8b36384b7ed5edfee80c0c7d60 WatchSource:0}: Error finding container 8b726a598784f7340aac0d2855773c72674a6c8b36384b7ed5edfee80c0c7d60: Status 404 returned error can't find the container with id 8b726a598784f7340aac0d2855773c72674a6c8b36384b7ed5edfee80c0c7d60 May 28 23:02:25.613197 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:25.613164 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ad23651_ba0a_4be3_9b1f_7accceb0a40f.slice/crio-c718ab096b8243c54c1c9f98fae054a4095dc6b9d52aeaa71d37f9372b66db05 WatchSource:0}: Error finding container c718ab096b8243c54c1c9f98fae054a4095dc6b9d52aeaa71d37f9372b66db05: Status 404 returned error can't find the container with id c718ab096b8243c54c1c9f98fae054a4095dc6b9d52aeaa71d37f9372b66db05 May 28 23:02:25.615886 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:25.615868 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod592a71ae_ae07_4ca8_971a_b9eb27b1781c.slice/crio-cebc50f8cddb940c44102361ddc1ba7fe6745dbc0aa4a454ed41edad6b8c1459 WatchSource:0}: Error finding container cebc50f8cddb940c44102361ddc1ba7fe6745dbc0aa4a454ed41edad6b8c1459: Status 404 returned error can't find the container with id cebc50f8cddb940c44102361ddc1ba7fe6745dbc0aa4a454ed41edad6b8c1459 May 28 23:02:25.617692 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:25.617604 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a66522a_9cb1_482c_b7b3_30d4d8979674.slice/crio-1f9f955e7fc89fa3631f0d38393a100bf713e9a53efb87e72d28747e91956ba9 WatchSource:0}: Error finding container 1f9f955e7fc89fa3631f0d38393a100bf713e9a53efb87e72d28747e91956ba9: Status 404 returned error can't find the container with id 1f9f955e7fc89fa3631f0d38393a100bf713e9a53efb87e72d28747e91956ba9 May 28 23:02:25.620109 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:25.619863 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43a1feb4_04fe_4605_99e9_0be12579d524.slice/crio-7336cc1fd06c6b20e1a9c3dd773c5d8422518749c2fd66ebba4dbd677ae0ccc9 WatchSource:0}: Error finding container 7336cc1fd06c6b20e1a9c3dd773c5d8422518749c2fd66ebba4dbd677ae0ccc9: Status 404 returned error can't find the container with id 7336cc1fd06c6b20e1a9c3dd773c5d8422518749c2fd66ebba4dbd677ae0ccc9 May 28 23:02:25.625337 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:02:25.625165 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7a1f983_74bf_44d3_a389_cf8d534f9102.slice/crio-d7939269c9202b7885acaed49c5bea7176e6090d409e31a3e3842b057f6428f4 WatchSource:0}: Error finding container d7939269c9202b7885acaed49c5bea7176e6090d409e31a3e3842b057f6428f4: Status 404 returned error can't find the container with id d7939269c9202b7885acaed49c5bea7176e6090d409e31a3e3842b057f6428f4 May 28 23:02:25.792886 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:25.792711 2577 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 28 23:02:25.906620 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:25.906588 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-27 22:57:23 +0000 UTC" deadline="2027-10-22 23:08:55.974476956 +0000 UTC" May 28 23:02:25.906620 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:25.906613 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12288h6m30.067866494s" May 28 23:02:25.993143 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:25.993118 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t5bp9" May 28 23:02:25.993265 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:25.993231 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t5bp9" podUID="d8e6e54a-9204-40ab-8c10-ded8a2cdb95d" May 28 23:02:25.999577 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:25.999545 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-z4cgj" event={"ID":"7ad23651-ba0a-4be3-9b1f-7accceb0a40f","Type":"ContainerStarted","Data":"c718ab096b8243c54c1c9f98fae054a4095dc6b9d52aeaa71d37f9372b66db05"} May 28 23:02:26.000601 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:26.000567 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7kqkf" event={"ID":"a7a1f983-74bf-44d3-a389-cf8d534f9102","Type":"ContainerStarted","Data":"d7939269c9202b7885acaed49c5bea7176e6090d409e31a3e3842b057f6428f4"} May 28 23:02:26.001716 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:26.001689 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d7zts" event={"ID":"43a1feb4-04fe-4605-99e9-0be12579d524","Type":"ContainerStarted","Data":"7336cc1fd06c6b20e1a9c3dd773c5d8422518749c2fd66ebba4dbd677ae0ccc9"} May 28 23:02:26.002709 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:26.002675 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-l6rfz" event={"ID":"592a71ae-ae07-4ca8-971a-b9eb27b1781c","Type":"ContainerStarted","Data":"cebc50f8cddb940c44102361ddc1ba7fe6745dbc0aa4a454ed41edad6b8c1459"} May 28 23:02:26.003753 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:26.003724 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s55jg" event={"ID":"027f1b95-7fce-400b-88a6-a6471274a1fa","Type":"ContainerStarted","Data":"8b726a598784f7340aac0d2855773c72674a6c8b36384b7ed5edfee80c0c7d60"} May 28 23:02:26.005888 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:26.005845 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-11.ec2.internal" event={"ID":"71527fc8142ac3b5ee8b35036b2415d4","Type":"ContainerStarted","Data":"7bbd7c624f38000896d20e0238d18259d06ff05075db7a93f97b2032313a71d6"} May 28 23:02:26.007807 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:26.007784 2577 generic.go:358] "Generic (PLEG): container finished" podID="222cdd22a86854a0e1ef952ab116e101" containerID="84cd410d20adeb08a19d020639d1c626a5ea50a872c59a1ca84f9a38b0d18390" exitCode=0 May 28 23:02:26.007907 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:26.007857 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-11.ec2.internal" event={"ID":"222cdd22a86854a0e1ef952ab116e101","Type":"ContainerDied","Data":"84cd410d20adeb08a19d020639d1c626a5ea50a872c59a1ca84f9a38b0d18390"} May 28 23:02:26.009663 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:26.009637 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sgcw7" event={"ID":"8a66522a-9cb1-482c-b7b3-30d4d8979674","Type":"ContainerStarted","Data":"1f9f955e7fc89fa3631f0d38393a100bf713e9a53efb87e72d28747e91956ba9"} May 28 23:02:26.010660 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:26.010639 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bwx9g" event={"ID":"f9743c1b-af51-440b-8793-1e65a2d4fd11","Type":"ContainerStarted","Data":"6914e1aba6c8a94d289c733e33fe78f8cd563f5246ea325de625f569731a3d78"} May 28 23:02:26.012173 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:26.012152 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mrdc2" event={"ID":"b8de4c18-8e9c-46a2-9454-9276c4405615","Type":"ContainerStarted","Data":"737266cf1171f5515254166a61ed31ef2553058f081e03dbf2f72cd2117ba40a"} May 28 23:02:26.013338 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:26.013319 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qmfbw" event={"ID":"01e7d2d5-dde5-4ff0-8ca5-213e5621be3b","Type":"ContainerStarted","Data":"b67fc27b0a4df622b0eb82e1375a736a6508dbbb22b225ab0a918a53c07b256d"} May 28 23:02:26.021418 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:26.021372 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-11.ec2.internal" podStartSLOduration=2.021358861 podStartE2EDuration="2.021358861s" podCreationTimestamp="2026-05-28 23:02:24 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 23:02:26.020958261 +0000 UTC m=+3.628772234" watchObservedRunningTime="2026-05-28 23:02:26.021358861 +0000 UTC m=+3.629172823" May 28 23:02:26.589596 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:26.589512 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xl4xs\" (UniqueName: \"kubernetes.io/projected/3022003a-db31-40b3-8099-98f3eadcfa26-kube-api-access-xl4xs\") pod \"network-check-target-sqr58\" (UID: \"3022003a-db31-40b3-8099-98f3eadcfa26\") " pod="openshift-network-diagnostics/network-check-target-sqr58" May 28 23:02:26.589773 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:26.589602 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8e6e54a-9204-40ab-8c10-ded8a2cdb95d-metrics-certs\") pod \"network-metrics-daemon-t5bp9\" (UID: \"d8e6e54a-9204-40ab-8c10-ded8a2cdb95d\") " pod="openshift-multus/network-metrics-daemon-t5bp9" May 28 23:02:26.589773 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:26.589713 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 23:02:26.589773 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:26.589776 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8e6e54a-9204-40ab-8c10-ded8a2cdb95d-metrics-certs podName:d8e6e54a-9204-40ab-8c10-ded8a2cdb95d nodeName:}" failed. No retries permitted until 2026-05-28 23:02:28.589756259 +0000 UTC m=+6.197570212 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d8e6e54a-9204-40ab-8c10-ded8a2cdb95d-metrics-certs") pod "network-metrics-daemon-t5bp9" (UID: "d8e6e54a-9204-40ab-8c10-ded8a2cdb95d") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 23:02:26.590218 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:26.590198 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 23:02:26.590218 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:26.590221 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 23:02:26.590399 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:26.590235 2577 projected.go:194] Error preparing data for projected volume kube-api-access-xl4xs for pod openshift-network-diagnostics/network-check-target-sqr58: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 23:02:26.590399 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:26.590278 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3022003a-db31-40b3-8099-98f3eadcfa26-kube-api-access-xl4xs podName:3022003a-db31-40b3-8099-98f3eadcfa26 nodeName:}" failed. No retries permitted until 2026-05-28 23:02:28.590263715 +0000 UTC m=+6.198077659 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-xl4xs" (UniqueName: "kubernetes.io/projected/3022003a-db31-40b3-8099-98f3eadcfa26-kube-api-access-xl4xs") pod "network-check-target-sqr58" (UID: "3022003a-db31-40b3-8099-98f3eadcfa26") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 23:02:26.995187 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:26.995113 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqr58" May 28 23:02:26.995616 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:26.995238 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqr58" podUID="3022003a-db31-40b3-8099-98f3eadcfa26" May 28 23:02:27.032166 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:27.032131 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-11.ec2.internal" event={"ID":"222cdd22a86854a0e1ef952ab116e101","Type":"ContainerStarted","Data":"e6a34aea2a19d39ef41044a1376929359520e547bb2a35a81a7450d9f10fc8cd"} May 28 23:02:27.993021 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:27.992983 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t5bp9" May 28 23:02:27.993215 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:27.993137 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t5bp9" podUID="d8e6e54a-9204-40ab-8c10-ded8a2cdb95d" May 28 23:02:28.606449 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:28.606413 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8e6e54a-9204-40ab-8c10-ded8a2cdb95d-metrics-certs\") pod \"network-metrics-daemon-t5bp9\" (UID: \"d8e6e54a-9204-40ab-8c10-ded8a2cdb95d\") " pod="openshift-multus/network-metrics-daemon-t5bp9" May 28 23:02:28.606882 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:28.606466 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xl4xs\" (UniqueName: \"kubernetes.io/projected/3022003a-db31-40b3-8099-98f3eadcfa26-kube-api-access-xl4xs\") pod \"network-check-target-sqr58\" (UID: \"3022003a-db31-40b3-8099-98f3eadcfa26\") " pod="openshift-network-diagnostics/network-check-target-sqr58" May 28 23:02:28.606882 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:28.606594 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 23:02:28.606882 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:28.606611 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 23:02:28.606882 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:28.606622 2577 projected.go:194] Error preparing data for projected volume kube-api-access-xl4xs for pod openshift-network-diagnostics/network-check-target-sqr58: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 23:02:28.606882 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:28.606675 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3022003a-db31-40b3-8099-98f3eadcfa26-kube-api-access-xl4xs podName:3022003a-db31-40b3-8099-98f3eadcfa26 nodeName:}" failed. No retries permitted until 2026-05-28 23:02:32.606656942 +0000 UTC m=+10.214470884 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-xl4xs" (UniqueName: "kubernetes.io/projected/3022003a-db31-40b3-8099-98f3eadcfa26-kube-api-access-xl4xs") pod "network-check-target-sqr58" (UID: "3022003a-db31-40b3-8099-98f3eadcfa26") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 23:02:28.607183 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:28.607044 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 23:02:28.607183 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:28.607105 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8e6e54a-9204-40ab-8c10-ded8a2cdb95d-metrics-certs podName:d8e6e54a-9204-40ab-8c10-ded8a2cdb95d nodeName:}" failed. No retries permitted until 2026-05-28 23:02:32.607091804 +0000 UTC m=+10.214905750 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d8e6e54a-9204-40ab-8c10-ded8a2cdb95d-metrics-certs") pod "network-metrics-daemon-t5bp9" (UID: "d8e6e54a-9204-40ab-8c10-ded8a2cdb95d") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 23:02:28.993642 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:28.993610 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqr58" May 28 23:02:28.993788 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:28.993745 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqr58" podUID="3022003a-db31-40b3-8099-98f3eadcfa26" May 28 23:02:29.992663 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:29.992616 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t5bp9" May 28 23:02:29.993120 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:29.992792 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t5bp9" podUID="d8e6e54a-9204-40ab-8c10-ded8a2cdb95d" May 28 23:02:30.993117 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:30.993088 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqr58" May 28 23:02:30.993562 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:30.993194 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqr58" podUID="3022003a-db31-40b3-8099-98f3eadcfa26" May 28 23:02:31.992956 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:31.992904 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t5bp9" May 28 23:02:31.993148 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:31.993061 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t5bp9" podUID="d8e6e54a-9204-40ab-8c10-ded8a2cdb95d" May 28 23:02:32.640977 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:32.640939 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8e6e54a-9204-40ab-8c10-ded8a2cdb95d-metrics-certs\") pod \"network-metrics-daemon-t5bp9\" (UID: \"d8e6e54a-9204-40ab-8c10-ded8a2cdb95d\") " pod="openshift-multus/network-metrics-daemon-t5bp9" May 28 23:02:32.641197 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:32.640991 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xl4xs\" (UniqueName: \"kubernetes.io/projected/3022003a-db31-40b3-8099-98f3eadcfa26-kube-api-access-xl4xs\") pod \"network-check-target-sqr58\" (UID: \"3022003a-db31-40b3-8099-98f3eadcfa26\") " pod="openshift-network-diagnostics/network-check-target-sqr58" May 28 23:02:32.641197 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:32.641115 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 23:02:32.641197 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:32.641134 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 23:02:32.641197 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:32.641151 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 23:02:32.641197 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:32.641163 2577 projected.go:194] Error preparing data for projected volume kube-api-access-xl4xs for pod openshift-network-diagnostics/network-check-target-sqr58: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 23:02:32.641197 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:32.641197 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8e6e54a-9204-40ab-8c10-ded8a2cdb95d-metrics-certs podName:d8e6e54a-9204-40ab-8c10-ded8a2cdb95d nodeName:}" failed. No retries permitted until 2026-05-28 23:02:40.641175414 +0000 UTC m=+18.248989360 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d8e6e54a-9204-40ab-8c10-ded8a2cdb95d-metrics-certs") pod "network-metrics-daemon-t5bp9" (UID: "d8e6e54a-9204-40ab-8c10-ded8a2cdb95d") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 23:02:32.641501 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:32.641219 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3022003a-db31-40b3-8099-98f3eadcfa26-kube-api-access-xl4xs podName:3022003a-db31-40b3-8099-98f3eadcfa26 nodeName:}" failed. No retries permitted until 2026-05-28 23:02:40.641208497 +0000 UTC m=+18.249022442 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-xl4xs" (UniqueName: "kubernetes.io/projected/3022003a-db31-40b3-8099-98f3eadcfa26-kube-api-access-xl4xs") pod "network-check-target-sqr58" (UID: "3022003a-db31-40b3-8099-98f3eadcfa26") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 23:02:32.993762 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:32.993244 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqr58" May 28 23:02:32.993762 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:32.993350 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqr58" podUID="3022003a-db31-40b3-8099-98f3eadcfa26" May 28 23:02:33.992616 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:33.992581 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t5bp9" May 28 23:02:33.992797 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:33.992722 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t5bp9" podUID="d8e6e54a-9204-40ab-8c10-ded8a2cdb95d" May 28 23:02:34.993334 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:34.993169 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqr58" May 28 23:02:34.993334 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:34.993295 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqr58" podUID="3022003a-db31-40b3-8099-98f3eadcfa26" May 28 23:02:35.993204 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:35.993122 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t5bp9" May 28 23:02:35.993361 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:35.993240 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t5bp9" podUID="d8e6e54a-9204-40ab-8c10-ded8a2cdb95d" May 28 23:02:36.992825 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:36.992791 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqr58" May 28 23:02:36.993011 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:36.992918 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqr58" podUID="3022003a-db31-40b3-8099-98f3eadcfa26" May 28 23:02:37.992309 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:37.992281 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t5bp9" May 28 23:02:37.992706 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:37.992393 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t5bp9" podUID="d8e6e54a-9204-40ab-8c10-ded8a2cdb95d" May 28 23:02:38.992990 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:38.992957 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqr58" May 28 23:02:38.993437 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:38.993099 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqr58" podUID="3022003a-db31-40b3-8099-98f3eadcfa26" May 28 23:02:39.993186 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:39.993153 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t5bp9" May 28 23:02:39.993609 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:39.993269 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t5bp9" podUID="d8e6e54a-9204-40ab-8c10-ded8a2cdb95d" May 28 23:02:40.700875 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:40.700832 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8e6e54a-9204-40ab-8c10-ded8a2cdb95d-metrics-certs\") pod \"network-metrics-daemon-t5bp9\" (UID: \"d8e6e54a-9204-40ab-8c10-ded8a2cdb95d\") " pod="openshift-multus/network-metrics-daemon-t5bp9" May 28 23:02:40.701034 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:40.700889 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xl4xs\" (UniqueName: \"kubernetes.io/projected/3022003a-db31-40b3-8099-98f3eadcfa26-kube-api-access-xl4xs\") pod \"network-check-target-sqr58\" (UID: \"3022003a-db31-40b3-8099-98f3eadcfa26\") " pod="openshift-network-diagnostics/network-check-target-sqr58" May 28 23:02:40.701034 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:40.701007 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 23:02:40.701034 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:40.701018 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 23:02:40.701173 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:40.701040 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 23:02:40.701173 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:40.701054 2577 projected.go:194] Error preparing data for projected volume kube-api-access-xl4xs for pod openshift-network-diagnostics/network-check-target-sqr58: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 23:02:40.701173 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:40.701096 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8e6e54a-9204-40ab-8c10-ded8a2cdb95d-metrics-certs podName:d8e6e54a-9204-40ab-8c10-ded8a2cdb95d nodeName:}" failed. No retries permitted until 2026-05-28 23:02:56.701061244 +0000 UTC m=+34.308875188 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d8e6e54a-9204-40ab-8c10-ded8a2cdb95d-metrics-certs") pod "network-metrics-daemon-t5bp9" (UID: "d8e6e54a-9204-40ab-8c10-ded8a2cdb95d") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 23:02:40.701173 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:40.701118 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3022003a-db31-40b3-8099-98f3eadcfa26-kube-api-access-xl4xs podName:3022003a-db31-40b3-8099-98f3eadcfa26 nodeName:}" failed. No retries permitted until 2026-05-28 23:02:56.701108027 +0000 UTC m=+34.308921969 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-xl4xs" (UniqueName: "kubernetes.io/projected/3022003a-db31-40b3-8099-98f3eadcfa26-kube-api-access-xl4xs") pod "network-check-target-sqr58" (UID: "3022003a-db31-40b3-8099-98f3eadcfa26") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 23:02:40.992773 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:40.992698 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqr58" May 28 23:02:40.992927 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:40.992833 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqr58" podUID="3022003a-db31-40b3-8099-98f3eadcfa26" May 28 23:02:41.993322 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:41.993288 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t5bp9" May 28 23:02:41.993731 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:41.993426 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t5bp9" podUID="d8e6e54a-9204-40ab-8c10-ded8a2cdb95d" May 28 23:02:42.994311 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:42.994274 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqr58" May 28 23:02:42.994763 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:42.994386 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqr58" podUID="3022003a-db31-40b3-8099-98f3eadcfa26" May 28 23:02:43.992681 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:43.992654 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t5bp9" May 28 23:02:43.993201 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:43.992788 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t5bp9" podUID="d8e6e54a-9204-40ab-8c10-ded8a2cdb95d" May 28 23:02:44.085548 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:44.084907 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sgcw7" event={"ID":"8a66522a-9cb1-482c-b7b3-30d4d8979674","Type":"ContainerStarted","Data":"9e1712c18a1dc7725acd5fe8f6fafc946e038d0f1ae948938baa0457e28a5960"} May 28 23:02:44.103142 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:44.102892 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-11.ec2.internal" podStartSLOduration=20.102875196 podStartE2EDuration="20.102875196s" podCreationTimestamp="2026-05-28 23:02:24 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 23:02:27.063596063 +0000 UTC m=+4.671410025" watchObservedRunningTime="2026-05-28 23:02:44.102875196 +0000 UTC m=+21.710689159" May 28 23:02:44.103659 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:44.103534 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-sgcw7" podStartSLOduration=2.808352291 podStartE2EDuration="21.103524125s" podCreationTimestamp="2026-05-28 23:02:23 +0000 UTC" firstStartedPulling="2026-05-28 23:02:25.621339569 +0000 UTC m=+3.229153509" lastFinishedPulling="2026-05-28 23:02:43.916511388 +0000 UTC m=+21.524325343" observedRunningTime="2026-05-28 23:02:44.103402668 +0000 UTC m=+21.711216624" watchObservedRunningTime="2026-05-28 23:02:44.103524125 +0000 UTC m=+21.711338088" May 28 23:02:44.993161 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:44.992880 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqr58" May 28 23:02:44.993288 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:44.993229 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqr58" podUID="3022003a-db31-40b3-8099-98f3eadcfa26" May 28 23:02:45.088175 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:45.088141 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bwx9g" event={"ID":"f9743c1b-af51-440b-8793-1e65a2d4fd11","Type":"ContainerStarted","Data":"e0dde20fb1ca3a105b46bcefa0c7eafe5a017c88ef9f9bb45686a80d6f936984"} May 28 23:02:45.089630 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:45.089610 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mrdc2" event={"ID":"b8de4c18-8e9c-46a2-9454-9276c4405615","Type":"ContainerStarted","Data":"65f2099254c6f6e27c50d44fc912cb97b7b2370e3a4c0672468eb7525686faeb"} May 28 23:02:45.095435 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:45.095397 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qmfbw" event={"ID":"01e7d2d5-dde5-4ff0-8ca5-213e5621be3b","Type":"ContainerStarted","Data":"5d380b28eca20cd4aae72e03b480c30d115eaf83730c5391bd30a4f83f026a78"} May 28 23:02:45.095435 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:45.095426 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qmfbw" event={"ID":"01e7d2d5-dde5-4ff0-8ca5-213e5621be3b","Type":"ContainerStarted","Data":"a4712d51a9830a49af476cfdd7574fd77f4e97b12c78caab69007a0692add939"} May 28 23:02:45.095606 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:45.095440 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qmfbw" event={"ID":"01e7d2d5-dde5-4ff0-8ca5-213e5621be3b","Type":"ContainerStarted","Data":"4ddf7090d0e4ccbc34ab5c2ffd56e15b2e84c8ac2a09c9977a4c3394835584b1"} May 28 23:02:45.095606 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:45.095451 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qmfbw" event={"ID":"01e7d2d5-dde5-4ff0-8ca5-213e5621be3b","Type":"ContainerStarted","Data":"08003e8e421ab9978e64730ced86187b683c5268d60ce08c123dae7d37cc48e6"} May 28 23:02:45.095606 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:45.095462 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qmfbw" event={"ID":"01e7d2d5-dde5-4ff0-8ca5-213e5621be3b","Type":"ContainerStarted","Data":"884fe07e7f54be29df6db0b7f47a6fedf956340e37348a86be7c4568a4553b88"} May 28 23:02:45.095606 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:45.095475 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qmfbw" event={"ID":"01e7d2d5-dde5-4ff0-8ca5-213e5621be3b","Type":"ContainerStarted","Data":"16fc73d667e5e9ee343e24846c576c5f57742646494c1aa8abbbb60993ace0a9"} May 28 23:02:45.096844 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:45.096821 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-z4cgj" event={"ID":"7ad23651-ba0a-4be3-9b1f-7accceb0a40f","Type":"ContainerStarted","Data":"92aec4ec13a6efabbef663384c93f6faec51a8f87f5b632d27abaebd488bb481"} May 28 23:02:45.098115 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:45.098091 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7kqkf" event={"ID":"a7a1f983-74bf-44d3-a389-cf8d534f9102","Type":"ContainerStarted","Data":"00b1a479f4e08a8781716f3e888803dd8c4d39d908511294020209336cd0b4c9"} May 28 23:02:45.099526 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:45.099503 2577 generic.go:358] "Generic (PLEG): container finished" podID="43a1feb4-04fe-4605-99e9-0be12579d524" containerID="4f5920c2e8dc2724bc4d0a24e0b79abd0f8f1c60a32f31c39d3c5a6956feac52" exitCode=0 May 28 23:02:45.099626 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:45.099570 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d7zts" event={"ID":"43a1feb4-04fe-4605-99e9-0be12579d524","Type":"ContainerDied","Data":"4f5920c2e8dc2724bc4d0a24e0b79abd0f8f1c60a32f31c39d3c5a6956feac52"} May 28 23:02:45.101347 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:45.101316 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s55jg" event={"ID":"027f1b95-7fce-400b-88a6-a6471274a1fa","Type":"ContainerStarted","Data":"543338bb37c954b3a470f2a3b04a4bebfafff207bef3fd00ac834d2ca9144898"} May 28 23:02:45.106568 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:45.106530 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-bwx9g" podStartSLOduration=12.03038672 podStartE2EDuration="22.106519571s" podCreationTimestamp="2026-05-28 23:02:23 +0000 UTC" firstStartedPulling="2026-05-28 23:02:25.626953419 +0000 UTC m=+3.234767373" lastFinishedPulling="2026-05-28 23:02:35.703086273 +0000 UTC m=+13.310900224" observedRunningTime="2026-05-28 23:02:45.106363331 +0000 UTC m=+22.714177293" watchObservedRunningTime="2026-05-28 23:02:45.106519571 +0000 UTC m=+22.714333591" May 28 23:02:45.123308 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:45.123023 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-z4cgj" podStartSLOduration=3.822824143 podStartE2EDuration="22.123009495s" podCreationTimestamp="2026-05-28 23:02:23 +0000 UTC" firstStartedPulling="2026-05-28 23:02:25.615291207 +0000 UTC m=+3.223105146" lastFinishedPulling="2026-05-28 23:02:43.915476552 +0000 UTC m=+21.523290498" observedRunningTime="2026-05-28 23:02:45.122529115 +0000 UTC m=+22.730343076" watchObservedRunningTime="2026-05-28 23:02:45.123009495 +0000 UTC m=+22.730823457" May 28 23:02:45.143854 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:45.143822 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-mrdc2" podStartSLOduration=3.792833173 podStartE2EDuration="22.143811876s" podCreationTimestamp="2026-05-28 23:02:23 +0000 UTC" firstStartedPulling="2026-05-28 23:02:25.627317342 +0000 UTC m=+3.235131282" lastFinishedPulling="2026-05-28 23:02:43.978296045 +0000 UTC m=+21.586109985" observedRunningTime="2026-05-28 23:02:45.143196232 +0000 UTC m=+22.751010184" watchObservedRunningTime="2026-05-28 23:02:45.143811876 +0000 UTC m=+22.751625837" May 28 23:02:45.203548 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:45.203505 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-7kqkf" podStartSLOduration=3.916169836 podStartE2EDuration="22.203493862s" podCreationTimestamp="2026-05-28 23:02:23 +0000 UTC" firstStartedPulling="2026-05-28 23:02:25.627739704 +0000 UTC m=+3.235553648" lastFinishedPulling="2026-05-28 23:02:43.915063722 +0000 UTC m=+21.522877674" observedRunningTime="2026-05-28 23:02:45.170510658 +0000 UTC m=+22.778324619" watchObservedRunningTime="2026-05-28 23:02:45.203493862 +0000 UTC m=+22.811307823" May 28 23:02:45.440298 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:45.440257 2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 28 23:02:45.941700 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:45.941593 2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-28T23:02:45.440275775Z","UUID":"b4458d7b-dc57-416d-9820-acded5e8f029","Handler":null,"Name":"","Endpoint":""} May 28 23:02:45.943616 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:45.943597 2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 28 23:02:45.943737 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:45.943627 2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 28 23:02:45.992632 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:45.992589 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t5bp9" May 28 23:02:45.992795 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:45.992722 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t5bp9" podUID="d8e6e54a-9204-40ab-8c10-ded8a2cdb95d" May 28 23:02:46.104829 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:46.104793 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-l6rfz" event={"ID":"592a71ae-ae07-4ca8-971a-b9eb27b1781c","Type":"ContainerStarted","Data":"b3892e93a1ecae62d19af87f86357947ca183aae927a4c8cc005bbb2a0602df6"} May 28 23:02:46.107498 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:46.106781 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s55jg" event={"ID":"027f1b95-7fce-400b-88a6-a6471274a1fa","Type":"ContainerStarted","Data":"b24ee439f95711946a880a982828543452261c7a68fc2d2e486272d5935f41d9"} May 28 23:02:46.124315 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:46.124244 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-l6rfz" podStartSLOduration=4.828568891 podStartE2EDuration="23.124228s" podCreationTimestamp="2026-05-28 23:02:23 +0000 UTC" firstStartedPulling="2026-05-28 23:02:25.617910827 +0000 UTC m=+3.225724772" lastFinishedPulling="2026-05-28 23:02:43.913569928 +0000 UTC m=+21.521383881" observedRunningTime="2026-05-28 23:02:46.124142349 +0000 UTC m=+23.731956313" watchObservedRunningTime="2026-05-28 23:02:46.124228 +0000 UTC m=+23.732041962" May 28 23:02:46.951019 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:46.950938 2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-7kqkf" May 28 23:02:46.951603 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:46.951583 2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-7kqkf" May 28 23:02:46.992572 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:46.992545 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqr58" May 28 23:02:46.992706 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:46.992655 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqr58" podUID="3022003a-db31-40b3-8099-98f3eadcfa26" May 28 23:02:47.110210 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:47.110175 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s55jg" event={"ID":"027f1b95-7fce-400b-88a6-a6471274a1fa","Type":"ContainerStarted","Data":"2ca5bda1232e4cca217a28660c42a1c97c82d150694900ed03405d6e48fec598"} May 28 23:02:47.113198 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:47.113175 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qmfbw" event={"ID":"01e7d2d5-dde5-4ff0-8ca5-213e5621be3b","Type":"ContainerStarted","Data":"f118b56ed4aacfed770eaa15d3db1d44c72e5e2db5eaf862387611a5faada0d4"} May 28 23:02:47.113446 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:47.113429 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-7kqkf" May 28 23:02:47.113892 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:47.113870 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-7kqkf" May 28 23:02:47.171601 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:47.171554 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s55jg" podStartSLOduration=3.325225417 podStartE2EDuration="24.171538268s" podCreationTimestamp="2026-05-28 23:02:23 +0000 UTC" firstStartedPulling="2026-05-28 23:02:25.61269925 +0000 UTC m=+3.220513190" lastFinishedPulling="2026-05-28 23:02:46.459012101 +0000 UTC m=+24.066826041" observedRunningTime="2026-05-28 23:02:47.166846979 +0000 UTC m=+24.774660944" watchObservedRunningTime="2026-05-28 23:02:47.171538268 +0000 UTC m=+24.779352225" May 28 23:02:47.992994 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:47.992821 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t5bp9" May 28 23:02:47.993192 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:47.993089 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t5bp9" podUID="d8e6e54a-9204-40ab-8c10-ded8a2cdb95d" May 28 23:02:48.993350 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:48.993323 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqr58" May 28 23:02:48.993763 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:48.993444 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqr58" podUID="3022003a-db31-40b3-8099-98f3eadcfa26" May 28 23:02:49.993271 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:49.993018 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t5bp9" May 28 23:02:49.993395 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:49.993299 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t5bp9" podUID="d8e6e54a-9204-40ab-8c10-ded8a2cdb95d" May 28 23:02:50.122417 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:50.122380 2577 generic.go:358] "Generic (PLEG): container finished" podID="43a1feb4-04fe-4605-99e9-0be12579d524" containerID="e0cb7460a7f78347f6d3270a9f6f0f2408ba8b96671ba2efa69c1505b872b3ba" exitCode=0 May 28 23:02:50.122569 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:50.122465 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d7zts" event={"ID":"43a1feb4-04fe-4605-99e9-0be12579d524","Type":"ContainerDied","Data":"e0cb7460a7f78347f6d3270a9f6f0f2408ba8b96671ba2efa69c1505b872b3ba"} May 28 23:02:50.125694 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:50.125674 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qmfbw" event={"ID":"01e7d2d5-dde5-4ff0-8ca5-213e5621be3b","Type":"ContainerStarted","Data":"21d7731c5eb222140b4938ea66481d6a4cdcbc1b71b8dbcf74d8745f3a035f00"} May 28 23:02:50.126001 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:50.125979 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qmfbw" May 28 23:02:50.126129 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:50.126014 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qmfbw" May 28 23:02:50.126129 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:50.126028 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qmfbw" May 28 23:02:50.140884 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:50.140864 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qmfbw" May 28 23:02:50.141010 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:50.140950 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qmfbw" May 28 23:02:50.173363 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:50.173324 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-qmfbw" podStartSLOduration=8.815827467 podStartE2EDuration="27.173313146s" podCreationTimestamp="2026-05-28 23:02:23 +0000 UTC" firstStartedPulling="2026-05-28 23:02:25.626756875 +0000 UTC m=+3.234570828" lastFinishedPulling="2026-05-28 23:02:43.984242555 +0000 UTC m=+21.592056507" observedRunningTime="2026-05-28 23:02:50.173011903 +0000 UTC m=+27.780825864" watchObservedRunningTime="2026-05-28 23:02:50.173313146 +0000 UTC m=+27.781127104" May 28 23:02:50.993226 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:50.993199 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqr58" May 28 23:02:50.993466 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:50.993316 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqr58" podUID="3022003a-db31-40b3-8099-98f3eadcfa26" May 28 23:02:51.217898 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:51.217871 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-t5bp9"] May 28 23:02:51.218011 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:51.217997 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t5bp9" May 28 23:02:51.218123 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:51.218106 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t5bp9" podUID="d8e6e54a-9204-40ab-8c10-ded8a2cdb95d" May 28 23:02:51.220868 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:51.220846 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-sqr58"] May 28 23:02:51.220968 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:51.220911 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqr58" May 28 23:02:51.221013 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:51.220982 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqr58" podUID="3022003a-db31-40b3-8099-98f3eadcfa26" May 28 23:02:52.131105 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:52.131055 2577 generic.go:358] "Generic (PLEG): container finished" podID="43a1feb4-04fe-4605-99e9-0be12579d524" containerID="8a00f8da835777934f29e13c0ab9ea9035c0f288296618489cc6a89578e120bc" exitCode=0 May 28 23:02:52.131487 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:52.131140 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d7zts" event={"ID":"43a1feb4-04fe-4605-99e9-0be12579d524","Type":"ContainerDied","Data":"8a00f8da835777934f29e13c0ab9ea9035c0f288296618489cc6a89578e120bc"} May 28 23:02:52.993827 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:52.993789 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqr58" May 28 23:02:52.993972 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:52.993897 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t5bp9" May 28 23:02:52.993972 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:52.993897 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqr58" podUID="3022003a-db31-40b3-8099-98f3eadcfa26" May 28 23:02:52.994051 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:52.993998 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t5bp9" podUID="d8e6e54a-9204-40ab-8c10-ded8a2cdb95d" May 28 23:02:54.138494 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:54.138309 2577 generic.go:358] "Generic (PLEG): container finished" podID="43a1feb4-04fe-4605-99e9-0be12579d524" containerID="59f49edba663a575d112bdaf2780f1abdc97e92641b8e1a44b77841e86864845" exitCode=0 May 28 23:02:54.138494 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:54.138388 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d7zts" event={"ID":"43a1feb4-04fe-4605-99e9-0be12579d524","Type":"ContainerDied","Data":"59f49edba663a575d112bdaf2780f1abdc97e92641b8e1a44b77841e86864845"} May 28 23:02:54.992928 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:54.992851 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t5bp9" May 28 23:02:54.992928 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:54.992889 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqr58" May 28 23:02:54.993159 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:54.992999 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t5bp9" podUID="d8e6e54a-9204-40ab-8c10-ded8a2cdb95d" May 28 23:02:54.993219 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:54.993155 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqr58" podUID="3022003a-db31-40b3-8099-98f3eadcfa26" May 28 23:02:56.724240 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:56.724154 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8e6e54a-9204-40ab-8c10-ded8a2cdb95d-metrics-certs\") pod \"network-metrics-daemon-t5bp9\" (UID: \"d8e6e54a-9204-40ab-8c10-ded8a2cdb95d\") " pod="openshift-multus/network-metrics-daemon-t5bp9" May 28 23:02:56.724240 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:56.724226 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xl4xs\" (UniqueName: \"kubernetes.io/projected/3022003a-db31-40b3-8099-98f3eadcfa26-kube-api-access-xl4xs\") pod \"network-check-target-sqr58\" (UID: \"3022003a-db31-40b3-8099-98f3eadcfa26\") " pod="openshift-network-diagnostics/network-check-target-sqr58" May 28 23:02:56.724789 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:56.724323 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 23:02:56.724789 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:56.724341 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 23:02:56.724789 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:56.724356 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 23:02:56.724789 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:56.724365 2577 projected.go:194] Error preparing data for projected volume kube-api-access-xl4xs for pod openshift-network-diagnostics/network-check-target-sqr58: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 23:02:56.724789 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:56.724400 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8e6e54a-9204-40ab-8c10-ded8a2cdb95d-metrics-certs podName:d8e6e54a-9204-40ab-8c10-ded8a2cdb95d nodeName:}" failed. No retries permitted until 2026-05-28 23:03:28.724379366 +0000 UTC m=+66.332193308 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d8e6e54a-9204-40ab-8c10-ded8a2cdb95d-metrics-certs") pod "network-metrics-daemon-t5bp9" (UID: "d8e6e54a-9204-40ab-8c10-ded8a2cdb95d") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 23:02:56.724789 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:56.724420 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3022003a-db31-40b3-8099-98f3eadcfa26-kube-api-access-xl4xs podName:3022003a-db31-40b3-8099-98f3eadcfa26 nodeName:}" failed. No retries permitted until 2026-05-28 23:03:28.724409895 +0000 UTC m=+66.332223842 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-xl4xs" (UniqueName: "kubernetes.io/projected/3022003a-db31-40b3-8099-98f3eadcfa26-kube-api-access-xl4xs") pod "network-check-target-sqr58" (UID: "3022003a-db31-40b3-8099-98f3eadcfa26") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 23:02:56.748487 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:56.748462 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-11.ec2.internal" event="NodeReady" May 28 23:02:56.748618 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:56.748591 2577 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 28 23:02:56.798151 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:56.798120 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-8zr45"] May 28 23:02:56.799969 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:56.799949 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8zr45" May 28 23:02:56.802396 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:56.802377 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-94qps\"" May 28 23:02:56.802653 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:56.802638 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 28 23:02:56.803214 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:56.803186 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 28 23:02:56.804274 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:56.804250 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-hs47z"] May 28 23:02:56.805928 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:56.805912 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hs47z" May 28 23:02:56.808265 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:56.807984 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 28 23:02:56.808265 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:56.807989 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 28 23:02:56.808265 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:56.808145 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-v6j6q\"" May 28 23:02:56.808505 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:56.808284 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 28 23:02:56.813610 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:56.813592 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8zr45"] May 28 23:02:56.817626 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:56.817606 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hs47z"] May 28 23:02:56.926600 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:56.926575 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e662546-4260-4167-aafa-19b834be1588-metrics-tls\") pod \"dns-default-8zr45\" (UID: \"4e662546-4260-4167-aafa-19b834be1588\") " pod="openshift-dns/dns-default-8zr45" May 28 23:02:56.926781 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:56.926632 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9jdw\" (UniqueName: \"kubernetes.io/projected/4e662546-4260-4167-aafa-19b834be1588-kube-api-access-d9jdw\") pod \"dns-default-8zr45\" (UID: \"4e662546-4260-4167-aafa-19b834be1588\") " pod="openshift-dns/dns-default-8zr45" May 28 23:02:56.926781 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:56.926696 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d2ec4e04-45b6-4bf3-9268-8e7799549fef-cert\") pod \"ingress-canary-hs47z\" (UID: \"d2ec4e04-45b6-4bf3-9268-8e7799549fef\") " pod="openshift-ingress-canary/ingress-canary-hs47z" May 28 23:02:56.926781 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:56.926736 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e662546-4260-4167-aafa-19b834be1588-tmp-dir\") pod \"dns-default-8zr45\" (UID: \"4e662546-4260-4167-aafa-19b834be1588\") " pod="openshift-dns/dns-default-8zr45" May 28 23:02:56.926938 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:56.926783 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tc2q\" (UniqueName: \"kubernetes.io/projected/d2ec4e04-45b6-4bf3-9268-8e7799549fef-kube-api-access-4tc2q\") pod \"ingress-canary-hs47z\" (UID: \"d2ec4e04-45b6-4bf3-9268-8e7799549fef\") " pod="openshift-ingress-canary/ingress-canary-hs47z" May 28 23:02:56.926938 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:56.926863 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4e662546-4260-4167-aafa-19b834be1588-config-volume\") pod \"dns-default-8zr45\" (UID: \"4e662546-4260-4167-aafa-19b834be1588\") " pod="openshift-dns/dns-default-8zr45" May 28 23:02:56.992708 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:56.992635 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqr58" May 28 23:02:56.992708 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:56.992649 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t5bp9" May 28 23:02:56.997930 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:56.997878 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6z5pd\"" May 28 23:02:56.997930 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:56.997911 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 28 23:02:56.998123 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:56.997952 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 28 23:02:56.998221 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:56.998204 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 28 23:02:56.998287 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:56.998225 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-65lhq\"" May 28 23:02:57.028130 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:57.028106 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d9jdw\" (UniqueName: \"kubernetes.io/projected/4e662546-4260-4167-aafa-19b834be1588-kube-api-access-d9jdw\") pod \"dns-default-8zr45\" (UID: \"4e662546-4260-4167-aafa-19b834be1588\") " pod="openshift-dns/dns-default-8zr45" May 28 23:02:57.028243 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:57.028144 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d2ec4e04-45b6-4bf3-9268-8e7799549fef-cert\") pod \"ingress-canary-hs47z\" (UID: \"d2ec4e04-45b6-4bf3-9268-8e7799549fef\") " pod="openshift-ingress-canary/ingress-canary-hs47z" May 28 23:02:57.028243 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:57.028171 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e662546-4260-4167-aafa-19b834be1588-tmp-dir\") pod \"dns-default-8zr45\" (UID: \"4e662546-4260-4167-aafa-19b834be1588\") " pod="openshift-dns/dns-default-8zr45" May 28 23:02:57.028243 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:57.028205 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4tc2q\" (UniqueName: \"kubernetes.io/projected/d2ec4e04-45b6-4bf3-9268-8e7799549fef-kube-api-access-4tc2q\") pod \"ingress-canary-hs47z\" (UID: \"d2ec4e04-45b6-4bf3-9268-8e7799549fef\") " pod="openshift-ingress-canary/ingress-canary-hs47z" May 28 23:02:57.028243 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:57.028235 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4e662546-4260-4167-aafa-19b834be1588-config-volume\") pod \"dns-default-8zr45\" (UID: \"4e662546-4260-4167-aafa-19b834be1588\") " pod="openshift-dns/dns-default-8zr45" May 28 23:02:57.028436 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:57.028274 2577 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 28 23:02:57.028436 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:57.028281 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e662546-4260-4167-aafa-19b834be1588-metrics-tls\") pod \"dns-default-8zr45\" (UID: \"4e662546-4260-4167-aafa-19b834be1588\") " pod="openshift-dns/dns-default-8zr45" May 28 23:02:57.028436 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:57.028334 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2ec4e04-45b6-4bf3-9268-8e7799549fef-cert podName:d2ec4e04-45b6-4bf3-9268-8e7799549fef nodeName:}" failed. No retries permitted until 2026-05-28 23:02:57.528314962 +0000 UTC m=+35.136128915 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d2ec4e04-45b6-4bf3-9268-8e7799549fef-cert") pod "ingress-canary-hs47z" (UID: "d2ec4e04-45b6-4bf3-9268-8e7799549fef") : secret "canary-serving-cert" not found May 28 23:02:57.028436 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:57.028372 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 28 23:02:57.028436 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:57.028422 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e662546-4260-4167-aafa-19b834be1588-metrics-tls podName:4e662546-4260-4167-aafa-19b834be1588 nodeName:}" failed. No retries permitted until 2026-05-28 23:02:57.528403185 +0000 UTC m=+35.136217126 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4e662546-4260-4167-aafa-19b834be1588-metrics-tls") pod "dns-default-8zr45" (UID: "4e662546-4260-4167-aafa-19b834be1588") : secret "dns-default-metrics-tls" not found May 28 23:02:57.028692 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:57.028572 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e662546-4260-4167-aafa-19b834be1588-tmp-dir\") pod \"dns-default-8zr45\" (UID: \"4e662546-4260-4167-aafa-19b834be1588\") " pod="openshift-dns/dns-default-8zr45" May 28 23:02:57.028829 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:57.028812 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4e662546-4260-4167-aafa-19b834be1588-config-volume\") pod \"dns-default-8zr45\" (UID: \"4e662546-4260-4167-aafa-19b834be1588\") " pod="openshift-dns/dns-default-8zr45" May 28 23:02:57.042325 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:57.042303 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9jdw\" (UniqueName: \"kubernetes.io/projected/4e662546-4260-4167-aafa-19b834be1588-kube-api-access-d9jdw\") pod \"dns-default-8zr45\" (UID: \"4e662546-4260-4167-aafa-19b834be1588\") " pod="openshift-dns/dns-default-8zr45" May 28 23:02:57.042420 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:57.042369 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tc2q\" (UniqueName: \"kubernetes.io/projected/d2ec4e04-45b6-4bf3-9268-8e7799549fef-kube-api-access-4tc2q\") pod \"ingress-canary-hs47z\" (UID: \"d2ec4e04-45b6-4bf3-9268-8e7799549fef\") " pod="openshift-ingress-canary/ingress-canary-hs47z" May 28 23:02:57.532101 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:57.532051 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e662546-4260-4167-aafa-19b834be1588-metrics-tls\") pod \"dns-default-8zr45\" (UID: \"4e662546-4260-4167-aafa-19b834be1588\") " pod="openshift-dns/dns-default-8zr45" May 28 23:02:57.532272 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:57.532127 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d2ec4e04-45b6-4bf3-9268-8e7799549fef-cert\") pod \"ingress-canary-hs47z\" (UID: \"d2ec4e04-45b6-4bf3-9268-8e7799549fef\") " pod="openshift-ingress-canary/ingress-canary-hs47z" May 28 23:02:57.532272 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:57.532182 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 28 23:02:57.532272 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:57.532210 2577 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 28 23:02:57.532272 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:57.532254 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e662546-4260-4167-aafa-19b834be1588-metrics-tls podName:4e662546-4260-4167-aafa-19b834be1588 nodeName:}" failed. No retries permitted until 2026-05-28 23:02:58.532235526 +0000 UTC m=+36.140049484 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4e662546-4260-4167-aafa-19b834be1588-metrics-tls") pod "dns-default-8zr45" (UID: "4e662546-4260-4167-aafa-19b834be1588") : secret "dns-default-metrics-tls" not found May 28 23:02:57.532505 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:57.532276 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2ec4e04-45b6-4bf3-9268-8e7799549fef-cert podName:d2ec4e04-45b6-4bf3-9268-8e7799549fef nodeName:}" failed. No retries permitted until 2026-05-28 23:02:58.532263155 +0000 UTC m=+36.140077095 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d2ec4e04-45b6-4bf3-9268-8e7799549fef-cert") pod "ingress-canary-hs47z" (UID: "d2ec4e04-45b6-4bf3-9268-8e7799549fef") : secret "canary-serving-cert" not found May 28 23:02:58.538450 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:58.538403 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e662546-4260-4167-aafa-19b834be1588-metrics-tls\") pod \"dns-default-8zr45\" (UID: \"4e662546-4260-4167-aafa-19b834be1588\") " pod="openshift-dns/dns-default-8zr45" May 28 23:02:58.539134 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:02:58.538482 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d2ec4e04-45b6-4bf3-9268-8e7799549fef-cert\") pod \"ingress-canary-hs47z\" (UID: \"d2ec4e04-45b6-4bf3-9268-8e7799549fef\") " pod="openshift-ingress-canary/ingress-canary-hs47z" May 28 23:02:58.539134 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:58.538578 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 28 23:02:58.539134 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:58.538658 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e662546-4260-4167-aafa-19b834be1588-metrics-tls podName:4e662546-4260-4167-aafa-19b834be1588 nodeName:}" failed. No retries permitted until 2026-05-28 23:03:00.538639933 +0000 UTC m=+38.146453892 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4e662546-4260-4167-aafa-19b834be1588-metrics-tls") pod "dns-default-8zr45" (UID: "4e662546-4260-4167-aafa-19b834be1588") : secret "dns-default-metrics-tls" not found May 28 23:02:58.539134 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:58.538590 2577 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 28 23:02:58.539134 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:02:58.538720 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2ec4e04-45b6-4bf3-9268-8e7799549fef-cert podName:d2ec4e04-45b6-4bf3-9268-8e7799549fef nodeName:}" failed. No retries permitted until 2026-05-28 23:03:00.538706292 +0000 UTC m=+38.146520232 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d2ec4e04-45b6-4bf3-9268-8e7799549fef-cert") pod "ingress-canary-hs47z" (UID: "d2ec4e04-45b6-4bf3-9268-8e7799549fef") : secret "canary-serving-cert" not found May 28 23:03:00.149794 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:00.149726 2577 generic.go:358] "Generic (PLEG): container finished" podID="43a1feb4-04fe-4605-99e9-0be12579d524" containerID="2509df0571fdcdffda8330bd15c4559fa0d42938fea646ecedfb848a8292c207" exitCode=0 May 28 23:03:00.149794 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:00.149786 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d7zts" event={"ID":"43a1feb4-04fe-4605-99e9-0be12579d524","Type":"ContainerDied","Data":"2509df0571fdcdffda8330bd15c4559fa0d42938fea646ecedfb848a8292c207"} May 28 23:03:00.554976 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:00.554925 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d2ec4e04-45b6-4bf3-9268-8e7799549fef-cert\") pod \"ingress-canary-hs47z\" (UID: \"d2ec4e04-45b6-4bf3-9268-8e7799549fef\") " pod="openshift-ingress-canary/ingress-canary-hs47z" May 28 23:03:00.554976 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:00.554978 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e662546-4260-4167-aafa-19b834be1588-metrics-tls\") pod \"dns-default-8zr45\" (UID: \"4e662546-4260-4167-aafa-19b834be1588\") " pod="openshift-dns/dns-default-8zr45" May 28 23:03:00.555167 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:03:00.555085 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 28 23:03:00.555167 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:03:00.555137 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e662546-4260-4167-aafa-19b834be1588-metrics-tls podName:4e662546-4260-4167-aafa-19b834be1588 nodeName:}" failed. No retries permitted until 2026-05-28 23:03:04.555123208 +0000 UTC m=+42.162937147 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4e662546-4260-4167-aafa-19b834be1588-metrics-tls") pod "dns-default-8zr45" (UID: "4e662546-4260-4167-aafa-19b834be1588") : secret "dns-default-metrics-tls" not found May 28 23:03:00.555167 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:03:00.555086 2577 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 28 23:03:00.555266 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:03:00.555212 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2ec4e04-45b6-4bf3-9268-8e7799549fef-cert podName:d2ec4e04-45b6-4bf3-9268-8e7799549fef nodeName:}" failed. No retries permitted until 2026-05-28 23:03:04.555198734 +0000 UTC m=+42.163012679 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d2ec4e04-45b6-4bf3-9268-8e7799549fef-cert") pod "ingress-canary-hs47z" (UID: "d2ec4e04-45b6-4bf3-9268-8e7799549fef") : secret "canary-serving-cert" not found May 28 23:03:01.153986 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:01.153951 2577 generic.go:358] "Generic (PLEG): container finished" podID="43a1feb4-04fe-4605-99e9-0be12579d524" containerID="77089f1ec21bfc459f3550418c68106b39a00fbf37db730b5200f58bd31eebfe" exitCode=0 May 28 23:03:01.154376 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:01.153995 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d7zts" event={"ID":"43a1feb4-04fe-4605-99e9-0be12579d524","Type":"ContainerDied","Data":"77089f1ec21bfc459f3550418c68106b39a00fbf37db730b5200f58bd31eebfe"} May 28 23:03:02.158682 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:02.158492 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d7zts" event={"ID":"43a1feb4-04fe-4605-99e9-0be12579d524","Type":"ContainerStarted","Data":"7c4b5f448d5fd89e45cbf325fefba6f319948c3fccd7330fcd66993087cfefc9"} May 28 23:03:02.182729 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:02.182680 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-d7zts" podStartSLOduration=4.943474391 podStartE2EDuration="39.182663466s" podCreationTimestamp="2026-05-28 23:02:23 +0000 UTC" firstStartedPulling="2026-05-28 23:02:25.623695102 +0000 UTC m=+3.231509049" lastFinishedPulling="2026-05-28 23:02:59.862884174 +0000 UTC m=+37.470698124" observedRunningTime="2026-05-28 23:03:02.181320579 +0000 UTC m=+39.789134539" watchObservedRunningTime="2026-05-28 23:03:02.182663466 +0000 UTC m=+39.790477426" May 28 23:03:04.581734 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:04.581696 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e662546-4260-4167-aafa-19b834be1588-metrics-tls\") pod \"dns-default-8zr45\" (UID: \"4e662546-4260-4167-aafa-19b834be1588\") " pod="openshift-dns/dns-default-8zr45" May 28 23:03:04.582179 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:04.581749 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d2ec4e04-45b6-4bf3-9268-8e7799549fef-cert\") pod \"ingress-canary-hs47z\" (UID: \"d2ec4e04-45b6-4bf3-9268-8e7799549fef\") " pod="openshift-ingress-canary/ingress-canary-hs47z" May 28 23:03:04.582179 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:03:04.581866 2577 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 28 23:03:04.582179 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:03:04.581877 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 28 23:03:04.582179 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:03:04.581916 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2ec4e04-45b6-4bf3-9268-8e7799549fef-cert podName:d2ec4e04-45b6-4bf3-9268-8e7799549fef nodeName:}" failed. No retries permitted until 2026-05-28 23:03:12.581902234 +0000 UTC m=+50.189716173 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d2ec4e04-45b6-4bf3-9268-8e7799549fef-cert") pod "ingress-canary-hs47z" (UID: "d2ec4e04-45b6-4bf3-9268-8e7799549fef") : secret "canary-serving-cert" not found May 28 23:03:04.582179 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:03:04.581944 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e662546-4260-4167-aafa-19b834be1588-metrics-tls podName:4e662546-4260-4167-aafa-19b834be1588 nodeName:}" failed. No retries permitted until 2026-05-28 23:03:12.581927047 +0000 UTC m=+50.189740993 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4e662546-4260-4167-aafa-19b834be1588-metrics-tls") pod "dns-default-8zr45" (UID: "4e662546-4260-4167-aafa-19b834be1588") : secret "dns-default-metrics-tls" not found May 28 23:03:12.642168 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:12.642129 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d2ec4e04-45b6-4bf3-9268-8e7799549fef-cert\") pod \"ingress-canary-hs47z\" (UID: \"d2ec4e04-45b6-4bf3-9268-8e7799549fef\") " pod="openshift-ingress-canary/ingress-canary-hs47z" May 28 23:03:12.642616 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:12.642197 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e662546-4260-4167-aafa-19b834be1588-metrics-tls\") pod \"dns-default-8zr45\" (UID: \"4e662546-4260-4167-aafa-19b834be1588\") " pod="openshift-dns/dns-default-8zr45" May 28 23:03:12.642616 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:03:12.642274 2577 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 28 23:03:12.642616 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:03:12.642340 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2ec4e04-45b6-4bf3-9268-8e7799549fef-cert podName:d2ec4e04-45b6-4bf3-9268-8e7799549fef nodeName:}" failed. No retries permitted until 2026-05-28 23:03:28.642321912 +0000 UTC m=+66.250135851 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d2ec4e04-45b6-4bf3-9268-8e7799549fef-cert") pod "ingress-canary-hs47z" (UID: "d2ec4e04-45b6-4bf3-9268-8e7799549fef") : secret "canary-serving-cert" not found May 28 23:03:12.642616 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:03:12.642280 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 28 23:03:12.642616 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:03:12.642403 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e662546-4260-4167-aafa-19b834be1588-metrics-tls podName:4e662546-4260-4167-aafa-19b834be1588 nodeName:}" failed. No retries permitted until 2026-05-28 23:03:28.642389965 +0000 UTC m=+66.250203904 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4e662546-4260-4167-aafa-19b834be1588-metrics-tls") pod "dns-default-8zr45" (UID: "4e662546-4260-4167-aafa-19b834be1588") : secret "dns-default-metrics-tls" not found May 28 23:03:22.145479 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:22.145453 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qmfbw" May 28 23:03:28.646798 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:28.646755 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d2ec4e04-45b6-4bf3-9268-8e7799549fef-cert\") pod \"ingress-canary-hs47z\" (UID: \"d2ec4e04-45b6-4bf3-9268-8e7799549fef\") " pod="openshift-ingress-canary/ingress-canary-hs47z" May 28 23:03:28.647264 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:28.646822 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e662546-4260-4167-aafa-19b834be1588-metrics-tls\") pod \"dns-default-8zr45\" (UID: \"4e662546-4260-4167-aafa-19b834be1588\") " pod="openshift-dns/dns-default-8zr45" May 28 23:03:28.647264 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:03:28.646890 2577 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 28 23:03:28.647264 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:03:28.646919 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 28 23:03:28.647264 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:03:28.646963 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2ec4e04-45b6-4bf3-9268-8e7799549fef-cert podName:d2ec4e04-45b6-4bf3-9268-8e7799549fef nodeName:}" failed. No retries permitted until 2026-05-28 23:04:00.646947666 +0000 UTC m=+98.254761605 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d2ec4e04-45b6-4bf3-9268-8e7799549fef-cert") pod "ingress-canary-hs47z" (UID: "d2ec4e04-45b6-4bf3-9268-8e7799549fef") : secret "canary-serving-cert" not found May 28 23:03:28.647264 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:03:28.646977 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e662546-4260-4167-aafa-19b834be1588-metrics-tls podName:4e662546-4260-4167-aafa-19b834be1588 nodeName:}" failed. No retries permitted until 2026-05-28 23:04:00.646970839 +0000 UTC m=+98.254784778 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4e662546-4260-4167-aafa-19b834be1588-metrics-tls") pod "dns-default-8zr45" (UID: "4e662546-4260-4167-aafa-19b834be1588") : secret "dns-default-metrics-tls" not found May 28 23:03:28.748085 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:28.748042 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xl4xs\" (UniqueName: \"kubernetes.io/projected/3022003a-db31-40b3-8099-98f3eadcfa26-kube-api-access-xl4xs\") pod \"network-check-target-sqr58\" (UID: \"3022003a-db31-40b3-8099-98f3eadcfa26\") " pod="openshift-network-diagnostics/network-check-target-sqr58" May 28 23:03:28.748229 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:28.748133 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8e6e54a-9204-40ab-8c10-ded8a2cdb95d-metrics-certs\") pod \"network-metrics-daemon-t5bp9\" (UID: \"d8e6e54a-9204-40ab-8c10-ded8a2cdb95d\") " pod="openshift-multus/network-metrics-daemon-t5bp9" May 28 23:03:28.750956 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:28.750937 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 28 23:03:28.751102 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:28.751085 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 28 23:03:28.759158 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:03:28.759142 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 28 23:03:28.759241 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:03:28.759229 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8e6e54a-9204-40ab-8c10-ded8a2cdb95d-metrics-certs podName:d8e6e54a-9204-40ab-8c10-ded8a2cdb95d nodeName:}" failed. No retries permitted until 2026-05-28 23:04:32.759207135 +0000 UTC m=+130.367021079 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d8e6e54a-9204-40ab-8c10-ded8a2cdb95d-metrics-certs") pod "network-metrics-daemon-t5bp9" (UID: "d8e6e54a-9204-40ab-8c10-ded8a2cdb95d") : secret "metrics-daemon-secret" not found May 28 23:03:28.761542 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:28.761525 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 28 23:03:28.772206 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:28.772190 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xl4xs\" (UniqueName: \"kubernetes.io/projected/3022003a-db31-40b3-8099-98f3eadcfa26-kube-api-access-xl4xs\") pod \"network-check-target-sqr58\" (UID: \"3022003a-db31-40b3-8099-98f3eadcfa26\") " pod="openshift-network-diagnostics/network-check-target-sqr58" May 28 23:03:28.806721 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:28.806702 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6z5pd\"" May 28 23:03:28.814666 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:28.814648 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqr58" May 28 23:03:28.999990 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:28.999962 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-sqr58"] May 28 23:03:29.003583 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:03:29.003558 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3022003a_db31_40b3_8099_98f3eadcfa26.slice/crio-77f8482e681dd02d775e554d1e28294b619a51c65d817177f2cdedf0b324aa96 WatchSource:0}: Error finding container 77f8482e681dd02d775e554d1e28294b619a51c65d817177f2cdedf0b324aa96: Status 404 returned error can't find the container with id 77f8482e681dd02d775e554d1e28294b619a51c65d817177f2cdedf0b324aa96 May 28 23:03:29.211415 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:29.211337 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-sqr58" event={"ID":"3022003a-db31-40b3-8099-98f3eadcfa26","Type":"ContainerStarted","Data":"77f8482e681dd02d775e554d1e28294b619a51c65d817177f2cdedf0b324aa96"} May 28 23:03:33.220914 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:33.220820 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-sqr58" event={"ID":"3022003a-db31-40b3-8099-98f3eadcfa26","Type":"ContainerStarted","Data":"957cf137e6c1e3f6f26d97decfad55563b3eb734a68231ae277dbe0d3d0a74ac"} May 28 23:03:33.221285 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:33.221026 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-sqr58" May 28 23:03:33.238170 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:33.238129 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-sqr58" podStartSLOduration=66.374661214 podStartE2EDuration="1m10.238116457s" podCreationTimestamp="2026-05-28 23:02:23 +0000 UTC" firstStartedPulling="2026-05-28 23:03:29.005332054 +0000 UTC m=+66.613145992" lastFinishedPulling="2026-05-28 23:03:32.868787282 +0000 UTC m=+70.476601235" observedRunningTime="2026-05-28 23:03:33.237505466 +0000 UTC m=+70.845319421" watchObservedRunningTime="2026-05-28 23:03:33.238116457 +0000 UTC m=+70.845930415" May 28 23:03:42.453970 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:42.453834 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-875lc"] May 28 23:03:42.455413 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:42.455397 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7cc6ddd568-pltq6"] May 28 23:03:42.455567 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:42.455547 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-875lc" May 28 23:03:42.456810 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:42.456794 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7cc6ddd568-pltq6" May 28 23:03:42.457995 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:42.457976 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" May 28 23:03:42.458098 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:42.457992 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 28 23:03:42.458098 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:42.458007 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" May 28 23:03:42.458349 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:42.458329 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 28 23:03:42.458462 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:42.458445 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-wjq9l\"" May 28 23:03:42.459033 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:42.459011 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" May 28 23:03:42.459139 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:42.459058 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 28 23:03:42.459139 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:42.459093 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" May 28 23:03:42.459342 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:42.459328 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 28 23:03:42.459403 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:42.459342 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" May 28 23:03:42.459403 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:42.459383 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" May 28 23:03:42.459511 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:42.459415 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-b4znv\"" May 28 23:03:42.464157 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:42.464138 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" May 28 23:03:42.465891 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:42.465875 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-875lc"] May 28 23:03:42.466632 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:42.466563 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7cc6ddd568-pltq6"] May 28 23:03:42.532016 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:42.531974 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/99deffb2-8926-48e6-ba16-b3807f87aa5d-stats-auth\") pod \"router-default-7cc6ddd568-pltq6\" (UID: \"99deffb2-8926-48e6-ba16-b3807f87aa5d\") " pod="openshift-ingress/router-default-7cc6ddd568-pltq6" May 28 23:03:42.532016 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:42.532015 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99deffb2-8926-48e6-ba16-b3807f87aa5d-metrics-certs\") pod \"router-default-7cc6ddd568-pltq6\" (UID: \"99deffb2-8926-48e6-ba16-b3807f87aa5d\") " pod="openshift-ingress/router-default-7cc6ddd568-pltq6" May 28 23:03:42.532222 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:42.532036 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/99deffb2-8926-48e6-ba16-b3807f87aa5d-default-certificate\") pod \"router-default-7cc6ddd568-pltq6\" (UID: \"99deffb2-8926-48e6-ba16-b3807f87aa5d\") " pod="openshift-ingress/router-default-7cc6ddd568-pltq6" May 28 23:03:42.532222 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:42.532117 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e503af1b-53d7-4ca7-9da9-990420799bc5-serving-cert\") pod \"insights-operator-78bdfb888c-875lc\" (UID: \"e503af1b-53d7-4ca7-9da9-990420799bc5\") " pod="openshift-insights/insights-operator-78bdfb888c-875lc" May 28 23:03:42.532222 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:42.532147 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frhm6\" (UniqueName: \"kubernetes.io/projected/99deffb2-8926-48e6-ba16-b3807f87aa5d-kube-api-access-frhm6\") pod \"router-default-7cc6ddd568-pltq6\" (UID: \"99deffb2-8926-48e6-ba16-b3807f87aa5d\") " pod="openshift-ingress/router-default-7cc6ddd568-pltq6" May 28 23:03:42.532222 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:42.532193 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e503af1b-53d7-4ca7-9da9-990420799bc5-service-ca-bundle\") pod \"insights-operator-78bdfb888c-875lc\" (UID: \"e503af1b-53d7-4ca7-9da9-990420799bc5\") " pod="openshift-insights/insights-operator-78bdfb888c-875lc" May 28 23:03:42.532222 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:42.532214 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e503af1b-53d7-4ca7-9da9-990420799bc5-tmp\") pod \"insights-operator-78bdfb888c-875lc\" (UID: \"e503af1b-53d7-4ca7-9da9-990420799bc5\") " pod="openshift-insights/insights-operator-78bdfb888c-875lc" May 28 23:03:42.532396 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:42.532228 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e503af1b-53d7-4ca7-9da9-990420799bc5-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-875lc\" (UID: \"e503af1b-53d7-4ca7-9da9-990420799bc5\") " pod="openshift-insights/insights-operator-78bdfb888c-875lc" May 28 23:03:42.532396 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:42.532246 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e503af1b-53d7-4ca7-9da9-990420799bc5-snapshots\") pod \"insights-operator-78bdfb888c-875lc\" (UID: \"e503af1b-53d7-4ca7-9da9-990420799bc5\") " pod="openshift-insights/insights-operator-78bdfb888c-875lc" May 28 23:03:42.532396 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:42.532272 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99deffb2-8926-48e6-ba16-b3807f87aa5d-service-ca-bundle\") pod \"router-default-7cc6ddd568-pltq6\" (UID: \"99deffb2-8926-48e6-ba16-b3807f87aa5d\") " pod="openshift-ingress/router-default-7cc6ddd568-pltq6" May 28 23:03:42.532396 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:42.532315 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dx428\" (UniqueName: \"kubernetes.io/projected/e503af1b-53d7-4ca7-9da9-990420799bc5-kube-api-access-dx428\") pod \"insights-operator-78bdfb888c-875lc\" (UID: \"e503af1b-53d7-4ca7-9da9-990420799bc5\") " pod="openshift-insights/insights-operator-78bdfb888c-875lc" May 28 23:03:42.633382 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:42.633345 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/99deffb2-8926-48e6-ba16-b3807f87aa5d-default-certificate\") pod \"router-default-7cc6ddd568-pltq6\" (UID: \"99deffb2-8926-48e6-ba16-b3807f87aa5d\") " pod="openshift-ingress/router-default-7cc6ddd568-pltq6" May 28 23:03:42.633460 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:42.633390 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e503af1b-53d7-4ca7-9da9-990420799bc5-serving-cert\") pod \"insights-operator-78bdfb888c-875lc\" (UID: \"e503af1b-53d7-4ca7-9da9-990420799bc5\") " pod="openshift-insights/insights-operator-78bdfb888c-875lc" May 28 23:03:42.633460 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:42.633411 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-frhm6\" (UniqueName: \"kubernetes.io/projected/99deffb2-8926-48e6-ba16-b3807f87aa5d-kube-api-access-frhm6\") pod \"router-default-7cc6ddd568-pltq6\" (UID: \"99deffb2-8926-48e6-ba16-b3807f87aa5d\") " pod="openshift-ingress/router-default-7cc6ddd568-pltq6" May 28 23:03:42.633538 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:42.633471 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e503af1b-53d7-4ca7-9da9-990420799bc5-service-ca-bundle\") pod \"insights-operator-78bdfb888c-875lc\" (UID: \"e503af1b-53d7-4ca7-9da9-990420799bc5\") " pod="openshift-insights/insights-operator-78bdfb888c-875lc" May 28 23:03:42.633538 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:42.633505 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e503af1b-53d7-4ca7-9da9-990420799bc5-tmp\") pod \"insights-operator-78bdfb888c-875lc\" (UID: \"e503af1b-53d7-4ca7-9da9-990420799bc5\") " pod="openshift-insights/insights-operator-78bdfb888c-875lc" May 28 23:03:42.633538 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:42.633529 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e503af1b-53d7-4ca7-9da9-990420799bc5-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-875lc\" (UID: \"e503af1b-53d7-4ca7-9da9-990420799bc5\") " pod="openshift-insights/insights-operator-78bdfb888c-875lc" May 28 23:03:42.633680 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:42.633558 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e503af1b-53d7-4ca7-9da9-990420799bc5-snapshots\") pod \"insights-operator-78bdfb888c-875lc\" (UID: \"e503af1b-53d7-4ca7-9da9-990420799bc5\") " pod="openshift-insights/insights-operator-78bdfb888c-875lc" May 28 23:03:42.633680 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:42.633582 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99deffb2-8926-48e6-ba16-b3807f87aa5d-service-ca-bundle\") pod \"router-default-7cc6ddd568-pltq6\" (UID: \"99deffb2-8926-48e6-ba16-b3807f87aa5d\") " pod="openshift-ingress/router-default-7cc6ddd568-pltq6" May 28 23:03:42.633680 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:42.633622 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dx428\" (UniqueName: \"kubernetes.io/projected/e503af1b-53d7-4ca7-9da9-990420799bc5-kube-api-access-dx428\") pod \"insights-operator-78bdfb888c-875lc\" (UID: \"e503af1b-53d7-4ca7-9da9-990420799bc5\") " pod="openshift-insights/insights-operator-78bdfb888c-875lc" May 28 23:03:42.633680 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:42.633653 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/99deffb2-8926-48e6-ba16-b3807f87aa5d-stats-auth\") pod \"router-default-7cc6ddd568-pltq6\" (UID: \"99deffb2-8926-48e6-ba16-b3807f87aa5d\") " pod="openshift-ingress/router-default-7cc6ddd568-pltq6" May 28 23:03:42.633680 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:42.633677 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99deffb2-8926-48e6-ba16-b3807f87aa5d-metrics-certs\") pod \"router-default-7cc6ddd568-pltq6\" (UID: \"99deffb2-8926-48e6-ba16-b3807f87aa5d\") " pod="openshift-ingress/router-default-7cc6ddd568-pltq6" May 28 23:03:42.633925 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:03:42.633772 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 28 23:03:42.633925 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:03:42.633849 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99deffb2-8926-48e6-ba16-b3807f87aa5d-metrics-certs podName:99deffb2-8926-48e6-ba16-b3807f87aa5d nodeName:}" failed. No retries permitted until 2026-05-28 23:03:43.133821611 +0000 UTC m=+80.741635556 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/99deffb2-8926-48e6-ba16-b3807f87aa5d-metrics-certs") pod "router-default-7cc6ddd568-pltq6" (UID: "99deffb2-8926-48e6-ba16-b3807f87aa5d") : secret "router-metrics-certs-default" not found May 28 23:03:42.634056 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:03:42.634040 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/99deffb2-8926-48e6-ba16-b3807f87aa5d-service-ca-bundle podName:99deffb2-8926-48e6-ba16-b3807f87aa5d nodeName:}" failed. No retries permitted until 2026-05-28 23:03:43.134025862 +0000 UTC m=+80.741839804 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/99deffb2-8926-48e6-ba16-b3807f87aa5d-service-ca-bundle") pod "router-default-7cc6ddd568-pltq6" (UID: "99deffb2-8926-48e6-ba16-b3807f87aa5d") : configmap references non-existent config key: service-ca.crt May 28 23:03:42.634348 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:42.634325 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e503af1b-53d7-4ca7-9da9-990420799bc5-tmp\") pod \"insights-operator-78bdfb888c-875lc\" (UID: \"e503af1b-53d7-4ca7-9da9-990420799bc5\") " pod="openshift-insights/insights-operator-78bdfb888c-875lc" May 28 23:03:42.634442 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:42.634346 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e503af1b-53d7-4ca7-9da9-990420799bc5-snapshots\") pod \"insights-operator-78bdfb888c-875lc\" (UID: \"e503af1b-53d7-4ca7-9da9-990420799bc5\") " pod="openshift-insights/insights-operator-78bdfb888c-875lc" May 28 23:03:42.634442 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:42.634418 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e503af1b-53d7-4ca7-9da9-990420799bc5-service-ca-bundle\") pod \"insights-operator-78bdfb888c-875lc\" (UID: \"e503af1b-53d7-4ca7-9da9-990420799bc5\") " pod="openshift-insights/insights-operator-78bdfb888c-875lc" May 28 23:03:42.634622 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:42.634604 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e503af1b-53d7-4ca7-9da9-990420799bc5-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-875lc\" (UID: \"e503af1b-53d7-4ca7-9da9-990420799bc5\") " pod="openshift-insights/insights-operator-78bdfb888c-875lc" May 28 23:03:42.635773 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:42.635746 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e503af1b-53d7-4ca7-9da9-990420799bc5-serving-cert\") pod \"insights-operator-78bdfb888c-875lc\" (UID: \"e503af1b-53d7-4ca7-9da9-990420799bc5\") " pod="openshift-insights/insights-operator-78bdfb888c-875lc" May 28 23:03:42.636433 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:42.636409 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/99deffb2-8926-48e6-ba16-b3807f87aa5d-default-certificate\") pod \"router-default-7cc6ddd568-pltq6\" (UID: \"99deffb2-8926-48e6-ba16-b3807f87aa5d\") " pod="openshift-ingress/router-default-7cc6ddd568-pltq6" May 28 23:03:42.636517 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:42.636414 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/99deffb2-8926-48e6-ba16-b3807f87aa5d-stats-auth\") pod \"router-default-7cc6ddd568-pltq6\" (UID: \"99deffb2-8926-48e6-ba16-b3807f87aa5d\") " pod="openshift-ingress/router-default-7cc6ddd568-pltq6" May 28 23:03:42.642946 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:42.642921 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-frhm6\" (UniqueName: \"kubernetes.io/projected/99deffb2-8926-48e6-ba16-b3807f87aa5d-kube-api-access-frhm6\") pod \"router-default-7cc6ddd568-pltq6\" (UID: \"99deffb2-8926-48e6-ba16-b3807f87aa5d\") " pod="openshift-ingress/router-default-7cc6ddd568-pltq6" May 28 23:03:42.643029 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:42.642947 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dx428\" (UniqueName: \"kubernetes.io/projected/e503af1b-53d7-4ca7-9da9-990420799bc5-kube-api-access-dx428\") pod \"insights-operator-78bdfb888c-875lc\" (UID: \"e503af1b-53d7-4ca7-9da9-990420799bc5\") " pod="openshift-insights/insights-operator-78bdfb888c-875lc" May 28 23:03:42.765669 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:42.765588 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-875lc" May 28 23:03:42.883804 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:42.883774 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-875lc"] May 28 23:03:42.887107 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:03:42.887060 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode503af1b_53d7_4ca7_9da9_990420799bc5.slice/crio-61d522b925f9fe5d7665f8f04d6ff33e3ca5e95c6ac81960caf99ba464a61f47 WatchSource:0}: Error finding container 61d522b925f9fe5d7665f8f04d6ff33e3ca5e95c6ac81960caf99ba464a61f47: Status 404 returned error can't find the container with id 61d522b925f9fe5d7665f8f04d6ff33e3ca5e95c6ac81960caf99ba464a61f47 May 28 23:03:43.135909 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:43.135880 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99deffb2-8926-48e6-ba16-b3807f87aa5d-service-ca-bundle\") pod \"router-default-7cc6ddd568-pltq6\" (UID: \"99deffb2-8926-48e6-ba16-b3807f87aa5d\") " pod="openshift-ingress/router-default-7cc6ddd568-pltq6" May 28 23:03:43.136051 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:43.135924 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99deffb2-8926-48e6-ba16-b3807f87aa5d-metrics-certs\") pod \"router-default-7cc6ddd568-pltq6\" (UID: \"99deffb2-8926-48e6-ba16-b3807f87aa5d\") " pod="openshift-ingress/router-default-7cc6ddd568-pltq6" May 28 23:03:43.136051 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:03:43.136036 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/99deffb2-8926-48e6-ba16-b3807f87aa5d-service-ca-bundle podName:99deffb2-8926-48e6-ba16-b3807f87aa5d nodeName:}" failed. No retries permitted until 2026-05-28 23:03:44.136019838 +0000 UTC m=+81.743833781 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/99deffb2-8926-48e6-ba16-b3807f87aa5d-service-ca-bundle") pod "router-default-7cc6ddd568-pltq6" (UID: "99deffb2-8926-48e6-ba16-b3807f87aa5d") : configmap references non-existent config key: service-ca.crt May 28 23:03:43.136159 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:03:43.136053 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 28 23:03:43.136159 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:03:43.136114 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99deffb2-8926-48e6-ba16-b3807f87aa5d-metrics-certs podName:99deffb2-8926-48e6-ba16-b3807f87aa5d nodeName:}" failed. No retries permitted until 2026-05-28 23:03:44.136101523 +0000 UTC m=+81.743915477 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/99deffb2-8926-48e6-ba16-b3807f87aa5d-metrics-certs") pod "router-default-7cc6ddd568-pltq6" (UID: "99deffb2-8926-48e6-ba16-b3807f87aa5d") : secret "router-metrics-certs-default" not found May 28 23:03:43.238693 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:43.238665 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-875lc" event={"ID":"e503af1b-53d7-4ca7-9da9-990420799bc5","Type":"ContainerStarted","Data":"61d522b925f9fe5d7665f8f04d6ff33e3ca5e95c6ac81960caf99ba464a61f47"} May 28 23:03:44.142127 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:44.142096 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99deffb2-8926-48e6-ba16-b3807f87aa5d-service-ca-bundle\") pod \"router-default-7cc6ddd568-pltq6\" (UID: \"99deffb2-8926-48e6-ba16-b3807f87aa5d\") " pod="openshift-ingress/router-default-7cc6ddd568-pltq6" May 28 23:03:44.142526 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:44.142146 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99deffb2-8926-48e6-ba16-b3807f87aa5d-metrics-certs\") pod \"router-default-7cc6ddd568-pltq6\" (UID: \"99deffb2-8926-48e6-ba16-b3807f87aa5d\") " pod="openshift-ingress/router-default-7cc6ddd568-pltq6" May 28 23:03:44.142526 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:03:44.142246 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/99deffb2-8926-48e6-ba16-b3807f87aa5d-service-ca-bundle podName:99deffb2-8926-48e6-ba16-b3807f87aa5d nodeName:}" failed. No retries permitted until 2026-05-28 23:03:46.142228558 +0000 UTC m=+83.750042497 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/99deffb2-8926-48e6-ba16-b3807f87aa5d-service-ca-bundle") pod "router-default-7cc6ddd568-pltq6" (UID: "99deffb2-8926-48e6-ba16-b3807f87aa5d") : configmap references non-existent config key: service-ca.crt May 28 23:03:44.142526 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:03:44.142271 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 28 23:03:44.142526 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:03:44.142320 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99deffb2-8926-48e6-ba16-b3807f87aa5d-metrics-certs podName:99deffb2-8926-48e6-ba16-b3807f87aa5d nodeName:}" failed. No retries permitted until 2026-05-28 23:03:46.142305774 +0000 UTC m=+83.750119712 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/99deffb2-8926-48e6-ba16-b3807f87aa5d-metrics-certs") pod "router-default-7cc6ddd568-pltq6" (UID: "99deffb2-8926-48e6-ba16-b3807f87aa5d") : secret "router-metrics-certs-default" not found May 28 23:03:45.244381 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:45.244350 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-875lc" event={"ID":"e503af1b-53d7-4ca7-9da9-990420799bc5","Type":"ContainerStarted","Data":"b225ca2e5ddcc89c7928e731275713417d08e9efa806fd0b78836ff26a75e493"} May 28 23:03:45.261913 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:45.261869 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-78bdfb888c-875lc" podStartSLOduration=1.406785982 podStartE2EDuration="3.261856634s" podCreationTimestamp="2026-05-28 23:03:42 +0000 UTC" firstStartedPulling="2026-05-28 23:03:42.888775554 +0000 UTC m=+80.496589494" lastFinishedPulling="2026-05-28 23:03:44.743846205 +0000 UTC m=+82.351660146" observedRunningTime="2026-05-28 23:03:45.261334147 +0000 UTC m=+82.869148108" watchObservedRunningTime="2026-05-28 23:03:45.261856634 +0000 UTC m=+82.869670595" May 28 23:03:46.155854 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:46.155812 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99deffb2-8926-48e6-ba16-b3807f87aa5d-metrics-certs\") pod \"router-default-7cc6ddd568-pltq6\" (UID: \"99deffb2-8926-48e6-ba16-b3807f87aa5d\") " pod="openshift-ingress/router-default-7cc6ddd568-pltq6" May 28 23:03:46.156030 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:46.155926 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99deffb2-8926-48e6-ba16-b3807f87aa5d-service-ca-bundle\") pod \"router-default-7cc6ddd568-pltq6\" (UID: \"99deffb2-8926-48e6-ba16-b3807f87aa5d\") " pod="openshift-ingress/router-default-7cc6ddd568-pltq6" May 28 23:03:46.156030 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:03:46.155959 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 28 23:03:46.156180 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:03:46.156032 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99deffb2-8926-48e6-ba16-b3807f87aa5d-metrics-certs podName:99deffb2-8926-48e6-ba16-b3807f87aa5d nodeName:}" failed. No retries permitted until 2026-05-28 23:03:50.156014868 +0000 UTC m=+87.763828809 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/99deffb2-8926-48e6-ba16-b3807f87aa5d-metrics-certs") pod "router-default-7cc6ddd568-pltq6" (UID: "99deffb2-8926-48e6-ba16-b3807f87aa5d") : secret "router-metrics-certs-default" not found May 28 23:03:46.156180 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:03:46.156115 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/99deffb2-8926-48e6-ba16-b3807f87aa5d-service-ca-bundle podName:99deffb2-8926-48e6-ba16-b3807f87aa5d nodeName:}" failed. No retries permitted until 2026-05-28 23:03:50.15609666 +0000 UTC m=+87.763910600 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/99deffb2-8926-48e6-ba16-b3807f87aa5d-service-ca-bundle") pod "router-default-7cc6ddd568-pltq6" (UID: "99deffb2-8926-48e6-ba16-b3807f87aa5d") : configmap references non-existent config key: service-ca.crt May 28 23:03:48.959986 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:48.959958 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-z4cgj_7ad23651-ba0a-4be3-9b1f-7accceb0a40f/dns-node-resolver/0.log" May 28 23:03:49.360293 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:49.360267 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bwx9g_f9743c1b-af51-440b-8793-1e65a2d4fd11/node-ca/0.log" May 28 23:03:50.188144 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:50.188113 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99deffb2-8926-48e6-ba16-b3807f87aa5d-service-ca-bundle\") pod \"router-default-7cc6ddd568-pltq6\" (UID: \"99deffb2-8926-48e6-ba16-b3807f87aa5d\") " pod="openshift-ingress/router-default-7cc6ddd568-pltq6" May 28 23:03:50.188598 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:50.188154 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99deffb2-8926-48e6-ba16-b3807f87aa5d-metrics-certs\") pod \"router-default-7cc6ddd568-pltq6\" (UID: \"99deffb2-8926-48e6-ba16-b3807f87aa5d\") " pod="openshift-ingress/router-default-7cc6ddd568-pltq6" May 28 23:03:50.188598 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:03:50.188326 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 28 23:03:50.188598 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:03:50.188341 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/99deffb2-8926-48e6-ba16-b3807f87aa5d-service-ca-bundle podName:99deffb2-8926-48e6-ba16-b3807f87aa5d nodeName:}" failed. No retries permitted until 2026-05-28 23:03:58.188317418 +0000 UTC m=+95.796131362 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/99deffb2-8926-48e6-ba16-b3807f87aa5d-service-ca-bundle") pod "router-default-7cc6ddd568-pltq6" (UID: "99deffb2-8926-48e6-ba16-b3807f87aa5d") : configmap references non-existent config key: service-ca.crt May 28 23:03:50.188598 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:03:50.188376 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99deffb2-8926-48e6-ba16-b3807f87aa5d-metrics-certs podName:99deffb2-8926-48e6-ba16-b3807f87aa5d nodeName:}" failed. No retries permitted until 2026-05-28 23:03:58.188364691 +0000 UTC m=+95.796178629 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/99deffb2-8926-48e6-ba16-b3807f87aa5d-metrics-certs") pod "router-default-7cc6ddd568-pltq6" (UID: "99deffb2-8926-48e6-ba16-b3807f87aa5d") : secret "router-metrics-certs-default" not found May 28 23:03:51.426169 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:51.426137 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-tcvb6"] May 28 23:03:51.428264 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:51.428249 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-tcvb6" May 28 23:03:51.430679 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:51.430654 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" May 28 23:03:51.430679 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:51.430662 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" May 28 23:03:51.431462 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:51.431442 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" May 28 23:03:51.431462 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:51.431449 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" May 28 23:03:51.431630 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:51.431449 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-qc5xb\"" May 28 23:03:51.433946 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:51.433926 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-tcvb6"] May 28 23:03:51.496991 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:51.496967 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/29f1d24b-cf80-4e23-afb2-4a4062509259-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-tcvb6\" (UID: \"29f1d24b-cf80-4e23-afb2-4a4062509259\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-tcvb6" May 28 23:03:51.497132 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:51.496997 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/29f1d24b-cf80-4e23-afb2-4a4062509259-config\") pod \"kube-storage-version-migrator-operator-565644f49-tcvb6\" (UID: \"29f1d24b-cf80-4e23-afb2-4a4062509259\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-tcvb6" May 28 23:03:51.497132 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:51.497087 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4v2lx\" (UniqueName: \"kubernetes.io/projected/29f1d24b-cf80-4e23-afb2-4a4062509259-kube-api-access-4v2lx\") pod \"kube-storage-version-migrator-operator-565644f49-tcvb6\" (UID: \"29f1d24b-cf80-4e23-afb2-4a4062509259\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-tcvb6" May 28 23:03:51.598271 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:51.598245 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/29f1d24b-cf80-4e23-afb2-4a4062509259-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-tcvb6\" (UID: \"29f1d24b-cf80-4e23-afb2-4a4062509259\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-tcvb6" May 28 23:03:51.598372 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:51.598276 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/29f1d24b-cf80-4e23-afb2-4a4062509259-config\") pod \"kube-storage-version-migrator-operator-565644f49-tcvb6\" (UID: \"29f1d24b-cf80-4e23-afb2-4a4062509259\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-tcvb6" May 28 23:03:51.598372 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:51.598331 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4v2lx\" (UniqueName: \"kubernetes.io/projected/29f1d24b-cf80-4e23-afb2-4a4062509259-kube-api-access-4v2lx\") pod \"kube-storage-version-migrator-operator-565644f49-tcvb6\" (UID: \"29f1d24b-cf80-4e23-afb2-4a4062509259\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-tcvb6" May 28 23:03:51.599343 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:51.599322 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/29f1d24b-cf80-4e23-afb2-4a4062509259-config\") pod \"kube-storage-version-migrator-operator-565644f49-tcvb6\" (UID: \"29f1d24b-cf80-4e23-afb2-4a4062509259\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-tcvb6" May 28 23:03:51.600429 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:51.600400 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/29f1d24b-cf80-4e23-afb2-4a4062509259-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-tcvb6\" (UID: \"29f1d24b-cf80-4e23-afb2-4a4062509259\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-tcvb6" May 28 23:03:51.606451 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:51.606431 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4v2lx\" (UniqueName: \"kubernetes.io/projected/29f1d24b-cf80-4e23-afb2-4a4062509259-kube-api-access-4v2lx\") pod \"kube-storage-version-migrator-operator-565644f49-tcvb6\" (UID: \"29f1d24b-cf80-4e23-afb2-4a4062509259\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-tcvb6" May 28 23:03:51.737020 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:51.736955 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-tcvb6" May 28 23:03:51.850847 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:51.850817 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-tcvb6"] May 28 23:03:51.853947 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:03:51.853918 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29f1d24b_cf80_4e23_afb2_4a4062509259.slice/crio-7bd52cb80f08a68897f6811bc495d9d1445df3c139599cc568626f16821749f3 WatchSource:0}: Error finding container 7bd52cb80f08a68897f6811bc495d9d1445df3c139599cc568626f16821749f3: Status 404 returned error can't find the container with id 7bd52cb80f08a68897f6811bc495d9d1445df3c139599cc568626f16821749f3 May 28 23:03:52.258013 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:52.257973 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-tcvb6" event={"ID":"29f1d24b-cf80-4e23-afb2-4a4062509259","Type":"ContainerStarted","Data":"7bd52cb80f08a68897f6811bc495d9d1445df3c139599cc568626f16821749f3"} May 28 23:03:52.440344 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:52.440310 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-chlh5"] May 28 23:03:52.442392 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:52.442371 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-chlh5" May 28 23:03:52.444885 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:52.444812 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" May 28 23:03:52.444885 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:52.444883 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" May 28 23:03:52.445057 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:52.444881 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" May 28 23:03:52.445529 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:52.445508 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" May 28 23:03:52.445633 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:52.445548 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-g8kzt\"" May 28 23:03:52.449610 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:52.449555 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-chlh5"] May 28 23:03:52.506252 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:52.506225 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/defb2d12-d7af-4230-9e37-28b734ebccc7-serving-cert\") pod \"service-ca-operator-57b5b68b8-chlh5\" (UID: \"defb2d12-d7af-4230-9e37-28b734ebccc7\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-chlh5" May 28 23:03:52.506392 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:52.506276 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zg8xl\" (UniqueName: \"kubernetes.io/projected/defb2d12-d7af-4230-9e37-28b734ebccc7-kube-api-access-zg8xl\") pod \"service-ca-operator-57b5b68b8-chlh5\" (UID: \"defb2d12-d7af-4230-9e37-28b734ebccc7\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-chlh5" May 28 23:03:52.506392 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:52.506340 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/defb2d12-d7af-4230-9e37-28b734ebccc7-config\") pod \"service-ca-operator-57b5b68b8-chlh5\" (UID: \"defb2d12-d7af-4230-9e37-28b734ebccc7\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-chlh5" May 28 23:03:52.607793 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:52.607754 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/defb2d12-d7af-4230-9e37-28b734ebccc7-serving-cert\") pod \"service-ca-operator-57b5b68b8-chlh5\" (UID: \"defb2d12-d7af-4230-9e37-28b734ebccc7\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-chlh5" May 28 23:03:52.607966 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:52.607820 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zg8xl\" (UniqueName: \"kubernetes.io/projected/defb2d12-d7af-4230-9e37-28b734ebccc7-kube-api-access-zg8xl\") pod \"service-ca-operator-57b5b68b8-chlh5\" (UID: \"defb2d12-d7af-4230-9e37-28b734ebccc7\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-chlh5" May 28 23:03:52.607966 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:52.607863 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/defb2d12-d7af-4230-9e37-28b734ebccc7-config\") pod \"service-ca-operator-57b5b68b8-chlh5\" (UID: \"defb2d12-d7af-4230-9e37-28b734ebccc7\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-chlh5" May 28 23:03:52.608539 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:52.608515 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/defb2d12-d7af-4230-9e37-28b734ebccc7-config\") pod \"service-ca-operator-57b5b68b8-chlh5\" (UID: \"defb2d12-d7af-4230-9e37-28b734ebccc7\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-chlh5" May 28 23:03:52.610437 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:52.610413 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/defb2d12-d7af-4230-9e37-28b734ebccc7-serving-cert\") pod \"service-ca-operator-57b5b68b8-chlh5\" (UID: \"defb2d12-d7af-4230-9e37-28b734ebccc7\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-chlh5" May 28 23:03:52.616821 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:52.616802 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zg8xl\" (UniqueName: \"kubernetes.io/projected/defb2d12-d7af-4230-9e37-28b734ebccc7-kube-api-access-zg8xl\") pod \"service-ca-operator-57b5b68b8-chlh5\" (UID: \"defb2d12-d7af-4230-9e37-28b734ebccc7\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-chlh5" May 28 23:03:52.753824 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:52.753782 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-chlh5" May 28 23:03:52.875452 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:52.875387 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-chlh5"] May 28 23:03:52.878781 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:03:52.878748 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddefb2d12_d7af_4230_9e37_28b734ebccc7.slice/crio-58d358e414b9432847d297a1b8f673d2206d9df9067d1a434a41ec035baad119 WatchSource:0}: Error finding container 58d358e414b9432847d297a1b8f673d2206d9df9067d1a434a41ec035baad119: Status 404 returned error can't find the container with id 58d358e414b9432847d297a1b8f673d2206d9df9067d1a434a41ec035baad119 May 28 23:03:53.260928 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:53.260855 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-chlh5" event={"ID":"defb2d12-d7af-4230-9e37-28b734ebccc7","Type":"ContainerStarted","Data":"58d358e414b9432847d297a1b8f673d2206d9df9067d1a434a41ec035baad119"} May 28 23:03:54.015678 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:54.015646 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7cd955b9f7-w74w4"] May 28 23:03:54.017915 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:54.017889 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7cd955b9f7-w74w4" May 28 23:03:54.020473 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:54.020390 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 28 23:03:54.020988 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:54.020899 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 28 23:03:54.020988 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:54.020912 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 28 23:03:54.021166 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:54.020897 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-js77n\"" May 28 23:03:54.026250 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:54.026087 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 28 23:03:54.030628 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:54.030600 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7cd955b9f7-w74w4"] May 28 23:03:54.118671 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:54.118637 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/38466838-c402-4a49-a894-a96c827df8f5-registry-certificates\") pod \"image-registry-7cd955b9f7-w74w4\" (UID: \"38466838-c402-4a49-a894-a96c827df8f5\") " pod="openshift-image-registry/image-registry-7cd955b9f7-w74w4" May 28 23:03:54.118671 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:54.118682 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/38466838-c402-4a49-a894-a96c827df8f5-installation-pull-secrets\") pod \"image-registry-7cd955b9f7-w74w4\" (UID: \"38466838-c402-4a49-a894-a96c827df8f5\") " pod="openshift-image-registry/image-registry-7cd955b9f7-w74w4" May 28 23:03:54.118913 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:54.118716 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4wwl\" (UniqueName: \"kubernetes.io/projected/38466838-c402-4a49-a894-a96c827df8f5-kube-api-access-z4wwl\") pod \"image-registry-7cd955b9f7-w74w4\" (UID: \"38466838-c402-4a49-a894-a96c827df8f5\") " pod="openshift-image-registry/image-registry-7cd955b9f7-w74w4" May 28 23:03:54.118913 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:54.118777 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/38466838-c402-4a49-a894-a96c827df8f5-trusted-ca\") pod \"image-registry-7cd955b9f7-w74w4\" (UID: \"38466838-c402-4a49-a894-a96c827df8f5\") " pod="openshift-image-registry/image-registry-7cd955b9f7-w74w4" May 28 23:03:54.118913 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:54.118882 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/38466838-c402-4a49-a894-a96c827df8f5-registry-tls\") pod \"image-registry-7cd955b9f7-w74w4\" (UID: \"38466838-c402-4a49-a894-a96c827df8f5\") " pod="openshift-image-registry/image-registry-7cd955b9f7-w74w4" May 28 23:03:54.119092 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:54.119000 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/38466838-c402-4a49-a894-a96c827df8f5-image-registry-private-configuration\") pod \"image-registry-7cd955b9f7-w74w4\" (UID: \"38466838-c402-4a49-a894-a96c827df8f5\") " pod="openshift-image-registry/image-registry-7cd955b9f7-w74w4" May 28 23:03:54.119092 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:54.119035 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/38466838-c402-4a49-a894-a96c827df8f5-ca-trust-extracted\") pod \"image-registry-7cd955b9f7-w74w4\" (UID: \"38466838-c402-4a49-a894-a96c827df8f5\") " pod="openshift-image-registry/image-registry-7cd955b9f7-w74w4" May 28 23:03:54.119238 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:54.119218 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/38466838-c402-4a49-a894-a96c827df8f5-bound-sa-token\") pod \"image-registry-7cd955b9f7-w74w4\" (UID: \"38466838-c402-4a49-a894-a96c827df8f5\") " pod="openshift-image-registry/image-registry-7cd955b9f7-w74w4" May 28 23:03:54.220672 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:54.220592 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/38466838-c402-4a49-a894-a96c827df8f5-bound-sa-token\") pod \"image-registry-7cd955b9f7-w74w4\" (UID: \"38466838-c402-4a49-a894-a96c827df8f5\") " pod="openshift-image-registry/image-registry-7cd955b9f7-w74w4" May 28 23:03:54.220672 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:54.220640 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/38466838-c402-4a49-a894-a96c827df8f5-registry-certificates\") pod \"image-registry-7cd955b9f7-w74w4\" (UID: \"38466838-c402-4a49-a894-a96c827df8f5\") " pod="openshift-image-registry/image-registry-7cd955b9f7-w74w4" May 28 23:03:54.220672 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:54.220669 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/38466838-c402-4a49-a894-a96c827df8f5-installation-pull-secrets\") pod \"image-registry-7cd955b9f7-w74w4\" (UID: \"38466838-c402-4a49-a894-a96c827df8f5\") " pod="openshift-image-registry/image-registry-7cd955b9f7-w74w4" May 28 23:03:54.220919 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:54.220704 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z4wwl\" (UniqueName: \"kubernetes.io/projected/38466838-c402-4a49-a894-a96c827df8f5-kube-api-access-z4wwl\") pod \"image-registry-7cd955b9f7-w74w4\" (UID: \"38466838-c402-4a49-a894-a96c827df8f5\") " pod="openshift-image-registry/image-registry-7cd955b9f7-w74w4" May 28 23:03:54.220919 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:54.220733 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/38466838-c402-4a49-a894-a96c827df8f5-trusted-ca\") pod \"image-registry-7cd955b9f7-w74w4\" (UID: \"38466838-c402-4a49-a894-a96c827df8f5\") " pod="openshift-image-registry/image-registry-7cd955b9f7-w74w4" May 28 23:03:54.220919 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:54.220766 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/38466838-c402-4a49-a894-a96c827df8f5-registry-tls\") pod \"image-registry-7cd955b9f7-w74w4\" (UID: \"38466838-c402-4a49-a894-a96c827df8f5\") " pod="openshift-image-registry/image-registry-7cd955b9f7-w74w4" May 28 23:03:54.220919 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:54.220821 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/38466838-c402-4a49-a894-a96c827df8f5-image-registry-private-configuration\") pod \"image-registry-7cd955b9f7-w74w4\" (UID: \"38466838-c402-4a49-a894-a96c827df8f5\") " pod="openshift-image-registry/image-registry-7cd955b9f7-w74w4" May 28 23:03:54.220919 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:54.220851 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/38466838-c402-4a49-a894-a96c827df8f5-ca-trust-extracted\") pod \"image-registry-7cd955b9f7-w74w4\" (UID: \"38466838-c402-4a49-a894-a96c827df8f5\") " pod="openshift-image-registry/image-registry-7cd955b9f7-w74w4" May 28 23:03:54.221359 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:03:54.220961 2577 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 28 23:03:54.221359 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:03:54.220982 2577 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7cd955b9f7-w74w4: secret "image-registry-tls" not found May 28 23:03:54.221359 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:03:54.221042 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38466838-c402-4a49-a894-a96c827df8f5-registry-tls podName:38466838-c402-4a49-a894-a96c827df8f5 nodeName:}" failed. No retries permitted until 2026-05-28 23:03:54.721019791 +0000 UTC m=+92.328833732 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/38466838-c402-4a49-a894-a96c827df8f5-registry-tls") pod "image-registry-7cd955b9f7-w74w4" (UID: "38466838-c402-4a49-a894-a96c827df8f5") : secret "image-registry-tls" not found May 28 23:03:54.221359 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:54.221214 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/38466838-c402-4a49-a894-a96c827df8f5-ca-trust-extracted\") pod \"image-registry-7cd955b9f7-w74w4\" (UID: \"38466838-c402-4a49-a894-a96c827df8f5\") " pod="openshift-image-registry/image-registry-7cd955b9f7-w74w4" May 28 23:03:54.221359 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:54.221285 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/38466838-c402-4a49-a894-a96c827df8f5-registry-certificates\") pod \"image-registry-7cd955b9f7-w74w4\" (UID: \"38466838-c402-4a49-a894-a96c827df8f5\") " pod="openshift-image-registry/image-registry-7cd955b9f7-w74w4" May 28 23:03:54.221939 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:54.221914 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/38466838-c402-4a49-a894-a96c827df8f5-trusted-ca\") pod \"image-registry-7cd955b9f7-w74w4\" (UID: \"38466838-c402-4a49-a894-a96c827df8f5\") " pod="openshift-image-registry/image-registry-7cd955b9f7-w74w4" May 28 23:03:54.223235 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:54.223208 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/38466838-c402-4a49-a894-a96c827df8f5-installation-pull-secrets\") pod \"image-registry-7cd955b9f7-w74w4\" (UID: \"38466838-c402-4a49-a894-a96c827df8f5\") " pod="openshift-image-registry/image-registry-7cd955b9f7-w74w4" May 28 23:03:54.223446 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:54.223429 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/38466838-c402-4a49-a894-a96c827df8f5-image-registry-private-configuration\") pod \"image-registry-7cd955b9f7-w74w4\" (UID: \"38466838-c402-4a49-a894-a96c827df8f5\") " pod="openshift-image-registry/image-registry-7cd955b9f7-w74w4" May 28 23:03:54.230025 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:54.229999 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/38466838-c402-4a49-a894-a96c827df8f5-bound-sa-token\") pod \"image-registry-7cd955b9f7-w74w4\" (UID: \"38466838-c402-4a49-a894-a96c827df8f5\") " pod="openshift-image-registry/image-registry-7cd955b9f7-w74w4" May 28 23:03:54.230510 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:54.230490 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4wwl\" (UniqueName: \"kubernetes.io/projected/38466838-c402-4a49-a894-a96c827df8f5-kube-api-access-z4wwl\") pod \"image-registry-7cd955b9f7-w74w4\" (UID: \"38466838-c402-4a49-a894-a96c827df8f5\") " pod="openshift-image-registry/image-registry-7cd955b9f7-w74w4" May 28 23:03:54.263944 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:54.263919 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-tcvb6" event={"ID":"29f1d24b-cf80-4e23-afb2-4a4062509259","Type":"ContainerStarted","Data":"f89d133bafd892bbfdbf06a8f20772f602e3ea7f699a47abd65689a53ef18305"} May 28 23:03:54.279612 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:54.279571 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-tcvb6" podStartSLOduration=1.248496751 podStartE2EDuration="3.279559819s" podCreationTimestamp="2026-05-28 23:03:51 +0000 UTC" firstStartedPulling="2026-05-28 23:03:51.855863506 +0000 UTC m=+89.463677445" lastFinishedPulling="2026-05-28 23:03:53.886926559 +0000 UTC m=+91.494740513" observedRunningTime="2026-05-28 23:03:54.278959705 +0000 UTC m=+91.886773667" watchObservedRunningTime="2026-05-28 23:03:54.279559819 +0000 UTC m=+91.887373780" May 28 23:03:54.725427 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:54.725385 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/38466838-c402-4a49-a894-a96c827df8f5-registry-tls\") pod \"image-registry-7cd955b9f7-w74w4\" (UID: \"38466838-c402-4a49-a894-a96c827df8f5\") " pod="openshift-image-registry/image-registry-7cd955b9f7-w74w4" May 28 23:03:54.725624 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:03:54.725551 2577 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 28 23:03:54.725624 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:03:54.725572 2577 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7cd955b9f7-w74w4: secret "image-registry-tls" not found May 28 23:03:54.725743 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:03:54.725657 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38466838-c402-4a49-a894-a96c827df8f5-registry-tls podName:38466838-c402-4a49-a894-a96c827df8f5 nodeName:}" failed. No retries permitted until 2026-05-28 23:03:55.725636237 +0000 UTC m=+93.333450192 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/38466838-c402-4a49-a894-a96c827df8f5-registry-tls") pod "image-registry-7cd955b9f7-w74w4" (UID: "38466838-c402-4a49-a894-a96c827df8f5") : secret "image-registry-tls" not found May 28 23:03:55.267504 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:55.267414 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-chlh5" event={"ID":"defb2d12-d7af-4230-9e37-28b734ebccc7","Type":"ContainerStarted","Data":"8c955f5054827aef20f23b5b9ba62daa20c3fa06641cc1d13c8a37e2d7648593"} May 28 23:03:55.285570 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:55.285528 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-chlh5" podStartSLOduration=1.180058779 podStartE2EDuration="3.285510794s" podCreationTimestamp="2026-05-28 23:03:52 +0000 UTC" firstStartedPulling="2026-05-28 23:03:52.881053719 +0000 UTC m=+90.488867669" lastFinishedPulling="2026-05-28 23:03:54.98650573 +0000 UTC m=+92.594319684" observedRunningTime="2026-05-28 23:03:55.28526541 +0000 UTC m=+92.893079372" watchObservedRunningTime="2026-05-28 23:03:55.285510794 +0000 UTC m=+92.893324757" May 28 23:03:55.733639 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:55.733600 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/38466838-c402-4a49-a894-a96c827df8f5-registry-tls\") pod \"image-registry-7cd955b9f7-w74w4\" (UID: \"38466838-c402-4a49-a894-a96c827df8f5\") " pod="openshift-image-registry/image-registry-7cd955b9f7-w74w4" May 28 23:03:55.733796 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:03:55.733746 2577 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 28 23:03:55.733796 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:03:55.733765 2577 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7cd955b9f7-w74w4: secret "image-registry-tls" not found May 28 23:03:55.733893 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:03:55.733821 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38466838-c402-4a49-a894-a96c827df8f5-registry-tls podName:38466838-c402-4a49-a894-a96c827df8f5 nodeName:}" failed. No retries permitted until 2026-05-28 23:03:57.73380505 +0000 UTC m=+95.341618988 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/38466838-c402-4a49-a894-a96c827df8f5-registry-tls") pod "image-registry-7cd955b9f7-w74w4" (UID: "38466838-c402-4a49-a894-a96c827df8f5") : secret "image-registry-tls" not found May 28 23:03:57.748507 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:57.748467 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/38466838-c402-4a49-a894-a96c827df8f5-registry-tls\") pod \"image-registry-7cd955b9f7-w74w4\" (UID: \"38466838-c402-4a49-a894-a96c827df8f5\") " pod="openshift-image-registry/image-registry-7cd955b9f7-w74w4" May 28 23:03:57.748920 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:03:57.748626 2577 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 28 23:03:57.748920 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:03:57.748641 2577 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7cd955b9f7-w74w4: secret "image-registry-tls" not found May 28 23:03:57.748920 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:03:57.748699 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38466838-c402-4a49-a894-a96c827df8f5-registry-tls podName:38466838-c402-4a49-a894-a96c827df8f5 nodeName:}" failed. No retries permitted until 2026-05-28 23:04:01.748682645 +0000 UTC m=+99.356496591 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/38466838-c402-4a49-a894-a96c827df8f5-registry-tls") pod "image-registry-7cd955b9f7-w74w4" (UID: "38466838-c402-4a49-a894-a96c827df8f5") : secret "image-registry-tls" not found May 28 23:03:58.252954 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:58.252909 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99deffb2-8926-48e6-ba16-b3807f87aa5d-metrics-certs\") pod \"router-default-7cc6ddd568-pltq6\" (UID: \"99deffb2-8926-48e6-ba16-b3807f87aa5d\") " pod="openshift-ingress/router-default-7cc6ddd568-pltq6" May 28 23:03:58.253162 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:03:58.252982 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99deffb2-8926-48e6-ba16-b3807f87aa5d-service-ca-bundle\") pod \"router-default-7cc6ddd568-pltq6\" (UID: \"99deffb2-8926-48e6-ba16-b3807f87aa5d\") " pod="openshift-ingress/router-default-7cc6ddd568-pltq6" May 28 23:03:58.253162 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:03:58.253085 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 28 23:03:58.253162 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:03:58.253101 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/99deffb2-8926-48e6-ba16-b3807f87aa5d-service-ca-bundle podName:99deffb2-8926-48e6-ba16-b3807f87aa5d nodeName:}" failed. No retries permitted until 2026-05-28 23:04:14.253087059 +0000 UTC m=+111.860900997 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/99deffb2-8926-48e6-ba16-b3807f87aa5d-service-ca-bundle") pod "router-default-7cc6ddd568-pltq6" (UID: "99deffb2-8926-48e6-ba16-b3807f87aa5d") : configmap references non-existent config key: service-ca.crt May 28 23:03:58.253162 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:03:58.253155 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99deffb2-8926-48e6-ba16-b3807f87aa5d-metrics-certs podName:99deffb2-8926-48e6-ba16-b3807f87aa5d nodeName:}" failed. No retries permitted until 2026-05-28 23:04:14.253141608 +0000 UTC m=+111.860955547 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/99deffb2-8926-48e6-ba16-b3807f87aa5d-metrics-certs") pod "router-default-7cc6ddd568-pltq6" (UID: "99deffb2-8926-48e6-ba16-b3807f87aa5d") : secret "router-metrics-certs-default" not found May 28 23:04:00.671209 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:00.671160 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e662546-4260-4167-aafa-19b834be1588-metrics-tls\") pod \"dns-default-8zr45\" (UID: \"4e662546-4260-4167-aafa-19b834be1588\") " pod="openshift-dns/dns-default-8zr45" May 28 23:04:00.671209 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:00.671211 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d2ec4e04-45b6-4bf3-9268-8e7799549fef-cert\") pod \"ingress-canary-hs47z\" (UID: \"d2ec4e04-45b6-4bf3-9268-8e7799549fef\") " pod="openshift-ingress-canary/ingress-canary-hs47z" May 28 23:04:00.671702 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:04:00.671313 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 28 23:04:00.671702 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:04:00.671327 2577 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 28 23:04:00.671702 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:04:00.671381 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2ec4e04-45b6-4bf3-9268-8e7799549fef-cert podName:d2ec4e04-45b6-4bf3-9268-8e7799549fef nodeName:}" failed. No retries permitted until 2026-05-28 23:05:04.671366288 +0000 UTC m=+162.279180227 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d2ec4e04-45b6-4bf3-9268-8e7799549fef-cert") pod "ingress-canary-hs47z" (UID: "d2ec4e04-45b6-4bf3-9268-8e7799549fef") : secret "canary-serving-cert" not found May 28 23:04:00.671702 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:04:00.671394 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e662546-4260-4167-aafa-19b834be1588-metrics-tls podName:4e662546-4260-4167-aafa-19b834be1588 nodeName:}" failed. No retries permitted until 2026-05-28 23:05:04.67138815 +0000 UTC m=+162.279202088 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4e662546-4260-4167-aafa-19b834be1588-metrics-tls") pod "dns-default-8zr45" (UID: "4e662546-4260-4167-aafa-19b834be1588") : secret "dns-default-metrics-tls" not found May 28 23:04:01.778309 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:01.778272 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/38466838-c402-4a49-a894-a96c827df8f5-registry-tls\") pod \"image-registry-7cd955b9f7-w74w4\" (UID: \"38466838-c402-4a49-a894-a96c827df8f5\") " pod="openshift-image-registry/image-registry-7cd955b9f7-w74w4" May 28 23:04:01.778671 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:04:01.778431 2577 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 28 23:04:01.778671 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:04:01.778447 2577 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7cd955b9f7-w74w4: secret "image-registry-tls" not found May 28 23:04:01.778671 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:04:01.778505 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38466838-c402-4a49-a894-a96c827df8f5-registry-tls podName:38466838-c402-4a49-a894-a96c827df8f5 nodeName:}" failed. No retries permitted until 2026-05-28 23:04:09.778488179 +0000 UTC m=+107.386302121 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/38466838-c402-4a49-a894-a96c827df8f5-registry-tls") pod "image-registry-7cd955b9f7-w74w4" (UID: "38466838-c402-4a49-a894-a96c827df8f5") : secret "image-registry-tls" not found May 28 23:04:04.225334 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:04.225290 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-sqr58" May 28 23:04:09.839714 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:09.839680 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/38466838-c402-4a49-a894-a96c827df8f5-registry-tls\") pod \"image-registry-7cd955b9f7-w74w4\" (UID: \"38466838-c402-4a49-a894-a96c827df8f5\") " pod="openshift-image-registry/image-registry-7cd955b9f7-w74w4" May 28 23:04:09.842051 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:09.842030 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/38466838-c402-4a49-a894-a96c827df8f5-registry-tls\") pod \"image-registry-7cd955b9f7-w74w4\" (UID: \"38466838-c402-4a49-a894-a96c827df8f5\") " pod="openshift-image-registry/image-registry-7cd955b9f7-w74w4" May 28 23:04:09.929848 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:09.929818 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7cd955b9f7-w74w4" May 28 23:04:10.048346 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:10.048319 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7cd955b9f7-w74w4"] May 28 23:04:10.050995 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:04:10.050959 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38466838_c402_4a49_a894_a96c827df8f5.slice/crio-6cf61f62daa0575c05131dfb1258fe44b5dae1dee52566960a35d29fe4335562 WatchSource:0}: Error finding container 6cf61f62daa0575c05131dfb1258fe44b5dae1dee52566960a35d29fe4335562: Status 404 returned error can't find the container with id 6cf61f62daa0575c05131dfb1258fe44b5dae1dee52566960a35d29fe4335562 May 28 23:04:10.299240 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:10.299198 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7cd955b9f7-w74w4" event={"ID":"38466838-c402-4a49-a894-a96c827df8f5","Type":"ContainerStarted","Data":"692b8989842b01827224848e2688abc865af94df4aba26991ffab9ccead140f6"} May 28 23:04:10.299240 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:10.299244 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7cd955b9f7-w74w4" event={"ID":"38466838-c402-4a49-a894-a96c827df8f5","Type":"ContainerStarted","Data":"6cf61f62daa0575c05131dfb1258fe44b5dae1dee52566960a35d29fe4335562"} May 28 23:04:10.299478 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:10.299323 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7cd955b9f7-w74w4" May 28 23:04:10.319970 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:10.319920 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7cd955b9f7-w74w4" podStartSLOduration=16.319907822 podStartE2EDuration="16.319907822s" podCreationTimestamp="2026-05-28 23:03:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 23:04:10.318907184 +0000 UTC m=+107.926721146" watchObservedRunningTime="2026-05-28 23:04:10.319907822 +0000 UTC m=+107.927721784" May 28 23:04:14.272031 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:14.271998 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99deffb2-8926-48e6-ba16-b3807f87aa5d-service-ca-bundle\") pod \"router-default-7cc6ddd568-pltq6\" (UID: \"99deffb2-8926-48e6-ba16-b3807f87aa5d\") " pod="openshift-ingress/router-default-7cc6ddd568-pltq6" May 28 23:04:14.272385 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:14.272083 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99deffb2-8926-48e6-ba16-b3807f87aa5d-metrics-certs\") pod \"router-default-7cc6ddd568-pltq6\" (UID: \"99deffb2-8926-48e6-ba16-b3807f87aa5d\") " pod="openshift-ingress/router-default-7cc6ddd568-pltq6" May 28 23:04:14.272575 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:14.272555 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99deffb2-8926-48e6-ba16-b3807f87aa5d-service-ca-bundle\") pod \"router-default-7cc6ddd568-pltq6\" (UID: \"99deffb2-8926-48e6-ba16-b3807f87aa5d\") " pod="openshift-ingress/router-default-7cc6ddd568-pltq6" May 28 23:04:14.274189 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:14.274173 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99deffb2-8926-48e6-ba16-b3807f87aa5d-metrics-certs\") pod \"router-default-7cc6ddd568-pltq6\" (UID: \"99deffb2-8926-48e6-ba16-b3807f87aa5d\") " pod="openshift-ingress/router-default-7cc6ddd568-pltq6" May 28 23:04:14.571090 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:14.571040 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7cc6ddd568-pltq6" May 28 23:04:14.690809 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:14.690770 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7cc6ddd568-pltq6"] May 28 23:04:14.695306 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:04:14.695271 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99deffb2_8926_48e6_ba16_b3807f87aa5d.slice/crio-225e7b33b6bca7456cfef180bcf4fe859b65c2b4e65460edd1a6681f0dcbad1f WatchSource:0}: Error finding container 225e7b33b6bca7456cfef180bcf4fe859b65c2b4e65460edd1a6681f0dcbad1f: Status 404 returned error can't find the container with id 225e7b33b6bca7456cfef180bcf4fe859b65c2b4e65460edd1a6681f0dcbad1f May 28 23:04:15.310476 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:15.310436 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7cc6ddd568-pltq6" event={"ID":"99deffb2-8926-48e6-ba16-b3807f87aa5d","Type":"ContainerStarted","Data":"a2d1b3627c5863266266fd4d377d0b94760f49a727b1a695530afa4ef2a16826"} May 28 23:04:15.310476 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:15.310470 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7cc6ddd568-pltq6" event={"ID":"99deffb2-8926-48e6-ba16-b3807f87aa5d","Type":"ContainerStarted","Data":"225e7b33b6bca7456cfef180bcf4fe859b65c2b4e65460edd1a6681f0dcbad1f"} May 28 23:04:15.328207 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:15.328162 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-7cc6ddd568-pltq6" podStartSLOduration=33.328149417 podStartE2EDuration="33.328149417s" podCreationTimestamp="2026-05-28 23:03:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 23:04:15.327678154 +0000 UTC m=+112.935492281" watchObservedRunningTime="2026-05-28 23:04:15.328149417 +0000 UTC m=+112.935963378" May 28 23:04:15.571700 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:15.571624 2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7cc6ddd568-pltq6" May 28 23:04:15.574159 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:15.574136 2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7cc6ddd568-pltq6" May 28 23:04:16.314160 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:16.314127 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7cc6ddd568-pltq6" May 28 23:04:16.315344 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:16.315322 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7cc6ddd568-pltq6" May 28 23:04:21.670788 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:21.670757 2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7cd955b9f7-w74w4"] May 28 23:04:21.701913 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:21.701885 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5bb668dbdb-9b9km"] May 28 23:04:21.705704 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:21.705683 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bb668dbdb-9b9km" May 28 23:04:21.726432 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:21.726409 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5bb668dbdb-9b9km"] May 28 23:04:21.763570 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:21.763543 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-6hg9m"] May 28 23:04:21.766897 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:21.766879 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6hg9m" May 28 23:04:21.771046 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:21.771028 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 28 23:04:21.771180 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:21.771106 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 28 23:04:21.771243 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:21.771202 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qd2hv\"" May 28 23:04:21.810257 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:21.810229 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6hg9m"] May 28 23:04:21.827475 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:21.827442 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/02a2b450-c415-489b-8510-c98d35df0795-image-registry-private-configuration\") pod \"image-registry-5bb668dbdb-9b9km\" (UID: \"02a2b450-c415-489b-8510-c98d35df0795\") " pod="openshift-image-registry/image-registry-5bb668dbdb-9b9km" May 28 23:04:21.827628 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:21.827485 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/24887236-2901-427f-8442-b82b07f3313b-data-volume\") pod \"insights-runtime-extractor-6hg9m\" (UID: \"24887236-2901-427f-8442-b82b07f3313b\") " pod="openshift-insights/insights-runtime-extractor-6hg9m" May 28 23:04:21.827628 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:21.827511 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46kl6\" (UniqueName: \"kubernetes.io/projected/24887236-2901-427f-8442-b82b07f3313b-kube-api-access-46kl6\") pod \"insights-runtime-extractor-6hg9m\" (UID: \"24887236-2901-427f-8442-b82b07f3313b\") " pod="openshift-insights/insights-runtime-extractor-6hg9m" May 28 23:04:21.827628 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:21.827579 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/02a2b450-c415-489b-8510-c98d35df0795-ca-trust-extracted\") pod \"image-registry-5bb668dbdb-9b9km\" (UID: \"02a2b450-c415-489b-8510-c98d35df0795\") " pod="openshift-image-registry/image-registry-5bb668dbdb-9b9km" May 28 23:04:21.827628 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:21.827607 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/02a2b450-c415-489b-8510-c98d35df0795-registry-certificates\") pod \"image-registry-5bb668dbdb-9b9km\" (UID: \"02a2b450-c415-489b-8510-c98d35df0795\") " pod="openshift-image-registry/image-registry-5bb668dbdb-9b9km" May 28 23:04:21.827835 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:21.827630 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/24887236-2901-427f-8442-b82b07f3313b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6hg9m\" (UID: \"24887236-2901-427f-8442-b82b07f3313b\") " pod="openshift-insights/insights-runtime-extractor-6hg9m" May 28 23:04:21.827835 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:21.827682 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/02a2b450-c415-489b-8510-c98d35df0795-bound-sa-token\") pod \"image-registry-5bb668dbdb-9b9km\" (UID: \"02a2b450-c415-489b-8510-c98d35df0795\") " pod="openshift-image-registry/image-registry-5bb668dbdb-9b9km" May 28 23:04:21.827835 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:21.827716 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/02a2b450-c415-489b-8510-c98d35df0795-installation-pull-secrets\") pod \"image-registry-5bb668dbdb-9b9km\" (UID: \"02a2b450-c415-489b-8510-c98d35df0795\") " pod="openshift-image-registry/image-registry-5bb668dbdb-9b9km" May 28 23:04:21.827835 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:21.827757 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/24887236-2901-427f-8442-b82b07f3313b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6hg9m\" (UID: \"24887236-2901-427f-8442-b82b07f3313b\") " pod="openshift-insights/insights-runtime-extractor-6hg9m" May 28 23:04:21.827835 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:21.827798 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqzzl\" (UniqueName: \"kubernetes.io/projected/02a2b450-c415-489b-8510-c98d35df0795-kube-api-access-nqzzl\") pod \"image-registry-5bb668dbdb-9b9km\" (UID: \"02a2b450-c415-489b-8510-c98d35df0795\") " pod="openshift-image-registry/image-registry-5bb668dbdb-9b9km" May 28 23:04:21.828003 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:21.827863 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/24887236-2901-427f-8442-b82b07f3313b-crio-socket\") pod \"insights-runtime-extractor-6hg9m\" (UID: \"24887236-2901-427f-8442-b82b07f3313b\") " pod="openshift-insights/insights-runtime-extractor-6hg9m" May 28 23:04:21.828003 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:21.827888 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/02a2b450-c415-489b-8510-c98d35df0795-registry-tls\") pod \"image-registry-5bb668dbdb-9b9km\" (UID: \"02a2b450-c415-489b-8510-c98d35df0795\") " pod="openshift-image-registry/image-registry-5bb668dbdb-9b9km" May 28 23:04:21.828003 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:21.827907 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/02a2b450-c415-489b-8510-c98d35df0795-trusted-ca\") pod \"image-registry-5bb668dbdb-9b9km\" (UID: \"02a2b450-c415-489b-8510-c98d35df0795\") " pod="openshift-image-registry/image-registry-5bb668dbdb-9b9km" May 28 23:04:21.928486 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:21.928403 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/02a2b450-c415-489b-8510-c98d35df0795-image-registry-private-configuration\") pod \"image-registry-5bb668dbdb-9b9km\" (UID: \"02a2b450-c415-489b-8510-c98d35df0795\") " pod="openshift-image-registry/image-registry-5bb668dbdb-9b9km" May 28 23:04:21.928486 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:21.928445 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/24887236-2901-427f-8442-b82b07f3313b-data-volume\") pod \"insights-runtime-extractor-6hg9m\" (UID: \"24887236-2901-427f-8442-b82b07f3313b\") " pod="openshift-insights/insights-runtime-extractor-6hg9m" May 28 23:04:21.928486 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:21.928474 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-46kl6\" (UniqueName: \"kubernetes.io/projected/24887236-2901-427f-8442-b82b07f3313b-kube-api-access-46kl6\") pod \"insights-runtime-extractor-6hg9m\" (UID: \"24887236-2901-427f-8442-b82b07f3313b\") " pod="openshift-insights/insights-runtime-extractor-6hg9m" May 28 23:04:21.928761 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:21.928512 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/02a2b450-c415-489b-8510-c98d35df0795-ca-trust-extracted\") pod \"image-registry-5bb668dbdb-9b9km\" (UID: \"02a2b450-c415-489b-8510-c98d35df0795\") " pod="openshift-image-registry/image-registry-5bb668dbdb-9b9km" May 28 23:04:21.928761 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:21.928540 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/02a2b450-c415-489b-8510-c98d35df0795-registry-certificates\") pod \"image-registry-5bb668dbdb-9b9km\" (UID: \"02a2b450-c415-489b-8510-c98d35df0795\") " pod="openshift-image-registry/image-registry-5bb668dbdb-9b9km" May 28 23:04:21.928761 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:21.928571 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/24887236-2901-427f-8442-b82b07f3313b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6hg9m\" (UID: \"24887236-2901-427f-8442-b82b07f3313b\") " pod="openshift-insights/insights-runtime-extractor-6hg9m" May 28 23:04:21.928761 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:21.928744 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/02a2b450-c415-489b-8510-c98d35df0795-bound-sa-token\") pod \"image-registry-5bb668dbdb-9b9km\" (UID: \"02a2b450-c415-489b-8510-c98d35df0795\") " pod="openshift-image-registry/image-registry-5bb668dbdb-9b9km" May 28 23:04:21.928961 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:21.928793 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/02a2b450-c415-489b-8510-c98d35df0795-installation-pull-secrets\") pod \"image-registry-5bb668dbdb-9b9km\" (UID: \"02a2b450-c415-489b-8510-c98d35df0795\") " pod="openshift-image-registry/image-registry-5bb668dbdb-9b9km" May 28 23:04:21.928961 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:21.928846 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/24887236-2901-427f-8442-b82b07f3313b-data-volume\") pod \"insights-runtime-extractor-6hg9m\" (UID: \"24887236-2901-427f-8442-b82b07f3313b\") " pod="openshift-insights/insights-runtime-extractor-6hg9m" May 28 23:04:21.928961 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:21.928849 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/24887236-2901-427f-8442-b82b07f3313b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6hg9m\" (UID: \"24887236-2901-427f-8442-b82b07f3313b\") " pod="openshift-insights/insights-runtime-extractor-6hg9m" May 28 23:04:21.928961 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:21.928921 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nqzzl\" (UniqueName: \"kubernetes.io/projected/02a2b450-c415-489b-8510-c98d35df0795-kube-api-access-nqzzl\") pod \"image-registry-5bb668dbdb-9b9km\" (UID: \"02a2b450-c415-489b-8510-c98d35df0795\") " pod="openshift-image-registry/image-registry-5bb668dbdb-9b9km" May 28 23:04:21.929181 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:21.928967 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/24887236-2901-427f-8442-b82b07f3313b-crio-socket\") pod \"insights-runtime-extractor-6hg9m\" (UID: \"24887236-2901-427f-8442-b82b07f3313b\") " pod="openshift-insights/insights-runtime-extractor-6hg9m" May 28 23:04:21.929181 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:21.928994 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/02a2b450-c415-489b-8510-c98d35df0795-registry-tls\") pod \"image-registry-5bb668dbdb-9b9km\" (UID: \"02a2b450-c415-489b-8510-c98d35df0795\") " pod="openshift-image-registry/image-registry-5bb668dbdb-9b9km" May 28 23:04:21.929181 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:21.929025 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/02a2b450-c415-489b-8510-c98d35df0795-trusted-ca\") pod \"image-registry-5bb668dbdb-9b9km\" (UID: \"02a2b450-c415-489b-8510-c98d35df0795\") " pod="openshift-image-registry/image-registry-5bb668dbdb-9b9km" May 28 23:04:21.929343 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:21.929282 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/24887236-2901-427f-8442-b82b07f3313b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6hg9m\" (UID: \"24887236-2901-427f-8442-b82b07f3313b\") " pod="openshift-insights/insights-runtime-extractor-6hg9m" May 28 23:04:21.929343 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:21.929297 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/24887236-2901-427f-8442-b82b07f3313b-crio-socket\") pod \"insights-runtime-extractor-6hg9m\" (UID: \"24887236-2901-427f-8442-b82b07f3313b\") " pod="openshift-insights/insights-runtime-extractor-6hg9m" May 28 23:04:21.929609 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:21.929584 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/02a2b450-c415-489b-8510-c98d35df0795-registry-certificates\") pod \"image-registry-5bb668dbdb-9b9km\" (UID: \"02a2b450-c415-489b-8510-c98d35df0795\") " pod="openshift-image-registry/image-registry-5bb668dbdb-9b9km" May 28 23:04:21.929715 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:21.929642 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/02a2b450-c415-489b-8510-c98d35df0795-ca-trust-extracted\") pod \"image-registry-5bb668dbdb-9b9km\" (UID: \"02a2b450-c415-489b-8510-c98d35df0795\") " pod="openshift-image-registry/image-registry-5bb668dbdb-9b9km" May 28 23:04:21.929934 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:21.929913 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/02a2b450-c415-489b-8510-c98d35df0795-trusted-ca\") pod \"image-registry-5bb668dbdb-9b9km\" (UID: \"02a2b450-c415-489b-8510-c98d35df0795\") " pod="openshift-image-registry/image-registry-5bb668dbdb-9b9km" May 28 23:04:21.931225 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:21.931194 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/24887236-2901-427f-8442-b82b07f3313b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6hg9m\" (UID: \"24887236-2901-427f-8442-b82b07f3313b\") " pod="openshift-insights/insights-runtime-extractor-6hg9m" May 28 23:04:21.931335 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:21.931244 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/02a2b450-c415-489b-8510-c98d35df0795-image-registry-private-configuration\") pod \"image-registry-5bb668dbdb-9b9km\" (UID: \"02a2b450-c415-489b-8510-c98d35df0795\") " pod="openshift-image-registry/image-registry-5bb668dbdb-9b9km" May 28 23:04:21.931335 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:21.931291 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/02a2b450-c415-489b-8510-c98d35df0795-installation-pull-secrets\") pod \"image-registry-5bb668dbdb-9b9km\" (UID: \"02a2b450-c415-489b-8510-c98d35df0795\") " pod="openshift-image-registry/image-registry-5bb668dbdb-9b9km" May 28 23:04:21.931689 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:21.931669 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/02a2b450-c415-489b-8510-c98d35df0795-registry-tls\") pod \"image-registry-5bb668dbdb-9b9km\" (UID: \"02a2b450-c415-489b-8510-c98d35df0795\") " pod="openshift-image-registry/image-registry-5bb668dbdb-9b9km" May 28 23:04:21.938495 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:21.938472 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/02a2b450-c415-489b-8510-c98d35df0795-bound-sa-token\") pod \"image-registry-5bb668dbdb-9b9km\" (UID: \"02a2b450-c415-489b-8510-c98d35df0795\") " pod="openshift-image-registry/image-registry-5bb668dbdb-9b9km" May 28 23:04:21.938614 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:21.938571 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-46kl6\" (UniqueName: \"kubernetes.io/projected/24887236-2901-427f-8442-b82b07f3313b-kube-api-access-46kl6\") pod \"insights-runtime-extractor-6hg9m\" (UID: \"24887236-2901-427f-8442-b82b07f3313b\") " pod="openshift-insights/insights-runtime-extractor-6hg9m" May 28 23:04:21.938898 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:21.938872 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqzzl\" (UniqueName: \"kubernetes.io/projected/02a2b450-c415-489b-8510-c98d35df0795-kube-api-access-nqzzl\") pod \"image-registry-5bb668dbdb-9b9km\" (UID: \"02a2b450-c415-489b-8510-c98d35df0795\") " pod="openshift-image-registry/image-registry-5bb668dbdb-9b9km" May 28 23:04:22.014208 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:22.014186 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bb668dbdb-9b9km" May 28 23:04:22.076683 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:22.076648 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6hg9m" May 28 23:04:22.140276 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:22.140224 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5bb668dbdb-9b9km"] May 28 23:04:22.148474 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:04:22.144897 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02a2b450_c415_489b_8510_c98d35df0795.slice/crio-2c767ac2e0ca9966674dad5ff1717e6041e8c8a391c0f4a28247e8a8cc500e49 WatchSource:0}: Error finding container 2c767ac2e0ca9966674dad5ff1717e6041e8c8a391c0f4a28247e8a8cc500e49: Status 404 returned error can't find the container with id 2c767ac2e0ca9966674dad5ff1717e6041e8c8a391c0f4a28247e8a8cc500e49 May 28 23:04:22.203267 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:22.203240 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6hg9m"] May 28 23:04:22.205318 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:04:22.205294 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24887236_2901_427f_8442_b82b07f3313b.slice/crio-9fbf7ac44c4fbd835dcfa93f80b9c743e3a051f89a03539420a8e7ff64f99cbf WatchSource:0}: Error finding container 9fbf7ac44c4fbd835dcfa93f80b9c743e3a051f89a03539420a8e7ff64f99cbf: Status 404 returned error can't find the container with id 9fbf7ac44c4fbd835dcfa93f80b9c743e3a051f89a03539420a8e7ff64f99cbf May 28 23:04:22.333430 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:22.333394 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bb668dbdb-9b9km" event={"ID":"02a2b450-c415-489b-8510-c98d35df0795","Type":"ContainerStarted","Data":"6ec359868a84460ef6faf6bf7b153678c71eb7365e361a9fa9cdc6d1082f3ea5"} May 28 23:04:22.333596 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:22.333435 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bb668dbdb-9b9km" event={"ID":"02a2b450-c415-489b-8510-c98d35df0795","Type":"ContainerStarted","Data":"2c767ac2e0ca9966674dad5ff1717e6041e8c8a391c0f4a28247e8a8cc500e49"} May 28 23:04:22.333596 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:22.333487 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5bb668dbdb-9b9km" May 28 23:04:22.336667 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:22.336640 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6hg9m" event={"ID":"24887236-2901-427f-8442-b82b07f3313b","Type":"ContainerStarted","Data":"b0430c6f02f91480ae65fca426b675c6cffe77d9a9f9896f5e41431cd2694907"} May 28 23:04:22.336778 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:22.336674 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6hg9m" event={"ID":"24887236-2901-427f-8442-b82b07f3313b","Type":"ContainerStarted","Data":"9fbf7ac44c4fbd835dcfa93f80b9c743e3a051f89a03539420a8e7ff64f99cbf"} May 28 23:04:22.353120 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:22.353054 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5bb668dbdb-9b9km" podStartSLOduration=1.3530362089999999 podStartE2EDuration="1.353036209s" podCreationTimestamp="2026-05-28 23:04:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 23:04:22.352217516 +0000 UTC m=+119.960031482" watchObservedRunningTime="2026-05-28 23:04:22.353036209 +0000 UTC m=+119.960850170" May 28 23:04:23.340661 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:23.340626 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6hg9m" event={"ID":"24887236-2901-427f-8442-b82b07f3313b","Type":"ContainerStarted","Data":"73e2fdab2e7e43513574849c62b00f25cf06218b4559b686c6d885a002430727"} May 28 23:04:24.144778 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:24.144745 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-48nqd"] May 28 23:04:24.148183 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:24.148161 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-48nqd" May 28 23:04:24.155368 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:24.155233 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 28 23:04:24.155368 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:24.155243 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" May 28 23:04:24.155368 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:24.155337 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 28 23:04:24.155616 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:24.155503 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" May 28 23:04:24.155762 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:24.155746 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-96b6b\"" May 28 23:04:24.156312 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:24.156290 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 28 23:04:24.160895 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:24.160864 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-48nqd"] May 28 23:04:24.247691 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:24.247655 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lc9bq\" (UniqueName: \"kubernetes.io/projected/0ed53912-4021-4728-9a9a-a34adc8cda68-kube-api-access-lc9bq\") pod \"prometheus-operator-7779bbdd78-48nqd\" (UID: \"0ed53912-4021-4728-9a9a-a34adc8cda68\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-48nqd" May 28 23:04:24.247858 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:24.247711 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0ed53912-4021-4728-9a9a-a34adc8cda68-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-48nqd\" (UID: \"0ed53912-4021-4728-9a9a-a34adc8cda68\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-48nqd" May 28 23:04:24.247858 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:24.247796 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ed53912-4021-4728-9a9a-a34adc8cda68-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-48nqd\" (UID: \"0ed53912-4021-4728-9a9a-a34adc8cda68\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-48nqd" May 28 23:04:24.247858 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:24.247828 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0ed53912-4021-4728-9a9a-a34adc8cda68-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-48nqd\" (UID: \"0ed53912-4021-4728-9a9a-a34adc8cda68\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-48nqd" May 28 23:04:24.348640 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:24.348570 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ed53912-4021-4728-9a9a-a34adc8cda68-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-48nqd\" (UID: \"0ed53912-4021-4728-9a9a-a34adc8cda68\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-48nqd" May 28 23:04:24.349146 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:24.348657 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0ed53912-4021-4728-9a9a-a34adc8cda68-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-48nqd\" (UID: \"0ed53912-4021-4728-9a9a-a34adc8cda68\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-48nqd" May 28 23:04:24.349146 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:24.348725 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lc9bq\" (UniqueName: \"kubernetes.io/projected/0ed53912-4021-4728-9a9a-a34adc8cda68-kube-api-access-lc9bq\") pod \"prometheus-operator-7779bbdd78-48nqd\" (UID: \"0ed53912-4021-4728-9a9a-a34adc8cda68\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-48nqd" May 28 23:04:24.349146 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:24.348767 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0ed53912-4021-4728-9a9a-a34adc8cda68-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-48nqd\" (UID: \"0ed53912-4021-4728-9a9a-a34adc8cda68\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-48nqd" May 28 23:04:24.349146 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:04:24.348892 2577 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found May 28 23:04:24.349146 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:04:24.348955 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ed53912-4021-4728-9a9a-a34adc8cda68-prometheus-operator-tls podName:0ed53912-4021-4728-9a9a-a34adc8cda68 nodeName:}" failed. No retries permitted until 2026-05-28 23:04:24.848933917 +0000 UTC m=+122.456747857 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/0ed53912-4021-4728-9a9a-a34adc8cda68-prometheus-operator-tls") pod "prometheus-operator-7779bbdd78-48nqd" (UID: "0ed53912-4021-4728-9a9a-a34adc8cda68") : secret "prometheus-operator-tls" not found May 28 23:04:24.349400 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:24.349336 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ed53912-4021-4728-9a9a-a34adc8cda68-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-48nqd\" (UID: \"0ed53912-4021-4728-9a9a-a34adc8cda68\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-48nqd" May 28 23:04:24.351552 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:24.351528 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0ed53912-4021-4728-9a9a-a34adc8cda68-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-48nqd\" (UID: \"0ed53912-4021-4728-9a9a-a34adc8cda68\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-48nqd" May 28 23:04:24.359901 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:24.359876 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lc9bq\" (UniqueName: \"kubernetes.io/projected/0ed53912-4021-4728-9a9a-a34adc8cda68-kube-api-access-lc9bq\") pod \"prometheus-operator-7779bbdd78-48nqd\" (UID: \"0ed53912-4021-4728-9a9a-a34adc8cda68\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-48nqd" May 28 23:04:24.853431 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:24.853406 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0ed53912-4021-4728-9a9a-a34adc8cda68-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-48nqd\" (UID: \"0ed53912-4021-4728-9a9a-a34adc8cda68\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-48nqd" May 28 23:04:24.855686 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:24.855657 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0ed53912-4021-4728-9a9a-a34adc8cda68-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-48nqd\" (UID: \"0ed53912-4021-4728-9a9a-a34adc8cda68\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-48nqd" May 28 23:04:25.057608 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:25.057582 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-48nqd" May 28 23:04:25.173725 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:25.173696 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-48nqd"] May 28 23:04:25.176435 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:04:25.176409 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ed53912_4021_4728_9a9a_a34adc8cda68.slice/crio-b4d8f78853f7cc181beb5ad973d6adec4e50753e9d3d4f758f4fa83f3acf2a59 WatchSource:0}: Error finding container b4d8f78853f7cc181beb5ad973d6adec4e50753e9d3d4f758f4fa83f3acf2a59: Status 404 returned error can't find the container with id b4d8f78853f7cc181beb5ad973d6adec4e50753e9d3d4f758f4fa83f3acf2a59 May 28 23:04:25.346881 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:25.346843 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-48nqd" event={"ID":"0ed53912-4021-4728-9a9a-a34adc8cda68","Type":"ContainerStarted","Data":"b4d8f78853f7cc181beb5ad973d6adec4e50753e9d3d4f758f4fa83f3acf2a59"} May 28 23:04:25.348416 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:25.348390 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6hg9m" event={"ID":"24887236-2901-427f-8442-b82b07f3313b","Type":"ContainerStarted","Data":"9c49c7b1c0f52e00950ef28fbd4ad183f79c5ea8e94dd4efe9b17602aa4b4827"} May 28 23:04:27.355401 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:27.355366 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-48nqd" event={"ID":"0ed53912-4021-4728-9a9a-a34adc8cda68","Type":"ContainerStarted","Data":"f9eb71a427f4218d714bd7858d962abd618e08a776f678b97ded991ac40a73ef"} May 28 23:04:27.355401 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:27.355398 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-48nqd" event={"ID":"0ed53912-4021-4728-9a9a-a34adc8cda68","Type":"ContainerStarted","Data":"6285242a6ff086b5fe176b12b7dcc9c924bda712ad662b56d0305fd0db921817"} May 28 23:04:27.373055 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:27.373004 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7779bbdd78-48nqd" podStartSLOduration=2.091870379 podStartE2EDuration="3.372991358s" podCreationTimestamp="2026-05-28 23:04:24 +0000 UTC" firstStartedPulling="2026-05-28 23:04:25.178339138 +0000 UTC m=+122.786153084" lastFinishedPulling="2026-05-28 23:04:26.459460111 +0000 UTC m=+124.067274063" observedRunningTime="2026-05-28 23:04:27.371361687 +0000 UTC m=+124.979175670" watchObservedRunningTime="2026-05-28 23:04:27.372991358 +0000 UTC m=+124.980805351" May 28 23:04:27.373222 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:27.373191 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-6hg9m" podStartSLOduration=4.185181314 podStartE2EDuration="6.373182184s" podCreationTimestamp="2026-05-28 23:04:21 +0000 UTC" firstStartedPulling="2026-05-28 23:04:22.26377477 +0000 UTC m=+119.871588726" lastFinishedPulling="2026-05-28 23:04:24.451775654 +0000 UTC m=+122.059589596" observedRunningTime="2026-05-28 23:04:25.369265358 +0000 UTC m=+122.977079320" watchObservedRunningTime="2026-05-28 23:04:27.373182184 +0000 UTC m=+124.980996145" May 28 23:04:29.501292 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:29.501262 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-d47lt"] May 28 23:04:29.505692 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:29.505673 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-d47lt" May 28 23:04:29.507835 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:29.507812 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 28 23:04:29.508026 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:29.508011 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 28 23:04:29.508122 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:29.508062 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 28 23:04:29.508190 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:29.508130 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-kwtl7\"" May 28 23:04:29.590428 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:29.590404 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f95d91ce-8915-4817-8066-463eb2e031fc-node-exporter-textfile\") pod \"node-exporter-d47lt\" (UID: \"f95d91ce-8915-4817-8066-463eb2e031fc\") " pod="openshift-monitoring/node-exporter-d47lt" May 28 23:04:29.590533 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:29.590434 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dhnc\" (UniqueName: \"kubernetes.io/projected/f95d91ce-8915-4817-8066-463eb2e031fc-kube-api-access-4dhnc\") pod \"node-exporter-d47lt\" (UID: \"f95d91ce-8915-4817-8066-463eb2e031fc\") " pod="openshift-monitoring/node-exporter-d47lt" May 28 23:04:29.590533 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:29.590454 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f95d91ce-8915-4817-8066-463eb2e031fc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-d47lt\" (UID: \"f95d91ce-8915-4817-8066-463eb2e031fc\") " pod="openshift-monitoring/node-exporter-d47lt" May 28 23:04:29.590533 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:29.590504 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f95d91ce-8915-4817-8066-463eb2e031fc-sys\") pod \"node-exporter-d47lt\" (UID: \"f95d91ce-8915-4817-8066-463eb2e031fc\") " pod="openshift-monitoring/node-exporter-d47lt" May 28 23:04:29.590635 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:29.590545 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f95d91ce-8915-4817-8066-463eb2e031fc-node-exporter-wtmp\") pod \"node-exporter-d47lt\" (UID: \"f95d91ce-8915-4817-8066-463eb2e031fc\") " pod="openshift-monitoring/node-exporter-d47lt" May 28 23:04:29.590635 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:29.590593 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f95d91ce-8915-4817-8066-463eb2e031fc-metrics-client-ca\") pod \"node-exporter-d47lt\" (UID: \"f95d91ce-8915-4817-8066-463eb2e031fc\") " pod="openshift-monitoring/node-exporter-d47lt" May 28 23:04:29.590635 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:29.590618 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f95d91ce-8915-4817-8066-463eb2e031fc-node-exporter-tls\") pod \"node-exporter-d47lt\" (UID: \"f95d91ce-8915-4817-8066-463eb2e031fc\") " pod="openshift-monitoring/node-exporter-d47lt" May 28 23:04:29.590717 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:29.590635 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f95d91ce-8915-4817-8066-463eb2e031fc-root\") pod \"node-exporter-d47lt\" (UID: \"f95d91ce-8915-4817-8066-463eb2e031fc\") " pod="openshift-monitoring/node-exporter-d47lt" May 28 23:04:29.590717 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:29.590689 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f95d91ce-8915-4817-8066-463eb2e031fc-node-exporter-accelerators-collector-config\") pod \"node-exporter-d47lt\" (UID: \"f95d91ce-8915-4817-8066-463eb2e031fc\") " pod="openshift-monitoring/node-exporter-d47lt" May 28 23:04:29.691684 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:29.691647 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f95d91ce-8915-4817-8066-463eb2e031fc-node-exporter-tls\") pod \"node-exporter-d47lt\" (UID: \"f95d91ce-8915-4817-8066-463eb2e031fc\") " pod="openshift-monitoring/node-exporter-d47lt" May 28 23:04:29.691684 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:29.691692 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f95d91ce-8915-4817-8066-463eb2e031fc-root\") pod \"node-exporter-d47lt\" (UID: \"f95d91ce-8915-4817-8066-463eb2e031fc\") " pod="openshift-monitoring/node-exporter-d47lt" May 28 23:04:29.691811 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:29.691762 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f95d91ce-8915-4817-8066-463eb2e031fc-node-exporter-accelerators-collector-config\") pod \"node-exporter-d47lt\" (UID: \"f95d91ce-8915-4817-8066-463eb2e031fc\") " pod="openshift-monitoring/node-exporter-d47lt" May 28 23:04:29.691811 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:29.691801 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f95d91ce-8915-4817-8066-463eb2e031fc-node-exporter-textfile\") pod \"node-exporter-d47lt\" (UID: \"f95d91ce-8915-4817-8066-463eb2e031fc\") " pod="openshift-monitoring/node-exporter-d47lt" May 28 23:04:29.691871 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:29.691822 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4dhnc\" (UniqueName: \"kubernetes.io/projected/f95d91ce-8915-4817-8066-463eb2e031fc-kube-api-access-4dhnc\") pod \"node-exporter-d47lt\" (UID: \"f95d91ce-8915-4817-8066-463eb2e031fc\") " pod="openshift-monitoring/node-exporter-d47lt" May 28 23:04:29.691871 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:29.691831 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f95d91ce-8915-4817-8066-463eb2e031fc-root\") pod \"node-exporter-d47lt\" (UID: \"f95d91ce-8915-4817-8066-463eb2e031fc\") " pod="openshift-monitoring/node-exporter-d47lt" May 28 23:04:29.691871 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:29.691849 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f95d91ce-8915-4817-8066-463eb2e031fc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-d47lt\" (UID: \"f95d91ce-8915-4817-8066-463eb2e031fc\") " pod="openshift-monitoring/node-exporter-d47lt" May 28 23:04:29.692013 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:29.691876 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f95d91ce-8915-4817-8066-463eb2e031fc-sys\") pod \"node-exporter-d47lt\" (UID: \"f95d91ce-8915-4817-8066-463eb2e031fc\") " pod="openshift-monitoring/node-exporter-d47lt" May 28 23:04:29.692013 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:29.691910 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f95d91ce-8915-4817-8066-463eb2e031fc-node-exporter-wtmp\") pod \"node-exporter-d47lt\" (UID: \"f95d91ce-8915-4817-8066-463eb2e031fc\") " pod="openshift-monitoring/node-exporter-d47lt" May 28 23:04:29.692013 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:29.691967 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f95d91ce-8915-4817-8066-463eb2e031fc-sys\") pod \"node-exporter-d47lt\" (UID: \"f95d91ce-8915-4817-8066-463eb2e031fc\") " pod="openshift-monitoring/node-exporter-d47lt" May 28 23:04:29.692174 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:29.692036 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f95d91ce-8915-4817-8066-463eb2e031fc-metrics-client-ca\") pod \"node-exporter-d47lt\" (UID: \"f95d91ce-8915-4817-8066-463eb2e031fc\") " pod="openshift-monitoring/node-exporter-d47lt" May 28 23:04:29.692174 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:29.692043 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f95d91ce-8915-4817-8066-463eb2e031fc-node-exporter-wtmp\") pod \"node-exporter-d47lt\" (UID: \"f95d91ce-8915-4817-8066-463eb2e031fc\") " pod="openshift-monitoring/node-exporter-d47lt" May 28 23:04:29.692252 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:29.692240 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f95d91ce-8915-4817-8066-463eb2e031fc-node-exporter-textfile\") pod \"node-exporter-d47lt\" (UID: \"f95d91ce-8915-4817-8066-463eb2e031fc\") " pod="openshift-monitoring/node-exporter-d47lt" May 28 23:04:29.692519 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:29.692496 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f95d91ce-8915-4817-8066-463eb2e031fc-node-exporter-accelerators-collector-config\") pod \"node-exporter-d47lt\" (UID: \"f95d91ce-8915-4817-8066-463eb2e031fc\") " pod="openshift-monitoring/node-exporter-d47lt" May 28 23:04:29.692615 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:29.692528 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f95d91ce-8915-4817-8066-463eb2e031fc-metrics-client-ca\") pod \"node-exporter-d47lt\" (UID: \"f95d91ce-8915-4817-8066-463eb2e031fc\") " pod="openshift-monitoring/node-exporter-d47lt" May 28 23:04:29.694045 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:29.694026 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f95d91ce-8915-4817-8066-463eb2e031fc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-d47lt\" (UID: \"f95d91ce-8915-4817-8066-463eb2e031fc\") " pod="openshift-monitoring/node-exporter-d47lt" May 28 23:04:29.694147 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:29.694130 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f95d91ce-8915-4817-8066-463eb2e031fc-node-exporter-tls\") pod \"node-exporter-d47lt\" (UID: \"f95d91ce-8915-4817-8066-463eb2e031fc\") " pod="openshift-monitoring/node-exporter-d47lt" May 28 23:04:29.699522 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:29.699503 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dhnc\" (UniqueName: \"kubernetes.io/projected/f95d91ce-8915-4817-8066-463eb2e031fc-kube-api-access-4dhnc\") pod \"node-exporter-d47lt\" (UID: \"f95d91ce-8915-4817-8066-463eb2e031fc\") " pod="openshift-monitoring/node-exporter-d47lt" May 28 23:04:29.815225 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:29.815198 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-d47lt" May 28 23:04:29.823107 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:04:29.823054 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf95d91ce_8915_4817_8066_463eb2e031fc.slice/crio-813dee0659f94deec14b17dde92a0f270ace3b0f7297089ba84aff19c11b767d WatchSource:0}: Error finding container 813dee0659f94deec14b17dde92a0f270ace3b0f7297089ba84aff19c11b767d: Status 404 returned error can't find the container with id 813dee0659f94deec14b17dde92a0f270ace3b0f7297089ba84aff19c11b767d May 28 23:04:30.363955 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:30.363919 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d47lt" event={"ID":"f95d91ce-8915-4817-8066-463eb2e031fc","Type":"ContainerStarted","Data":"813dee0659f94deec14b17dde92a0f270ace3b0f7297089ba84aff19c11b767d"} May 28 23:04:31.367165 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:31.367136 2577 generic.go:358] "Generic (PLEG): container finished" podID="f95d91ce-8915-4817-8066-463eb2e031fc" containerID="90023b4fa3df892df1bb3be9c9c3e711cc7f20a5770a463cef312c4f7b90b3d8" exitCode=0 May 28 23:04:31.367514 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:31.367204 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d47lt" event={"ID":"f95d91ce-8915-4817-8066-463eb2e031fc","Type":"ContainerDied","Data":"90023b4fa3df892df1bb3be9c9c3e711cc7f20a5770a463cef312c4f7b90b3d8"} May 28 23:04:31.677166 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:31.676800 2577 patch_prober.go:28] interesting pod/image-registry-7cd955b9f7-w74w4 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 28 23:04:31.677166 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:31.676858 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7cd955b9f7-w74w4" podUID="38466838-c402-4a49-a894-a96c827df8f5" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 28 23:04:32.371033 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:32.371001 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d47lt" event={"ID":"f95d91ce-8915-4817-8066-463eb2e031fc","Type":"ContainerStarted","Data":"eaa781a2c4e64f12c1391649c76e0e969a12a0cbf66ee91361576045b88daab0"} May 28 23:04:32.371479 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:32.371038 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d47lt" event={"ID":"f95d91ce-8915-4817-8066-463eb2e031fc","Type":"ContainerStarted","Data":"0cccf947fa6c4584dc80adb20a944d6c345cceeca09d88cdba3604240fd11a1e"} May 28 23:04:32.390331 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:32.390274 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-d47lt" podStartSLOduration=2.5329669 podStartE2EDuration="3.390256703s" podCreationTimestamp="2026-05-28 23:04:29 +0000 UTC" firstStartedPulling="2026-05-28 23:04:29.824978033 +0000 UTC m=+127.432791972" lastFinishedPulling="2026-05-28 23:04:30.682267837 +0000 UTC m=+128.290081775" observedRunningTime="2026-05-28 23:04:32.389929069 +0000 UTC m=+129.997743031" watchObservedRunningTime="2026-05-28 23:04:32.390256703 +0000 UTC m=+129.998070665" May 28 23:04:32.562481 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:32.562453 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7b6f467554-fn7fd"] May 28 23:04:32.565735 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:32.565701 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7b6f467554-fn7fd" May 28 23:04:32.568231 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:32.568209 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" May 28 23:04:32.568368 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:32.568270 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" May 28 23:04:32.568368 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:32.568273 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" May 28 23:04:32.568495 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:32.568369 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" May 28 23:04:32.568495 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:32.568426 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-191jp0m6khp26\"" May 28 23:04:32.568495 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:32.568468 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" May 28 23:04:32.568676 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:32.568513 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-pvwcw\"" May 28 23:04:32.581254 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:32.581229 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7b6f467554-fn7fd"] May 28 23:04:32.721241 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:32.721165 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/86e38423-23c4-433b-9a56-59c8392e1438-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7b6f467554-fn7fd\" (UID: \"86e38423-23c4-433b-9a56-59c8392e1438\") " pod="openshift-monitoring/thanos-querier-7b6f467554-fn7fd" May 28 23:04:32.721241 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:32.721229 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/86e38423-23c4-433b-9a56-59c8392e1438-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7b6f467554-fn7fd\" (UID: \"86e38423-23c4-433b-9a56-59c8392e1438\") " pod="openshift-monitoring/thanos-querier-7b6f467554-fn7fd" May 28 23:04:32.721445 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:32.721256 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/86e38423-23c4-433b-9a56-59c8392e1438-metrics-client-ca\") pod \"thanos-querier-7b6f467554-fn7fd\" (UID: \"86e38423-23c4-433b-9a56-59c8392e1438\") " pod="openshift-monitoring/thanos-querier-7b6f467554-fn7fd" May 28 23:04:32.721445 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:32.721273 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/86e38423-23c4-433b-9a56-59c8392e1438-secret-thanos-querier-tls\") pod \"thanos-querier-7b6f467554-fn7fd\" (UID: \"86e38423-23c4-433b-9a56-59c8392e1438\") " pod="openshift-monitoring/thanos-querier-7b6f467554-fn7fd" May 28 23:04:32.721445 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:32.721298 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/86e38423-23c4-433b-9a56-59c8392e1438-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7b6f467554-fn7fd\" (UID: \"86e38423-23c4-433b-9a56-59c8392e1438\") " pod="openshift-monitoring/thanos-querier-7b6f467554-fn7fd" May 28 23:04:32.721445 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:32.721342 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/86e38423-23c4-433b-9a56-59c8392e1438-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7b6f467554-fn7fd\" (UID: \"86e38423-23c4-433b-9a56-59c8392e1438\") " pod="openshift-monitoring/thanos-querier-7b6f467554-fn7fd" May 28 23:04:32.721445 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:32.721369 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/86e38423-23c4-433b-9a56-59c8392e1438-secret-grpc-tls\") pod \"thanos-querier-7b6f467554-fn7fd\" (UID: \"86e38423-23c4-433b-9a56-59c8392e1438\") " pod="openshift-monitoring/thanos-querier-7b6f467554-fn7fd" May 28 23:04:32.721641 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:32.721498 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88dvn\" (UniqueName: \"kubernetes.io/projected/86e38423-23c4-433b-9a56-59c8392e1438-kube-api-access-88dvn\") pod \"thanos-querier-7b6f467554-fn7fd\" (UID: \"86e38423-23c4-433b-9a56-59c8392e1438\") " pod="openshift-monitoring/thanos-querier-7b6f467554-fn7fd" May 28 23:04:32.822093 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:32.822039 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-88dvn\" (UniqueName: \"kubernetes.io/projected/86e38423-23c4-433b-9a56-59c8392e1438-kube-api-access-88dvn\") pod \"thanos-querier-7b6f467554-fn7fd\" (UID: \"86e38423-23c4-433b-9a56-59c8392e1438\") " pod="openshift-monitoring/thanos-querier-7b6f467554-fn7fd" May 28 23:04:32.822279 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:32.822120 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/86e38423-23c4-433b-9a56-59c8392e1438-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7b6f467554-fn7fd\" (UID: \"86e38423-23c4-433b-9a56-59c8392e1438\") " pod="openshift-monitoring/thanos-querier-7b6f467554-fn7fd" May 28 23:04:32.822279 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:32.822159 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8e6e54a-9204-40ab-8c10-ded8a2cdb95d-metrics-certs\") pod \"network-metrics-daemon-t5bp9\" (UID: \"d8e6e54a-9204-40ab-8c10-ded8a2cdb95d\") " pod="openshift-multus/network-metrics-daemon-t5bp9" May 28 23:04:32.822279 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:32.822194 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/86e38423-23c4-433b-9a56-59c8392e1438-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7b6f467554-fn7fd\" (UID: \"86e38423-23c4-433b-9a56-59c8392e1438\") " pod="openshift-monitoring/thanos-querier-7b6f467554-fn7fd" May 28 23:04:32.822279 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:32.822222 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/86e38423-23c4-433b-9a56-59c8392e1438-metrics-client-ca\") pod \"thanos-querier-7b6f467554-fn7fd\" (UID: \"86e38423-23c4-433b-9a56-59c8392e1438\") " pod="openshift-monitoring/thanos-querier-7b6f467554-fn7fd" May 28 23:04:32.822279 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:32.822246 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/86e38423-23c4-433b-9a56-59c8392e1438-secret-thanos-querier-tls\") pod \"thanos-querier-7b6f467554-fn7fd\" (UID: \"86e38423-23c4-433b-9a56-59c8392e1438\") " pod="openshift-monitoring/thanos-querier-7b6f467554-fn7fd" May 28 23:04:32.822279 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:32.822273 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/86e38423-23c4-433b-9a56-59c8392e1438-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7b6f467554-fn7fd\" (UID: \"86e38423-23c4-433b-9a56-59c8392e1438\") " pod="openshift-monitoring/thanos-querier-7b6f467554-fn7fd" May 28 23:04:32.822569 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:32.822301 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/86e38423-23c4-433b-9a56-59c8392e1438-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7b6f467554-fn7fd\" (UID: \"86e38423-23c4-433b-9a56-59c8392e1438\") " pod="openshift-monitoring/thanos-querier-7b6f467554-fn7fd" May 28 23:04:32.822569 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:32.822334 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/86e38423-23c4-433b-9a56-59c8392e1438-secret-grpc-tls\") pod \"thanos-querier-7b6f467554-fn7fd\" (UID: \"86e38423-23c4-433b-9a56-59c8392e1438\") " pod="openshift-monitoring/thanos-querier-7b6f467554-fn7fd" May 28 23:04:32.823132 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:32.823104 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/86e38423-23c4-433b-9a56-59c8392e1438-metrics-client-ca\") pod \"thanos-querier-7b6f467554-fn7fd\" (UID: \"86e38423-23c4-433b-9a56-59c8392e1438\") " pod="openshift-monitoring/thanos-querier-7b6f467554-fn7fd" May 28 23:04:32.825094 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:32.825054 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/86e38423-23c4-433b-9a56-59c8392e1438-secret-grpc-tls\") pod \"thanos-querier-7b6f467554-fn7fd\" (UID: \"86e38423-23c4-433b-9a56-59c8392e1438\") " pod="openshift-monitoring/thanos-querier-7b6f467554-fn7fd" May 28 23:04:32.825278 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:32.825215 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8e6e54a-9204-40ab-8c10-ded8a2cdb95d-metrics-certs\") pod \"network-metrics-daemon-t5bp9\" (UID: \"d8e6e54a-9204-40ab-8c10-ded8a2cdb95d\") " pod="openshift-multus/network-metrics-daemon-t5bp9" May 28 23:04:32.825278 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:32.825263 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/86e38423-23c4-433b-9a56-59c8392e1438-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7b6f467554-fn7fd\" (UID: \"86e38423-23c4-433b-9a56-59c8392e1438\") " pod="openshift-monitoring/thanos-querier-7b6f467554-fn7fd" May 28 23:04:32.825404 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:32.825269 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/86e38423-23c4-433b-9a56-59c8392e1438-secret-thanos-querier-tls\") pod \"thanos-querier-7b6f467554-fn7fd\" (UID: \"86e38423-23c4-433b-9a56-59c8392e1438\") " pod="openshift-monitoring/thanos-querier-7b6f467554-fn7fd" May 28 23:04:32.825404 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:32.825378 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/86e38423-23c4-433b-9a56-59c8392e1438-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7b6f467554-fn7fd\" (UID: \"86e38423-23c4-433b-9a56-59c8392e1438\") " pod="openshift-monitoring/thanos-querier-7b6f467554-fn7fd" May 28 23:04:32.825532 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:32.825513 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/86e38423-23c4-433b-9a56-59c8392e1438-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7b6f467554-fn7fd\" (UID: \"86e38423-23c4-433b-9a56-59c8392e1438\") " pod="openshift-monitoring/thanos-querier-7b6f467554-fn7fd" May 28 23:04:32.825568 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:32.825552 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/86e38423-23c4-433b-9a56-59c8392e1438-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7b6f467554-fn7fd\" (UID: \"86e38423-23c4-433b-9a56-59c8392e1438\") " pod="openshift-monitoring/thanos-querier-7b6f467554-fn7fd" May 28 23:04:32.830526 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:32.830504 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-88dvn\" (UniqueName: \"kubernetes.io/projected/86e38423-23c4-433b-9a56-59c8392e1438-kube-api-access-88dvn\") pod \"thanos-querier-7b6f467554-fn7fd\" (UID: \"86e38423-23c4-433b-9a56-59c8392e1438\") " pod="openshift-monitoring/thanos-querier-7b6f467554-fn7fd" May 28 23:04:32.876162 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:32.876127 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7b6f467554-fn7fd" May 28 23:04:33.001874 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:33.001853 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7b6f467554-fn7fd"] May 28 23:04:33.004213 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:04:33.004185 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86e38423_23c4_433b_9a56_59c8392e1438.slice/crio-4b23a38cd3a31137abeb40a160d2dfa19713db07e76c110e96a2583db39f1fb2 WatchSource:0}: Error finding container 4b23a38cd3a31137abeb40a160d2dfa19713db07e76c110e96a2583db39f1fb2: Status 404 returned error can't find the container with id 4b23a38cd3a31137abeb40a160d2dfa19713db07e76c110e96a2583db39f1fb2 May 28 23:04:33.011557 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:33.011534 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-65lhq\"" May 28 23:04:33.020141 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:33.020123 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t5bp9" May 28 23:04:33.134676 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:33.134642 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-t5bp9"] May 28 23:04:33.138123 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:04:33.138098 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8e6e54a_9204_40ab_8c10_ded8a2cdb95d.slice/crio-fc4346833f5e1f3ca17be9d62dae014f9db31e3a3df53ee78c2af5b585880838 WatchSource:0}: Error finding container fc4346833f5e1f3ca17be9d62dae014f9db31e3a3df53ee78c2af5b585880838: Status 404 returned error can't find the container with id fc4346833f5e1f3ca17be9d62dae014f9db31e3a3df53ee78c2af5b585880838 May 28 23:04:33.374379 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:33.374348 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-t5bp9" event={"ID":"d8e6e54a-9204-40ab-8c10-ded8a2cdb95d","Type":"ContainerStarted","Data":"fc4346833f5e1f3ca17be9d62dae014f9db31e3a3df53ee78c2af5b585880838"} May 28 23:04:33.375289 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:33.375268 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b6f467554-fn7fd" event={"ID":"86e38423-23c4-433b-9a56-59c8392e1438","Type":"ContainerStarted","Data":"4b23a38cd3a31137abeb40a160d2dfa19713db07e76c110e96a2583db39f1fb2"} May 28 23:04:34.265543 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:34.265515 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-sb9k6"] May 28 23:04:34.274234 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:34.273790 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-sb9k6" May 28 23:04:34.276329 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:34.276282 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-sb9k6"] May 28 23:04:34.277114 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:34.276887 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-fkrlh\"" May 28 23:04:34.277606 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:34.277522 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" May 28 23:04:34.381472 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:34.381428 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-t5bp9" event={"ID":"d8e6e54a-9204-40ab-8c10-ded8a2cdb95d","Type":"ContainerStarted","Data":"34f34403c5488b5166e0905ad5c46ac99899be1e50f3d6dad0fcc671f8e2ef3e"} May 28 23:04:34.381472 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:34.381468 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-t5bp9" event={"ID":"d8e6e54a-9204-40ab-8c10-ded8a2cdb95d","Type":"ContainerStarted","Data":"ddff6b954d51cbca13fd6d64f67366470d634824f81fee2ca3422331772e01ce"} May 28 23:04:34.398637 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:34.398534 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-t5bp9" podStartSLOduration=130.402530809 podStartE2EDuration="2m11.398516743s" podCreationTimestamp="2026-05-28 23:02:23 +0000 UTC" firstStartedPulling="2026-05-28 23:04:33.13986556 +0000 UTC m=+130.747679499" lastFinishedPulling="2026-05-28 23:04:34.13585149 +0000 UTC m=+131.743665433" observedRunningTime="2026-05-28 23:04:34.39652385 +0000 UTC m=+132.004337813" watchObservedRunningTime="2026-05-28 23:04:34.398516743 +0000 UTC m=+132.006330723" May 28 23:04:34.438350 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:34.438323 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/15217d65-9210-4ad7-a639-d571a8139402-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-sb9k6\" (UID: \"15217d65-9210-4ad7-a639-d571a8139402\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-sb9k6" May 28 23:04:34.539351 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:34.539311 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/15217d65-9210-4ad7-a639-d571a8139402-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-sb9k6\" (UID: \"15217d65-9210-4ad7-a639-d571a8139402\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-sb9k6" May 28 23:04:34.539502 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:04:34.539451 2577 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found May 28 23:04:34.539568 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:04:34.539520 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15217d65-9210-4ad7-a639-d571a8139402-monitoring-plugin-cert podName:15217d65-9210-4ad7-a639-d571a8139402 nodeName:}" failed. No retries permitted until 2026-05-28 23:04:35.039500305 +0000 UTC m=+132.647314268 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/15217d65-9210-4ad7-a639-d571a8139402-monitoring-plugin-cert") pod "monitoring-plugin-665c9c8584-sb9k6" (UID: "15217d65-9210-4ad7-a639-d571a8139402") : secret "monitoring-plugin-cert" not found May 28 23:04:35.042554 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:35.042531 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/15217d65-9210-4ad7-a639-d571a8139402-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-sb9k6\" (UID: \"15217d65-9210-4ad7-a639-d571a8139402\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-sb9k6" May 28 23:04:35.044920 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:35.044893 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/15217d65-9210-4ad7-a639-d571a8139402-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-sb9k6\" (UID: \"15217d65-9210-4ad7-a639-d571a8139402\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-sb9k6" May 28 23:04:35.188056 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:35.188036 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-sb9k6" May 28 23:04:35.312976 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:35.312952 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-sb9k6"] May 28 23:04:35.315252 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:04:35.315231 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15217d65_9210_4ad7_a639_d571a8139402.slice/crio-33a27788af5491dfe02dd0b52f9252a1fe7fe2548e9834d35a6cf3dd2193fc91 WatchSource:0}: Error finding container 33a27788af5491dfe02dd0b52f9252a1fe7fe2548e9834d35a6cf3dd2193fc91: Status 404 returned error can't find the container with id 33a27788af5491dfe02dd0b52f9252a1fe7fe2548e9834d35a6cf3dd2193fc91 May 28 23:04:35.386353 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:35.386327 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b6f467554-fn7fd" event={"ID":"86e38423-23c4-433b-9a56-59c8392e1438","Type":"ContainerStarted","Data":"78ec6c716ba051d2447a79c5c071c12e072198a6b0b3ef2ebf2b2447522e21fd"} May 28 23:04:35.386691 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:35.386363 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b6f467554-fn7fd" event={"ID":"86e38423-23c4-433b-9a56-59c8392e1438","Type":"ContainerStarted","Data":"f96bbc8e6f082d9d896407e8e50a4542fde39f3f1970e2fa57cfce592ca0c917"} May 28 23:04:35.386691 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:35.386380 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b6f467554-fn7fd" event={"ID":"86e38423-23c4-433b-9a56-59c8392e1438","Type":"ContainerStarted","Data":"b3257a05988d5fa11b6724028b899ef1c15e4713c7ab6414607c98006807b1e4"} May 28 23:04:35.387357 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:35.387334 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-sb9k6" event={"ID":"15217d65-9210-4ad7-a639-d571a8139402","Type":"ContainerStarted","Data":"33a27788af5491dfe02dd0b52f9252a1fe7fe2548e9834d35a6cf3dd2193fc91"} May 28 23:04:35.712427 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:35.712340 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 28 23:04:35.716686 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:35.716665 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 28 23:04:35.720099 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:35.720053 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 28 23:04:35.720203 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:35.720141 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 28 23:04:35.720245 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:35.720141 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 28 23:04:35.720384 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:35.720340 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 28 23:04:35.720497 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:35.720443 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 28 23:04:35.720497 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:35.720444 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" May 28 23:04:35.721300 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:35.721117 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-c8dqeri330ls0\"" May 28 23:04:35.721300 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:35.721135 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 28 23:04:35.721300 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:35.721134 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-nnqnk\"" May 28 23:04:35.721300 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:35.721197 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 28 23:04:35.721300 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:35.721137 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 28 23:04:35.721300 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:35.721238 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 28 23:04:35.721578 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:35.721563 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 28 23:04:35.723737 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:35.723719 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 28 23:04:35.727662 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:35.726856 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 28 23:04:35.738987 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:35.736846 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 28 23:04:35.848376 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:35.848329 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:04:35.848591 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:35.848380 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-web-config\") pod \"prometheus-k8s-0\" (UID: \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:04:35.848591 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:35.848417 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:04:35.848591 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:35.848460 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:04:35.848591 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:35.848508 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:04:35.848591 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:35.848534 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-config-out\") pod \"prometheus-k8s-0\" (UID: \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:04:35.848591 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:35.848566 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:04:35.848948 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:35.848597 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:04:35.848948 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:35.848627 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lw7wv\" (UniqueName: \"kubernetes.io/projected/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-kube-api-access-lw7wv\") pod \"prometheus-k8s-0\" (UID: \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:04:35.848948 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:35.848663 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:04:35.848948 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:35.848735 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:04:35.848948 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:35.848764 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:04:35.848948 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:35.848811 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:04:35.848948 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:35.848837 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:04:35.848948 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:35.848866 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:04:35.848948 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:35.848888 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:04:35.848948 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:35.848933 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-config\") pod \"prometheus-k8s-0\" (UID: \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:04:35.849428 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:35.848960 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:04:35.951267 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:35.950777 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:04:35.951267 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:35.950827 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-config-out\") pod \"prometheus-k8s-0\" (UID: \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:04:35.951267 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:35.950855 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:04:35.951267 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:35.951038 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:04:35.951267 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:35.951111 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lw7wv\" (UniqueName: \"kubernetes.io/projected/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-kube-api-access-lw7wv\") pod \"prometheus-k8s-0\" (UID: \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:04:35.951267 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:35.951147 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:04:35.951267 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:35.951214 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:04:35.951267 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:35.951240 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:04:35.951777 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:35.951290 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:04:35.951890 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:35.951865 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:04:35.954612 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:35.952322 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:04:35.954612 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:35.953142 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:04:35.954612 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:35.953473 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:04:35.954612 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:35.953516 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:04:35.954612 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:35.953541 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:04:35.954612 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:35.953571 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-config\") pod \"prometheus-k8s-0\" (UID: \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:04:35.954612 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:35.953602 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:04:35.954612 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:35.953638 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:04:35.954612 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:35.953667 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-web-config\") pod \"prometheus-k8s-0\" (UID: \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:04:35.954612 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:35.953709 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:04:35.954612 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:35.953736 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:04:35.955283 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:35.954711 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:04:35.955283 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:35.954753 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:04:35.955424 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:35.955368 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:04:35.958456 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:35.958296 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-web-config\") pod \"prometheus-k8s-0\" (UID: \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:04:35.959092 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:35.958792 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:04:35.959426 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:35.959375 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:04:35.959426 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:35.959337 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:04:35.960371 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:35.960315 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:04:35.961037 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:35.960994 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:04:35.961603 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:35.961555 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-config\") pod \"prometheus-k8s-0\" (UID: \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:04:35.962192 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:35.962151 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:04:35.962830 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:35.962753 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:04:35.963099 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:35.963044 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-config-out\") pod \"prometheus-k8s-0\" (UID: \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:04:35.963956 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:35.963934 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lw7wv\" (UniqueName: \"kubernetes.io/projected/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-kube-api-access-lw7wv\") pod \"prometheus-k8s-0\" (UID: \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:04:35.965283 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:35.965240 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:04:36.029222 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:36.029181 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 28 23:04:36.258091 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:36.257902 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 28 23:04:36.269508 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:04:36.269478 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc8e4817_ba44_4271_8fc6_f5dfc5ea3cd2.slice/crio-fa25b37a3004ad01695e93dede498315723af0d5078a5ef0798dbbfebf081a07 WatchSource:0}: Error finding container fa25b37a3004ad01695e93dede498315723af0d5078a5ef0798dbbfebf081a07: Status 404 returned error can't find the container with id fa25b37a3004ad01695e93dede498315723af0d5078a5ef0798dbbfebf081a07 May 28 23:04:36.393390 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:36.393356 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b6f467554-fn7fd" event={"ID":"86e38423-23c4-433b-9a56-59c8392e1438","Type":"ContainerStarted","Data":"ce333c9f5b0f2279f77fc6f2489bfec3f34413216681f63e3cc3b1a62eebf5df"} May 28 23:04:36.393851 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:36.393399 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b6f467554-fn7fd" event={"ID":"86e38423-23c4-433b-9a56-59c8392e1438","Type":"ContainerStarted","Data":"e612630d3372990872d4aa8c97a9ce6d433a323c4fd4471e411ef4926c985d1a"} May 28 23:04:36.394618 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:36.394590 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2","Type":"ContainerStarted","Data":"fa25b37a3004ad01695e93dede498315723af0d5078a5ef0798dbbfebf081a07"} May 28 23:04:37.398990 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:37.398959 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b6f467554-fn7fd" event={"ID":"86e38423-23c4-433b-9a56-59c8392e1438","Type":"ContainerStarted","Data":"749423b239479c8e3082100b44bb78b57ef5d5ce00e916061871c7b16dc060c1"} May 28 23:04:37.399313 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:37.399182 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7b6f467554-fn7fd" May 28 23:04:37.400167 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:37.400142 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-sb9k6" event={"ID":"15217d65-9210-4ad7-a639-d571a8139402","Type":"ContainerStarted","Data":"df910eaf3b20059086581db471a3dbf11f3555e528b75bcb6cd8d65aa3c2f4e8"} May 28 23:04:37.400283 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:37.400271 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-sb9k6" May 28 23:04:37.401402 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:37.401383 2577 generic.go:358] "Generic (PLEG): container finished" podID="cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2" containerID="1b7202bf94e0382223fdda14ff1abbbc2a90bed20e27bac56ba0ce342d86668d" exitCode=0 May 28 23:04:37.401482 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:37.401451 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2","Type":"ContainerDied","Data":"1b7202bf94e0382223fdda14ff1abbbc2a90bed20e27bac56ba0ce342d86668d"} May 28 23:04:37.405393 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:37.405375 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-sb9k6" May 28 23:04:37.422410 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:37.422366 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7b6f467554-fn7fd" podStartSLOduration=2.288276414 podStartE2EDuration="5.422353749s" podCreationTimestamp="2026-05-28 23:04:32 +0000 UTC" firstStartedPulling="2026-05-28 23:04:33.006030716 +0000 UTC m=+130.613844655" lastFinishedPulling="2026-05-28 23:04:36.140108038 +0000 UTC m=+133.747921990" observedRunningTime="2026-05-28 23:04:37.420920606 +0000 UTC m=+135.028734621" watchObservedRunningTime="2026-05-28 23:04:37.422353749 +0000 UTC m=+135.030167710" May 28 23:04:37.463027 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:37.462983 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-665c9c8584-sb9k6" podStartSLOduration=2.110736158 podStartE2EDuration="3.462971211s" podCreationTimestamp="2026-05-28 23:04:34 +0000 UTC" firstStartedPulling="2026-05-28 23:04:35.317029644 +0000 UTC m=+132.924843587" lastFinishedPulling="2026-05-28 23:04:36.669264687 +0000 UTC m=+134.277078640" observedRunningTime="2026-05-28 23:04:37.461854361 +0000 UTC m=+135.069668323" watchObservedRunningTime="2026-05-28 23:04:37.462971211 +0000 UTC m=+135.070785215" May 28 23:04:40.417157 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:40.417104 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2","Type":"ContainerStarted","Data":"6d63feb56dccb5e3053197f17ded1df1d3ac9077b815858ba6ef9e3b4cc8bf2c"} May 28 23:04:40.417542 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:40.417159 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2","Type":"ContainerStarted","Data":"54134dac55f6d876ec0d19ef894d4e34a997ce326d96e17025feb92ad35a6b92"} May 28 23:04:40.417542 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:40.417176 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2","Type":"ContainerStarted","Data":"5bb4f1c5374d2797b2c454252210150cd3c75c618bb83e2b45d35c270ed5ebce"} May 28 23:04:41.422614 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:41.422580 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2","Type":"ContainerStarted","Data":"ef555fdc3e4a77051efa19927d7d228a4cae501fbe21a1da937e3cf76669a546"} May 28 23:04:41.422614 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:41.422618 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2","Type":"ContainerStarted","Data":"924e14c079f1aaad02b1a3ed9fc23c5ebf188409b83f2ad69cb322f08e05122a"} May 28 23:04:41.423013 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:41.422631 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2","Type":"ContainerStarted","Data":"c41384d65b621eff4192319c4ead9cad35b03883884c6cfeaf685238189be1cc"} May 28 23:04:41.453684 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:41.453615 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.535399807 podStartE2EDuration="6.453600818s" podCreationTimestamp="2026-05-28 23:04:35 +0000 UTC" firstStartedPulling="2026-05-28 23:04:36.272324237 +0000 UTC m=+133.880138182" lastFinishedPulling="2026-05-28 23:04:40.190525251 +0000 UTC m=+137.798339193" observedRunningTime="2026-05-28 23:04:41.451927739 +0000 UTC m=+139.059741697" watchObservedRunningTime="2026-05-28 23:04:41.453600818 +0000 UTC m=+139.061414787" May 28 23:04:41.675289 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:41.675210 2577 patch_prober.go:28] interesting pod/image-registry-7cd955b9f7-w74w4 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 28 23:04:41.675289 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:41.675257 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7cd955b9f7-w74w4" podUID="38466838-c402-4a49-a894-a96c827df8f5" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 28 23:04:42.018174 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:42.018101 2577 patch_prober.go:28] interesting pod/image-registry-5bb668dbdb-9b9km container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 28 23:04:42.018174 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:42.018160 2577 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5bb668dbdb-9b9km" podUID="02a2b450-c415-489b-8510-c98d35df0795" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 28 23:04:43.344474 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:43.344440 2577 patch_prober.go:28] interesting pod/image-registry-5bb668dbdb-9b9km container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 28 23:04:43.344923 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:43.344501 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5bb668dbdb-9b9km" podUID="02a2b450-c415-489b-8510-c98d35df0795" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 28 23:04:43.410851 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:43.410826 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7b6f467554-fn7fd" May 28 23:04:46.030059 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:46.030016 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 28 23:04:46.689682 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:46.689610 2577 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7cd955b9f7-w74w4" podUID="38466838-c402-4a49-a894-a96c827df8f5" containerName="registry" containerID="cri-o://692b8989842b01827224848e2688abc865af94df4aba26991ffab9ccead140f6" gracePeriod=30 May 28 23:04:46.929669 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:46.929643 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7cd955b9f7-w74w4" May 28 23:04:46.948013 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:46.947947 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/38466838-c402-4a49-a894-a96c827df8f5-registry-certificates\") pod \"38466838-c402-4a49-a894-a96c827df8f5\" (UID: \"38466838-c402-4a49-a894-a96c827df8f5\") " May 28 23:04:46.948013 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:46.947978 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/38466838-c402-4a49-a894-a96c827df8f5-bound-sa-token\") pod \"38466838-c402-4a49-a894-a96c827df8f5\" (UID: \"38466838-c402-4a49-a894-a96c827df8f5\") " May 28 23:04:46.948013 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:46.948003 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z4wwl\" (UniqueName: \"kubernetes.io/projected/38466838-c402-4a49-a894-a96c827df8f5-kube-api-access-z4wwl\") pod \"38466838-c402-4a49-a894-a96c827df8f5\" (UID: \"38466838-c402-4a49-a894-a96c827df8f5\") " May 28 23:04:46.948393 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:46.948157 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/38466838-c402-4a49-a894-a96c827df8f5-ca-trust-extracted\") pod \"38466838-c402-4a49-a894-a96c827df8f5\" (UID: \"38466838-c402-4a49-a894-a96c827df8f5\") " May 28 23:04:46.948393 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:46.948268 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/38466838-c402-4a49-a894-a96c827df8f5-image-registry-private-configuration\") pod \"38466838-c402-4a49-a894-a96c827df8f5\" (UID: \"38466838-c402-4a49-a894-a96c827df8f5\") " May 28 23:04:46.948393 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:46.948323 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/38466838-c402-4a49-a894-a96c827df8f5-installation-pull-secrets\") pod \"38466838-c402-4a49-a894-a96c827df8f5\" (UID: \"38466838-c402-4a49-a894-a96c827df8f5\") " May 28 23:04:46.948393 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:46.948355 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/38466838-c402-4a49-a894-a96c827df8f5-registry-tls\") pod \"38466838-c402-4a49-a894-a96c827df8f5\" (UID: \"38466838-c402-4a49-a894-a96c827df8f5\") " May 28 23:04:46.948393 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:46.948384 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/38466838-c402-4a49-a894-a96c827df8f5-trusted-ca\") pod \"38466838-c402-4a49-a894-a96c827df8f5\" (UID: \"38466838-c402-4a49-a894-a96c827df8f5\") " May 28 23:04:46.949641 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:46.948424 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38466838-c402-4a49-a894-a96c827df8f5-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "38466838-c402-4a49-a894-a96c827df8f5" (UID: "38466838-c402-4a49-a894-a96c827df8f5"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 23:04:46.949641 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:46.948743 2577 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/38466838-c402-4a49-a894-a96c827df8f5-registry-certificates\") on node \"ip-10-0-132-11.ec2.internal\" DevicePath \"\"" May 28 23:04:46.949641 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:46.949385 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38466838-c402-4a49-a894-a96c827df8f5-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "38466838-c402-4a49-a894-a96c827df8f5" (UID: "38466838-c402-4a49-a894-a96c827df8f5"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 23:04:46.952455 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:46.952427 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38466838-c402-4a49-a894-a96c827df8f5-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "38466838-c402-4a49-a894-a96c827df8f5" (UID: "38466838-c402-4a49-a894-a96c827df8f5"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 23:04:46.953163 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:46.953121 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38466838-c402-4a49-a894-a96c827df8f5-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "38466838-c402-4a49-a894-a96c827df8f5" (UID: "38466838-c402-4a49-a894-a96c827df8f5"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 23:04:46.953272 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:46.953176 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38466838-c402-4a49-a894-a96c827df8f5-kube-api-access-z4wwl" (OuterVolumeSpecName: "kube-api-access-z4wwl") pod "38466838-c402-4a49-a894-a96c827df8f5" (UID: "38466838-c402-4a49-a894-a96c827df8f5"). InnerVolumeSpecName "kube-api-access-z4wwl". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 23:04:46.953272 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:46.953209 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38466838-c402-4a49-a894-a96c827df8f5-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "38466838-c402-4a49-a894-a96c827df8f5" (UID: "38466838-c402-4a49-a894-a96c827df8f5"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 23:04:46.953619 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:46.953519 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38466838-c402-4a49-a894-a96c827df8f5-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "38466838-c402-4a49-a894-a96c827df8f5" (UID: "38466838-c402-4a49-a894-a96c827df8f5"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 23:04:46.962162 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:46.962043 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38466838-c402-4a49-a894-a96c827df8f5-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "38466838-c402-4a49-a894-a96c827df8f5" (UID: "38466838-c402-4a49-a894-a96c827df8f5"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 23:04:47.049394 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:47.049369 2577 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/38466838-c402-4a49-a894-a96c827df8f5-image-registry-private-configuration\") on node \"ip-10-0-132-11.ec2.internal\" DevicePath \"\"" May 28 23:04:47.049394 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:47.049396 2577 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/38466838-c402-4a49-a894-a96c827df8f5-installation-pull-secrets\") on node \"ip-10-0-132-11.ec2.internal\" DevicePath \"\"" May 28 23:04:47.049767 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:47.049409 2577 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/38466838-c402-4a49-a894-a96c827df8f5-registry-tls\") on node \"ip-10-0-132-11.ec2.internal\" DevicePath \"\"" May 28 23:04:47.049767 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:47.049422 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/38466838-c402-4a49-a894-a96c827df8f5-trusted-ca\") on node \"ip-10-0-132-11.ec2.internal\" DevicePath \"\"" May 28 23:04:47.049767 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:47.049435 2577 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/38466838-c402-4a49-a894-a96c827df8f5-bound-sa-token\") on node \"ip-10-0-132-11.ec2.internal\" DevicePath \"\"" May 28 23:04:47.049767 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:47.049447 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z4wwl\" (UniqueName: \"kubernetes.io/projected/38466838-c402-4a49-a894-a96c827df8f5-kube-api-access-z4wwl\") on node \"ip-10-0-132-11.ec2.internal\" DevicePath \"\"" May 28 23:04:47.049767 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:47.049463 2577 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/38466838-c402-4a49-a894-a96c827df8f5-ca-trust-extracted\") on node \"ip-10-0-132-11.ec2.internal\" DevicePath \"\"" May 28 23:04:47.443121 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:47.443085 2577 generic.go:358] "Generic (PLEG): container finished" podID="38466838-c402-4a49-a894-a96c827df8f5" containerID="692b8989842b01827224848e2688abc865af94df4aba26991ffab9ccead140f6" exitCode=0 May 28 23:04:47.443280 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:47.443157 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7cd955b9f7-w74w4" May 28 23:04:47.443280 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:47.443158 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7cd955b9f7-w74w4" event={"ID":"38466838-c402-4a49-a894-a96c827df8f5","Type":"ContainerDied","Data":"692b8989842b01827224848e2688abc865af94df4aba26991ffab9ccead140f6"} May 28 23:04:47.443280 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:47.443261 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7cd955b9f7-w74w4" event={"ID":"38466838-c402-4a49-a894-a96c827df8f5","Type":"ContainerDied","Data":"6cf61f62daa0575c05131dfb1258fe44b5dae1dee52566960a35d29fe4335562"} May 28 23:04:47.443280 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:47.443275 2577 scope.go:117] "RemoveContainer" containerID="692b8989842b01827224848e2688abc865af94df4aba26991ffab9ccead140f6" May 28 23:04:47.451197 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:47.451174 2577 scope.go:117] "RemoveContainer" containerID="692b8989842b01827224848e2688abc865af94df4aba26991ffab9ccead140f6" May 28 23:04:47.451440 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:04:47.451420 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"692b8989842b01827224848e2688abc865af94df4aba26991ffab9ccead140f6\": container with ID starting with 692b8989842b01827224848e2688abc865af94df4aba26991ffab9ccead140f6 not found: ID does not exist" containerID="692b8989842b01827224848e2688abc865af94df4aba26991ffab9ccead140f6" May 28 23:04:47.451490 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:47.451448 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"692b8989842b01827224848e2688abc865af94df4aba26991ffab9ccead140f6"} err="failed to get container status \"692b8989842b01827224848e2688abc865af94df4aba26991ffab9ccead140f6\": rpc error: code = NotFound desc = could not find container \"692b8989842b01827224848e2688abc865af94df4aba26991ffab9ccead140f6\": container with ID starting with 692b8989842b01827224848e2688abc865af94df4aba26991ffab9ccead140f6 not found: ID does not exist" May 28 23:04:47.460146 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:47.460124 2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7cd955b9f7-w74w4"] May 28 23:04:47.464287 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:47.464267 2577 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7cd955b9f7-w74w4"] May 28 23:04:48.996280 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:48.996254 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38466838-c402-4a49-a894-a96c827df8f5" path="/var/lib/kubelet/pods/38466838-c402-4a49-a894-a96c827df8f5/volumes" May 28 23:04:52.017925 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:52.017894 2577 patch_prober.go:28] interesting pod/image-registry-5bb668dbdb-9b9km container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 28 23:04:52.018329 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:52.017947 2577 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5bb668dbdb-9b9km" podUID="02a2b450-c415-489b-8510-c98d35df0795" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 28 23:04:53.345261 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:53.345220 2577 patch_prober.go:28] interesting pod/image-registry-5bb668dbdb-9b9km container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 28 23:04:53.345652 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:04:53.345273 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5bb668dbdb-9b9km" podUID="02a2b450-c415-489b-8510-c98d35df0795" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 28 23:04:59.812050 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:04:59.812012 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-8zr45" podUID="4e662546-4260-4167-aafa-19b834be1588" May 28 23:04:59.819164 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:04:59.819131 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-hs47z" podUID="d2ec4e04-45b6-4bf3-9268-8e7799549fef" May 28 23:05:00.477384 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:00.477353 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8zr45" May 28 23:05:00.477541 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:00.477353 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hs47z" May 28 23:05:02.018179 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:02.018148 2577 patch_prober.go:28] interesting pod/image-registry-5bb668dbdb-9b9km container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 28 23:05:02.018594 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:02.018200 2577 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5bb668dbdb-9b9km" podUID="02a2b450-c415-489b-8510-c98d35df0795" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 28 23:05:02.018594 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:02.018242 2577 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-5bb668dbdb-9b9km" May 28 23:05:02.018739 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:02.018639 2577 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"6ec359868a84460ef6faf6bf7b153678c71eb7365e361a9fa9cdc6d1082f3ea5"} pod="openshift-image-registry/image-registry-5bb668dbdb-9b9km" containerMessage="Container registry failed liveness probe, will be restarted" May 28 23:05:02.021915 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:02.021893 2577 patch_prober.go:28] interesting pod/image-registry-5bb668dbdb-9b9km container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 28 23:05:02.022017 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:02.021928 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5bb668dbdb-9b9km" podUID="02a2b450-c415-489b-8510-c98d35df0795" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 28 23:05:04.487729 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:04.487699 2577 generic.go:358] "Generic (PLEG): container finished" podID="29f1d24b-cf80-4e23-afb2-4a4062509259" containerID="f89d133bafd892bbfdbf06a8f20772f602e3ea7f699a47abd65689a53ef18305" exitCode=0 May 28 23:05:04.488087 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:04.487774 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-tcvb6" event={"ID":"29f1d24b-cf80-4e23-afb2-4a4062509259","Type":"ContainerDied","Data":"f89d133bafd892bbfdbf06a8f20772f602e3ea7f699a47abd65689a53ef18305"} May 28 23:05:04.488141 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:04.488122 2577 scope.go:117] "RemoveContainer" containerID="f89d133bafd892bbfdbf06a8f20772f602e3ea7f699a47abd65689a53ef18305" May 28 23:05:04.698400 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:04.698326 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e662546-4260-4167-aafa-19b834be1588-metrics-tls\") pod \"dns-default-8zr45\" (UID: \"4e662546-4260-4167-aafa-19b834be1588\") " pod="openshift-dns/dns-default-8zr45" May 28 23:05:04.698400 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:04.698359 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d2ec4e04-45b6-4bf3-9268-8e7799549fef-cert\") pod \"ingress-canary-hs47z\" (UID: \"d2ec4e04-45b6-4bf3-9268-8e7799549fef\") " pod="openshift-ingress-canary/ingress-canary-hs47z" May 28 23:05:04.700662 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:04.700637 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e662546-4260-4167-aafa-19b834be1588-metrics-tls\") pod \"dns-default-8zr45\" (UID: \"4e662546-4260-4167-aafa-19b834be1588\") " pod="openshift-dns/dns-default-8zr45" May 28 23:05:04.700802 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:04.700736 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d2ec4e04-45b6-4bf3-9268-8e7799549fef-cert\") pod \"ingress-canary-hs47z\" (UID: \"d2ec4e04-45b6-4bf3-9268-8e7799549fef\") " pod="openshift-ingress-canary/ingress-canary-hs47z" May 28 23:05:04.981259 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:04.981186 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-94qps\"" May 28 23:05:04.981867 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:04.981849 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-v6j6q\"" May 28 23:05:04.989560 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:04.989539 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hs47z" May 28 23:05:04.989675 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:04.989635 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8zr45" May 28 23:05:05.127134 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:05.127101 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hs47z"] May 28 23:05:05.130166 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:05:05.130137 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2ec4e04_45b6_4bf3_9268_8e7799549fef.slice/crio-79470d54d5340d77ad0b6099ced869e4c4d998e48832b2a9ddbed54ffcee1349 WatchSource:0}: Error finding container 79470d54d5340d77ad0b6099ced869e4c4d998e48832b2a9ddbed54ffcee1349: Status 404 returned error can't find the container with id 79470d54d5340d77ad0b6099ced869e4c4d998e48832b2a9ddbed54ffcee1349 May 28 23:05:05.139974 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:05.139954 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8zr45"] May 28 23:05:05.141828 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:05:05.141802 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e662546_4260_4167_aafa_19b834be1588.slice/crio-ae8db67374afee0ace53b0e8cdfcbb1d3ffcfa9a43363b4d11d7632a06dedb9e WatchSource:0}: Error finding container ae8db67374afee0ace53b0e8cdfcbb1d3ffcfa9a43363b4d11d7632a06dedb9e: Status 404 returned error can't find the container with id ae8db67374afee0ace53b0e8cdfcbb1d3ffcfa9a43363b4d11d7632a06dedb9e May 28 23:05:05.491590 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:05.491559 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hs47z" event={"ID":"d2ec4e04-45b6-4bf3-9268-8e7799549fef","Type":"ContainerStarted","Data":"79470d54d5340d77ad0b6099ced869e4c4d998e48832b2a9ddbed54ffcee1349"} May 28 23:05:05.493156 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:05.493130 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-tcvb6" event={"ID":"29f1d24b-cf80-4e23-afb2-4a4062509259","Type":"ContainerStarted","Data":"896a14abc6df551e21d87cc661f58d297a2e6f2c902d2ee056bd061e29f40a7e"} May 28 23:05:05.494060 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:05.494033 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8zr45" event={"ID":"4e662546-4260-4167-aafa-19b834be1588","Type":"ContainerStarted","Data":"ae8db67374afee0ace53b0e8cdfcbb1d3ffcfa9a43363b4d11d7632a06dedb9e"} May 28 23:05:06.498533 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:06.498442 2577 generic.go:358] "Generic (PLEG): container finished" podID="e503af1b-53d7-4ca7-9da9-990420799bc5" containerID="b225ca2e5ddcc89c7928e731275713417d08e9efa806fd0b78836ff26a75e493" exitCode=0 May 28 23:05:06.498533 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:06.498524 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-875lc" event={"ID":"e503af1b-53d7-4ca7-9da9-990420799bc5","Type":"ContainerDied","Data":"b225ca2e5ddcc89c7928e731275713417d08e9efa806fd0b78836ff26a75e493"} May 28 23:05:06.498989 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:06.498947 2577 scope.go:117] "RemoveContainer" containerID="b225ca2e5ddcc89c7928e731275713417d08e9efa806fd0b78836ff26a75e493" May 28 23:05:07.503188 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:07.503153 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-875lc" event={"ID":"e503af1b-53d7-4ca7-9da9-990420799bc5","Type":"ContainerStarted","Data":"5f2680e3e61983fd3d4e14ab7ae59a45cd7d772a0e686c12e3a1e655a35a7d7b"} May 28 23:05:07.504410 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:07.504383 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hs47z" event={"ID":"d2ec4e04-45b6-4bf3-9268-8e7799549fef","Type":"ContainerStarted","Data":"d3f771648e662709d472887a8444cd4fb862ff803f5c5783805473d29772c01d"} May 28 23:05:07.505875 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:07.505856 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8zr45" event={"ID":"4e662546-4260-4167-aafa-19b834be1588","Type":"ContainerStarted","Data":"86807a8d90c5b07a18edaffd8dad284447c45d8176c8aa07464604464c64ec3d"} May 28 23:05:07.505969 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:07.505880 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8zr45" event={"ID":"4e662546-4260-4167-aafa-19b834be1588","Type":"ContainerStarted","Data":"29d65cd1790cb098850324d9f15a04d2c48b0f6e353b1b799dd3cdff7d6b4150"} May 28 23:05:07.506010 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:07.505968 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-8zr45" May 28 23:05:07.539974 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:07.539917 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-hs47z" podStartSLOduration=129.455455409 podStartE2EDuration="2m11.53990056s" podCreationTimestamp="2026-05-28 23:02:56 +0000 UTC" firstStartedPulling="2026-05-28 23:05:05.132060501 +0000 UTC m=+162.739874443" lastFinishedPulling="2026-05-28 23:05:07.21650564 +0000 UTC m=+164.824319594" observedRunningTime="2026-05-28 23:05:07.538618844 +0000 UTC m=+165.146432844" watchObservedRunningTime="2026-05-28 23:05:07.53990056 +0000 UTC m=+165.147714522" May 28 23:05:07.560657 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:07.560605 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-8zr45" podStartSLOduration=129.489948342 podStartE2EDuration="2m11.560587526s" podCreationTimestamp="2026-05-28 23:02:56 +0000 UTC" firstStartedPulling="2026-05-28 23:05:05.143414746 +0000 UTC m=+162.751228684" lastFinishedPulling="2026-05-28 23:05:07.214053926 +0000 UTC m=+164.821867868" observedRunningTime="2026-05-28 23:05:07.559400156 +0000 UTC m=+165.167214138" watchObservedRunningTime="2026-05-28 23:05:07.560587526 +0000 UTC m=+165.168401469" May 28 23:05:11.518865 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:11.518834 2577 generic.go:358] "Generic (PLEG): container finished" podID="defb2d12-d7af-4230-9e37-28b734ebccc7" containerID="8c955f5054827aef20f23b5b9ba62daa20c3fa06641cc1d13c8a37e2d7648593" exitCode=0 May 28 23:05:11.519311 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:11.518894 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-chlh5" event={"ID":"defb2d12-d7af-4230-9e37-28b734ebccc7","Type":"ContainerDied","Data":"8c955f5054827aef20f23b5b9ba62daa20c3fa06641cc1d13c8a37e2d7648593"} May 28 23:05:11.519355 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:11.519307 2577 scope.go:117] "RemoveContainer" containerID="8c955f5054827aef20f23b5b9ba62daa20c3fa06641cc1d13c8a37e2d7648593" May 28 23:05:12.022795 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:12.022770 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5bb668dbdb-9b9km" May 28 23:05:12.523635 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:12.523551 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-chlh5" event={"ID":"defb2d12-d7af-4230-9e37-28b734ebccc7","Type":"ContainerStarted","Data":"8532efcfb966b684c570cd9b69b641b47ec60bb63b6086f1937c4ceddcedd71c"} May 28 23:05:17.511052 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:17.511023 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-8zr45" May 28 23:05:27.036780 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:27.036746 2577 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5bb668dbdb-9b9km" podUID="02a2b450-c415-489b-8510-c98d35df0795" containerName="registry" containerID="cri-o://6ec359868a84460ef6faf6bf7b153678c71eb7365e361a9fa9cdc6d1082f3ea5" gracePeriod=30 May 28 23:05:28.572287 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:28.572257 2577 generic.go:358] "Generic (PLEG): container finished" podID="02a2b450-c415-489b-8510-c98d35df0795" containerID="6ec359868a84460ef6faf6bf7b153678c71eb7365e361a9fa9cdc6d1082f3ea5" exitCode=0 May 28 23:05:28.572639 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:28.572352 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bb668dbdb-9b9km" event={"ID":"02a2b450-c415-489b-8510-c98d35df0795","Type":"ContainerDied","Data":"6ec359868a84460ef6faf6bf7b153678c71eb7365e361a9fa9cdc6d1082f3ea5"} May 28 23:05:28.572639 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:28.572387 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bb668dbdb-9b9km" event={"ID":"02a2b450-c415-489b-8510-c98d35df0795","Type":"ContainerStarted","Data":"be0516456ef398c9c8cd86b2d39a1412a4dcafc7705291467f0b301074365ac6"} May 28 23:05:28.572639 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:28.572429 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5bb668dbdb-9b9km" May 28 23:05:36.029526 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:36.029489 2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 28 23:05:36.044752 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:36.044720 2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 28 23:05:36.611162 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:36.611126 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 28 23:05:49.579321 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:49.579293 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5bb668dbdb-9b9km" May 28 23:05:54.073871 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.073828 2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 28 23:05:54.074367 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.074302 2577 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2" containerName="prometheus" containerID="cri-o://5bb4f1c5374d2797b2c454252210150cd3c75c618bb83e2b45d35c270ed5ebce" gracePeriod=600 May 28 23:05:54.074367 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.074342 2577 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2" containerName="thanos-sidecar" containerID="cri-o://6d63feb56dccb5e3053197f17ded1df1d3ac9077b815858ba6ef9e3b4cc8bf2c" gracePeriod=600 May 28 23:05:54.074485 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.074393 2577 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2" containerName="kube-rbac-proxy-thanos" containerID="cri-o://ef555fdc3e4a77051efa19927d7d228a4cae501fbe21a1da937e3cf76669a546" gracePeriod=600 May 28 23:05:54.074485 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.074437 2577 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2" containerName="kube-rbac-proxy-web" containerID="cri-o://c41384d65b621eff4192319c4ead9cad35b03883884c6cfeaf685238189be1cc" gracePeriod=600 May 28 23:05:54.074587 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.074387 2577 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2" containerName="config-reloader" containerID="cri-o://54134dac55f6d876ec0d19ef894d4e34a997ce326d96e17025feb92ad35a6b92" gracePeriod=600 May 28 23:05:54.074587 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.074505 2577 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2" containerName="kube-rbac-proxy" containerID="cri-o://924e14c079f1aaad02b1a3ed9fc23c5ebf188409b83f2ad69cb322f08e05122a" gracePeriod=600 May 28 23:05:54.334790 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.334766 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 28 23:05:54.400271 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.400234 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\" (UID: \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\") " May 28 23:05:54.400431 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.400307 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-configmap-kubelet-serving-ca-bundle\") pod \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\" (UID: \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\") " May 28 23:05:54.400431 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.400350 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-tls-assets\") pod \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\" (UID: \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\") " May 28 23:05:54.400431 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.400379 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-secret-prometheus-k8s-tls\") pod \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\" (UID: \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\") " May 28 23:05:54.400431 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.400406 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-prometheus-k8s-rulefiles-0\") pod \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\" (UID: \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\") " May 28 23:05:54.400431 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.400431 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-secret-metrics-client-certs\") pod \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\" (UID: \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\") " May 28 23:05:54.400716 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.400473 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-prometheus-k8s-db\") pod \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\" (UID: \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\") " May 28 23:05:54.400716 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.400507 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-prometheus-trusted-ca-bundle\") pod \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\" (UID: \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\") " May 28 23:05:54.400716 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.400543 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\" (UID: \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\") " May 28 23:05:54.400716 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.400586 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lw7wv\" (UniqueName: \"kubernetes.io/projected/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-kube-api-access-lw7wv\") pod \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\" (UID: \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\") " May 28 23:05:54.400716 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.400619 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-config\") pod \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\" (UID: \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\") " May 28 23:05:54.400716 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.400650 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-secret-kube-rbac-proxy\") pod \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\" (UID: \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\") " May 28 23:05:54.400716 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.400679 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-thanos-prometheus-http-client-file\") pod \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\" (UID: \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\") " May 28 23:05:54.400716 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.400714 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-web-config\") pod \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\" (UID: \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\") " May 28 23:05:54.401144 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.400775 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-secret-grpc-tls\") pod \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\" (UID: \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\") " May 28 23:05:54.401144 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.400808 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-configmap-serving-certs-ca-bundle\") pod \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\" (UID: \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\") " May 28 23:05:54.401144 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.400836 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-config-out\") pod \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\" (UID: \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\") " May 28 23:05:54.401144 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.401040 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2" (UID: "cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 23:05:54.401963 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.401832 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2" (UID: "cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 23:05:54.401963 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.401935 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2" (UID: "cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 23:05:54.403158 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.402860 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2" (UID: "cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 23:05:54.403158 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.402886 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2" (UID: "cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 23:05:54.404498 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.404458 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2" (UID: "cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 23:05:54.404593 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.404543 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-config-out" (OuterVolumeSpecName: "config-out") pod "cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2" (UID: "cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 23:05:54.404593 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.404570 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2" (UID: "cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 23:05:54.404831 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.404789 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2" (UID: "cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 23:05:54.404909 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.404868 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2" (UID: "cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 23:05:54.405089 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.405038 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2" (UID: "cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 23:05:54.405335 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.405308 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2" (UID: "cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 23:05:54.405501 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.405474 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2" (UID: "cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 23:05:54.406004 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.405980 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-config" (OuterVolumeSpecName: "config") pod "cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2" (UID: "cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 23:05:54.406225 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.406206 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2" (UID: "cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 23:05:54.406375 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.406356 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-kube-api-access-lw7wv" (OuterVolumeSpecName: "kube-api-access-lw7wv") pod "cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2" (UID: "cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2"). InnerVolumeSpecName "kube-api-access-lw7wv". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 23:05:54.416210 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.416188 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-web-config" (OuterVolumeSpecName: "web-config") pod "cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2" (UID: "cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 23:05:54.501382 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.501340 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-configmap-metrics-client-ca\") pod \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\" (UID: \"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2\") " May 28 23:05:54.501547 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.501472 2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-132-11.ec2.internal\" DevicePath \"\"" May 28 23:05:54.501547 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.501486 2577 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-132-11.ec2.internal\" DevicePath \"\"" May 28 23:05:54.501547 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.501496 2577 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-tls-assets\") on node \"ip-10-0-132-11.ec2.internal\" DevicePath \"\"" May 28 23:05:54.501547 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.501505 2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-secret-prometheus-k8s-tls\") on node \"ip-10-0-132-11.ec2.internal\" DevicePath \"\"" May 28 23:05:54.501547 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.501513 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-132-11.ec2.internal\" DevicePath \"\"" May 28 23:05:54.501547 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.501523 2577 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-secret-metrics-client-certs\") on node \"ip-10-0-132-11.ec2.internal\" DevicePath \"\"" May 28 23:05:54.501547 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.501533 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-prometheus-k8s-db\") on node \"ip-10-0-132-11.ec2.internal\" DevicePath \"\"" May 28 23:05:54.501547 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.501541 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-prometheus-trusted-ca-bundle\") on node \"ip-10-0-132-11.ec2.internal\" DevicePath \"\"" May 28 23:05:54.501547 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.501550 2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-132-11.ec2.internal\" DevicePath \"\"" May 28 23:05:54.501811 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.501559 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lw7wv\" (UniqueName: \"kubernetes.io/projected/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-kube-api-access-lw7wv\") on node \"ip-10-0-132-11.ec2.internal\" DevicePath \"\"" May 28 23:05:54.501811 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.501567 2577 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-config\") on node \"ip-10-0-132-11.ec2.internal\" DevicePath \"\"" May 28 23:05:54.501811 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.501576 2577 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-secret-kube-rbac-proxy\") on node \"ip-10-0-132-11.ec2.internal\" DevicePath \"\"" May 28 23:05:54.501811 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.501584 2577 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-thanos-prometheus-http-client-file\") on node \"ip-10-0-132-11.ec2.internal\" DevicePath \"\"" May 28 23:05:54.501811 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.501593 2577 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-web-config\") on node \"ip-10-0-132-11.ec2.internal\" DevicePath \"\"" May 28 23:05:54.501811 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.501601 2577 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-secret-grpc-tls\") on node \"ip-10-0-132-11.ec2.internal\" DevicePath \"\"" May 28 23:05:54.501811 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.501608 2577 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-132-11.ec2.internal\" DevicePath \"\"" May 28 23:05:54.501811 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.501617 2577 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-config-out\") on node \"ip-10-0-132-11.ec2.internal\" DevicePath \"\"" May 28 23:05:54.501811 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.501666 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2" (UID: "cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 23:05:54.602613 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.602535 2577 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2-configmap-metrics-client-ca\") on node \"ip-10-0-132-11.ec2.internal\" DevicePath \"\"" May 28 23:05:54.649399 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.649367 2577 generic.go:358] "Generic (PLEG): container finished" podID="cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2" containerID="ef555fdc3e4a77051efa19927d7d228a4cae501fbe21a1da937e3cf76669a546" exitCode=0 May 28 23:05:54.649399 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.649394 2577 generic.go:358] "Generic (PLEG): container finished" podID="cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2" containerID="924e14c079f1aaad02b1a3ed9fc23c5ebf188409b83f2ad69cb322f08e05122a" exitCode=0 May 28 23:05:54.649399 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.649403 2577 generic.go:358] "Generic (PLEG): container finished" podID="cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2" containerID="c41384d65b621eff4192319c4ead9cad35b03883884c6cfeaf685238189be1cc" exitCode=0 May 28 23:05:54.649647 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.649413 2577 generic.go:358] "Generic (PLEG): container finished" podID="cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2" containerID="6d63feb56dccb5e3053197f17ded1df1d3ac9077b815858ba6ef9e3b4cc8bf2c" exitCode=0 May 28 23:05:54.649647 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.649422 2577 generic.go:358] "Generic (PLEG): container finished" podID="cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2" containerID="54134dac55f6d876ec0d19ef894d4e34a997ce326d96e17025feb92ad35a6b92" exitCode=0 May 28 23:05:54.649647 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.649420 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2","Type":"ContainerDied","Data":"ef555fdc3e4a77051efa19927d7d228a4cae501fbe21a1da937e3cf76669a546"} May 28 23:05:54.649647 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.649466 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2","Type":"ContainerDied","Data":"924e14c079f1aaad02b1a3ed9fc23c5ebf188409b83f2ad69cb322f08e05122a"} May 28 23:05:54.649647 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.649484 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2","Type":"ContainerDied","Data":"c41384d65b621eff4192319c4ead9cad35b03883884c6cfeaf685238189be1cc"} May 28 23:05:54.649647 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.649493 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 28 23:05:54.649647 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.649498 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2","Type":"ContainerDied","Data":"6d63feb56dccb5e3053197f17ded1df1d3ac9077b815858ba6ef9e3b4cc8bf2c"} May 28 23:05:54.649647 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.649429 2577 generic.go:358] "Generic (PLEG): container finished" podID="cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2" containerID="5bb4f1c5374d2797b2c454252210150cd3c75c618bb83e2b45d35c270ed5ebce" exitCode=0 May 28 23:05:54.649647 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.649525 2577 scope.go:117] "RemoveContainer" containerID="ef555fdc3e4a77051efa19927d7d228a4cae501fbe21a1da937e3cf76669a546" May 28 23:05:54.649647 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.649513 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2","Type":"ContainerDied","Data":"54134dac55f6d876ec0d19ef894d4e34a997ce326d96e17025feb92ad35a6b92"} May 28 23:05:54.649647 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.649574 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2","Type":"ContainerDied","Data":"5bb4f1c5374d2797b2c454252210150cd3c75c618bb83e2b45d35c270ed5ebce"} May 28 23:05:54.649647 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.649595 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2","Type":"ContainerDied","Data":"fa25b37a3004ad01695e93dede498315723af0d5078a5ef0798dbbfebf081a07"} May 28 23:05:54.657113 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.657095 2577 scope.go:117] "RemoveContainer" containerID="924e14c079f1aaad02b1a3ed9fc23c5ebf188409b83f2ad69cb322f08e05122a" May 28 23:05:54.663546 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.663528 2577 scope.go:117] "RemoveContainer" containerID="c41384d65b621eff4192319c4ead9cad35b03883884c6cfeaf685238189be1cc" May 28 23:05:54.670410 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.670393 2577 scope.go:117] "RemoveContainer" containerID="6d63feb56dccb5e3053197f17ded1df1d3ac9077b815858ba6ef9e3b4cc8bf2c" May 28 23:05:54.675138 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.675108 2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 28 23:05:54.678789 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.678765 2577 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 28 23:05:54.679047 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.679025 2577 scope.go:117] "RemoveContainer" containerID="54134dac55f6d876ec0d19ef894d4e34a997ce326d96e17025feb92ad35a6b92" May 28 23:05:54.687026 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.687006 2577 scope.go:117] "RemoveContainer" containerID="5bb4f1c5374d2797b2c454252210150cd3c75c618bb83e2b45d35c270ed5ebce" May 28 23:05:54.693893 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.693873 2577 scope.go:117] "RemoveContainer" containerID="1b7202bf94e0382223fdda14ff1abbbc2a90bed20e27bac56ba0ce342d86668d" May 28 23:05:54.700033 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.700018 2577 scope.go:117] "RemoveContainer" containerID="ef555fdc3e4a77051efa19927d7d228a4cae501fbe21a1da937e3cf76669a546" May 28 23:05:54.700296 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:05:54.700279 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef555fdc3e4a77051efa19927d7d228a4cae501fbe21a1da937e3cf76669a546\": container with ID starting with ef555fdc3e4a77051efa19927d7d228a4cae501fbe21a1da937e3cf76669a546 not found: ID does not exist" containerID="ef555fdc3e4a77051efa19927d7d228a4cae501fbe21a1da937e3cf76669a546" May 28 23:05:54.700369 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.700309 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef555fdc3e4a77051efa19927d7d228a4cae501fbe21a1da937e3cf76669a546"} err="failed to get container status \"ef555fdc3e4a77051efa19927d7d228a4cae501fbe21a1da937e3cf76669a546\": rpc error: code = NotFound desc = could not find container \"ef555fdc3e4a77051efa19927d7d228a4cae501fbe21a1da937e3cf76669a546\": container with ID starting with ef555fdc3e4a77051efa19927d7d228a4cae501fbe21a1da937e3cf76669a546 not found: ID does not exist" May 28 23:05:54.700369 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.700336 2577 scope.go:117] "RemoveContainer" containerID="924e14c079f1aaad02b1a3ed9fc23c5ebf188409b83f2ad69cb322f08e05122a" May 28 23:05:54.700556 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:05:54.700538 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"924e14c079f1aaad02b1a3ed9fc23c5ebf188409b83f2ad69cb322f08e05122a\": container with ID starting with 924e14c079f1aaad02b1a3ed9fc23c5ebf188409b83f2ad69cb322f08e05122a not found: ID does not exist" containerID="924e14c079f1aaad02b1a3ed9fc23c5ebf188409b83f2ad69cb322f08e05122a" May 28 23:05:54.700594 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.700562 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"924e14c079f1aaad02b1a3ed9fc23c5ebf188409b83f2ad69cb322f08e05122a"} err="failed to get container status \"924e14c079f1aaad02b1a3ed9fc23c5ebf188409b83f2ad69cb322f08e05122a\": rpc error: code = NotFound desc = could not find container \"924e14c079f1aaad02b1a3ed9fc23c5ebf188409b83f2ad69cb322f08e05122a\": container with ID starting with 924e14c079f1aaad02b1a3ed9fc23c5ebf188409b83f2ad69cb322f08e05122a not found: ID does not exist" May 28 23:05:54.700594 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.700582 2577 scope.go:117] "RemoveContainer" containerID="c41384d65b621eff4192319c4ead9cad35b03883884c6cfeaf685238189be1cc" May 28 23:05:54.700803 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:05:54.700788 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c41384d65b621eff4192319c4ead9cad35b03883884c6cfeaf685238189be1cc\": container with ID starting with c41384d65b621eff4192319c4ead9cad35b03883884c6cfeaf685238189be1cc not found: ID does not exist" containerID="c41384d65b621eff4192319c4ead9cad35b03883884c6cfeaf685238189be1cc" May 28 23:05:54.700847 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.700806 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c41384d65b621eff4192319c4ead9cad35b03883884c6cfeaf685238189be1cc"} err="failed to get container status \"c41384d65b621eff4192319c4ead9cad35b03883884c6cfeaf685238189be1cc\": rpc error: code = NotFound desc = could not find container \"c41384d65b621eff4192319c4ead9cad35b03883884c6cfeaf685238189be1cc\": container with ID starting with c41384d65b621eff4192319c4ead9cad35b03883884c6cfeaf685238189be1cc not found: ID does not exist" May 28 23:05:54.700847 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.700820 2577 scope.go:117] "RemoveContainer" containerID="6d63feb56dccb5e3053197f17ded1df1d3ac9077b815858ba6ef9e3b4cc8bf2c" May 28 23:05:54.701108 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:05:54.701054 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d63feb56dccb5e3053197f17ded1df1d3ac9077b815858ba6ef9e3b4cc8bf2c\": container with ID starting with 6d63feb56dccb5e3053197f17ded1df1d3ac9077b815858ba6ef9e3b4cc8bf2c not found: ID does not exist" containerID="6d63feb56dccb5e3053197f17ded1df1d3ac9077b815858ba6ef9e3b4cc8bf2c" May 28 23:05:54.701108 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.701094 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d63feb56dccb5e3053197f17ded1df1d3ac9077b815858ba6ef9e3b4cc8bf2c"} err="failed to get container status \"6d63feb56dccb5e3053197f17ded1df1d3ac9077b815858ba6ef9e3b4cc8bf2c\": rpc error: code = NotFound desc = could not find container \"6d63feb56dccb5e3053197f17ded1df1d3ac9077b815858ba6ef9e3b4cc8bf2c\": container with ID starting with 6d63feb56dccb5e3053197f17ded1df1d3ac9077b815858ba6ef9e3b4cc8bf2c not found: ID does not exist" May 28 23:05:54.701223 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.701116 2577 scope.go:117] "RemoveContainer" containerID="54134dac55f6d876ec0d19ef894d4e34a997ce326d96e17025feb92ad35a6b92" May 28 23:05:54.701367 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:05:54.701350 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54134dac55f6d876ec0d19ef894d4e34a997ce326d96e17025feb92ad35a6b92\": container with ID starting with 54134dac55f6d876ec0d19ef894d4e34a997ce326d96e17025feb92ad35a6b92 not found: ID does not exist" containerID="54134dac55f6d876ec0d19ef894d4e34a997ce326d96e17025feb92ad35a6b92" May 28 23:05:54.701403 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.701372 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54134dac55f6d876ec0d19ef894d4e34a997ce326d96e17025feb92ad35a6b92"} err="failed to get container status \"54134dac55f6d876ec0d19ef894d4e34a997ce326d96e17025feb92ad35a6b92\": rpc error: code = NotFound desc = could not find container \"54134dac55f6d876ec0d19ef894d4e34a997ce326d96e17025feb92ad35a6b92\": container with ID starting with 54134dac55f6d876ec0d19ef894d4e34a997ce326d96e17025feb92ad35a6b92 not found: ID does not exist" May 28 23:05:54.701403 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.701387 2577 scope.go:117] "RemoveContainer" containerID="5bb4f1c5374d2797b2c454252210150cd3c75c618bb83e2b45d35c270ed5ebce" May 28 23:05:54.701624 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:05:54.701604 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5bb4f1c5374d2797b2c454252210150cd3c75c618bb83e2b45d35c270ed5ebce\": container with ID starting with 5bb4f1c5374d2797b2c454252210150cd3c75c618bb83e2b45d35c270ed5ebce not found: ID does not exist" containerID="5bb4f1c5374d2797b2c454252210150cd3c75c618bb83e2b45d35c270ed5ebce" May 28 23:05:54.701682 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.701630 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5bb4f1c5374d2797b2c454252210150cd3c75c618bb83e2b45d35c270ed5ebce"} err="failed to get container status \"5bb4f1c5374d2797b2c454252210150cd3c75c618bb83e2b45d35c270ed5ebce\": rpc error: code = NotFound desc = could not find container \"5bb4f1c5374d2797b2c454252210150cd3c75c618bb83e2b45d35c270ed5ebce\": container with ID starting with 5bb4f1c5374d2797b2c454252210150cd3c75c618bb83e2b45d35c270ed5ebce not found: ID does not exist" May 28 23:05:54.701682 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.701650 2577 scope.go:117] "RemoveContainer" containerID="1b7202bf94e0382223fdda14ff1abbbc2a90bed20e27bac56ba0ce342d86668d" May 28 23:05:54.702120 ip-10-0-132-11 kubenswrapper[2577]: E0528 23:05:54.702093 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b7202bf94e0382223fdda14ff1abbbc2a90bed20e27bac56ba0ce342d86668d\": container with ID starting with 1b7202bf94e0382223fdda14ff1abbbc2a90bed20e27bac56ba0ce342d86668d not found: ID does not exist" containerID="1b7202bf94e0382223fdda14ff1abbbc2a90bed20e27bac56ba0ce342d86668d" May 28 23:05:54.702230 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.702126 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b7202bf94e0382223fdda14ff1abbbc2a90bed20e27bac56ba0ce342d86668d"} err="failed to get container status \"1b7202bf94e0382223fdda14ff1abbbc2a90bed20e27bac56ba0ce342d86668d\": rpc error: code = NotFound desc = could not find container \"1b7202bf94e0382223fdda14ff1abbbc2a90bed20e27bac56ba0ce342d86668d\": container with ID starting with 1b7202bf94e0382223fdda14ff1abbbc2a90bed20e27bac56ba0ce342d86668d not found: ID does not exist" May 28 23:05:54.702230 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.702147 2577 scope.go:117] "RemoveContainer" containerID="ef555fdc3e4a77051efa19927d7d228a4cae501fbe21a1da937e3cf76669a546" May 28 23:05:54.702473 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.702451 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef555fdc3e4a77051efa19927d7d228a4cae501fbe21a1da937e3cf76669a546"} err="failed to get container status \"ef555fdc3e4a77051efa19927d7d228a4cae501fbe21a1da937e3cf76669a546\": rpc error: code = NotFound desc = could not find container \"ef555fdc3e4a77051efa19927d7d228a4cae501fbe21a1da937e3cf76669a546\": container with ID starting with ef555fdc3e4a77051efa19927d7d228a4cae501fbe21a1da937e3cf76669a546 not found: ID does not exist" May 28 23:05:54.702559 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.702475 2577 scope.go:117] "RemoveContainer" containerID="924e14c079f1aaad02b1a3ed9fc23c5ebf188409b83f2ad69cb322f08e05122a" May 28 23:05:54.702749 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.702720 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"924e14c079f1aaad02b1a3ed9fc23c5ebf188409b83f2ad69cb322f08e05122a"} err="failed to get container status \"924e14c079f1aaad02b1a3ed9fc23c5ebf188409b83f2ad69cb322f08e05122a\": rpc error: code = NotFound desc = could not find container \"924e14c079f1aaad02b1a3ed9fc23c5ebf188409b83f2ad69cb322f08e05122a\": container with ID starting with 924e14c079f1aaad02b1a3ed9fc23c5ebf188409b83f2ad69cb322f08e05122a not found: ID does not exist" May 28 23:05:54.702857 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.702750 2577 scope.go:117] "RemoveContainer" containerID="c41384d65b621eff4192319c4ead9cad35b03883884c6cfeaf685238189be1cc" May 28 23:05:54.703033 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.703008 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c41384d65b621eff4192319c4ead9cad35b03883884c6cfeaf685238189be1cc"} err="failed to get container status \"c41384d65b621eff4192319c4ead9cad35b03883884c6cfeaf685238189be1cc\": rpc error: code = NotFound desc = could not find container \"c41384d65b621eff4192319c4ead9cad35b03883884c6cfeaf685238189be1cc\": container with ID starting with c41384d65b621eff4192319c4ead9cad35b03883884c6cfeaf685238189be1cc not found: ID does not exist" May 28 23:05:54.703122 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.703035 2577 scope.go:117] "RemoveContainer" containerID="6d63feb56dccb5e3053197f17ded1df1d3ac9077b815858ba6ef9e3b4cc8bf2c" May 28 23:05:54.703342 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.703322 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d63feb56dccb5e3053197f17ded1df1d3ac9077b815858ba6ef9e3b4cc8bf2c"} err="failed to get container status \"6d63feb56dccb5e3053197f17ded1df1d3ac9077b815858ba6ef9e3b4cc8bf2c\": rpc error: code = NotFound desc = could not find container \"6d63feb56dccb5e3053197f17ded1df1d3ac9077b815858ba6ef9e3b4cc8bf2c\": container with ID starting with 6d63feb56dccb5e3053197f17ded1df1d3ac9077b815858ba6ef9e3b4cc8bf2c not found: ID does not exist" May 28 23:05:54.703406 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.703343 2577 scope.go:117] "RemoveContainer" containerID="54134dac55f6d876ec0d19ef894d4e34a997ce326d96e17025feb92ad35a6b92" May 28 23:05:54.703576 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.703558 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54134dac55f6d876ec0d19ef894d4e34a997ce326d96e17025feb92ad35a6b92"} err="failed to get container status \"54134dac55f6d876ec0d19ef894d4e34a997ce326d96e17025feb92ad35a6b92\": rpc error: code = NotFound desc = could not find container \"54134dac55f6d876ec0d19ef894d4e34a997ce326d96e17025feb92ad35a6b92\": container with ID starting with 54134dac55f6d876ec0d19ef894d4e34a997ce326d96e17025feb92ad35a6b92 not found: ID does not exist" May 28 23:05:54.703645 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.703576 2577 scope.go:117] "RemoveContainer" containerID="5bb4f1c5374d2797b2c454252210150cd3c75c618bb83e2b45d35c270ed5ebce" May 28 23:05:54.703645 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.703603 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 28 23:05:54.703801 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.703780 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5bb4f1c5374d2797b2c454252210150cd3c75c618bb83e2b45d35c270ed5ebce"} err="failed to get container status \"5bb4f1c5374d2797b2c454252210150cd3c75c618bb83e2b45d35c270ed5ebce\": rpc error: code = NotFound desc = could not find container \"5bb4f1c5374d2797b2c454252210150cd3c75c618bb83e2b45d35c270ed5ebce\": container with ID starting with 5bb4f1c5374d2797b2c454252210150cd3c75c618bb83e2b45d35c270ed5ebce not found: ID does not exist" May 28 23:05:54.703858 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.703804 2577 scope.go:117] "RemoveContainer" containerID="1b7202bf94e0382223fdda14ff1abbbc2a90bed20e27bac56ba0ce342d86668d" May 28 23:05:54.703937 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.703921 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38466838-c402-4a49-a894-a96c827df8f5" containerName="registry" May 28 23:05:54.703937 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.703938 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="38466838-c402-4a49-a894-a96c827df8f5" containerName="registry" May 28 23:05:54.704049 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.703947 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2" containerName="init-config-reloader" May 28 23:05:54.704049 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.703955 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2" containerName="init-config-reloader" May 28 23:05:54.704049 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.703966 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2" containerName="config-reloader" May 28 23:05:54.704049 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.703975 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2" containerName="config-reloader" May 28 23:05:54.704049 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.703984 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2" containerName="kube-rbac-proxy" May 28 23:05:54.704049 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.703990 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2" containerName="kube-rbac-proxy" May 28 23:05:54.704049 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.704001 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2" containerName="kube-rbac-proxy-thanos" May 28 23:05:54.704049 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.704009 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2" containerName="kube-rbac-proxy-thanos" May 28 23:05:54.704049 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.704019 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2" containerName="thanos-sidecar" May 28 23:05:54.704049 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.704026 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2" containerName="thanos-sidecar" May 28 23:05:54.704049 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.704035 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2" containerName="kube-rbac-proxy-web" May 28 23:05:54.704049 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.704042 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2" containerName="kube-rbac-proxy-web" May 28 23:05:54.704049 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.704031 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b7202bf94e0382223fdda14ff1abbbc2a90bed20e27bac56ba0ce342d86668d"} err="failed to get container status \"1b7202bf94e0382223fdda14ff1abbbc2a90bed20e27bac56ba0ce342d86668d\": rpc error: code = NotFound desc = could not find container \"1b7202bf94e0382223fdda14ff1abbbc2a90bed20e27bac56ba0ce342d86668d\": container with ID starting with 1b7202bf94e0382223fdda14ff1abbbc2a90bed20e27bac56ba0ce342d86668d not found: ID does not exist" May 28 23:05:54.704049 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.704056 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2" containerName="prometheus" May 28 23:05:54.705060 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.704057 2577 scope.go:117] "RemoveContainer" containerID="ef555fdc3e4a77051efa19927d7d228a4cae501fbe21a1da937e3cf76669a546" May 28 23:05:54.705060 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.704062 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2" containerName="prometheus" May 28 23:05:54.705060 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.704131 2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2" containerName="prometheus" May 28 23:05:54.705060 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.704143 2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2" containerName="config-reloader" May 28 23:05:54.705060 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.704152 2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="38466838-c402-4a49-a894-a96c827df8f5" containerName="registry" May 28 23:05:54.705060 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.704162 2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2" containerName="thanos-sidecar" May 28 23:05:54.705060 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.704170 2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2" containerName="kube-rbac-proxy-web" May 28 23:05:54.705060 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.704179 2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2" containerName="kube-rbac-proxy" May 28 23:05:54.705060 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.704189 2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2" containerName="kube-rbac-proxy-thanos" May 28 23:05:54.705060 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.704321 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef555fdc3e4a77051efa19927d7d228a4cae501fbe21a1da937e3cf76669a546"} err="failed to get container status \"ef555fdc3e4a77051efa19927d7d228a4cae501fbe21a1da937e3cf76669a546\": rpc error: code = NotFound desc = could not find container \"ef555fdc3e4a77051efa19927d7d228a4cae501fbe21a1da937e3cf76669a546\": container with ID starting with ef555fdc3e4a77051efa19927d7d228a4cae501fbe21a1da937e3cf76669a546 not found: ID does not exist" May 28 23:05:54.705060 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.704342 2577 scope.go:117] "RemoveContainer" containerID="924e14c079f1aaad02b1a3ed9fc23c5ebf188409b83f2ad69cb322f08e05122a" May 28 23:05:54.705060 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.704621 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"924e14c079f1aaad02b1a3ed9fc23c5ebf188409b83f2ad69cb322f08e05122a"} err="failed to get container status \"924e14c079f1aaad02b1a3ed9fc23c5ebf188409b83f2ad69cb322f08e05122a\": rpc error: code = NotFound desc = could not find container \"924e14c079f1aaad02b1a3ed9fc23c5ebf188409b83f2ad69cb322f08e05122a\": container with ID starting with 924e14c079f1aaad02b1a3ed9fc23c5ebf188409b83f2ad69cb322f08e05122a not found: ID does not exist" May 28 23:05:54.705060 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.704656 2577 scope.go:117] "RemoveContainer" containerID="c41384d65b621eff4192319c4ead9cad35b03883884c6cfeaf685238189be1cc" May 28 23:05:54.705060 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.704936 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c41384d65b621eff4192319c4ead9cad35b03883884c6cfeaf685238189be1cc"} err="failed to get container status \"c41384d65b621eff4192319c4ead9cad35b03883884c6cfeaf685238189be1cc\": rpc error: code = NotFound desc = could not find container \"c41384d65b621eff4192319c4ead9cad35b03883884c6cfeaf685238189be1cc\": container with ID starting with c41384d65b621eff4192319c4ead9cad35b03883884c6cfeaf685238189be1cc not found: ID does not exist" May 28 23:05:54.705060 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.704967 2577 scope.go:117] "RemoveContainer" containerID="6d63feb56dccb5e3053197f17ded1df1d3ac9077b815858ba6ef9e3b4cc8bf2c" May 28 23:05:54.705718 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.705283 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d63feb56dccb5e3053197f17ded1df1d3ac9077b815858ba6ef9e3b4cc8bf2c"} err="failed to get container status \"6d63feb56dccb5e3053197f17ded1df1d3ac9077b815858ba6ef9e3b4cc8bf2c\": rpc error: code = NotFound desc = could not find container \"6d63feb56dccb5e3053197f17ded1df1d3ac9077b815858ba6ef9e3b4cc8bf2c\": container with ID starting with 6d63feb56dccb5e3053197f17ded1df1d3ac9077b815858ba6ef9e3b4cc8bf2c not found: ID does not exist" May 28 23:05:54.705718 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.705303 2577 scope.go:117] "RemoveContainer" containerID="54134dac55f6d876ec0d19ef894d4e34a997ce326d96e17025feb92ad35a6b92" May 28 23:05:54.705718 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.705524 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54134dac55f6d876ec0d19ef894d4e34a997ce326d96e17025feb92ad35a6b92"} err="failed to get container status \"54134dac55f6d876ec0d19ef894d4e34a997ce326d96e17025feb92ad35a6b92\": rpc error: code = NotFound desc = could not find container \"54134dac55f6d876ec0d19ef894d4e34a997ce326d96e17025feb92ad35a6b92\": container with ID starting with 54134dac55f6d876ec0d19ef894d4e34a997ce326d96e17025feb92ad35a6b92 not found: ID does not exist" May 28 23:05:54.705718 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.705545 2577 scope.go:117] "RemoveContainer" containerID="5bb4f1c5374d2797b2c454252210150cd3c75c618bb83e2b45d35c270ed5ebce" May 28 23:05:54.705866 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.705747 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5bb4f1c5374d2797b2c454252210150cd3c75c618bb83e2b45d35c270ed5ebce"} err="failed to get container status \"5bb4f1c5374d2797b2c454252210150cd3c75c618bb83e2b45d35c270ed5ebce\": rpc error: code = NotFound desc = could not find container \"5bb4f1c5374d2797b2c454252210150cd3c75c618bb83e2b45d35c270ed5ebce\": container with ID starting with 5bb4f1c5374d2797b2c454252210150cd3c75c618bb83e2b45d35c270ed5ebce not found: ID does not exist" May 28 23:05:54.705866 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.705763 2577 scope.go:117] "RemoveContainer" containerID="1b7202bf94e0382223fdda14ff1abbbc2a90bed20e27bac56ba0ce342d86668d" May 28 23:05:54.706007 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.705989 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b7202bf94e0382223fdda14ff1abbbc2a90bed20e27bac56ba0ce342d86668d"} err="failed to get container status \"1b7202bf94e0382223fdda14ff1abbbc2a90bed20e27bac56ba0ce342d86668d\": rpc error: code = NotFound desc = could not find container \"1b7202bf94e0382223fdda14ff1abbbc2a90bed20e27bac56ba0ce342d86668d\": container with ID starting with 1b7202bf94e0382223fdda14ff1abbbc2a90bed20e27bac56ba0ce342d86668d not found: ID does not exist" May 28 23:05:54.706047 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.706007 2577 scope.go:117] "RemoveContainer" containerID="ef555fdc3e4a77051efa19927d7d228a4cae501fbe21a1da937e3cf76669a546" May 28 23:05:54.706230 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.706211 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef555fdc3e4a77051efa19927d7d228a4cae501fbe21a1da937e3cf76669a546"} err="failed to get container status \"ef555fdc3e4a77051efa19927d7d228a4cae501fbe21a1da937e3cf76669a546\": rpc error: code = NotFound desc = could not find container \"ef555fdc3e4a77051efa19927d7d228a4cae501fbe21a1da937e3cf76669a546\": container with ID starting with ef555fdc3e4a77051efa19927d7d228a4cae501fbe21a1da937e3cf76669a546 not found: ID does not exist" May 28 23:05:54.706266 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.706231 2577 scope.go:117] "RemoveContainer" containerID="924e14c079f1aaad02b1a3ed9fc23c5ebf188409b83f2ad69cb322f08e05122a" May 28 23:05:54.706437 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.706419 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"924e14c079f1aaad02b1a3ed9fc23c5ebf188409b83f2ad69cb322f08e05122a"} err="failed to get container status \"924e14c079f1aaad02b1a3ed9fc23c5ebf188409b83f2ad69cb322f08e05122a\": rpc error: code = NotFound desc = could not find container \"924e14c079f1aaad02b1a3ed9fc23c5ebf188409b83f2ad69cb322f08e05122a\": container with ID starting with 924e14c079f1aaad02b1a3ed9fc23c5ebf188409b83f2ad69cb322f08e05122a not found: ID does not exist" May 28 23:05:54.706482 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.706437 2577 scope.go:117] "RemoveContainer" containerID="c41384d65b621eff4192319c4ead9cad35b03883884c6cfeaf685238189be1cc" May 28 23:05:54.706661 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.706640 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c41384d65b621eff4192319c4ead9cad35b03883884c6cfeaf685238189be1cc"} err="failed to get container status \"c41384d65b621eff4192319c4ead9cad35b03883884c6cfeaf685238189be1cc\": rpc error: code = NotFound desc = could not find container \"c41384d65b621eff4192319c4ead9cad35b03883884c6cfeaf685238189be1cc\": container with ID starting with c41384d65b621eff4192319c4ead9cad35b03883884c6cfeaf685238189be1cc not found: ID does not exist" May 28 23:05:54.706724 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.706661 2577 scope.go:117] "RemoveContainer" containerID="6d63feb56dccb5e3053197f17ded1df1d3ac9077b815858ba6ef9e3b4cc8bf2c" May 28 23:05:54.706848 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.706830 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d63feb56dccb5e3053197f17ded1df1d3ac9077b815858ba6ef9e3b4cc8bf2c"} err="failed to get container status \"6d63feb56dccb5e3053197f17ded1df1d3ac9077b815858ba6ef9e3b4cc8bf2c\": rpc error: code = NotFound desc = could not find container \"6d63feb56dccb5e3053197f17ded1df1d3ac9077b815858ba6ef9e3b4cc8bf2c\": container with ID starting with 6d63feb56dccb5e3053197f17ded1df1d3ac9077b815858ba6ef9e3b4cc8bf2c not found: ID does not exist" May 28 23:05:54.706902 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.706850 2577 scope.go:117] "RemoveContainer" containerID="54134dac55f6d876ec0d19ef894d4e34a997ce326d96e17025feb92ad35a6b92" May 28 23:05:54.707023 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.707008 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54134dac55f6d876ec0d19ef894d4e34a997ce326d96e17025feb92ad35a6b92"} err="failed to get container status \"54134dac55f6d876ec0d19ef894d4e34a997ce326d96e17025feb92ad35a6b92\": rpc error: code = NotFound desc = could not find container \"54134dac55f6d876ec0d19ef894d4e34a997ce326d96e17025feb92ad35a6b92\": container with ID starting with 54134dac55f6d876ec0d19ef894d4e34a997ce326d96e17025feb92ad35a6b92 not found: ID does not exist" May 28 23:05:54.707085 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.707025 2577 scope.go:117] "RemoveContainer" containerID="5bb4f1c5374d2797b2c454252210150cd3c75c618bb83e2b45d35c270ed5ebce" May 28 23:05:54.707237 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.707221 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5bb4f1c5374d2797b2c454252210150cd3c75c618bb83e2b45d35c270ed5ebce"} err="failed to get container status \"5bb4f1c5374d2797b2c454252210150cd3c75c618bb83e2b45d35c270ed5ebce\": rpc error: code = NotFound desc = could not find container \"5bb4f1c5374d2797b2c454252210150cd3c75c618bb83e2b45d35c270ed5ebce\": container with ID starting with 5bb4f1c5374d2797b2c454252210150cd3c75c618bb83e2b45d35c270ed5ebce not found: ID does not exist" May 28 23:05:54.707285 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.707237 2577 scope.go:117] "RemoveContainer" containerID="1b7202bf94e0382223fdda14ff1abbbc2a90bed20e27bac56ba0ce342d86668d" May 28 23:05:54.707434 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.707415 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b7202bf94e0382223fdda14ff1abbbc2a90bed20e27bac56ba0ce342d86668d"} err="failed to get container status \"1b7202bf94e0382223fdda14ff1abbbc2a90bed20e27bac56ba0ce342d86668d\": rpc error: code = NotFound desc = could not find container \"1b7202bf94e0382223fdda14ff1abbbc2a90bed20e27bac56ba0ce342d86668d\": container with ID starting with 1b7202bf94e0382223fdda14ff1abbbc2a90bed20e27bac56ba0ce342d86668d not found: ID does not exist" May 28 23:05:54.707498 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.707437 2577 scope.go:117] "RemoveContainer" containerID="ef555fdc3e4a77051efa19927d7d228a4cae501fbe21a1da937e3cf76669a546" May 28 23:05:54.707646 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.707628 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef555fdc3e4a77051efa19927d7d228a4cae501fbe21a1da937e3cf76669a546"} err="failed to get container status \"ef555fdc3e4a77051efa19927d7d228a4cae501fbe21a1da937e3cf76669a546\": rpc error: code = NotFound desc = could not find container \"ef555fdc3e4a77051efa19927d7d228a4cae501fbe21a1da937e3cf76669a546\": container with ID starting with ef555fdc3e4a77051efa19927d7d228a4cae501fbe21a1da937e3cf76669a546 not found: ID does not exist" May 28 23:05:54.707695 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.707647 2577 scope.go:117] "RemoveContainer" containerID="924e14c079f1aaad02b1a3ed9fc23c5ebf188409b83f2ad69cb322f08e05122a" May 28 23:05:54.707821 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.707804 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"924e14c079f1aaad02b1a3ed9fc23c5ebf188409b83f2ad69cb322f08e05122a"} err="failed to get container status \"924e14c079f1aaad02b1a3ed9fc23c5ebf188409b83f2ad69cb322f08e05122a\": rpc error: code = NotFound desc = could not find container \"924e14c079f1aaad02b1a3ed9fc23c5ebf188409b83f2ad69cb322f08e05122a\": container with ID starting with 924e14c079f1aaad02b1a3ed9fc23c5ebf188409b83f2ad69cb322f08e05122a not found: ID does not exist" May 28 23:05:54.707889 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.707823 2577 scope.go:117] "RemoveContainer" containerID="c41384d65b621eff4192319c4ead9cad35b03883884c6cfeaf685238189be1cc" May 28 23:05:54.708017 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.708001 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c41384d65b621eff4192319c4ead9cad35b03883884c6cfeaf685238189be1cc"} err="failed to get container status \"c41384d65b621eff4192319c4ead9cad35b03883884c6cfeaf685238189be1cc\": rpc error: code = NotFound desc = could not find container \"c41384d65b621eff4192319c4ead9cad35b03883884c6cfeaf685238189be1cc\": container with ID starting with c41384d65b621eff4192319c4ead9cad35b03883884c6cfeaf685238189be1cc not found: ID does not exist" May 28 23:05:54.708063 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.708017 2577 scope.go:117] "RemoveContainer" containerID="6d63feb56dccb5e3053197f17ded1df1d3ac9077b815858ba6ef9e3b4cc8bf2c" May 28 23:05:54.708229 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.708215 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d63feb56dccb5e3053197f17ded1df1d3ac9077b815858ba6ef9e3b4cc8bf2c"} err="failed to get container status \"6d63feb56dccb5e3053197f17ded1df1d3ac9077b815858ba6ef9e3b4cc8bf2c\": rpc error: code = NotFound desc = could not find container \"6d63feb56dccb5e3053197f17ded1df1d3ac9077b815858ba6ef9e3b4cc8bf2c\": container with ID starting with 6d63feb56dccb5e3053197f17ded1df1d3ac9077b815858ba6ef9e3b4cc8bf2c not found: ID does not exist" May 28 23:05:54.708273 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.708231 2577 scope.go:117] "RemoveContainer" containerID="54134dac55f6d876ec0d19ef894d4e34a997ce326d96e17025feb92ad35a6b92" May 28 23:05:54.708431 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.708410 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54134dac55f6d876ec0d19ef894d4e34a997ce326d96e17025feb92ad35a6b92"} err="failed to get container status \"54134dac55f6d876ec0d19ef894d4e34a997ce326d96e17025feb92ad35a6b92\": rpc error: code = NotFound desc = could not find container \"54134dac55f6d876ec0d19ef894d4e34a997ce326d96e17025feb92ad35a6b92\": container with ID starting with 54134dac55f6d876ec0d19ef894d4e34a997ce326d96e17025feb92ad35a6b92 not found: ID does not exist" May 28 23:05:54.708503 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.708433 2577 scope.go:117] "RemoveContainer" containerID="5bb4f1c5374d2797b2c454252210150cd3c75c618bb83e2b45d35c270ed5ebce" May 28 23:05:54.708624 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.708601 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5bb4f1c5374d2797b2c454252210150cd3c75c618bb83e2b45d35c270ed5ebce"} err="failed to get container status \"5bb4f1c5374d2797b2c454252210150cd3c75c618bb83e2b45d35c270ed5ebce\": rpc error: code = NotFound desc = could not find container \"5bb4f1c5374d2797b2c454252210150cd3c75c618bb83e2b45d35c270ed5ebce\": container with ID starting with 5bb4f1c5374d2797b2c454252210150cd3c75c618bb83e2b45d35c270ed5ebce not found: ID does not exist" May 28 23:05:54.708674 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.708626 2577 scope.go:117] "RemoveContainer" containerID="1b7202bf94e0382223fdda14ff1abbbc2a90bed20e27bac56ba0ce342d86668d" May 28 23:05:54.708785 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.708771 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b7202bf94e0382223fdda14ff1abbbc2a90bed20e27bac56ba0ce342d86668d"} err="failed to get container status \"1b7202bf94e0382223fdda14ff1abbbc2a90bed20e27bac56ba0ce342d86668d\": rpc error: code = NotFound desc = could not find container \"1b7202bf94e0382223fdda14ff1abbbc2a90bed20e27bac56ba0ce342d86668d\": container with ID starting with 1b7202bf94e0382223fdda14ff1abbbc2a90bed20e27bac56ba0ce342d86668d not found: ID does not exist" May 28 23:05:54.708827 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.708785 2577 scope.go:117] "RemoveContainer" containerID="ef555fdc3e4a77051efa19927d7d228a4cae501fbe21a1da937e3cf76669a546" May 28 23:05:54.708974 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.708958 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef555fdc3e4a77051efa19927d7d228a4cae501fbe21a1da937e3cf76669a546"} err="failed to get container status \"ef555fdc3e4a77051efa19927d7d228a4cae501fbe21a1da937e3cf76669a546\": rpc error: code = NotFound desc = could not find container \"ef555fdc3e4a77051efa19927d7d228a4cae501fbe21a1da937e3cf76669a546\": container with ID starting with ef555fdc3e4a77051efa19927d7d228a4cae501fbe21a1da937e3cf76669a546 not found: ID does not exist" May 28 23:05:54.709022 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.708974 2577 scope.go:117] "RemoveContainer" containerID="924e14c079f1aaad02b1a3ed9fc23c5ebf188409b83f2ad69cb322f08e05122a" May 28 23:05:54.709208 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.709193 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"924e14c079f1aaad02b1a3ed9fc23c5ebf188409b83f2ad69cb322f08e05122a"} err="failed to get container status \"924e14c079f1aaad02b1a3ed9fc23c5ebf188409b83f2ad69cb322f08e05122a\": rpc error: code = NotFound desc = could not find container \"924e14c079f1aaad02b1a3ed9fc23c5ebf188409b83f2ad69cb322f08e05122a\": container with ID starting with 924e14c079f1aaad02b1a3ed9fc23c5ebf188409b83f2ad69cb322f08e05122a not found: ID does not exist" May 28 23:05:54.709252 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.709208 2577 scope.go:117] "RemoveContainer" containerID="c41384d65b621eff4192319c4ead9cad35b03883884c6cfeaf685238189be1cc" May 28 23:05:54.709408 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.709387 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c41384d65b621eff4192319c4ead9cad35b03883884c6cfeaf685238189be1cc"} err="failed to get container status \"c41384d65b621eff4192319c4ead9cad35b03883884c6cfeaf685238189be1cc\": rpc error: code = NotFound desc = could not find container \"c41384d65b621eff4192319c4ead9cad35b03883884c6cfeaf685238189be1cc\": container with ID starting with c41384d65b621eff4192319c4ead9cad35b03883884c6cfeaf685238189be1cc not found: ID does not exist" May 28 23:05:54.709408 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.709406 2577 scope.go:117] "RemoveContainer" containerID="6d63feb56dccb5e3053197f17ded1df1d3ac9077b815858ba6ef9e3b4cc8bf2c" May 28 23:05:54.709607 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.709591 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d63feb56dccb5e3053197f17ded1df1d3ac9077b815858ba6ef9e3b4cc8bf2c"} err="failed to get container status \"6d63feb56dccb5e3053197f17ded1df1d3ac9077b815858ba6ef9e3b4cc8bf2c\": rpc error: code = NotFound desc = could not find container \"6d63feb56dccb5e3053197f17ded1df1d3ac9077b815858ba6ef9e3b4cc8bf2c\": container with ID starting with 6d63feb56dccb5e3053197f17ded1df1d3ac9077b815858ba6ef9e3b4cc8bf2c not found: ID does not exist" May 28 23:05:54.709646 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.709608 2577 scope.go:117] "RemoveContainer" containerID="54134dac55f6d876ec0d19ef894d4e34a997ce326d96e17025feb92ad35a6b92" May 28 23:05:54.709818 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.709803 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 28 23:05:54.709865 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.709825 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54134dac55f6d876ec0d19ef894d4e34a997ce326d96e17025feb92ad35a6b92"} err="failed to get container status \"54134dac55f6d876ec0d19ef894d4e34a997ce326d96e17025feb92ad35a6b92\": rpc error: code = NotFound desc = could not find container \"54134dac55f6d876ec0d19ef894d4e34a997ce326d96e17025feb92ad35a6b92\": container with ID starting with 54134dac55f6d876ec0d19ef894d4e34a997ce326d96e17025feb92ad35a6b92 not found: ID does not exist" May 28 23:05:54.709865 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.709842 2577 scope.go:117] "RemoveContainer" containerID="5bb4f1c5374d2797b2c454252210150cd3c75c618bb83e2b45d35c270ed5ebce" May 28 23:05:54.710062 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.710033 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5bb4f1c5374d2797b2c454252210150cd3c75c618bb83e2b45d35c270ed5ebce"} err="failed to get container status \"5bb4f1c5374d2797b2c454252210150cd3c75c618bb83e2b45d35c270ed5ebce\": rpc error: code = NotFound desc = could not find container \"5bb4f1c5374d2797b2c454252210150cd3c75c618bb83e2b45d35c270ed5ebce\": container with ID starting with 5bb4f1c5374d2797b2c454252210150cd3c75c618bb83e2b45d35c270ed5ebce not found: ID does not exist" May 28 23:05:54.710062 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.710063 2577 scope.go:117] "RemoveContainer" containerID="1b7202bf94e0382223fdda14ff1abbbc2a90bed20e27bac56ba0ce342d86668d" May 28 23:05:54.710412 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.710390 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b7202bf94e0382223fdda14ff1abbbc2a90bed20e27bac56ba0ce342d86668d"} err="failed to get container status \"1b7202bf94e0382223fdda14ff1abbbc2a90bed20e27bac56ba0ce342d86668d\": rpc error: code = NotFound desc = could not find container \"1b7202bf94e0382223fdda14ff1abbbc2a90bed20e27bac56ba0ce342d86668d\": container with ID starting with 1b7202bf94e0382223fdda14ff1abbbc2a90bed20e27bac56ba0ce342d86668d not found: ID does not exist" May 28 23:05:54.712635 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.712614 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 28 23:05:54.712764 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.712688 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 28 23:05:54.712764 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.712729 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 28 23:05:54.712922 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.712797 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 28 23:05:54.712922 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.712872 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 28 23:05:54.713053 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.712974 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 28 23:05:54.713053 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.712985 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 28 23:05:54.713209 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.713193 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 28 23:05:54.713341 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.713287 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 28 23:05:54.713685 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.713660 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" May 28 23:05:54.713974 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.713957 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-c8dqeri330ls0\"" May 28 23:05:54.714232 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.714211 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-nnqnk\"" May 28 23:05:54.714329 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.714218 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 28 23:05:54.716490 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.716466 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 28 23:05:54.720448 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.720424 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 28 23:05:54.720736 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.720720 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 28 23:05:54.803402 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.803371 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/94b607d8-bd3f-4091-b9c9-eaa15495a647-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"94b607d8-bd3f-4091-b9c9-eaa15495a647\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:05:54.803402 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.803409 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94b607d8-bd3f-4091-b9c9-eaa15495a647-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"94b607d8-bd3f-4091-b9c9-eaa15495a647\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:05:54.803621 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.803426 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/94b607d8-bd3f-4091-b9c9-eaa15495a647-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"94b607d8-bd3f-4091-b9c9-eaa15495a647\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:05:54.803621 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.803470 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/94b607d8-bd3f-4091-b9c9-eaa15495a647-config\") pod \"prometheus-k8s-0\" (UID: \"94b607d8-bd3f-4091-b9c9-eaa15495a647\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:05:54.803621 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.803543 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/94b607d8-bd3f-4091-b9c9-eaa15495a647-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"94b607d8-bd3f-4091-b9c9-eaa15495a647\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:05:54.803621 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.803571 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/94b607d8-bd3f-4091-b9c9-eaa15495a647-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"94b607d8-bd3f-4091-b9c9-eaa15495a647\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:05:54.803621 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.803594 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/94b607d8-bd3f-4091-b9c9-eaa15495a647-web-config\") pod \"prometheus-k8s-0\" (UID: \"94b607d8-bd3f-4091-b9c9-eaa15495a647\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:05:54.803621 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.803616 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/94b607d8-bd3f-4091-b9c9-eaa15495a647-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"94b607d8-bd3f-4091-b9c9-eaa15495a647\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:05:54.803864 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.803633 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/94b607d8-bd3f-4091-b9c9-eaa15495a647-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"94b607d8-bd3f-4091-b9c9-eaa15495a647\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:05:54.803864 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.803668 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94b607d8-bd3f-4091-b9c9-eaa15495a647-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"94b607d8-bd3f-4091-b9c9-eaa15495a647\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:05:54.803864 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.803687 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/94b607d8-bd3f-4091-b9c9-eaa15495a647-config-out\") pod \"prometheus-k8s-0\" (UID: \"94b607d8-bd3f-4091-b9c9-eaa15495a647\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:05:54.803864 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.803701 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/94b607d8-bd3f-4091-b9c9-eaa15495a647-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"94b607d8-bd3f-4091-b9c9-eaa15495a647\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:05:54.803864 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.803725 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/94b607d8-bd3f-4091-b9c9-eaa15495a647-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"94b607d8-bd3f-4091-b9c9-eaa15495a647\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:05:54.803864 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.803773 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/94b607d8-bd3f-4091-b9c9-eaa15495a647-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"94b607d8-bd3f-4091-b9c9-eaa15495a647\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:05:54.803864 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.803791 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/94b607d8-bd3f-4091-b9c9-eaa15495a647-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"94b607d8-bd3f-4091-b9c9-eaa15495a647\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:05:54.803864 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.803809 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94b607d8-bd3f-4091-b9c9-eaa15495a647-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"94b607d8-bd3f-4091-b9c9-eaa15495a647\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:05:54.804219 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.803928 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/94b607d8-bd3f-4091-b9c9-eaa15495a647-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"94b607d8-bd3f-4091-b9c9-eaa15495a647\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:05:54.804219 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.803970 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fx7vx\" (UniqueName: \"kubernetes.io/projected/94b607d8-bd3f-4091-b9c9-eaa15495a647-kube-api-access-fx7vx\") pod \"prometheus-k8s-0\" (UID: \"94b607d8-bd3f-4091-b9c9-eaa15495a647\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:05:54.904723 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.904641 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/94b607d8-bd3f-4091-b9c9-eaa15495a647-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"94b607d8-bd3f-4091-b9c9-eaa15495a647\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:05:54.904723 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.904675 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94b607d8-bd3f-4091-b9c9-eaa15495a647-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"94b607d8-bd3f-4091-b9c9-eaa15495a647\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:05:54.904723 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.904695 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/94b607d8-bd3f-4091-b9c9-eaa15495a647-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"94b607d8-bd3f-4091-b9c9-eaa15495a647\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:05:54.904933 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.904816 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/94b607d8-bd3f-4091-b9c9-eaa15495a647-config\") pod \"prometheus-k8s-0\" (UID: \"94b607d8-bd3f-4091-b9c9-eaa15495a647\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:05:54.904933 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.904874 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/94b607d8-bd3f-4091-b9c9-eaa15495a647-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"94b607d8-bd3f-4091-b9c9-eaa15495a647\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:05:54.904933 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.904924 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/94b607d8-bd3f-4091-b9c9-eaa15495a647-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"94b607d8-bd3f-4091-b9c9-eaa15495a647\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:05:54.905091 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.904952 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/94b607d8-bd3f-4091-b9c9-eaa15495a647-web-config\") pod \"prometheus-k8s-0\" (UID: \"94b607d8-bd3f-4091-b9c9-eaa15495a647\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:05:54.905091 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.904983 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/94b607d8-bd3f-4091-b9c9-eaa15495a647-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"94b607d8-bd3f-4091-b9c9-eaa15495a647\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:05:54.905091 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.905008 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/94b607d8-bd3f-4091-b9c9-eaa15495a647-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"94b607d8-bd3f-4091-b9c9-eaa15495a647\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:05:54.905253 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.905109 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94b607d8-bd3f-4091-b9c9-eaa15495a647-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"94b607d8-bd3f-4091-b9c9-eaa15495a647\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:05:54.905253 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.905143 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/94b607d8-bd3f-4091-b9c9-eaa15495a647-config-out\") pod \"prometheus-k8s-0\" (UID: \"94b607d8-bd3f-4091-b9c9-eaa15495a647\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:05:54.905253 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.905171 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/94b607d8-bd3f-4091-b9c9-eaa15495a647-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"94b607d8-bd3f-4091-b9c9-eaa15495a647\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:05:54.905253 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.905200 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/94b607d8-bd3f-4091-b9c9-eaa15495a647-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"94b607d8-bd3f-4091-b9c9-eaa15495a647\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:05:54.905253 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.905243 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/94b607d8-bd3f-4091-b9c9-eaa15495a647-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"94b607d8-bd3f-4091-b9c9-eaa15495a647\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:05:54.905503 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.905277 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/94b607d8-bd3f-4091-b9c9-eaa15495a647-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"94b607d8-bd3f-4091-b9c9-eaa15495a647\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:05:54.905503 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.905304 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94b607d8-bd3f-4091-b9c9-eaa15495a647-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"94b607d8-bd3f-4091-b9c9-eaa15495a647\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:05:54.905503 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.905335 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/94b607d8-bd3f-4091-b9c9-eaa15495a647-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"94b607d8-bd3f-4091-b9c9-eaa15495a647\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:05:54.905503 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.905360 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fx7vx\" (UniqueName: \"kubernetes.io/projected/94b607d8-bd3f-4091-b9c9-eaa15495a647-kube-api-access-fx7vx\") pod \"prometheus-k8s-0\" (UID: \"94b607d8-bd3f-4091-b9c9-eaa15495a647\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:05:54.905503 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.905491 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94b607d8-bd3f-4091-b9c9-eaa15495a647-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"94b607d8-bd3f-4091-b9c9-eaa15495a647\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:05:54.905769 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.905663 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/94b607d8-bd3f-4091-b9c9-eaa15495a647-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"94b607d8-bd3f-4091-b9c9-eaa15495a647\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:05:54.908090 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.907418 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/94b607d8-bd3f-4091-b9c9-eaa15495a647-config\") pod \"prometheus-k8s-0\" (UID: \"94b607d8-bd3f-4091-b9c9-eaa15495a647\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:05:54.908090 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.907799 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/94b607d8-bd3f-4091-b9c9-eaa15495a647-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"94b607d8-bd3f-4091-b9c9-eaa15495a647\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:05:54.908090 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.908089 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94b607d8-bd3f-4091-b9c9-eaa15495a647-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"94b607d8-bd3f-4091-b9c9-eaa15495a647\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:05:54.908330 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.908186 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/94b607d8-bd3f-4091-b9c9-eaa15495a647-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"94b607d8-bd3f-4091-b9c9-eaa15495a647\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:05:54.908394 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.908373 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/94b607d8-bd3f-4091-b9c9-eaa15495a647-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"94b607d8-bd3f-4091-b9c9-eaa15495a647\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:05:54.908394 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.908376 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/94b607d8-bd3f-4091-b9c9-eaa15495a647-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"94b607d8-bd3f-4091-b9c9-eaa15495a647\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:05:54.908516 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.908502 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/94b607d8-bd3f-4091-b9c9-eaa15495a647-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"94b607d8-bd3f-4091-b9c9-eaa15495a647\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:05:54.908840 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.908734 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/94b607d8-bd3f-4091-b9c9-eaa15495a647-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"94b607d8-bd3f-4091-b9c9-eaa15495a647\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:05:54.908840 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.908798 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/94b607d8-bd3f-4091-b9c9-eaa15495a647-config-out\") pod \"prometheus-k8s-0\" (UID: \"94b607d8-bd3f-4091-b9c9-eaa15495a647\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:05:54.908998 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.908927 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/94b607d8-bd3f-4091-b9c9-eaa15495a647-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"94b607d8-bd3f-4091-b9c9-eaa15495a647\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:05:54.909054 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.909017 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94b607d8-bd3f-4091-b9c9-eaa15495a647-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"94b607d8-bd3f-4091-b9c9-eaa15495a647\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:05:54.910359 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.910339 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/94b607d8-bd3f-4091-b9c9-eaa15495a647-web-config\") pod \"prometheus-k8s-0\" (UID: \"94b607d8-bd3f-4091-b9c9-eaa15495a647\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:05:54.910458 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.910388 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/94b607d8-bd3f-4091-b9c9-eaa15495a647-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"94b607d8-bd3f-4091-b9c9-eaa15495a647\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:05:54.910542 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.910524 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/94b607d8-bd3f-4091-b9c9-eaa15495a647-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"94b607d8-bd3f-4091-b9c9-eaa15495a647\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:05:54.910757 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.910740 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/94b607d8-bd3f-4091-b9c9-eaa15495a647-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"94b607d8-bd3f-4091-b9c9-eaa15495a647\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:05:54.912868 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.912852 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fx7vx\" (UniqueName: \"kubernetes.io/projected/94b607d8-bd3f-4091-b9c9-eaa15495a647-kube-api-access-fx7vx\") pod \"prometheus-k8s-0\" (UID: \"94b607d8-bd3f-4091-b9c9-eaa15495a647\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 23:05:54.996749 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:54.996718 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2" path="/var/lib/kubelet/pods/cc8e4817-ba44-4271-8fc6-f5dfc5ea3cd2/volumes" May 28 23:05:55.020762 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:55.020692 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 28 23:05:55.153189 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:55.153158 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 28 23:05:55.156785 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:05:55.156729 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94b607d8_bd3f_4091_b9c9_eaa15495a647.slice/crio-641a4de302c90b84c37426d90e9d3711e631bc87f05cadf67c487fccb94343ee WatchSource:0}: Error finding container 641a4de302c90b84c37426d90e9d3711e631bc87f05cadf67c487fccb94343ee: Status 404 returned error can't find the container with id 641a4de302c90b84c37426d90e9d3711e631bc87f05cadf67c487fccb94343ee May 28 23:05:55.654778 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:55.654741 2577 generic.go:358] "Generic (PLEG): container finished" podID="94b607d8-bd3f-4091-b9c9-eaa15495a647" containerID="221e8b083a34d4827aa79d9e94ae48a48fbf813294def63c0e00b07ef0513de1" exitCode=0 May 28 23:05:55.654946 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:55.654823 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"94b607d8-bd3f-4091-b9c9-eaa15495a647","Type":"ContainerDied","Data":"221e8b083a34d4827aa79d9e94ae48a48fbf813294def63c0e00b07ef0513de1"} May 28 23:05:55.654946 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:55.654851 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"94b607d8-bd3f-4091-b9c9-eaa15495a647","Type":"ContainerStarted","Data":"641a4de302c90b84c37426d90e9d3711e631bc87f05cadf67c487fccb94343ee"} May 28 23:05:56.661029 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:56.660994 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"94b607d8-bd3f-4091-b9c9-eaa15495a647","Type":"ContainerStarted","Data":"2619450e8e2dae973fcebd75c2e0005c5447713dd8e779bcee8f8759cdcdcafe"} May 28 23:05:56.661444 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:56.661038 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"94b607d8-bd3f-4091-b9c9-eaa15495a647","Type":"ContainerStarted","Data":"2050cb43f3ba37458b8f6d0978c2892a40096b8d2d38ea660670f5e4d7fefbdd"} May 28 23:05:56.661444 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:56.661052 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"94b607d8-bd3f-4091-b9c9-eaa15495a647","Type":"ContainerStarted","Data":"e72ba7042cf59af7583f76910a7f231a82dcca8f7ec32a3493cbe6c02f577dd4"} May 28 23:05:56.661444 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:56.661064 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"94b607d8-bd3f-4091-b9c9-eaa15495a647","Type":"ContainerStarted","Data":"88ab6b071be29f6c64141ab250fc746212bdafacb0644e23f2b17be8df62c913"} May 28 23:05:56.661444 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:56.661097 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"94b607d8-bd3f-4091-b9c9-eaa15495a647","Type":"ContainerStarted","Data":"0d808edd90c0d8f95320144b2f1440dd614cbb535a3b1d0e498d47b8a5f6dcbb"} May 28 23:05:56.661444 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:56.661109 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"94b607d8-bd3f-4091-b9c9-eaa15495a647","Type":"ContainerStarted","Data":"9f91970a621d881981c767600dba6a9d97b47cd35b2a2630cf92e5c8bac76fc9"} May 28 23:05:56.686845 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:05:56.686799 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.686784303 podStartE2EDuration="2.686784303s" podCreationTimestamp="2026-05-28 23:05:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 23:05:56.68613719 +0000 UTC m=+214.293951151" watchObservedRunningTime="2026-05-28 23:05:56.686784303 +0000 UTC m=+214.294598266" May 28 23:06:00.021242 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:06:00.021206 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 28 23:06:55.021489 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:06:55.021408 2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 28 23:06:55.036701 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:06:55.036675 2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 28 23:06:55.841995 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:06:55.841971 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 28 23:07:22.886480 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:07:22.886442 2577 kubelet.go:1628] "Image garbage collection succeeded" May 28 23:07:33.423507 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:07:33.423471 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-f7x9q"] May 28 23:07:33.426521 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:07:33.426506 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f7x9q" May 28 23:07:33.429118 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:07:33.429097 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 28 23:07:33.434966 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:07:33.434945 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-f7x9q"] May 28 23:07:33.483737 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:07:33.483713 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e745ff7e-80a1-4805-8dfd-fdaa34dc7316-dbus\") pod \"global-pull-secret-syncer-f7x9q\" (UID: \"e745ff7e-80a1-4805-8dfd-fdaa34dc7316\") " pod="kube-system/global-pull-secret-syncer-f7x9q" May 28 23:07:33.483884 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:07:33.483838 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e745ff7e-80a1-4805-8dfd-fdaa34dc7316-original-pull-secret\") pod \"global-pull-secret-syncer-f7x9q\" (UID: \"e745ff7e-80a1-4805-8dfd-fdaa34dc7316\") " pod="kube-system/global-pull-secret-syncer-f7x9q" May 28 23:07:33.483884 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:07:33.483872 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e745ff7e-80a1-4805-8dfd-fdaa34dc7316-kubelet-config\") pod \"global-pull-secret-syncer-f7x9q\" (UID: \"e745ff7e-80a1-4805-8dfd-fdaa34dc7316\") " pod="kube-system/global-pull-secret-syncer-f7x9q" May 28 23:07:33.584318 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:07:33.584287 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e745ff7e-80a1-4805-8dfd-fdaa34dc7316-original-pull-secret\") pod \"global-pull-secret-syncer-f7x9q\" (UID: \"e745ff7e-80a1-4805-8dfd-fdaa34dc7316\") " pod="kube-system/global-pull-secret-syncer-f7x9q" May 28 23:07:33.584491 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:07:33.584334 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e745ff7e-80a1-4805-8dfd-fdaa34dc7316-kubelet-config\") pod \"global-pull-secret-syncer-f7x9q\" (UID: \"e745ff7e-80a1-4805-8dfd-fdaa34dc7316\") " pod="kube-system/global-pull-secret-syncer-f7x9q" May 28 23:07:33.584491 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:07:33.584364 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e745ff7e-80a1-4805-8dfd-fdaa34dc7316-dbus\") pod \"global-pull-secret-syncer-f7x9q\" (UID: \"e745ff7e-80a1-4805-8dfd-fdaa34dc7316\") " pod="kube-system/global-pull-secret-syncer-f7x9q" May 28 23:07:33.584491 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:07:33.584461 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e745ff7e-80a1-4805-8dfd-fdaa34dc7316-kubelet-config\") pod \"global-pull-secret-syncer-f7x9q\" (UID: \"e745ff7e-80a1-4805-8dfd-fdaa34dc7316\") " pod="kube-system/global-pull-secret-syncer-f7x9q" May 28 23:07:33.584624 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:07:33.584529 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e745ff7e-80a1-4805-8dfd-fdaa34dc7316-dbus\") pod \"global-pull-secret-syncer-f7x9q\" (UID: \"e745ff7e-80a1-4805-8dfd-fdaa34dc7316\") " pod="kube-system/global-pull-secret-syncer-f7x9q" May 28 23:07:33.586624 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:07:33.586600 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e745ff7e-80a1-4805-8dfd-fdaa34dc7316-original-pull-secret\") pod \"global-pull-secret-syncer-f7x9q\" (UID: \"e745ff7e-80a1-4805-8dfd-fdaa34dc7316\") " pod="kube-system/global-pull-secret-syncer-f7x9q" May 28 23:07:33.736213 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:07:33.736130 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f7x9q" May 28 23:07:33.857843 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:07:33.857808 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-f7x9q"] May 28 23:07:33.860799 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:07:33.860773 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode745ff7e_80a1_4805_8dfd_fdaa34dc7316.slice/crio-f8f988ca45b89d6a3ec1b6e72cdcf84de9ec99f43e6d98fece84dc7e3bbbafe3 WatchSource:0}: Error finding container f8f988ca45b89d6a3ec1b6e72cdcf84de9ec99f43e6d98fece84dc7e3bbbafe3: Status 404 returned error can't find the container with id f8f988ca45b89d6a3ec1b6e72cdcf84de9ec99f43e6d98fece84dc7e3bbbafe3 May 28 23:07:33.862673 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:07:33.862656 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 28 23:07:33.927943 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:07:33.927908 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-f7x9q" event={"ID":"e745ff7e-80a1-4805-8dfd-fdaa34dc7316","Type":"ContainerStarted","Data":"f8f988ca45b89d6a3ec1b6e72cdcf84de9ec99f43e6d98fece84dc7e3bbbafe3"} May 28 23:07:38.946003 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:07:38.945963 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-f7x9q" event={"ID":"e745ff7e-80a1-4805-8dfd-fdaa34dc7316","Type":"ContainerStarted","Data":"3cfc9111cdcfa41c4cf0b280c97c9f3ff4b8f76f2079a776b01bf01a6af15f05"} May 28 23:17:32.424569 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:17:32.424500 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-f7x9q" podStartSLOduration=595.216668765 podStartE2EDuration="9m59.424485651s" podCreationTimestamp="2026-05-28 23:07:33 +0000 UTC" firstStartedPulling="2026-05-28 23:07:33.862794973 +0000 UTC m=+311.470608913" lastFinishedPulling="2026-05-28 23:07:38.07061186 +0000 UTC m=+315.678425799" observedRunningTime="2026-05-28 23:07:38.961740126 +0000 UTC m=+316.569554098" watchObservedRunningTime="2026-05-28 23:17:32.424485651 +0000 UTC m=+910.032299612" May 28 23:17:32.425004 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:17:32.424641 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-test-apply-m54qz"] May 28 23:17:32.428062 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:17:32.428047 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-m54qz" May 28 23:17:32.430833 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:17:32.430810 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\"" May 28 23:17:32.431662 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:17:32.431642 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" May 28 23:17:32.431662 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:17:32.431655 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" May 28 23:17:32.431810 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:17:32.431752 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-dockercfg-s95cc\"" May 28 23:17:32.437802 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:17:32.437784 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-test-apply-m54qz"] May 28 23:17:32.518730 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:17:32.518706 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgqht\" (UniqueName: \"kubernetes.io/projected/3da81806-e5d7-43f2-9909-0acc012dde66-kube-api-access-qgqht\") pod \"feast-test-apply-m54qz\" (UID: \"3da81806-e5d7-43f2-9909-0acc012dde66\") " pod="test-ns-feast/feast-test-apply-m54qz" May 28 23:17:32.619747 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:17:32.619720 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qgqht\" (UniqueName: \"kubernetes.io/projected/3da81806-e5d7-43f2-9909-0acc012dde66-kube-api-access-qgqht\") pod \"feast-test-apply-m54qz\" (UID: \"3da81806-e5d7-43f2-9909-0acc012dde66\") " pod="test-ns-feast/feast-test-apply-m54qz" May 28 23:17:32.629517 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:17:32.629491 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgqht\" (UniqueName: \"kubernetes.io/projected/3da81806-e5d7-43f2-9909-0acc012dde66-kube-api-access-qgqht\") pod \"feast-test-apply-m54qz\" (UID: \"3da81806-e5d7-43f2-9909-0acc012dde66\") " pod="test-ns-feast/feast-test-apply-m54qz" May 28 23:17:32.749221 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:17:32.749145 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-m54qz" May 28 23:17:32.874306 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:17:32.874278 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-test-apply-m54qz"] May 28 23:17:32.877408 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:17:32.877378 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3da81806_e5d7_43f2_9909_0acc012dde66.slice/crio-64f24282740ed8db90e2f2fd1c2c4cb11b133f095a248097e98997a19f672087 WatchSource:0}: Error finding container 64f24282740ed8db90e2f2fd1c2c4cb11b133f095a248097e98997a19f672087: Status 404 returned error can't find the container with id 64f24282740ed8db90e2f2fd1c2c4cb11b133f095a248097e98997a19f672087 May 28 23:17:32.879135 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:17:32.879120 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 28 23:17:33.579793 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:17:33.579748 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-m54qz" event={"ID":"3da81806-e5d7-43f2-9909-0acc012dde66","Type":"ContainerStarted","Data":"64f24282740ed8db90e2f2fd1c2c4cb11b133f095a248097e98997a19f672087"} May 28 23:17:38.596661 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:17:38.596626 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-m54qz" event={"ID":"3da81806-e5d7-43f2-9909-0acc012dde66","Type":"ContainerStarted","Data":"48429f80a85dc811acf709d8f015b67eaeeac0641eed4663ce2db50a0f98f8b6"} May 28 23:17:44.616577 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:17:44.616538 2577 generic.go:358] "Generic (PLEG): container finished" podID="3da81806-e5d7-43f2-9909-0acc012dde66" containerID="48429f80a85dc811acf709d8f015b67eaeeac0641eed4663ce2db50a0f98f8b6" exitCode=0 May 28 23:17:44.616944 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:17:44.616591 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-m54qz" event={"ID":"3da81806-e5d7-43f2-9909-0acc012dde66","Type":"ContainerDied","Data":"48429f80a85dc811acf709d8f015b67eaeeac0641eed4663ce2db50a0f98f8b6"} May 28 23:17:45.620752 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:17:45.620721 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-m54qz" event={"ID":"3da81806-e5d7-43f2-9909-0acc012dde66","Type":"ContainerStarted","Data":"85539c44c96af80610145da51272d7757a0a5e4bc1296110f6aaee01fe89d344"} May 28 23:17:45.637540 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:17:45.637498 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-test-apply-m54qz" podStartSLOduration=8.646317086 podStartE2EDuration="13.637485806s" podCreationTimestamp="2026-05-28 23:17:32 +0000 UTC" firstStartedPulling="2026-05-28 23:17:32.879254105 +0000 UTC m=+910.487068043" lastFinishedPulling="2026-05-28 23:17:37.870422824 +0000 UTC m=+915.478236763" observedRunningTime="2026-05-28 23:17:45.636130211 +0000 UTC m=+923.243944182" watchObservedRunningTime="2026-05-28 23:17:45.637485806 +0000 UTC m=+923.245299767" May 28 23:17:53.645257 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:17:53.645225 2577 generic.go:358] "Generic (PLEG): container finished" podID="3da81806-e5d7-43f2-9909-0acc012dde66" containerID="85539c44c96af80610145da51272d7757a0a5e4bc1296110f6aaee01fe89d344" exitCode=0 May 28 23:17:53.645613 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:17:53.645288 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-m54qz" event={"ID":"3da81806-e5d7-43f2-9909-0acc012dde66","Type":"ContainerDied","Data":"85539c44c96af80610145da51272d7757a0a5e4bc1296110f6aaee01fe89d344"} May 28 23:17:54.770969 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:17:54.770947 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-m54qz" May 28 23:17:54.899595 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:17:54.899519 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qgqht\" (UniqueName: \"kubernetes.io/projected/3da81806-e5d7-43f2-9909-0acc012dde66-kube-api-access-qgqht\") pod \"3da81806-e5d7-43f2-9909-0acc012dde66\" (UID: \"3da81806-e5d7-43f2-9909-0acc012dde66\") " May 28 23:17:54.901562 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:17:54.901534 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3da81806-e5d7-43f2-9909-0acc012dde66-kube-api-access-qgqht" (OuterVolumeSpecName: "kube-api-access-qgqht") pod "3da81806-e5d7-43f2-9909-0acc012dde66" (UID: "3da81806-e5d7-43f2-9909-0acc012dde66"). InnerVolumeSpecName "kube-api-access-qgqht". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 23:17:55.000257 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:17:55.000231 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qgqht\" (UniqueName: \"kubernetes.io/projected/3da81806-e5d7-43f2-9909-0acc012dde66-kube-api-access-qgqht\") on node \"ip-10-0-132-11.ec2.internal\" DevicePath \"\"" May 28 23:17:55.652654 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:17:55.652620 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-m54qz" event={"ID":"3da81806-e5d7-43f2-9909-0acc012dde66","Type":"ContainerDied","Data":"64f24282740ed8db90e2f2fd1c2c4cb11b133f095a248097e98997a19f672087"} May 28 23:17:55.652654 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:17:55.652653 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="64f24282740ed8db90e2f2fd1c2c4cb11b133f095a248097e98997a19f672087" May 28 23:17:55.652853 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:17:55.652666 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-m54qz" May 28 23:17:55.832269 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:17:55.832237 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-feast_feast-test-apply-m54qz_3da81806-e5d7-43f2-9909-0acc012dde66/feast-0/0.log" May 28 23:17:55.838861 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:17:55.838838 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-feast_feast-test-apply-m54qz_3da81806-e5d7-43f2-9909-0acc012dde66/feast-1/0.log" May 28 23:18:31.214145 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:18:31.214104 2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-test-apply-m54qz"] May 28 23:18:31.219900 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:18:31.219872 2577 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-test-apply-m54qz"] May 28 23:18:32.996859 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:18:32.996822 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3da81806-e5d7-43f2-9909-0acc012dde66" path="/var/lib/kubelet/pods/3da81806-e5d7-43f2-9909-0acc012dde66/volumes" May 28 23:24:22.959545 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:24:22.959516 2577 scope.go:117] "RemoveContainer" containerID="48429f80a85dc811acf709d8f015b67eaeeac0641eed4663ce2db50a0f98f8b6" May 28 23:24:22.966946 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:24:22.966925 2577 scope.go:117] "RemoveContainer" containerID="85539c44c96af80610145da51272d7757a0a5e4bc1296110f6aaee01fe89d344" May 28 23:34:41.505941 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:41.505906 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-f7x9q_e745ff7e-80a1-4805-8dfd-fdaa34dc7316/global-pull-secret-syncer/0.log" May 28 23:34:41.598087 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:41.598039 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-7kqkf_a7a1f983-74bf-44d3-a389-cf8d534f9102/konnectivity-agent/0.log" May 28 23:34:41.674789 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:41.674756 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-11.ec2.internal_71527fc8142ac3b5ee8b35036b2415d4/haproxy/0.log" May 28 23:34:44.676609 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:44.676579 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-665c9c8584-sb9k6_15217d65-9210-4ad7-a639-d571a8139402/monitoring-plugin/0.log" May 28 23:34:44.777129 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:44.777037 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-d47lt_f95d91ce-8915-4817-8066-463eb2e031fc/node-exporter/0.log" May 28 23:34:44.796491 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:44.796462 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-d47lt_f95d91ce-8915-4817-8066-463eb2e031fc/kube-rbac-proxy/0.log" May 28 23:34:44.822918 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:44.822892 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-d47lt_f95d91ce-8915-4817-8066-463eb2e031fc/init-textfile/0.log" May 28 23:34:44.990448 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:44.990422 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_94b607d8-bd3f-4091-b9c9-eaa15495a647/prometheus/0.log" May 28 23:34:45.010044 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:45.010018 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_94b607d8-bd3f-4091-b9c9-eaa15495a647/config-reloader/0.log" May 28 23:34:45.028418 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:45.028362 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_94b607d8-bd3f-4091-b9c9-eaa15495a647/thanos-sidecar/0.log" May 28 23:34:45.048488 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:45.048457 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_94b607d8-bd3f-4091-b9c9-eaa15495a647/kube-rbac-proxy-web/0.log" May 28 23:34:45.067412 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:45.067386 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_94b607d8-bd3f-4091-b9c9-eaa15495a647/kube-rbac-proxy/0.log" May 28 23:34:45.087244 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:45.087195 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_94b607d8-bd3f-4091-b9c9-eaa15495a647/kube-rbac-proxy-thanos/0.log" May 28 23:34:45.107393 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:45.107378 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_94b607d8-bd3f-4091-b9c9-eaa15495a647/init-config-reloader/0.log" May 28 23:34:45.134733 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:45.134712 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-48nqd_0ed53912-4021-4728-9a9a-a34adc8cda68/prometheus-operator/0.log" May 28 23:34:45.152921 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:45.152896 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-48nqd_0ed53912-4021-4728-9a9a-a34adc8cda68/kube-rbac-proxy/0.log" May 28 23:34:45.270888 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:45.270854 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b6f467554-fn7fd_86e38423-23c4-433b-9a56-59c8392e1438/thanos-query/0.log" May 28 23:34:45.288495 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:45.288409 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b6f467554-fn7fd_86e38423-23c4-433b-9a56-59c8392e1438/kube-rbac-proxy-web/0.log" May 28 23:34:45.308223 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:45.308202 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b6f467554-fn7fd_86e38423-23c4-433b-9a56-59c8392e1438/kube-rbac-proxy/0.log" May 28 23:34:45.327651 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:45.327633 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b6f467554-fn7fd_86e38423-23c4-433b-9a56-59c8392e1438/prom-label-proxy/0.log" May 28 23:34:45.347002 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:45.346980 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b6f467554-fn7fd_86e38423-23c4-433b-9a56-59c8392e1438/kube-rbac-proxy-rules/0.log" May 28 23:34:45.368058 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:45.368039 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b6f467554-fn7fd_86e38423-23c4-433b-9a56-59c8392e1438/kube-rbac-proxy-metrics/0.log" May 28 23:34:47.940178 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:47.940142 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-vppqb/perf-node-gather-daemonset-8ml2x"] May 28 23:34:47.940533 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:47.940415 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3da81806-e5d7-43f2-9909-0acc012dde66" containerName="feast-1" May 28 23:34:47.940533 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:47.940425 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3da81806-e5d7-43f2-9909-0acc012dde66" containerName="feast-1" May 28 23:34:47.940533 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:47.940443 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3da81806-e5d7-43f2-9909-0acc012dde66" containerName="feast-0" May 28 23:34:47.940533 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:47.940450 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3da81806-e5d7-43f2-9909-0acc012dde66" containerName="feast-0" May 28 23:34:47.940533 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:47.940495 2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="3da81806-e5d7-43f2-9909-0acc012dde66" containerName="feast-1" May 28 23:34:47.943704 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:47.943687 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vppqb/perf-node-gather-daemonset-8ml2x" May 28 23:34:47.945800 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:47.945778 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vppqb\"/\"kube-root-ca.crt\"" May 28 23:34:47.945959 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:47.945934 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vppqb\"/\"openshift-service-ca.crt\"" May 28 23:34:47.946693 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:47.946671 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-vppqb\"/\"default-dockercfg-pj9km\"" May 28 23:34:47.951686 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:47.951665 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vppqb/perf-node-gather-daemonset-8ml2x"] May 28 23:34:48.030274 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:48.030246 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/91e576a4-975f-413e-a967-2b03b523fcdd-sys\") pod \"perf-node-gather-daemonset-8ml2x\" (UID: \"91e576a4-975f-413e-a967-2b03b523fcdd\") " pod="openshift-must-gather-vppqb/perf-node-gather-daemonset-8ml2x" May 28 23:34:48.030274 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:48.030275 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwhhv\" (UniqueName: \"kubernetes.io/projected/91e576a4-975f-413e-a967-2b03b523fcdd-kube-api-access-nwhhv\") pod \"perf-node-gather-daemonset-8ml2x\" (UID: \"91e576a4-975f-413e-a967-2b03b523fcdd\") " pod="openshift-must-gather-vppqb/perf-node-gather-daemonset-8ml2x" May 28 23:34:48.030465 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:48.030323 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/91e576a4-975f-413e-a967-2b03b523fcdd-podres\") pod \"perf-node-gather-daemonset-8ml2x\" (UID: \"91e576a4-975f-413e-a967-2b03b523fcdd\") " pod="openshift-must-gather-vppqb/perf-node-gather-daemonset-8ml2x" May 28 23:34:48.030465 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:48.030394 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/91e576a4-975f-413e-a967-2b03b523fcdd-proc\") pod \"perf-node-gather-daemonset-8ml2x\" (UID: \"91e576a4-975f-413e-a967-2b03b523fcdd\") " pod="openshift-must-gather-vppqb/perf-node-gather-daemonset-8ml2x" May 28 23:34:48.030465 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:48.030420 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/91e576a4-975f-413e-a967-2b03b523fcdd-lib-modules\") pod \"perf-node-gather-daemonset-8ml2x\" (UID: \"91e576a4-975f-413e-a967-2b03b523fcdd\") " pod="openshift-must-gather-vppqb/perf-node-gather-daemonset-8ml2x" May 28 23:34:48.131590 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:48.131566 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/91e576a4-975f-413e-a967-2b03b523fcdd-podres\") pod \"perf-node-gather-daemonset-8ml2x\" (UID: \"91e576a4-975f-413e-a967-2b03b523fcdd\") " pod="openshift-must-gather-vppqb/perf-node-gather-daemonset-8ml2x" May 28 23:34:48.131745 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:48.131619 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/91e576a4-975f-413e-a967-2b03b523fcdd-proc\") pod \"perf-node-gather-daemonset-8ml2x\" (UID: \"91e576a4-975f-413e-a967-2b03b523fcdd\") " pod="openshift-must-gather-vppqb/perf-node-gather-daemonset-8ml2x" May 28 23:34:48.131745 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:48.131637 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/91e576a4-975f-413e-a967-2b03b523fcdd-lib-modules\") pod \"perf-node-gather-daemonset-8ml2x\" (UID: \"91e576a4-975f-413e-a967-2b03b523fcdd\") " pod="openshift-must-gather-vppqb/perf-node-gather-daemonset-8ml2x" May 28 23:34:48.131745 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:48.131662 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/91e576a4-975f-413e-a967-2b03b523fcdd-sys\") pod \"perf-node-gather-daemonset-8ml2x\" (UID: \"91e576a4-975f-413e-a967-2b03b523fcdd\") " pod="openshift-must-gather-vppqb/perf-node-gather-daemonset-8ml2x" May 28 23:34:48.131745 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:48.131679 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nwhhv\" (UniqueName: \"kubernetes.io/projected/91e576a4-975f-413e-a967-2b03b523fcdd-kube-api-access-nwhhv\") pod \"perf-node-gather-daemonset-8ml2x\" (UID: \"91e576a4-975f-413e-a967-2b03b523fcdd\") " pod="openshift-must-gather-vppqb/perf-node-gather-daemonset-8ml2x" May 28 23:34:48.131745 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:48.131691 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/91e576a4-975f-413e-a967-2b03b523fcdd-proc\") pod \"perf-node-gather-daemonset-8ml2x\" (UID: \"91e576a4-975f-413e-a967-2b03b523fcdd\") " pod="openshift-must-gather-vppqb/perf-node-gather-daemonset-8ml2x" May 28 23:34:48.131745 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:48.131726 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/91e576a4-975f-413e-a967-2b03b523fcdd-podres\") pod \"perf-node-gather-daemonset-8ml2x\" (UID: \"91e576a4-975f-413e-a967-2b03b523fcdd\") " pod="openshift-must-gather-vppqb/perf-node-gather-daemonset-8ml2x" May 28 23:34:48.131962 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:48.131770 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/91e576a4-975f-413e-a967-2b03b523fcdd-sys\") pod \"perf-node-gather-daemonset-8ml2x\" (UID: \"91e576a4-975f-413e-a967-2b03b523fcdd\") " pod="openshift-must-gather-vppqb/perf-node-gather-daemonset-8ml2x" May 28 23:34:48.131962 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:48.131799 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/91e576a4-975f-413e-a967-2b03b523fcdd-lib-modules\") pod \"perf-node-gather-daemonset-8ml2x\" (UID: \"91e576a4-975f-413e-a967-2b03b523fcdd\") " pod="openshift-must-gather-vppqb/perf-node-gather-daemonset-8ml2x" May 28 23:34:48.139316 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:48.139293 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwhhv\" (UniqueName: \"kubernetes.io/projected/91e576a4-975f-413e-a967-2b03b523fcdd-kube-api-access-nwhhv\") pod \"perf-node-gather-daemonset-8ml2x\" (UID: \"91e576a4-975f-413e-a967-2b03b523fcdd\") " pod="openshift-must-gather-vppqb/perf-node-gather-daemonset-8ml2x" May 28 23:34:48.152960 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:48.152943 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8zr45_4e662546-4260-4167-aafa-19b834be1588/dns/0.log" May 28 23:34:48.170710 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:48.170691 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8zr45_4e662546-4260-4167-aafa-19b834be1588/kube-rbac-proxy/0.log" May 28 23:34:48.254084 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:48.254007 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vppqb/perf-node-gather-daemonset-8ml2x" May 28 23:34:48.307469 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:48.307435 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-z4cgj_7ad23651-ba0a-4be3-9b1f-7accceb0a40f/dns-node-resolver/0.log" May 28 23:34:48.374447 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:48.374419 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vppqb/perf-node-gather-daemonset-8ml2x"] May 28 23:34:48.377425 ip-10-0-132-11 kubenswrapper[2577]: W0528 23:34:48.377394 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod91e576a4_975f_413e_a967_2b03b523fcdd.slice/crio-dc79644641504fbf517fecfd6b721e75808d37668c0cc005f6b62fc05f7b4276 WatchSource:0}: Error finding container dc79644641504fbf517fecfd6b721e75808d37668c0cc005f6b62fc05f7b4276: Status 404 returned error can't find the container with id dc79644641504fbf517fecfd6b721e75808d37668c0cc005f6b62fc05f7b4276 May 28 23:34:48.378871 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:48.378854 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 28 23:34:48.436280 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:48.436253 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vppqb/perf-node-gather-daemonset-8ml2x" event={"ID":"91e576a4-975f-413e-a967-2b03b523fcdd","Type":"ContainerStarted","Data":"dc79644641504fbf517fecfd6b721e75808d37668c0cc005f6b62fc05f7b4276"} May 28 23:34:48.674183 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:48.674142 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5bb668dbdb-9b9km_02a2b450-c415-489b-8510-c98d35df0795/registry/0.log" May 28 23:34:48.687302 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:48.687281 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5bb668dbdb-9b9km_02a2b450-c415-489b-8510-c98d35df0795/registry/1.log" May 28 23:34:48.705774 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:48.705747 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bwx9g_f9743c1b-af51-440b-8793-1e65a2d4fd11/node-ca/0.log" May 28 23:34:49.435557 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:49.435521 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7cc6ddd568-pltq6_99deffb2-8926-48e6-ba16-b3807f87aa5d/router/0.log" May 28 23:34:49.439698 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:49.439673 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vppqb/perf-node-gather-daemonset-8ml2x" event={"ID":"91e576a4-975f-413e-a967-2b03b523fcdd","Type":"ContainerStarted","Data":"4103fac4f7639254687968d133570c793beb611faf7355f82e4938ba5deaad9c"} May 28 23:34:49.439827 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:49.439808 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-vppqb/perf-node-gather-daemonset-8ml2x" May 28 23:34:49.453881 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:49.453842 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-vppqb/perf-node-gather-daemonset-8ml2x" podStartSLOduration=2.453831122 podStartE2EDuration="2.453831122s" podCreationTimestamp="2026-05-28 23:34:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 23:34:49.452953263 +0000 UTC m=+1947.060767224" watchObservedRunningTime="2026-05-28 23:34:49.453831122 +0000 UTC m=+1947.061645082" May 28 23:34:49.727798 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:49.727725 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hs47z_d2ec4e04-45b6-4bf3-9268-8e7799549fef/serve-healthcheck-canary/0.log" May 28 23:34:50.046968 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:50.046885 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-875lc_e503af1b-53d7-4ca7-9da9-990420799bc5/insights-operator/0.log" May 28 23:34:50.048174 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:50.048144 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-875lc_e503af1b-53d7-4ca7-9da9-990420799bc5/insights-operator/1.log" May 28 23:34:50.066608 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:50.066590 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6hg9m_24887236-2901-427f-8442-b82b07f3313b/kube-rbac-proxy/0.log" May 28 23:34:50.084403 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:50.084382 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6hg9m_24887236-2901-427f-8442-b82b07f3313b/exporter/0.log" May 28 23:34:50.102659 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:50.102630 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6hg9m_24887236-2901-427f-8442-b82b07f3313b/extractor/0.log" May 28 23:34:54.214813 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:54.214769 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-tcvb6_29f1d24b-cf80-4e23-afb2-4a4062509259/kube-storage-version-migrator-operator/1.log" May 28 23:34:54.216451 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:54.216413 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-tcvb6_29f1d24b-cf80-4e23-afb2-4a4062509259/kube-storage-version-migrator-operator/0.log" May 28 23:34:55.060841 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:55.060813 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d7zts_43a1feb4-04fe-4605-99e9-0be12579d524/kube-multus-additional-cni-plugins/0.log" May 28 23:34:55.078724 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:55.078705 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d7zts_43a1feb4-04fe-4605-99e9-0be12579d524/egress-router-binary-copy/0.log" May 28 23:34:55.096844 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:55.096820 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d7zts_43a1feb4-04fe-4605-99e9-0be12579d524/cni-plugins/0.log" May 28 23:34:55.116081 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:55.116058 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d7zts_43a1feb4-04fe-4605-99e9-0be12579d524/bond-cni-plugin/0.log" May 28 23:34:55.134087 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:55.134052 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d7zts_43a1feb4-04fe-4605-99e9-0be12579d524/routeoverride-cni/0.log" May 28 23:34:55.151617 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:55.151596 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d7zts_43a1feb4-04fe-4605-99e9-0be12579d524/whereabouts-cni-bincopy/0.log" May 28 23:34:55.168410 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:55.168388 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d7zts_43a1feb4-04fe-4605-99e9-0be12579d524/whereabouts-cni/0.log" May 28 23:34:55.356599 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:55.356526 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-mrdc2_b8de4c18-8e9c-46a2-9454-9276c4405615/kube-multus/0.log" May 28 23:34:55.452203 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:55.452179 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-vppqb/perf-node-gather-daemonset-8ml2x" May 28 23:34:55.458616 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:55.458593 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-t5bp9_d8e6e54a-9204-40ab-8c10-ded8a2cdb95d/network-metrics-daemon/0.log" May 28 23:34:55.479434 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:55.479405 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-t5bp9_d8e6e54a-9204-40ab-8c10-ded8a2cdb95d/kube-rbac-proxy/0.log" May 28 23:34:56.413343 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:56.413312 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qmfbw_01e7d2d5-dde5-4ff0-8ca5-213e5621be3b/ovn-controller/0.log" May 28 23:34:56.446153 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:56.446122 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qmfbw_01e7d2d5-dde5-4ff0-8ca5-213e5621be3b/ovn-acl-logging/0.log" May 28 23:34:56.464088 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:56.464040 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qmfbw_01e7d2d5-dde5-4ff0-8ca5-213e5621be3b/kube-rbac-proxy-node/0.log" May 28 23:34:56.483856 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:56.483790 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qmfbw_01e7d2d5-dde5-4ff0-8ca5-213e5621be3b/kube-rbac-proxy-ovn-metrics/0.log" May 28 23:34:56.499972 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:56.499946 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qmfbw_01e7d2d5-dde5-4ff0-8ca5-213e5621be3b/northd/0.log" May 28 23:34:56.520474 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:56.520456 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qmfbw_01e7d2d5-dde5-4ff0-8ca5-213e5621be3b/nbdb/0.log" May 28 23:34:56.544003 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:56.543986 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qmfbw_01e7d2d5-dde5-4ff0-8ca5-213e5621be3b/sbdb/0.log" May 28 23:34:56.706259 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:56.706220 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qmfbw_01e7d2d5-dde5-4ff0-8ca5-213e5621be3b/ovnkube-controller/0.log" May 28 23:34:57.953670 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:57.953643 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-sqr58_3022003a-db31-40b3-8099-98f3eadcfa26/network-check-target-container/0.log" May 28 23:34:58.790538 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:58.790456 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-l6rfz_592a71ae-ae07-4ca8-971a-b9eb27b1781c/iptables-alerter/0.log" May 28 23:34:59.408412 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:34:59.408379 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-sgcw7_8a66522a-9cb1-482c-b7b3-30d4d8979674/tuned/0.log" May 28 23:35:01.712670 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:35:01.712642 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-57b5b68b8-chlh5_defb2d12-d7af-4230-9e37-28b734ebccc7/service-ca-operator/1.log" May 28 23:35:01.714292 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:35:01.714272 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-57b5b68b8-chlh5_defb2d12-d7af-4230-9e37-28b734ebccc7/service-ca-operator/0.log" May 28 23:35:02.338889 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:35:02.338859 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-s55jg_027f1b95-7fce-400b-88a6-a6471274a1fa/csi-driver/0.log" May 28 23:35:02.358020 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:35:02.357999 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-s55jg_027f1b95-7fce-400b-88a6-a6471274a1fa/csi-node-driver-registrar/0.log" May 28 23:35:02.375907 ip-10-0-132-11 kubenswrapper[2577]: I0528 23:35:02.375884 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-s55jg_027f1b95-7fce-400b-88a6-a6471274a1fa/csi-liveness-probe/0.log"