May 21 10:27:30.562442 ip-10-0-140-254 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory May 21 10:27:30.562454 ip-10-0-140-254 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory May 21 10:27:30.562461 ip-10-0-140-254 systemd[1]: kubelet.service: Failed with result 'resources'. May 21 10:27:30.562663 ip-10-0-140-254 systemd[1]: Failed to start Kubernetes Kubelet. May 21 10:27:40.811356 ip-10-0-140-254 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. May 21 10:27:40.811374 ip-10-0-140-254 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 8b6d962ca1224d82be25de06133baf98 -- May 21 10:30:04.643182 ip-10-0-140-254 systemd[1]: Starting Kubernetes Kubelet... May 21 10:30:05.160031 ip-10-0-140-254 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 10:30:05.160031 ip-10-0-140-254 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 21 10:30:05.160031 ip-10-0-140-254 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 10:30:05.160031 ip-10-0-140-254 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 21 10:30:05.160031 ip-10-0-140-254 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 10:30:05.161942 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.161857 2563 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 21 10:30:05.165751 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.165735 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 10:30:05.165751 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.165751 2563 feature_gate.go:328] unrecognized feature gate: Example2 May 21 10:30:05.165812 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.165755 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 10:30:05.165812 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.165758 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 10:30:05.165812 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.165761 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 10:30:05.165812 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.165764 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 10:30:05.165812 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.165767 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 10:30:05.165812 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.165770 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 10:30:05.165812 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.165773 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 10:30:05.165812 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.165776 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 10:30:05.165812 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.165778 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 10:30:05.165812 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.165781 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 10:30:05.165812 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.165784 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 10:30:05.165812 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.165786 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 10:30:05.165812 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.165789 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 10:30:05.165812 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.165791 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 10:30:05.165812 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.165794 2563 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 10:30:05.165812 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.165796 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 10:30:05.165812 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.165799 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 10:30:05.165812 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.165802 2563 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 10:30:05.165812 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.165804 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 10:30:05.165812 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.165807 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 10:30:05.166300 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.165816 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 10:30:05.166300 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.165833 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 10:30:05.166300 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.165837 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 10:30:05.166300 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.165840 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 10:30:05.166300 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.165844 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 10:30:05.166300 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.165849 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 10:30:05.166300 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.165853 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 10:30:05.166300 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.165857 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 10:30:05.166300 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.165860 2563 feature_gate.go:328] unrecognized feature gate: Example May 21 10:30:05.166300 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.165863 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 10:30:05.166300 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.165866 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 10:30:05.166300 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.165870 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 10:30:05.166300 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.165872 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 10:30:05.166300 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.165875 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 10:30:05.166300 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.165878 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 10:30:05.166300 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.165881 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 10:30:05.166300 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.165884 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 10:30:05.166300 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.165886 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 10:30:05.166300 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.165889 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 10:30:05.166761 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.165892 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 10:30:05.166761 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.165895 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 10:30:05.166761 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.165898 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 10:30:05.166761 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.165900 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 10:30:05.166761 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.165903 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 10:30:05.166761 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.165906 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 10:30:05.166761 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.165908 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 10:30:05.166761 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.165911 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 10:30:05.166761 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.165914 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 10:30:05.166761 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.165916 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 10:30:05.166761 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.165918 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 10:30:05.166761 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.165921 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 10:30:05.166761 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.165923 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 10:30:05.166761 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.165926 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 10:30:05.166761 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.165929 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 10:30:05.166761 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.165932 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 10:30:05.166761 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.165935 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 10:30:05.166761 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.165938 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 10:30:05.166761 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.165941 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 10:30:05.166761 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.165943 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 10:30:05.167264 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.165946 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 10:30:05.167264 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.165949 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 10:30:05.167264 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.165951 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 10:30:05.167264 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.165954 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 10:30:05.167264 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.165957 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 10:30:05.167264 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.165960 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 10:30:05.167264 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.165963 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 10:30:05.167264 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.165966 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 10:30:05.167264 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.165968 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 10:30:05.167264 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.165971 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 10:30:05.167264 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.165973 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 10:30:05.167264 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.165976 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 10:30:05.167264 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.165979 2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 10:30:05.167264 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.165981 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 10:30:05.167264 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.165984 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 10:30:05.167264 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.165987 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 10:30:05.167264 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.165990 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 10:30:05.167264 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.165992 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 10:30:05.167264 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.165995 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 10:30:05.167264 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.165997 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 10:30:05.167749 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166000 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 10:30:05.167749 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166002 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 10:30:05.167749 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166005 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 10:30:05.167749 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166007 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 10:30:05.167749 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166010 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 10:30:05.167749 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166393 2563 feature_gate.go:328] unrecognized feature gate: Example May 21 10:30:05.167749 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166400 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 10:30:05.167749 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166403 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 10:30:05.167749 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166407 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 10:30:05.167749 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166409 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 10:30:05.167749 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166412 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 10:30:05.167749 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166415 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 10:30:05.167749 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166418 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 10:30:05.167749 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166421 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 10:30:05.167749 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166424 2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 10:30:05.167749 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166427 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 10:30:05.167749 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166429 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 10:30:05.167749 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166432 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 10:30:05.167749 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166434 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 10:30:05.168214 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166437 2563 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 10:30:05.168214 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166439 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 10:30:05.168214 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166442 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 10:30:05.168214 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166445 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 10:30:05.168214 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166448 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 10:30:05.168214 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166451 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 10:30:05.168214 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166453 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 10:30:05.168214 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166456 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 10:30:05.168214 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166459 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 10:30:05.168214 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166462 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 10:30:05.168214 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166466 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 10:30:05.168214 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166469 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 10:30:05.168214 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166472 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 10:30:05.168214 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166476 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 10:30:05.168214 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166479 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 10:30:05.168214 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166482 2563 feature_gate.go:328] unrecognized feature gate: Example2 May 21 10:30:05.168214 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166484 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 10:30:05.168214 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166487 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 10:30:05.168214 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166489 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 10:30:05.168214 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166492 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 10:30:05.168737 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166495 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 10:30:05.168737 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166497 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 10:30:05.168737 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166500 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 10:30:05.168737 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166502 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 10:30:05.168737 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166505 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 10:30:05.168737 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166507 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 10:30:05.168737 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166510 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 10:30:05.168737 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166512 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 10:30:05.168737 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166515 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 10:30:05.168737 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166517 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 10:30:05.168737 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166520 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 10:30:05.168737 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166522 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 10:30:05.168737 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166525 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 10:30:05.168737 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166528 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 10:30:05.168737 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166530 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 10:30:05.168737 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166532 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 10:30:05.168737 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166535 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 10:30:05.168737 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166537 2563 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 10:30:05.168737 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166540 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 10:30:05.168737 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166543 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 10:30:05.169233 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166546 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 10:30:05.169233 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166549 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 10:30:05.169233 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166552 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 10:30:05.169233 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166554 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 10:30:05.169233 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166557 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 10:30:05.169233 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166559 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 10:30:05.169233 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166562 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 10:30:05.169233 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166564 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 10:30:05.169233 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166567 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 10:30:05.169233 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166569 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 10:30:05.169233 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166572 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 10:30:05.169233 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166574 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 10:30:05.169233 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166577 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 10:30:05.169233 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166579 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 10:30:05.169233 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166581 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 10:30:05.169233 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166584 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 10:30:05.169233 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166586 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 10:30:05.169233 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166591 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 10:30:05.169233 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166594 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 10:30:05.169699 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166597 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 10:30:05.169699 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166600 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 10:30:05.169699 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166603 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 10:30:05.169699 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166605 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 10:30:05.169699 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166608 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 10:30:05.169699 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166610 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 10:30:05.169699 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166613 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 10:30:05.169699 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166616 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 10:30:05.169699 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166619 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 10:30:05.169699 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166621 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 10:30:05.169699 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166624 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 10:30:05.169699 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166626 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 10:30:05.169699 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.166629 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 10:30:05.169699 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168186 2563 flags.go:64] FLAG: --address="0.0.0.0" May 21 10:30:05.169699 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168197 2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 21 10:30:05.169699 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168204 2563 flags.go:64] FLAG: --anonymous-auth="true" May 21 10:30:05.169699 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168209 2563 flags.go:64] FLAG: --application-metrics-count-limit="100" May 21 10:30:05.169699 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168213 2563 flags.go:64] FLAG: --authentication-token-webhook="false" May 21 10:30:05.169699 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168216 2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 21 10:30:05.169699 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168221 2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 21 10:30:05.169699 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168230 2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 21 10:30:05.170217 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168234 2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 21 10:30:05.170217 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168236 2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 21 10:30:05.170217 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168240 2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 21 10:30:05.170217 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168243 2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 21 10:30:05.170217 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168246 2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 21 10:30:05.170217 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168249 2563 flags.go:64] FLAG: --cgroup-root="" May 21 10:30:05.170217 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168252 2563 flags.go:64] FLAG: --cgroups-per-qos="true" May 21 10:30:05.170217 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168255 2563 flags.go:64] FLAG: --client-ca-file="" May 21 10:30:05.170217 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168258 2563 flags.go:64] FLAG: --cloud-config="" May 21 10:30:05.170217 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168260 2563 flags.go:64] FLAG: --cloud-provider="external" May 21 10:30:05.170217 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168263 2563 flags.go:64] FLAG: --cluster-dns="[]" May 21 10:30:05.170217 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168268 2563 flags.go:64] FLAG: --cluster-domain="" May 21 10:30:05.170217 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168271 2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 21 10:30:05.170217 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168274 2563 flags.go:64] FLAG: --config-dir="" May 21 10:30:05.170217 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168277 2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 21 10:30:05.170217 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168281 2563 flags.go:64] FLAG: --container-log-max-files="5" May 21 10:30:05.170217 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168285 2563 flags.go:64] FLAG: --container-log-max-size="10Mi" May 21 10:30:05.170217 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168289 2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 21 10:30:05.170217 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168292 2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 21 10:30:05.170217 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168295 2563 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 21 10:30:05.170217 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168298 2563 flags.go:64] FLAG: --contention-profiling="false" May 21 10:30:05.170217 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168301 2563 flags.go:64] FLAG: --cpu-cfs-quota="true" May 21 10:30:05.170217 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168304 2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 21 10:30:05.170217 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168307 2563 flags.go:64] FLAG: --cpu-manager-policy="none" May 21 10:30:05.170217 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168310 2563 flags.go:64] FLAG: --cpu-manager-policy-options="" May 21 10:30:05.170818 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168314 2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 21 10:30:05.170818 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168318 2563 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 21 10:30:05.170818 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168321 2563 flags.go:64] FLAG: --enable-debugging-handlers="true" May 21 10:30:05.170818 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168324 2563 flags.go:64] FLAG: --enable-load-reader="false" May 21 10:30:05.170818 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168326 2563 flags.go:64] FLAG: --enable-server="true" May 21 10:30:05.170818 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168329 2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 21 10:30:05.170818 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168334 2563 flags.go:64] FLAG: --event-burst="100" May 21 10:30:05.170818 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168337 2563 flags.go:64] FLAG: --event-qps="50" May 21 10:30:05.170818 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168340 2563 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 21 10:30:05.170818 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168343 2563 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 21 10:30:05.170818 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168346 2563 flags.go:64] FLAG: --eviction-hard="" May 21 10:30:05.170818 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168349 2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 21 10:30:05.170818 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168352 2563 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 21 10:30:05.170818 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168355 2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 21 10:30:05.170818 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168358 2563 flags.go:64] FLAG: --eviction-soft="" May 21 10:30:05.170818 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168361 2563 flags.go:64] FLAG: --eviction-soft-grace-period="" May 21 10:30:05.170818 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168364 2563 flags.go:64] FLAG: --exit-on-lock-contention="false" May 21 10:30:05.170818 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168367 2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 21 10:30:05.170818 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168370 2563 flags.go:64] FLAG: --experimental-mounter-path="" May 21 10:30:05.170818 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168372 2563 flags.go:64] FLAG: --fail-cgroupv1="false" May 21 10:30:05.170818 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168375 2563 flags.go:64] FLAG: --fail-swap-on="true" May 21 10:30:05.170818 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168378 2563 flags.go:64] FLAG: --feature-gates="" May 21 10:30:05.170818 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168383 2563 flags.go:64] FLAG: --file-check-frequency="20s" May 21 10:30:05.170818 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168386 2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 21 10:30:05.170818 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168389 2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 21 10:30:05.171433 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168392 2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 21 10:30:05.171433 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168395 2563 flags.go:64] FLAG: --healthz-port="10248" May 21 10:30:05.171433 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168398 2563 flags.go:64] FLAG: --help="false" May 21 10:30:05.171433 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168401 2563 flags.go:64] FLAG: --hostname-override="ip-10-0-140-254.ec2.internal" May 21 10:30:05.171433 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168404 2563 flags.go:64] FLAG: --housekeeping-interval="10s" May 21 10:30:05.171433 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168407 2563 flags.go:64] FLAG: --http-check-frequency="20s" May 21 10:30:05.171433 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168410 2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 21 10:30:05.171433 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168413 2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 21 10:30:05.171433 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168417 2563 flags.go:64] FLAG: --image-gc-high-threshold="85" May 21 10:30:05.171433 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168420 2563 flags.go:64] FLAG: --image-gc-low-threshold="80" May 21 10:30:05.171433 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168423 2563 flags.go:64] FLAG: --image-service-endpoint="" May 21 10:30:05.171433 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168426 2563 flags.go:64] FLAG: --kernel-memcg-notification="false" May 21 10:30:05.171433 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168429 2563 flags.go:64] FLAG: --kube-api-burst="100" May 21 10:30:05.171433 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168432 2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 21 10:30:05.171433 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168435 2563 flags.go:64] FLAG: --kube-api-qps="50" May 21 10:30:05.171433 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168438 2563 flags.go:64] FLAG: --kube-reserved="" May 21 10:30:05.171433 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168440 2563 flags.go:64] FLAG: --kube-reserved-cgroup="" May 21 10:30:05.171433 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168443 2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 21 10:30:05.171433 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168446 2563 flags.go:64] FLAG: --kubelet-cgroups="" May 21 10:30:05.171433 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168449 2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 21 10:30:05.171433 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168452 2563 flags.go:64] FLAG: --lock-file="" May 21 10:30:05.171433 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168454 2563 flags.go:64] FLAG: --log-cadvisor-usage="false" May 21 10:30:05.171433 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168457 2563 flags.go:64] FLAG: --log-flush-frequency="5s" May 21 10:30:05.171433 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168460 2563 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 21 10:30:05.172026 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168465 2563 flags.go:64] FLAG: --log-json-split-stream="false" May 21 10:30:05.172026 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168468 2563 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 21 10:30:05.172026 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168471 2563 flags.go:64] FLAG: --log-text-split-stream="false" May 21 10:30:05.172026 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168474 2563 flags.go:64] FLAG: --logging-format="text" May 21 10:30:05.172026 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168476 2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 21 10:30:05.172026 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168480 2563 flags.go:64] FLAG: --make-iptables-util-chains="true" May 21 10:30:05.172026 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168483 2563 flags.go:64] FLAG: --manifest-url="" May 21 10:30:05.172026 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168485 2563 flags.go:64] FLAG: --manifest-url-header="" May 21 10:30:05.172026 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168490 2563 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 21 10:30:05.172026 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168493 2563 flags.go:64] FLAG: --max-open-files="1000000" May 21 10:30:05.172026 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168497 2563 flags.go:64] FLAG: --max-pods="110" May 21 10:30:05.172026 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168500 2563 flags.go:64] FLAG: --maximum-dead-containers="-1" May 21 10:30:05.172026 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168502 2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 21 10:30:05.172026 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168505 2563 flags.go:64] FLAG: --memory-manager-policy="None" May 21 10:30:05.172026 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168508 2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 21 10:30:05.172026 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168511 2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 21 10:30:05.172026 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168514 2563 flags.go:64] FLAG: --node-ip="0.0.0.0" May 21 10:30:05.172026 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168516 2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 21 10:30:05.172026 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168524 2563 flags.go:64] FLAG: --node-status-max-images="50" May 21 10:30:05.172026 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168527 2563 flags.go:64] FLAG: --node-status-update-frequency="10s" May 21 10:30:05.172026 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168531 2563 flags.go:64] FLAG: --oom-score-adj="-999" May 21 10:30:05.172026 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168533 2563 flags.go:64] FLAG: --pod-cidr="" May 21 10:30:05.172026 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168536 2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 21 10:30:05.172577 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168542 2563 flags.go:64] FLAG: --pod-manifest-path="" May 21 10:30:05.172577 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168545 2563 flags.go:64] FLAG: --pod-max-pids="-1" May 21 10:30:05.172577 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168548 2563 flags.go:64] FLAG: --pods-per-core="0" May 21 10:30:05.172577 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168550 2563 flags.go:64] FLAG: --port="10250" May 21 10:30:05.172577 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168553 2563 flags.go:64] FLAG: --protect-kernel-defaults="false" May 21 10:30:05.172577 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168556 2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a830c45d8e11f569" May 21 10:30:05.172577 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168559 2563 flags.go:64] FLAG: --qos-reserved="" May 21 10:30:05.172577 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168562 2563 flags.go:64] FLAG: --read-only-port="10255" May 21 10:30:05.172577 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168565 2563 flags.go:64] FLAG: --register-node="true" May 21 10:30:05.172577 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168568 2563 flags.go:64] FLAG: --register-schedulable="true" May 21 10:30:05.172577 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168571 2563 flags.go:64] FLAG: --register-with-taints="" May 21 10:30:05.172577 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168575 2563 flags.go:64] FLAG: --registry-burst="10" May 21 10:30:05.172577 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168577 2563 flags.go:64] FLAG: --registry-qps="5" May 21 10:30:05.172577 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168580 2563 flags.go:64] FLAG: --reserved-cpus="" May 21 10:30:05.172577 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168583 2563 flags.go:64] FLAG: --reserved-memory="" May 21 10:30:05.172577 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168587 2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 21 10:30:05.172577 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168590 2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 21 10:30:05.172577 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168593 2563 flags.go:64] FLAG: --rotate-certificates="false" May 21 10:30:05.172577 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168596 2563 flags.go:64] FLAG: --rotate-server-certificates="false" May 21 10:30:05.172577 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168599 2563 flags.go:64] FLAG: --runonce="false" May 21 10:30:05.172577 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168602 2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 21 10:30:05.172577 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168605 2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 21 10:30:05.172577 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168608 2563 flags.go:64] FLAG: --seccomp-default="false" May 21 10:30:05.172577 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168610 2563 flags.go:64] FLAG: --serialize-image-pulls="true" May 21 10:30:05.172577 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168614 2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 21 10:30:05.172577 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168617 2563 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 21 10:30:05.173253 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168620 2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 21 10:30:05.173253 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168623 2563 flags.go:64] FLAG: --storage-driver-password="root" May 21 10:30:05.173253 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168626 2563 flags.go:64] FLAG: --storage-driver-secure="false" May 21 10:30:05.173253 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168629 2563 flags.go:64] FLAG: --storage-driver-table="stats" May 21 10:30:05.173253 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168632 2563 flags.go:64] FLAG: --storage-driver-user="root" May 21 10:30:05.173253 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168635 2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 21 10:30:05.173253 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168638 2563 flags.go:64] FLAG: --sync-frequency="1m0s" May 21 10:30:05.173253 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168640 2563 flags.go:64] FLAG: --system-cgroups="" May 21 10:30:05.173253 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168643 2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 21 10:30:05.173253 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168648 2563 flags.go:64] FLAG: --system-reserved-cgroup="" May 21 10:30:05.173253 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168651 2563 flags.go:64] FLAG: --tls-cert-file="" May 21 10:30:05.173253 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168654 2563 flags.go:64] FLAG: --tls-cipher-suites="[]" May 21 10:30:05.173253 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168658 2563 flags.go:64] FLAG: --tls-min-version="" May 21 10:30:05.173253 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168661 2563 flags.go:64] FLAG: --tls-private-key-file="" May 21 10:30:05.173253 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168666 2563 flags.go:64] FLAG: --topology-manager-policy="none" May 21 10:30:05.173253 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168669 2563 flags.go:64] FLAG: --topology-manager-policy-options="" May 21 10:30:05.173253 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168672 2563 flags.go:64] FLAG: --topology-manager-scope="container" May 21 10:30:05.173253 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168675 2563 flags.go:64] FLAG: --v="2" May 21 10:30:05.173253 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168679 2563 flags.go:64] FLAG: --version="false" May 21 10:30:05.173253 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168683 2563 flags.go:64] FLAG: --vmodule="" May 21 10:30:05.173253 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168687 2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 21 10:30:05.173253 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.168690 2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 21 10:30:05.173253 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.168799 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 10:30:05.173253 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.168803 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 10:30:05.173253 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.168806 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 10:30:05.173857 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.168810 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 10:30:05.173857 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.168813 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 10:30:05.173857 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.168816 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 10:30:05.173857 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.168833 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 10:30:05.173857 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.168836 2563 feature_gate.go:328] unrecognized feature gate: Example2 May 21 10:30:05.173857 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.168838 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 10:30:05.173857 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.168841 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 10:30:05.173857 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.168844 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 10:30:05.173857 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.168847 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 10:30:05.173857 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.168849 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 10:30:05.173857 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.168852 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 10:30:05.173857 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.168855 2563 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 10:30:05.173857 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.168858 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 10:30:05.173857 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.168860 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 10:30:05.173857 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.168863 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 10:30:05.173857 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.168865 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 10:30:05.173857 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.168868 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 10:30:05.173857 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.168870 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 10:30:05.173857 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.168873 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 10:30:05.173857 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.168875 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 10:30:05.174354 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.168878 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 10:30:05.174354 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.168882 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 10:30:05.174354 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.168885 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 10:30:05.174354 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.168887 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 10:30:05.174354 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.168889 2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 10:30:05.174354 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.168892 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 10:30:05.174354 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.168894 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 10:30:05.174354 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.168897 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 10:30:05.174354 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.168902 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 10:30:05.174354 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.168905 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 10:30:05.174354 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.168909 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 10:30:05.174354 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.168913 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 10:30:05.174354 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.168916 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 10:30:05.174354 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.168918 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 10:30:05.174354 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.168921 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 10:30:05.174354 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.168923 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 10:30:05.174354 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.168926 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 10:30:05.174354 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.168929 2563 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 10:30:05.174354 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.168931 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 10:30:05.174901 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.168934 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 10:30:05.174901 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.168936 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 10:30:05.174901 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.168939 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 10:30:05.174901 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.168941 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 10:30:05.174901 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.168944 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 10:30:05.174901 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.168949 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 10:30:05.174901 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.168952 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 10:30:05.174901 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.168954 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 10:30:05.174901 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.168957 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 10:30:05.174901 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.168960 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 10:30:05.174901 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.168963 2563 feature_gate.go:328] unrecognized feature gate: Example May 21 10:30:05.174901 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.168965 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 10:30:05.174901 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.168968 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 10:30:05.174901 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.168970 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 10:30:05.174901 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.168977 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 10:30:05.174901 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.168979 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 10:30:05.174901 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.168982 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 10:30:05.174901 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.168984 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 10:30:05.174901 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.168986 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 10:30:05.175385 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.168989 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 10:30:05.175385 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.168992 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 10:30:05.175385 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.168996 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 10:30:05.175385 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.168999 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 10:30:05.175385 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.169002 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 10:30:05.175385 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.169004 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 10:30:05.175385 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.169007 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 10:30:05.175385 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.169009 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 10:30:05.175385 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.169012 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 10:30:05.175385 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.169014 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 10:30:05.175385 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.169017 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 10:30:05.175385 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.169019 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 10:30:05.175385 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.169022 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 10:30:05.175385 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.169024 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 10:30:05.175385 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.169027 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 10:30:05.175385 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.169029 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 10:30:05.175385 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.169032 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 10:30:05.175385 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.169034 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 10:30:05.175385 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.169037 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 10:30:05.175385 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.169040 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 10:30:05.175893 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.169042 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 10:30:05.175893 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.169045 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 10:30:05.175893 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.169047 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 10:30:05.175893 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.169050 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 10:30:05.175893 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.169052 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 10:30:05.175893 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.169057 2563 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 10:30:05.176052 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.175910 2563 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 21 10:30:05.176052 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.175925 2563 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 21 10:30:05.176052 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.175972 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 10:30:05.176052 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.175977 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 10:30:05.176052 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.175981 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 10:30:05.176052 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.175984 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 10:30:05.176052 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.175986 2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 10:30:05.176052 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.175990 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 10:30:05.176052 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.175993 2563 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 10:30:05.176052 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.175996 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 10:30:05.176052 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.175999 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 10:30:05.176052 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176001 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 10:30:05.176052 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176004 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 10:30:05.176052 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176006 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 10:30:05.176052 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176010 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 10:30:05.176052 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176012 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 10:30:05.176052 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176015 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 10:30:05.176052 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176018 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 10:30:05.176052 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176020 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 10:30:05.176052 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176023 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 10:30:05.176536 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176027 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 10:30:05.176536 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176031 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 10:30:05.176536 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176034 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 10:30:05.176536 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176037 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 10:30:05.176536 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176039 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 10:30:05.176536 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176042 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 10:30:05.176536 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176045 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 10:30:05.176536 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176048 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 10:30:05.176536 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176050 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 10:30:05.176536 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176053 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 10:30:05.176536 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176056 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 10:30:05.176536 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176059 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 10:30:05.176536 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176061 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 10:30:05.176536 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176065 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 10:30:05.176536 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176068 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 10:30:05.176536 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176071 2563 feature_gate.go:328] unrecognized feature gate: Example2 May 21 10:30:05.176536 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176073 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 10:30:05.176536 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176075 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 10:30:05.176536 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176078 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 10:30:05.176536 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176080 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 10:30:05.177211 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176083 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 10:30:05.177211 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176085 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 10:30:05.177211 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176087 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 10:30:05.177211 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176090 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 10:30:05.177211 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176093 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 10:30:05.177211 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176095 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 10:30:05.177211 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176098 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 10:30:05.177211 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176100 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 10:30:05.177211 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176102 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 10:30:05.177211 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176106 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 10:30:05.177211 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176108 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 10:30:05.177211 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176111 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 10:30:05.177211 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176113 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 10:30:05.177211 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176116 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 10:30:05.177211 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176119 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 10:30:05.177211 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176122 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 10:30:05.177211 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176124 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 10:30:05.177211 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176128 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 10:30:05.177211 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176133 2563 feature_gate.go:328] unrecognized feature gate: Example May 21 10:30:05.177678 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176136 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 10:30:05.177678 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176138 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 10:30:05.177678 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176141 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 10:30:05.177678 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176144 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 10:30:05.177678 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176147 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 10:30:05.177678 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176149 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 10:30:05.177678 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176152 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 10:30:05.177678 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176155 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 10:30:05.177678 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176158 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 10:30:05.177678 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176160 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 10:30:05.177678 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176162 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 10:30:05.177678 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176165 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 10:30:05.177678 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176167 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 10:30:05.177678 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176170 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 10:30:05.177678 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176173 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 10:30:05.177678 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176175 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 10:30:05.177678 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176178 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 10:30:05.177678 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176180 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 10:30:05.177678 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176183 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 10:30:05.177678 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176185 2563 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 10:30:05.178198 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176188 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 10:30:05.178198 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176191 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 10:30:05.178198 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176193 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 10:30:05.178198 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176196 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 10:30:05.178198 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176198 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 10:30:05.178198 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176201 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 10:30:05.178198 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176204 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 10:30:05.178198 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176207 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 10:30:05.178198 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176209 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 10:30:05.178198 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.176215 2563 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 10:30:05.178198 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176316 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 10:30:05.178198 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176320 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 10:30:05.178198 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176323 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 10:30:05.178198 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176326 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 10:30:05.178198 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176329 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 10:30:05.178567 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176331 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 10:30:05.178567 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176334 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 10:30:05.178567 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176337 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 10:30:05.178567 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176339 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 10:30:05.178567 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176342 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 10:30:05.178567 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176347 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 10:30:05.178567 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176351 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 10:30:05.178567 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176353 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 10:30:05.178567 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176356 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 10:30:05.178567 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176359 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 10:30:05.178567 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176362 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 10:30:05.178567 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176364 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 10:30:05.178567 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176367 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 10:30:05.178567 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176370 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 10:30:05.178567 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176372 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 10:30:05.178567 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176375 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 10:30:05.178567 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176377 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 10:30:05.178567 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176380 2563 feature_gate.go:328] unrecognized feature gate: Example May 21 10:30:05.178567 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176382 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 10:30:05.179072 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176385 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 10:30:05.179072 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176387 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 10:30:05.179072 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176390 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 10:30:05.179072 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176393 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 10:30:05.179072 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176396 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 10:30:05.179072 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176399 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 10:30:05.179072 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176402 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 10:30:05.179072 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176404 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 10:30:05.179072 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176407 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 10:30:05.179072 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176409 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 10:30:05.179072 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176412 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 10:30:05.179072 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176415 2563 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 10:30:05.179072 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176417 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 10:30:05.179072 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176420 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 10:30:05.179072 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176422 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 10:30:05.179072 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176425 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 10:30:05.179072 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176427 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 10:30:05.179072 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176430 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 10:30:05.179072 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176432 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 10:30:05.179072 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176435 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 10:30:05.179574 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176438 2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 10:30:05.179574 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176440 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 10:30:05.179574 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176444 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 10:30:05.179574 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176447 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 10:30:05.179574 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176449 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 10:30:05.179574 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176452 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 10:30:05.179574 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176454 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 10:30:05.179574 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176457 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 10:30:05.179574 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176459 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 10:30:05.179574 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176462 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 10:30:05.179574 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176464 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 10:30:05.179574 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176467 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 10:30:05.179574 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176469 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 10:30:05.179574 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176472 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 10:30:05.179574 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176474 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 10:30:05.179574 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176477 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 10:30:05.179574 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176480 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 10:30:05.179574 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176483 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 10:30:05.179574 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176485 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 10:30:05.179574 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176488 2563 feature_gate.go:328] unrecognized feature gate: Example2 May 21 10:30:05.180068 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176490 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 10:30:05.180068 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176493 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 10:30:05.180068 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176495 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 10:30:05.180068 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176497 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 10:30:05.180068 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176500 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 10:30:05.180068 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176502 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 10:30:05.180068 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176505 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 10:30:05.180068 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176507 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 10:30:05.180068 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176510 2563 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 10:30:05.180068 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176512 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 10:30:05.180068 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176514 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 10:30:05.180068 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176517 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 10:30:05.180068 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176520 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 10:30:05.180068 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176522 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 10:30:05.180068 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176525 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 10:30:05.180068 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176527 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 10:30:05.180068 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176530 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 10:30:05.180068 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176532 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 10:30:05.180068 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176535 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 10:30:05.180068 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176537 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 10:30:05.180585 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176540 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 10:30:05.180585 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:05.176543 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 10:30:05.180585 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.176548 2563 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 10:30:05.180585 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.177483 2563 server.go:962] "Client rotation is on, will bootstrap in background" May 21 10:30:05.181730 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.181716 2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 21 10:30:05.182872 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.182860 2563 server.go:1019] "Starting client certificate rotation" May 21 10:30:05.182979 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.182961 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 21 10:30:05.183013 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.183003 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 21 10:30:05.212546 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.212529 2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 21 10:30:05.219778 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.219751 2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 21 10:30:05.240118 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.240097 2563 log.go:25] "Validated CRI v1 runtime API" May 21 10:30:05.246119 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.246101 2563 log.go:25] "Validated CRI v1 image API" May 21 10:30:05.247702 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.247682 2563 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 21 10:30:05.250832 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.250803 2563 fs.go:135] Filesystem UUIDs: map[3b641985-6491-45cf-abad-66c2fd38e981:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 bf89653b-f198-4ce7-b211-d50389a38c89:/dev/nvme0n1p3] May 21 10:30:05.250900 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.250835 2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 21 10:30:05.252585 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.252397 2563 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 21 10:30:05.255426 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.255313 2563 manager.go:217] Machine: {Timestamp:2026-05-21 10:30:05.254812152 +0000 UTC m=+0.465972259 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3104414 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2daee637b086c499f5b321f6bc0010 SystemUUID:ec2daee6-37b0-86c4-99f5-b321f6bc0010 BootID:8b6d962c-a122-4d82-be25-de06133baf98 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:28:c7:4d:6a:63 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:28:c7:4d:6a:63 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:06:34:58:21:2d:56 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 21 10:30:05.255426 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.255421 2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 21 10:30:05.255534 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.255519 2563 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 21 10:30:05.259305 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.259284 2563 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 21 10:30:05.259471 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.259308 2563 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-254.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 21 10:30:05.259512 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.259481 2563 topology_manager.go:138] "Creating topology manager with none policy" May 21 10:30:05.259512 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.259490 2563 container_manager_linux.go:306] "Creating device plugin manager" May 21 10:30:05.259512 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.259498 2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 21 10:30:05.260472 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.260462 2563 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 21 10:30:05.263212 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.263202 2563 state_mem.go:36] "Initialized new in-memory state store" May 21 10:30:05.263316 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.263307 2563 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 21 10:30:05.266158 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.266126 2563 kubelet.go:491] "Attempting to sync node with API server" May 21 10:30:05.266158 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.266143 2563 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 21 10:30:05.266158 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.266155 2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 21 10:30:05.266252 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.266164 2563 kubelet.go:397] "Adding apiserver pod source" May 21 10:30:05.266252 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.266173 2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 21 10:30:05.267490 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.267477 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 21 10:30:05.267545 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.267496 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 21 10:30:05.270928 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.270914 2563 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 21 10:30:05.273297 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.273282 2563 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 21 10:30:05.274317 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.274292 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 21 10:30:05.274317 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.274315 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 21 10:30:05.274446 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.274324 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 21 10:30:05.274446 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.274333 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 21 10:30:05.274446 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.274345 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 21 10:30:05.274446 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.274353 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 21 10:30:05.274446 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.274370 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 21 10:30:05.274446 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.274379 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 21 10:30:05.274446 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.274389 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 21 10:30:05.274446 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.274398 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 21 10:30:05.274446 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.274416 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 21 10:30:05.274748 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.274734 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 21 10:30:05.274800 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.274781 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 21 10:30:05.274800 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.274791 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 21 10:30:05.279337 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.279317 2563 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 21 10:30:05.279434 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.279370 2563 server.go:1295] "Started kubelet" May 21 10:30:05.279533 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.279447 2563 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 21 10:30:05.279577 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.279557 2563 server_v1.go:47] "podresources" method="list" useActivePods=true May 21 10:30:05.280638 ip-10-0-140-254 systemd[1]: Started Kubernetes Kubelet. May 21 10:30:05.281011 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.280912 2563 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-254.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 21 10:30:05.281011 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.280965 2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 21 10:30:05.281160 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.281038 2563 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 21 10:30:05.281160 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:05.281125 2563 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-254.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 21 10:30:05.281321 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:05.281206 2563 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 21 10:30:05.283789 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.283774 2563 server.go:317] "Adding debug handlers to kubelet server" May 21 10:30:05.289281 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:05.288109 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-254.ec2.internal.18b18df39f6cc8dc default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-254.ec2.internal,UID:ip-10-0-140-254.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-254.ec2.internal,},FirstTimestamp:2026-05-21 10:30:05.279332572 +0000 UTC m=+0.490492677,LastTimestamp:2026-05-21 10:30:05.279332572 +0000 UTC m=+0.490492677,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-254.ec2.internal,}" May 21 10:30:05.290070 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.290032 2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 21 10:30:05.290132 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.290086 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 21 10:30:05.290317 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.290199 2563 volume_manager.go:295] "The desired_state_of_world populator starts" May 21 10:30:05.290317 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.290229 2563 volume_manager.go:297] "Starting Kubelet Volume Manager" May 21 10:30:05.290436 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.290344 2563 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 21 10:30:05.290436 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.290403 2563 reconstruct.go:97] "Volume reconstruction finished" May 21 10:30:05.290436 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.290412 2563 reconciler.go:26] "Reconciler: start to sync state" May 21 10:30:05.292255 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.292187 2563 factory.go:55] Registering systemd factory May 21 10:30:05.292255 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.292206 2563 factory.go:223] Registration of the systemd container factory successfully May 21 10:30:05.292532 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.292512 2563 factory.go:153] Registering CRI-O factory May 21 10:30:05.292532 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.292529 2563 factory.go:223] Registration of the crio container factory successfully May 21 10:30:05.292667 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.292581 2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 21 10:30:05.292667 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.292599 2563 factory.go:103] Registering Raw factory May 21 10:30:05.292667 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.292613 2563 manager.go:1196] Started watching for new ooms in manager May 21 10:30:05.292890 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:05.292816 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-254.ec2.internal\" not found" May 21 10:30:05.293117 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.293102 2563 manager.go:319] Starting recovery of all containers May 21 10:30:05.293201 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:05.293137 2563 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 21 10:30:05.299779 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.299728 2563 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 21 10:30:05.302779 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:05.302757 2563 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" May 21 10:30:05.302954 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:05.302930 2563 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-254.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" May 21 10:30:05.303621 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.303599 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6mccs" May 21 10:30:05.304102 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.304086 2563 manager.go:324] Recovery completed May 21 10:30:05.308291 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.308276 2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 10:30:05.310140 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.310123 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6mccs" May 21 10:30:05.310215 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.310127 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-254.ec2.internal" event="NodeHasSufficientMemory" May 21 10:30:05.310215 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.310185 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-254.ec2.internal" event="NodeHasNoDiskPressure" May 21 10:30:05.310215 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.310200 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-254.ec2.internal" event="NodeHasSufficientPID" May 21 10:30:05.310773 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.310757 2563 cpu_manager.go:222] "Starting CPU manager" policy="none" May 21 10:30:05.310773 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.310770 2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 21 10:30:05.310950 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.310788 2563 state_mem.go:36] "Initialized new in-memory state store" May 21 10:30:05.315694 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.315678 2563 policy_none.go:49] "None policy: Start" May 21 10:30:05.315776 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.315698 2563 memory_manager.go:186] "Starting memorymanager" policy="None" May 21 10:30:05.315776 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.315712 2563 state_mem.go:35] "Initializing new in-memory state store" May 21 10:30:05.366572 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.366533 2563 manager.go:341] "Starting Device Plugin manager" May 21 10:30:05.387189 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:05.366657 2563 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 21 10:30:05.387189 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.366672 2563 server.go:85] "Starting device plugin registration server" May 21 10:30:05.387189 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.366940 2563 eviction_manager.go:189] "Eviction manager: starting control loop" May 21 10:30:05.387189 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.366951 2563 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 21 10:30:05.387189 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.367027 2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 21 10:30:05.387189 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.367113 2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 21 10:30:05.387189 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.367124 2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 21 10:30:05.387189 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:05.367685 2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 21 10:30:05.387189 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:05.367727 2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-254.ec2.internal\" not found" May 21 10:30:05.395533 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.395505 2563 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 21 10:30:05.395533 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.395534 2563 status_manager.go:230] "Starting to sync pod status with apiserver" May 21 10:30:05.395662 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.395555 2563 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 21 10:30:05.395662 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.395561 2563 kubelet.go:2451] "Starting kubelet main sync loop" May 21 10:30:05.395662 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:05.395602 2563 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 21 10:30:05.398334 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.398311 2563 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 21 10:30:05.467205 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.467176 2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 10:30:05.468398 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.468379 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-254.ec2.internal" event="NodeHasSufficientMemory" May 21 10:30:05.468479 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.468413 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-254.ec2.internal" event="NodeHasNoDiskPressure" May 21 10:30:05.468479 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.468423 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-254.ec2.internal" event="NodeHasSufficientPID" May 21 10:30:05.468479 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.468445 2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-254.ec2.internal" May 21 10:30:05.481269 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.481245 2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-254.ec2.internal" May 21 10:30:05.481328 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:05.481274 2563 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-254.ec2.internal\": node \"ip-10-0-140-254.ec2.internal\" not found" May 21 10:30:05.496165 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.496140 2563 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-254.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-254.ec2.internal"] May 21 10:30:05.496243 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.496210 2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 10:30:05.497605 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.497584 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-254.ec2.internal" event="NodeHasSufficientMemory" May 21 10:30:05.497689 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.497614 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-254.ec2.internal" event="NodeHasNoDiskPressure" May 21 10:30:05.497689 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.497624 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-254.ec2.internal" event="NodeHasSufficientPID" May 21 10:30:05.499975 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.499962 2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 10:30:05.500148 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.500133 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-254.ec2.internal" May 21 10:30:05.500183 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.500166 2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 10:30:05.501214 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.501193 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-254.ec2.internal" event="NodeHasSufficientMemory" May 21 10:30:05.501214 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.501212 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-254.ec2.internal" event="NodeHasSufficientMemory" May 21 10:30:05.501336 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.501224 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-254.ec2.internal" event="NodeHasNoDiskPressure" May 21 10:30:05.501336 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.501240 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-254.ec2.internal" event="NodeHasSufficientPID" May 21 10:30:05.501336 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.501242 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-254.ec2.internal" event="NodeHasNoDiskPressure" May 21 10:30:05.501336 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.501264 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-254.ec2.internal" event="NodeHasSufficientPID" May 21 10:30:05.503543 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.503528 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-254.ec2.internal" May 21 10:30:05.503608 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.503565 2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 10:30:05.503661 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:05.503643 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-254.ec2.internal\" not found" May 21 10:30:05.504352 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.504338 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-254.ec2.internal" event="NodeHasSufficientMemory" May 21 10:30:05.504421 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.504369 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-254.ec2.internal" event="NodeHasNoDiskPressure" May 21 10:30:05.504421 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.504383 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-254.ec2.internal" event="NodeHasSufficientPID" May 21 10:30:05.525617 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:05.525551 2563 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-254.ec2.internal\" not found" node="ip-10-0-140-254.ec2.internal" May 21 10:30:05.530322 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:05.530303 2563 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-254.ec2.internal\" not found" node="ip-10-0-140-254.ec2.internal" May 21 10:30:05.592459 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.592421 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f1722d85539e90b00c9a8bb5c877e531-config\") pod \"kube-apiserver-proxy-ip-10-0-140-254.ec2.internal\" (UID: \"f1722d85539e90b00c9a8bb5c877e531\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-254.ec2.internal" May 21 10:30:05.592459 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.592463 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6b0ff1b7e12fad90bedfc5d0dc087ade-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-254.ec2.internal\" (UID: \"6b0ff1b7e12fad90bedfc5d0dc087ade\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-254.ec2.internal" May 21 10:30:05.592674 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.592489 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b0ff1b7e12fad90bedfc5d0dc087ade-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-254.ec2.internal\" (UID: \"6b0ff1b7e12fad90bedfc5d0dc087ade\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-254.ec2.internal" May 21 10:30:05.603753 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:05.603724 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-254.ec2.internal\" not found" May 21 10:30:05.693605 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.693575 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6b0ff1b7e12fad90bedfc5d0dc087ade-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-254.ec2.internal\" (UID: \"6b0ff1b7e12fad90bedfc5d0dc087ade\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-254.ec2.internal" May 21 10:30:05.693605 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.693592 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6b0ff1b7e12fad90bedfc5d0dc087ade-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-254.ec2.internal\" (UID: \"6b0ff1b7e12fad90bedfc5d0dc087ade\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-254.ec2.internal" May 21 10:30:05.693711 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.693646 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b0ff1b7e12fad90bedfc5d0dc087ade-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-254.ec2.internal\" (UID: \"6b0ff1b7e12fad90bedfc5d0dc087ade\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-254.ec2.internal" May 21 10:30:05.693711 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.693665 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f1722d85539e90b00c9a8bb5c877e531-config\") pod \"kube-apiserver-proxy-ip-10-0-140-254.ec2.internal\" (UID: \"f1722d85539e90b00c9a8bb5c877e531\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-254.ec2.internal" May 21 10:30:05.693711 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.693692 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f1722d85539e90b00c9a8bb5c877e531-config\") pod \"kube-apiserver-proxy-ip-10-0-140-254.ec2.internal\" (UID: \"f1722d85539e90b00c9a8bb5c877e531\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-254.ec2.internal" May 21 10:30:05.693802 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.693747 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b0ff1b7e12fad90bedfc5d0dc087ade-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-254.ec2.internal\" (UID: \"6b0ff1b7e12fad90bedfc5d0dc087ade\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-254.ec2.internal" May 21 10:30:05.704699 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:05.704671 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-254.ec2.internal\" not found" May 21 10:30:05.805023 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:05.804946 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-254.ec2.internal\" not found" May 21 10:30:05.828254 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.828227 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-254.ec2.internal" May 21 10:30:05.833113 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:05.833091 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-254.ec2.internal" May 21 10:30:05.906082 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:05.906041 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-254.ec2.internal\" not found" May 21 10:30:06.006572 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:06.006542 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-254.ec2.internal\" not found" May 21 10:30:06.107212 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:06.107123 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-254.ec2.internal\" not found" May 21 10:30:06.182482 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:06.182444 2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 21 10:30:06.183193 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:06.182624 2563 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 21 10:30:06.208007 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:06.207970 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-254.ec2.internal\" not found" May 21 10:30:06.277322 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:06.277297 2563 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 21 10:30:06.290891 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:06.290862 2563 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-254.ec2.internal" May 21 10:30:06.290891 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:06.290880 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 21 10:30:06.301680 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:06.301634 2563 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 21 10:30:06.305034 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:06.304858 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 21 10:30:06.306575 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:06.306550 2563 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-254.ec2.internal" May 21 10:30:06.312527 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:06.312479 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-20 10:25:05 +0000 UTC" deadline="2028-03-07 12:14:37.675851884 +0000 UTC" May 21 10:30:06.312527 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:06.312515 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15745h44m31.36334094s" May 21 10:30:06.316961 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:06.316939 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 21 10:30:06.324334 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:06.324311 2563 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 21 10:30:06.333019 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:06.332995 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-g5wht" May 21 10:30:06.341153 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:06.341133 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-g5wht" May 21 10:30:06.426014 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:06.425972 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b0ff1b7e12fad90bedfc5d0dc087ade.slice/crio-51871a474cb726ffdf1b758a27145db92202782697346f18f0daec4c20556e4d WatchSource:0}: Error finding container 51871a474cb726ffdf1b758a27145db92202782697346f18f0daec4c20556e4d: Status 404 returned error can't find the container with id 51871a474cb726ffdf1b758a27145db92202782697346f18f0daec4c20556e4d May 21 10:30:06.426160 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:06.426145 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1722d85539e90b00c9a8bb5c877e531.slice/crio-2f10cdf0b2ba1b865af22da09453b3f402b401475a5b2ded485adcdf78596dba WatchSource:0}: Error finding container 2f10cdf0b2ba1b865af22da09453b3f402b401475a5b2ded485adcdf78596dba: Status 404 returned error can't find the container with id 2f10cdf0b2ba1b865af22da09453b3f402b401475a5b2ded485adcdf78596dba May 21 10:30:06.430411 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:06.430395 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 10:30:06.861373 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:06.861341 2563 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 21 10:30:07.266725 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.266640 2563 apiserver.go:52] "Watching apiserver" May 21 10:30:07.272104 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.272079 2563 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 21 10:30:07.272508 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.272479 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-r74kc","openshift-dns/node-resolver-7hg45","openshift-image-registry/node-ca-vp867","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-254.ec2.internal","openshift-multus/multus-additional-cni-plugins-b6m2m","openshift-multus/multus-bjc58","openshift-network-operator/iptables-alerter-6575x","kube-system/konnectivity-agent-mf2tq","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cdskv","openshift-multus/network-metrics-daemon-hnvv7","openshift-network-diagnostics/network-check-target-s556t","openshift-ovn-kubernetes/ovnkube-node-jmp49","kube-system/kube-apiserver-proxy-ip-10-0-140-254.ec2.internal"] May 21 10:30:07.277384 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.277358 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hnvv7" May 21 10:30:07.277531 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.277429 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7hg45" May 21 10:30:07.277531 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:07.277446 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hnvv7" podUID="a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f" May 21 10:30:07.279679 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.279656 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vp867" May 21 10:30:07.281972 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.281950 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-b6m2m" May 21 10:30:07.283030 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.283010 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 21 10:30:07.283143 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.283128 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-89cnq\"" May 21 10:30:07.284594 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.284573 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 21 10:30:07.284681 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.284599 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 21 10:30:07.284981 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.284960 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 21 10:30:07.285072 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.285028 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 21 10:30:07.285072 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.285030 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 21 10:30:07.285190 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.284966 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 21 10:30:07.285693 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.285300 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 21 10:30:07.285693 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.285343 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 21 10:30:07.285693 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.285438 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 21 10:30:07.285693 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.285569 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-lp89k\"" May 21 10:30:07.285693 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.285570 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-pl6fr\"" May 21 10:30:07.287509 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.287489 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bjc58" May 21 10:30:07.290097 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.290075 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6575x" May 21 10:30:07.290263 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.290176 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mf2tq" May 21 10:30:07.290794 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.290776 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-dmdzv\"" May 21 10:30:07.291174 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.291139 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 21 10:30:07.293586 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.292897 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 21 10:30:07.293586 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.293120 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-vkm5q\"" May 21 10:30:07.293586 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.293337 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-hvhtd\"" May 21 10:30:07.293934 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.293916 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cdskv" May 21 10:30:07.295318 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.294771 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 21 10:30:07.295318 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.294794 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 21 10:30:07.297572 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.296526 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-r74kc" May 21 10:30:07.298381 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.298361 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 21 10:30:07.298490 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.298474 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 21 10:30:07.298794 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.298761 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-db48l\"" May 21 10:30:07.298898 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.298802 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 21 10:30:07.299103 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.299068 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 21 10:30:07.299103 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.299095 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 21 10:30:07.299300 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.299273 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-x7t5h\"" May 21 10:30:07.299473 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.299460 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 21 10:30:07.299513 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.299470 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 21 10:30:07.300921 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.300901 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/da312e42-a265-4201-9a40-29d1d16a9815-tuning-conf-dir\") pod \"multus-additional-cni-plugins-b6m2m\" (UID: \"da312e42-a265-4201-9a40-29d1d16a9815\") " pod="openshift-multus/multus-additional-cni-plugins-b6m2m" May 21 10:30:07.301011 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.300937 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/da312e42-a265-4201-9a40-29d1d16a9815-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-b6m2m\" (UID: \"da312e42-a265-4201-9a40-29d1d16a9815\") " pod="openshift-multus/multus-additional-cni-plugins-b6m2m" May 21 10:30:07.301011 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.300985 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cd0770fc-db63-4ee9-8945-b9f3df987d5b-device-dir\") pod \"aws-ebs-csi-driver-node-cdskv\" (UID: \"cd0770fc-db63-4ee9-8945-b9f3df987d5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cdskv" May 21 10:30:07.301114 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.301024 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cd0770fc-db63-4ee9-8945-b9f3df987d5b-sys-fs\") pod \"aws-ebs-csi-driver-node-cdskv\" (UID: \"cd0770fc-db63-4ee9-8945-b9f3df987d5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cdskv" May 21 10:30:07.301114 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.301075 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1dcc3698-3bfb-44e1-9a50-e94dc6eebfee-cnibin\") pod \"multus-bjc58\" (UID: \"1dcc3698-3bfb-44e1-9a50-e94dc6eebfee\") " pod="openshift-multus/multus-bjc58" May 21 10:30:07.301229 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.301141 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1dcc3698-3bfb-44e1-9a50-e94dc6eebfee-host-run-k8s-cni-cncf-io\") pod \"multus-bjc58\" (UID: \"1dcc3698-3bfb-44e1-9a50-e94dc6eebfee\") " pod="openshift-multus/multus-bjc58" May 21 10:30:07.301229 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.301170 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1dcc3698-3bfb-44e1-9a50-e94dc6eebfee-host-var-lib-cni-bin\") pod \"multus-bjc58\" (UID: \"1dcc3698-3bfb-44e1-9a50-e94dc6eebfee\") " pod="openshift-multus/multus-bjc58" May 21 10:30:07.301229 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.301203 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/da312e42-a265-4201-9a40-29d1d16a9815-cnibin\") pod \"multus-additional-cni-plugins-b6m2m\" (UID: \"da312e42-a265-4201-9a40-29d1d16a9815\") " pod="openshift-multus/multus-additional-cni-plugins-b6m2m" May 21 10:30:07.301363 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.301227 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ecce324-6dad-4c21-b5d0-60950c0b12a8-tmp-dir\") pod \"node-resolver-7hg45\" (UID: \"0ecce324-6dad-4c21-b5d0-60950c0b12a8\") " pod="openshift-dns/node-resolver-7hg45" May 21 10:30:07.301363 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.301255 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1dcc3698-3bfb-44e1-9a50-e94dc6eebfee-host-run-netns\") pod \"multus-bjc58\" (UID: \"1dcc3698-3bfb-44e1-9a50-e94dc6eebfee\") " pod="openshift-multus/multus-bjc58" May 21 10:30:07.301363 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.301292 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvtm2\" (UniqueName: \"kubernetes.io/projected/1dcc3698-3bfb-44e1-9a50-e94dc6eebfee-kube-api-access-hvtm2\") pod \"multus-bjc58\" (UID: \"1dcc3698-3bfb-44e1-9a50-e94dc6eebfee\") " pod="openshift-multus/multus-bjc58" May 21 10:30:07.301363 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.301318 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qpkh\" (UniqueName: \"kubernetes.io/projected/0ecce324-6dad-4c21-b5d0-60950c0b12a8-kube-api-access-9qpkh\") pod \"node-resolver-7hg45\" (UID: \"0ecce324-6dad-4c21-b5d0-60950c0b12a8\") " pod="openshift-dns/node-resolver-7hg45" May 21 10:30:07.301554 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.301364 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1dcc3698-3bfb-44e1-9a50-e94dc6eebfee-os-release\") pod \"multus-bjc58\" (UID: \"1dcc3698-3bfb-44e1-9a50-e94dc6eebfee\") " pod="openshift-multus/multus-bjc58" May 21 10:30:07.301554 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.301398 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1dcc3698-3bfb-44e1-9a50-e94dc6eebfee-host-var-lib-kubelet\") pod \"multus-bjc58\" (UID: \"1dcc3698-3bfb-44e1-9a50-e94dc6eebfee\") " pod="openshift-multus/multus-bjc58" May 21 10:30:07.301554 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.301425 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1dcc3698-3bfb-44e1-9a50-e94dc6eebfee-hostroot\") pod \"multus-bjc58\" (UID: \"1dcc3698-3bfb-44e1-9a50-e94dc6eebfee\") " pod="openshift-multus/multus-bjc58" May 21 10:30:07.301554 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.301453 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1dcc3698-3bfb-44e1-9a50-e94dc6eebfee-multus-conf-dir\") pod \"multus-bjc58\" (UID: \"1dcc3698-3bfb-44e1-9a50-e94dc6eebfee\") " pod="openshift-multus/multus-bjc58" May 21 10:30:07.301554 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.301477 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1dcc3698-3bfb-44e1-9a50-e94dc6eebfee-multus-daemon-config\") pod \"multus-bjc58\" (UID: \"1dcc3698-3bfb-44e1-9a50-e94dc6eebfee\") " pod="openshift-multus/multus-bjc58" May 21 10:30:07.301554 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.301502 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9c4ae568-a2e3-47d6-aedb-4733f4cf72ad-agent-certs\") pod \"konnectivity-agent-mf2tq\" (UID: \"9c4ae568-a2e3-47d6-aedb-4733f4cf72ad\") " pod="kube-system/konnectivity-agent-mf2tq" May 21 10:30:07.301554 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.301527 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kj59z\" (UniqueName: \"kubernetes.io/projected/da312e42-a265-4201-9a40-29d1d16a9815-kube-api-access-kj59z\") pod \"multus-additional-cni-plugins-b6m2m\" (UID: \"da312e42-a265-4201-9a40-29d1d16a9815\") " pod="openshift-multus/multus-additional-cni-plugins-b6m2m" May 21 10:30:07.301554 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.301552 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cd0770fc-db63-4ee9-8945-b9f3df987d5b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cdskv\" (UID: \"cd0770fc-db63-4ee9-8945-b9f3df987d5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cdskv" May 21 10:30:07.301978 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.301588 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cd0770fc-db63-4ee9-8945-b9f3df987d5b-etc-selinux\") pod \"aws-ebs-csi-driver-node-cdskv\" (UID: \"cd0770fc-db63-4ee9-8945-b9f3df987d5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cdskv" May 21 10:30:07.301978 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.301619 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1dcc3698-3bfb-44e1-9a50-e94dc6eebfee-system-cni-dir\") pod \"multus-bjc58\" (UID: \"1dcc3698-3bfb-44e1-9a50-e94dc6eebfee\") " pod="openshift-multus/multus-bjc58" May 21 10:30:07.301978 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.301644 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1dcc3698-3bfb-44e1-9a50-e94dc6eebfee-multus-cni-dir\") pod \"multus-bjc58\" (UID: \"1dcc3698-3bfb-44e1-9a50-e94dc6eebfee\") " pod="openshift-multus/multus-bjc58" May 21 10:30:07.301978 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.301676 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1dcc3698-3bfb-44e1-9a50-e94dc6eebfee-cni-binary-copy\") pod \"multus-bjc58\" (UID: \"1dcc3698-3bfb-44e1-9a50-e94dc6eebfee\") " pod="openshift-multus/multus-bjc58" May 21 10:30:07.301978 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.301699 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1dcc3698-3bfb-44e1-9a50-e94dc6eebfee-etc-kubernetes\") pod \"multus-bjc58\" (UID: \"1dcc3698-3bfb-44e1-9a50-e94dc6eebfee\") " pod="openshift-multus/multus-bjc58" May 21 10:30:07.301978 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.301726 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cd0770fc-db63-4ee9-8945-b9f3df987d5b-socket-dir\") pod \"aws-ebs-csi-driver-node-cdskv\" (UID: \"cd0770fc-db63-4ee9-8945-b9f3df987d5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cdskv" May 21 10:30:07.301978 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.301750 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cd0770fc-db63-4ee9-8945-b9f3df987d5b-registration-dir\") pod \"aws-ebs-csi-driver-node-cdskv\" (UID: \"cd0770fc-db63-4ee9-8945-b9f3df987d5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cdskv" May 21 10:30:07.301978 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.301795 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnw2v\" (UniqueName: \"kubernetes.io/projected/cd0770fc-db63-4ee9-8945-b9f3df987d5b-kube-api-access-pnw2v\") pod \"aws-ebs-csi-driver-node-cdskv\" (UID: \"cd0770fc-db63-4ee9-8945-b9f3df987d5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cdskv" May 21 10:30:07.301978 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.301807 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s556t" May 21 10:30:07.301978 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.301859 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0ecce324-6dad-4c21-b5d0-60950c0b12a8-hosts-file\") pod \"node-resolver-7hg45\" (UID: \"0ecce324-6dad-4c21-b5d0-60950c0b12a8\") " pod="openshift-dns/node-resolver-7hg45" May 21 10:30:07.301978 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.301881 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jmp49" May 21 10:30:07.301978 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.301898 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1dcc3698-3bfb-44e1-9a50-e94dc6eebfee-multus-socket-dir-parent\") pod \"multus-bjc58\" (UID: \"1dcc3698-3bfb-44e1-9a50-e94dc6eebfee\") " pod="openshift-multus/multus-bjc58" May 21 10:30:07.301978 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:07.301899 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s556t" podUID="ee605341-c804-4b65-9f94-b0e9c77469cb" May 21 10:30:07.301978 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.301933 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/da312e42-a265-4201-9a40-29d1d16a9815-cni-binary-copy\") pod \"multus-additional-cni-plugins-b6m2m\" (UID: \"da312e42-a265-4201-9a40-29d1d16a9815\") " pod="openshift-multus/multus-additional-cni-plugins-b6m2m" May 21 10:30:07.301978 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.301951 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/da312e42-a265-4201-9a40-29d1d16a9815-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-b6m2m\" (UID: \"da312e42-a265-4201-9a40-29d1d16a9815\") " pod="openshift-multus/multus-additional-cni-plugins-b6m2m" May 21 10:30:07.301978 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.301970 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrvrr\" (UniqueName: \"kubernetes.io/projected/2b0f26ae-1e09-4748-8edc-01ca61e76324-kube-api-access-zrvrr\") pod \"node-ca-vp867\" (UID: \"2b0f26ae-1e09-4748-8edc-01ca61e76324\") " pod="openshift-image-registry/node-ca-vp867" May 21 10:30:07.302711 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.301995 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/532b9f67-fb6d-47bb-83a4-e7d4f70c189e-iptables-alerter-script\") pod \"iptables-alerter-6575x\" (UID: \"532b9f67-fb6d-47bb-83a4-e7d4f70c189e\") " pod="openshift-network-operator/iptables-alerter-6575x" May 21 10:30:07.302711 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.302023 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/532b9f67-fb6d-47bb-83a4-e7d4f70c189e-host-slash\") pod \"iptables-alerter-6575x\" (UID: \"532b9f67-fb6d-47bb-83a4-e7d4f70c189e\") " pod="openshift-network-operator/iptables-alerter-6575x" May 21 10:30:07.302711 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.302042 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/da312e42-a265-4201-9a40-29d1d16a9815-system-cni-dir\") pod \"multus-additional-cni-plugins-b6m2m\" (UID: \"da312e42-a265-4201-9a40-29d1d16a9815\") " pod="openshift-multus/multus-additional-cni-plugins-b6m2m" May 21 10:30:07.302711 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.302057 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/da312e42-a265-4201-9a40-29d1d16a9815-os-release\") pod \"multus-additional-cni-plugins-b6m2m\" (UID: \"da312e42-a265-4201-9a40-29d1d16a9815\") " pod="openshift-multus/multus-additional-cni-plugins-b6m2m" May 21 10:30:07.302711 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.302071 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f-metrics-certs\") pod \"network-metrics-daemon-hnvv7\" (UID: \"a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f\") " pod="openshift-multus/network-metrics-daemon-hnvv7" May 21 10:30:07.302711 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.302090 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-st7kr\" (UniqueName: \"kubernetes.io/projected/a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f-kube-api-access-st7kr\") pod \"network-metrics-daemon-hnvv7\" (UID: \"a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f\") " pod="openshift-multus/network-metrics-daemon-hnvv7" May 21 10:30:07.302711 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.302115 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2b0f26ae-1e09-4748-8edc-01ca61e76324-host\") pod \"node-ca-vp867\" (UID: \"2b0f26ae-1e09-4748-8edc-01ca61e76324\") " pod="openshift-image-registry/node-ca-vp867" May 21 10:30:07.302711 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.302129 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1dcc3698-3bfb-44e1-9a50-e94dc6eebfee-host-var-lib-cni-multus\") pod \"multus-bjc58\" (UID: \"1dcc3698-3bfb-44e1-9a50-e94dc6eebfee\") " pod="openshift-multus/multus-bjc58" May 21 10:30:07.302711 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.302146 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1dcc3698-3bfb-44e1-9a50-e94dc6eebfee-host-run-multus-certs\") pod \"multus-bjc58\" (UID: \"1dcc3698-3bfb-44e1-9a50-e94dc6eebfee\") " pod="openshift-multus/multus-bjc58" May 21 10:30:07.302711 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.302163 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnp4k\" (UniqueName: \"kubernetes.io/projected/532b9f67-fb6d-47bb-83a4-e7d4f70c189e-kube-api-access-gnp4k\") pod \"iptables-alerter-6575x\" (UID: \"532b9f67-fb6d-47bb-83a4-e7d4f70c189e\") " pod="openshift-network-operator/iptables-alerter-6575x" May 21 10:30:07.302711 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.302177 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2b0f26ae-1e09-4748-8edc-01ca61e76324-serviceca\") pod \"node-ca-vp867\" (UID: \"2b0f26ae-1e09-4748-8edc-01ca61e76324\") " pod="openshift-image-registry/node-ca-vp867" May 21 10:30:07.302711 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.302206 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9c4ae568-a2e3-47d6-aedb-4733f4cf72ad-konnectivity-ca\") pod \"konnectivity-agent-mf2tq\" (UID: \"9c4ae568-a2e3-47d6-aedb-4733f4cf72ad\") " pod="kube-system/konnectivity-agent-mf2tq" May 21 10:30:07.305841 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.305805 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 21 10:30:07.307275 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.307256 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 21 10:30:07.307376 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.307318 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 21 10:30:07.307376 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.307328 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 21 10:30:07.307483 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.307425 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 21 10:30:07.307483 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.307464 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 21 10:30:07.307697 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.307680 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-q5dh5\"" May 21 10:30:07.342354 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.342318 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 10:25:06 +0000 UTC" deadline="2027-11-06 18:06:56.236231856 +0000 UTC" May 21 10:30:07.342354 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.342351 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12823h36m48.893884071s" May 21 10:30:07.391759 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.391724 2563 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 21 10:30:07.399783 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.399726 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-254.ec2.internal" event={"ID":"6b0ff1b7e12fad90bedfc5d0dc087ade","Type":"ContainerStarted","Data":"51871a474cb726ffdf1b758a27145db92202782697346f18f0daec4c20556e4d"} May 21 10:30:07.400770 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.400744 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-254.ec2.internal" event={"ID":"f1722d85539e90b00c9a8bb5c877e531","Type":"ContainerStarted","Data":"2f10cdf0b2ba1b865af22da09453b3f402b401475a5b2ded485adcdf78596dba"} May 21 10:30:07.403048 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.403025 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13bdaed8-f4ef-4751-b367-f343320aae60-etc-openvswitch\") pod \"ovnkube-node-jmp49\" (UID: \"13bdaed8-f4ef-4751-b367-f343320aae60\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmp49" May 21 10:30:07.403141 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.403055 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63386de8-09b5-4de2-bf23-270c4f9636da-etc-kubernetes\") pod \"tuned-r74kc\" (UID: \"63386de8-09b5-4de2-bf23-270c4f9636da\") " pod="openshift-cluster-node-tuning-operator/tuned-r74kc" May 21 10:30:07.403141 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.403084 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/63386de8-09b5-4de2-bf23-270c4f9636da-etc-tuned\") pod \"tuned-r74kc\" (UID: \"63386de8-09b5-4de2-bf23-270c4f9636da\") " pod="openshift-cluster-node-tuning-operator/tuned-r74kc" May 21 10:30:07.403141 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.403115 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1dcc3698-3bfb-44e1-9a50-e94dc6eebfee-multus-daemon-config\") pod \"multus-bjc58\" (UID: \"1dcc3698-3bfb-44e1-9a50-e94dc6eebfee\") " pod="openshift-multus/multus-bjc58" May 21 10:30:07.403286 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.403138 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13bdaed8-f4ef-4751-b367-f343320aae60-host-run-ovn-kubernetes\") pod \"ovnkube-node-jmp49\" (UID: \"13bdaed8-f4ef-4751-b367-f343320aae60\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmp49" May 21 10:30:07.403286 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.403176 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13bdaed8-f4ef-4751-b367-f343320aae60-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jmp49\" (UID: \"13bdaed8-f4ef-4751-b367-f343320aae60\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmp49" May 21 10:30:07.403286 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.403206 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cd0770fc-db63-4ee9-8945-b9f3df987d5b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cdskv\" (UID: \"cd0770fc-db63-4ee9-8945-b9f3df987d5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cdskv" May 21 10:30:07.403286 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.403238 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/63386de8-09b5-4de2-bf23-270c4f9636da-tmp\") pod \"tuned-r74kc\" (UID: \"63386de8-09b5-4de2-bf23-270c4f9636da\") " pod="openshift-cluster-node-tuning-operator/tuned-r74kc" May 21 10:30:07.403286 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.403272 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cd0770fc-db63-4ee9-8945-b9f3df987d5b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cdskv\" (UID: \"cd0770fc-db63-4ee9-8945-b9f3df987d5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cdskv" May 21 10:30:07.403286 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.403267 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/13bdaed8-f4ef-4751-b367-f343320aae60-run-systemd\") pod \"ovnkube-node-jmp49\" (UID: \"13bdaed8-f4ef-4751-b367-f343320aae60\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmp49" May 21 10:30:07.403472 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.403309 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/13bdaed8-f4ef-4751-b367-f343320aae60-host-cni-netd\") pod \"ovnkube-node-jmp49\" (UID: \"13bdaed8-f4ef-4751-b367-f343320aae60\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmp49" May 21 10:30:07.403472 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.403329 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/13bdaed8-f4ef-4751-b367-f343320aae60-ovn-node-metrics-cert\") pod \"ovnkube-node-jmp49\" (UID: \"13bdaed8-f4ef-4751-b367-f343320aae60\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmp49" May 21 10:30:07.403472 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.403351 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cd0770fc-db63-4ee9-8945-b9f3df987d5b-registration-dir\") pod \"aws-ebs-csi-driver-node-cdskv\" (UID: \"cd0770fc-db63-4ee9-8945-b9f3df987d5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cdskv" May 21 10:30:07.403472 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.403409 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pnw2v\" (UniqueName: \"kubernetes.io/projected/cd0770fc-db63-4ee9-8945-b9f3df987d5b-kube-api-access-pnw2v\") pod \"aws-ebs-csi-driver-node-cdskv\" (UID: \"cd0770fc-db63-4ee9-8945-b9f3df987d5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cdskv" May 21 10:30:07.403472 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.403454 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/63386de8-09b5-4de2-bf23-270c4f9636da-etc-sysconfig\") pod \"tuned-r74kc\" (UID: \"63386de8-09b5-4de2-bf23-270c4f9636da\") " pod="openshift-cluster-node-tuning-operator/tuned-r74kc" May 21 10:30:07.403628 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.403478 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/63386de8-09b5-4de2-bf23-270c4f9636da-etc-sysctl-d\") pod \"tuned-r74kc\" (UID: \"63386de8-09b5-4de2-bf23-270c4f9636da\") " pod="openshift-cluster-node-tuning-operator/tuned-r74kc" May 21 10:30:07.403628 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.403508 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/da312e42-a265-4201-9a40-29d1d16a9815-os-release\") pod \"multus-additional-cni-plugins-b6m2m\" (UID: \"da312e42-a265-4201-9a40-29d1d16a9815\") " pod="openshift-multus/multus-additional-cni-plugins-b6m2m" May 21 10:30:07.403628 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.403478 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cd0770fc-db63-4ee9-8945-b9f3df987d5b-registration-dir\") pod \"aws-ebs-csi-driver-node-cdskv\" (UID: \"cd0770fc-db63-4ee9-8945-b9f3df987d5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cdskv" May 21 10:30:07.403628 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.403603 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/da312e42-a265-4201-9a40-29d1d16a9815-os-release\") pod \"multus-additional-cni-plugins-b6m2m\" (UID: \"da312e42-a265-4201-9a40-29d1d16a9815\") " pod="openshift-multus/multus-additional-cni-plugins-b6m2m" May 21 10:30:07.403849 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.403627 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1dcc3698-3bfb-44e1-9a50-e94dc6eebfee-host-var-lib-cni-multus\") pod \"multus-bjc58\" (UID: \"1dcc3698-3bfb-44e1-9a50-e94dc6eebfee\") " pod="openshift-multus/multus-bjc58" May 21 10:30:07.403849 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.403660 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1dcc3698-3bfb-44e1-9a50-e94dc6eebfee-host-run-multus-certs\") pod \"multus-bjc58\" (UID: \"1dcc3698-3bfb-44e1-9a50-e94dc6eebfee\") " pod="openshift-multus/multus-bjc58" May 21 10:30:07.403849 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.403689 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/13bdaed8-f4ef-4751-b367-f343320aae60-systemd-units\") pod \"ovnkube-node-jmp49\" (UID: \"13bdaed8-f4ef-4751-b367-f343320aae60\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmp49" May 21 10:30:07.403849 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.403710 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1dcc3698-3bfb-44e1-9a50-e94dc6eebfee-host-var-lib-cni-multus\") pod \"multus-bjc58\" (UID: \"1dcc3698-3bfb-44e1-9a50-e94dc6eebfee\") " pod="openshift-multus/multus-bjc58" May 21 10:30:07.403849 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.403715 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/13bdaed8-f4ef-4751-b367-f343320aae60-host-slash\") pod \"ovnkube-node-jmp49\" (UID: \"13bdaed8-f4ef-4751-b367-f343320aae60\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmp49" May 21 10:30:07.403849 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.403765 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6rzv\" (UniqueName: \"kubernetes.io/projected/ee605341-c804-4b65-9f94-b0e9c77469cb-kube-api-access-r6rzv\") pod \"network-check-target-s556t\" (UID: \"ee605341-c804-4b65-9f94-b0e9c77469cb\") " pod="openshift-network-diagnostics/network-check-target-s556t" May 21 10:30:07.403849 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.403768 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1dcc3698-3bfb-44e1-9a50-e94dc6eebfee-host-run-multus-certs\") pod \"multus-bjc58\" (UID: \"1dcc3698-3bfb-44e1-9a50-e94dc6eebfee\") " pod="openshift-multus/multus-bjc58" May 21 10:30:07.403849 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.403790 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/63386de8-09b5-4de2-bf23-270c4f9636da-sys\") pod \"tuned-r74kc\" (UID: \"63386de8-09b5-4de2-bf23-270c4f9636da\") " pod="openshift-cluster-node-tuning-operator/tuned-r74kc" May 21 10:30:07.403849 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.403833 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/13bdaed8-f4ef-4751-b367-f343320aae60-run-ovn\") pod \"ovnkube-node-jmp49\" (UID: \"13bdaed8-f4ef-4751-b367-f343320aae60\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmp49" May 21 10:30:07.403849 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.403844 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1dcc3698-3bfb-44e1-9a50-e94dc6eebfee-multus-daemon-config\") pod \"multus-bjc58\" (UID: \"1dcc3698-3bfb-44e1-9a50-e94dc6eebfee\") " pod="openshift-multus/multus-bjc58" May 21 10:30:07.404233 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.403855 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/13bdaed8-f4ef-4751-b367-f343320aae60-ovnkube-script-lib\") pod \"ovnkube-node-jmp49\" (UID: \"13bdaed8-f4ef-4751-b367-f343320aae60\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmp49" May 21 10:30:07.404233 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.403876 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/da312e42-a265-4201-9a40-29d1d16a9815-tuning-conf-dir\") pod \"multus-additional-cni-plugins-b6m2m\" (UID: \"da312e42-a265-4201-9a40-29d1d16a9815\") " pod="openshift-multus/multus-additional-cni-plugins-b6m2m" May 21 10:30:07.404233 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.403896 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/da312e42-a265-4201-9a40-29d1d16a9815-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-b6m2m\" (UID: \"da312e42-a265-4201-9a40-29d1d16a9815\") " pod="openshift-multus/multus-additional-cni-plugins-b6m2m" May 21 10:30:07.404233 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.403923 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cd0770fc-db63-4ee9-8945-b9f3df987d5b-device-dir\") pod \"aws-ebs-csi-driver-node-cdskv\" (UID: \"cd0770fc-db63-4ee9-8945-b9f3df987d5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cdskv" May 21 10:30:07.404233 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.404022 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cd0770fc-db63-4ee9-8945-b9f3df987d5b-sys-fs\") pod \"aws-ebs-csi-driver-node-cdskv\" (UID: \"cd0770fc-db63-4ee9-8945-b9f3df987d5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cdskv" May 21 10:30:07.404233 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.404045 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cd0770fc-db63-4ee9-8945-b9f3df987d5b-device-dir\") pod \"aws-ebs-csi-driver-node-cdskv\" (UID: \"cd0770fc-db63-4ee9-8945-b9f3df987d5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cdskv" May 21 10:30:07.404233 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.404055 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/da312e42-a265-4201-9a40-29d1d16a9815-tuning-conf-dir\") pod \"multus-additional-cni-plugins-b6m2m\" (UID: \"da312e42-a265-4201-9a40-29d1d16a9815\") " pod="openshift-multus/multus-additional-cni-plugins-b6m2m" May 21 10:30:07.404233 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.404077 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hvtm2\" (UniqueName: \"kubernetes.io/projected/1dcc3698-3bfb-44e1-9a50-e94dc6eebfee-kube-api-access-hvtm2\") pod \"multus-bjc58\" (UID: \"1dcc3698-3bfb-44e1-9a50-e94dc6eebfee\") " pod="openshift-multus/multus-bjc58" May 21 10:30:07.404233 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.404107 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/13bdaed8-f4ef-4751-b367-f343320aae60-ovnkube-config\") pod \"ovnkube-node-jmp49\" (UID: \"13bdaed8-f4ef-4751-b367-f343320aae60\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmp49" May 21 10:30:07.404233 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.404152 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cd0770fc-db63-4ee9-8945-b9f3df987d5b-sys-fs\") pod \"aws-ebs-csi-driver-node-cdskv\" (UID: \"cd0770fc-db63-4ee9-8945-b9f3df987d5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cdskv" May 21 10:30:07.404661 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.404253 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/da312e42-a265-4201-9a40-29d1d16a9815-cnibin\") pod \"multus-additional-cni-plugins-b6m2m\" (UID: \"da312e42-a265-4201-9a40-29d1d16a9815\") " pod="openshift-multus/multus-additional-cni-plugins-b6m2m" May 21 10:30:07.404661 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.404281 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ecce324-6dad-4c21-b5d0-60950c0b12a8-tmp-dir\") pod \"node-resolver-7hg45\" (UID: \"0ecce324-6dad-4c21-b5d0-60950c0b12a8\") " pod="openshift-dns/node-resolver-7hg45" May 21 10:30:07.404661 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.404301 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1dcc3698-3bfb-44e1-9a50-e94dc6eebfee-host-run-netns\") pod \"multus-bjc58\" (UID: \"1dcc3698-3bfb-44e1-9a50-e94dc6eebfee\") " pod="openshift-multus/multus-bjc58" May 21 10:30:07.404661 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.404325 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnfds\" (UniqueName: \"kubernetes.io/projected/63386de8-09b5-4de2-bf23-270c4f9636da-kube-api-access-gnfds\") pod \"tuned-r74kc\" (UID: \"63386de8-09b5-4de2-bf23-270c4f9636da\") " pod="openshift-cluster-node-tuning-operator/tuned-r74kc" May 21 10:30:07.404661 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.404330 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/da312e42-a265-4201-9a40-29d1d16a9815-cnibin\") pod \"multus-additional-cni-plugins-b6m2m\" (UID: \"da312e42-a265-4201-9a40-29d1d16a9815\") " pod="openshift-multus/multus-additional-cni-plugins-b6m2m" May 21 10:30:07.404661 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.404339 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/da312e42-a265-4201-9a40-29d1d16a9815-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-b6m2m\" (UID: \"da312e42-a265-4201-9a40-29d1d16a9815\") " pod="openshift-multus/multus-additional-cni-plugins-b6m2m" May 21 10:30:07.404661 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.404349 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9qpkh\" (UniqueName: \"kubernetes.io/projected/0ecce324-6dad-4c21-b5d0-60950c0b12a8-kube-api-access-9qpkh\") pod \"node-resolver-7hg45\" (UID: \"0ecce324-6dad-4c21-b5d0-60950c0b12a8\") " pod="openshift-dns/node-resolver-7hg45" May 21 10:30:07.404661 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.404373 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1dcc3698-3bfb-44e1-9a50-e94dc6eebfee-os-release\") pod \"multus-bjc58\" (UID: \"1dcc3698-3bfb-44e1-9a50-e94dc6eebfee\") " pod="openshift-multus/multus-bjc58" May 21 10:30:07.404661 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.404396 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1dcc3698-3bfb-44e1-9a50-e94dc6eebfee-host-var-lib-kubelet\") pod \"multus-bjc58\" (UID: \"1dcc3698-3bfb-44e1-9a50-e94dc6eebfee\") " pod="openshift-multus/multus-bjc58" May 21 10:30:07.404661 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.404419 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1dcc3698-3bfb-44e1-9a50-e94dc6eebfee-hostroot\") pod \"multus-bjc58\" (UID: \"1dcc3698-3bfb-44e1-9a50-e94dc6eebfee\") " pod="openshift-multus/multus-bjc58" May 21 10:30:07.404661 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.404423 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1dcc3698-3bfb-44e1-9a50-e94dc6eebfee-host-run-netns\") pod \"multus-bjc58\" (UID: \"1dcc3698-3bfb-44e1-9a50-e94dc6eebfee\") " pod="openshift-multus/multus-bjc58" May 21 10:30:07.404661 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.404441 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1dcc3698-3bfb-44e1-9a50-e94dc6eebfee-multus-conf-dir\") pod \"multus-bjc58\" (UID: \"1dcc3698-3bfb-44e1-9a50-e94dc6eebfee\") " pod="openshift-multus/multus-bjc58" May 21 10:30:07.404661 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.404465 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9c4ae568-a2e3-47d6-aedb-4733f4cf72ad-agent-certs\") pod \"konnectivity-agent-mf2tq\" (UID: \"9c4ae568-a2e3-47d6-aedb-4733f4cf72ad\") " pod="kube-system/konnectivity-agent-mf2tq" May 21 10:30:07.404661 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.404469 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1dcc3698-3bfb-44e1-9a50-e94dc6eebfee-host-var-lib-kubelet\") pod \"multus-bjc58\" (UID: \"1dcc3698-3bfb-44e1-9a50-e94dc6eebfee\") " pod="openshift-multus/multus-bjc58" May 21 10:30:07.404661 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.404488 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/63386de8-09b5-4de2-bf23-270c4f9636da-run\") pod \"tuned-r74kc\" (UID: \"63386de8-09b5-4de2-bf23-270c4f9636da\") " pod="openshift-cluster-node-tuning-operator/tuned-r74kc" May 21 10:30:07.404661 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.404491 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1dcc3698-3bfb-44e1-9a50-e94dc6eebfee-os-release\") pod \"multus-bjc58\" (UID: \"1dcc3698-3bfb-44e1-9a50-e94dc6eebfee\") " pod="openshift-multus/multus-bjc58" May 21 10:30:07.404661 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.404516 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1dcc3698-3bfb-44e1-9a50-e94dc6eebfee-multus-conf-dir\") pod \"multus-bjc58\" (UID: \"1dcc3698-3bfb-44e1-9a50-e94dc6eebfee\") " pod="openshift-multus/multus-bjc58" May 21 10:30:07.404661 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.404524 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/63386de8-09b5-4de2-bf23-270c4f9636da-var-lib-kubelet\") pod \"tuned-r74kc\" (UID: \"63386de8-09b5-4de2-bf23-270c4f9636da\") " pod="openshift-cluster-node-tuning-operator/tuned-r74kc" May 21 10:30:07.405493 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.404548 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1dcc3698-3bfb-44e1-9a50-e94dc6eebfee-hostroot\") pod \"multus-bjc58\" (UID: \"1dcc3698-3bfb-44e1-9a50-e94dc6eebfee\") " pod="openshift-multus/multus-bjc58" May 21 10:30:07.405493 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.404547 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kj59z\" (UniqueName: \"kubernetes.io/projected/da312e42-a265-4201-9a40-29d1d16a9815-kube-api-access-kj59z\") pod \"multus-additional-cni-plugins-b6m2m\" (UID: \"da312e42-a265-4201-9a40-29d1d16a9815\") " pod="openshift-multus/multus-additional-cni-plugins-b6m2m" May 21 10:30:07.405493 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.404571 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cd0770fc-db63-4ee9-8945-b9f3df987d5b-etc-selinux\") pod \"aws-ebs-csi-driver-node-cdskv\" (UID: \"cd0770fc-db63-4ee9-8945-b9f3df987d5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cdskv" May 21 10:30:07.405493 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.404587 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1dcc3698-3bfb-44e1-9a50-e94dc6eebfee-system-cni-dir\") pod \"multus-bjc58\" (UID: \"1dcc3698-3bfb-44e1-9a50-e94dc6eebfee\") " pod="openshift-multus/multus-bjc58" May 21 10:30:07.405493 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.404603 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1dcc3698-3bfb-44e1-9a50-e94dc6eebfee-multus-cni-dir\") pod \"multus-bjc58\" (UID: \"1dcc3698-3bfb-44e1-9a50-e94dc6eebfee\") " pod="openshift-multus/multus-bjc58" May 21 10:30:07.405493 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.404627 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1dcc3698-3bfb-44e1-9a50-e94dc6eebfee-cni-binary-copy\") pod \"multus-bjc58\" (UID: \"1dcc3698-3bfb-44e1-9a50-e94dc6eebfee\") " pod="openshift-multus/multus-bjc58" May 21 10:30:07.405493 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.404645 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1dcc3698-3bfb-44e1-9a50-e94dc6eebfee-etc-kubernetes\") pod \"multus-bjc58\" (UID: \"1dcc3698-3bfb-44e1-9a50-e94dc6eebfee\") " pod="openshift-multus/multus-bjc58" May 21 10:30:07.405493 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.404661 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/63386de8-09b5-4de2-bf23-270c4f9636da-etc-modprobe-d\") pod \"tuned-r74kc\" (UID: \"63386de8-09b5-4de2-bf23-270c4f9636da\") " pod="openshift-cluster-node-tuning-operator/tuned-r74kc" May 21 10:30:07.405493 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.404683 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cd0770fc-db63-4ee9-8945-b9f3df987d5b-etc-selinux\") pod \"aws-ebs-csi-driver-node-cdskv\" (UID: \"cd0770fc-db63-4ee9-8945-b9f3df987d5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cdskv" May 21 10:30:07.405493 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.404699 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/63386de8-09b5-4de2-bf23-270c4f9636da-lib-modules\") pod \"tuned-r74kc\" (UID: \"63386de8-09b5-4de2-bf23-270c4f9636da\") " pod="openshift-cluster-node-tuning-operator/tuned-r74kc" May 21 10:30:07.405493 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.404716 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cd0770fc-db63-4ee9-8945-b9f3df987d5b-socket-dir\") pod \"aws-ebs-csi-driver-node-cdskv\" (UID: \"cd0770fc-db63-4ee9-8945-b9f3df987d5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cdskv" May 21 10:30:07.405493 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.404720 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ecce324-6dad-4c21-b5d0-60950c0b12a8-tmp-dir\") pod \"node-resolver-7hg45\" (UID: \"0ecce324-6dad-4c21-b5d0-60950c0b12a8\") " pod="openshift-dns/node-resolver-7hg45" May 21 10:30:07.405493 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.404733 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0ecce324-6dad-4c21-b5d0-60950c0b12a8-hosts-file\") pod \"node-resolver-7hg45\" (UID: \"0ecce324-6dad-4c21-b5d0-60950c0b12a8\") " pod="openshift-dns/node-resolver-7hg45" May 21 10:30:07.405493 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.404751 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1dcc3698-3bfb-44e1-9a50-e94dc6eebfee-multus-socket-dir-parent\") pod \"multus-bjc58\" (UID: \"1dcc3698-3bfb-44e1-9a50-e94dc6eebfee\") " pod="openshift-multus/multus-bjc58" May 21 10:30:07.405493 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.404759 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1dcc3698-3bfb-44e1-9a50-e94dc6eebfee-system-cni-dir\") pod \"multus-bjc58\" (UID: \"1dcc3698-3bfb-44e1-9a50-e94dc6eebfee\") " pod="openshift-multus/multus-bjc58" May 21 10:30:07.405493 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.404768 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/63386de8-09b5-4de2-bf23-270c4f9636da-etc-systemd\") pod \"tuned-r74kc\" (UID: \"63386de8-09b5-4de2-bf23-270c4f9636da\") " pod="openshift-cluster-node-tuning-operator/tuned-r74kc" May 21 10:30:07.405493 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.404802 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1dcc3698-3bfb-44e1-9a50-e94dc6eebfee-etc-kubernetes\") pod \"multus-bjc58\" (UID: \"1dcc3698-3bfb-44e1-9a50-e94dc6eebfee\") " pod="openshift-multus/multus-bjc58" May 21 10:30:07.405493 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.404801 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/63386de8-09b5-4de2-bf23-270c4f9636da-host\") pod \"tuned-r74kc\" (UID: \"63386de8-09b5-4de2-bf23-270c4f9636da\") " pod="openshift-cluster-node-tuning-operator/tuned-r74kc" May 21 10:30:07.406305 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.404854 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/13bdaed8-f4ef-4751-b367-f343320aae60-host-kubelet\") pod \"ovnkube-node-jmp49\" (UID: \"13bdaed8-f4ef-4751-b367-f343320aae60\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmp49" May 21 10:30:07.406305 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.404864 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1dcc3698-3bfb-44e1-9a50-e94dc6eebfee-multus-cni-dir\") pod \"multus-bjc58\" (UID: \"1dcc3698-3bfb-44e1-9a50-e94dc6eebfee\") " pod="openshift-multus/multus-bjc58" May 21 10:30:07.406305 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.404877 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1dcc3698-3bfb-44e1-9a50-e94dc6eebfee-multus-socket-dir-parent\") pod \"multus-bjc58\" (UID: \"1dcc3698-3bfb-44e1-9a50-e94dc6eebfee\") " pod="openshift-multus/multus-bjc58" May 21 10:30:07.406305 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.404859 2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 21 10:30:07.406305 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.404887 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13bdaed8-f4ef-4751-b367-f343320aae60-run-openvswitch\") pod \"ovnkube-node-jmp49\" (UID: \"13bdaed8-f4ef-4751-b367-f343320aae60\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmp49" May 21 10:30:07.406305 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.404899 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0ecce324-6dad-4c21-b5d0-60950c0b12a8-hosts-file\") pod \"node-resolver-7hg45\" (UID: \"0ecce324-6dad-4c21-b5d0-60950c0b12a8\") " pod="openshift-dns/node-resolver-7hg45" May 21 10:30:07.406305 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.404912 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flnqj\" (UniqueName: \"kubernetes.io/projected/13bdaed8-f4ef-4751-b367-f343320aae60-kube-api-access-flnqj\") pod \"ovnkube-node-jmp49\" (UID: \"13bdaed8-f4ef-4751-b367-f343320aae60\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmp49" May 21 10:30:07.406305 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.404952 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/da312e42-a265-4201-9a40-29d1d16a9815-cni-binary-copy\") pod \"multus-additional-cni-plugins-b6m2m\" (UID: \"da312e42-a265-4201-9a40-29d1d16a9815\") " pod="openshift-multus/multus-additional-cni-plugins-b6m2m" May 21 10:30:07.406305 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.404967 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cd0770fc-db63-4ee9-8945-b9f3df987d5b-socket-dir\") pod \"aws-ebs-csi-driver-node-cdskv\" (UID: \"cd0770fc-db63-4ee9-8945-b9f3df987d5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cdskv" May 21 10:30:07.406305 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.404996 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/da312e42-a265-4201-9a40-29d1d16a9815-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-b6m2m\" (UID: \"da312e42-a265-4201-9a40-29d1d16a9815\") " pod="openshift-multus/multus-additional-cni-plugins-b6m2m" May 21 10:30:07.406305 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.405091 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zrvrr\" (UniqueName: \"kubernetes.io/projected/2b0f26ae-1e09-4748-8edc-01ca61e76324-kube-api-access-zrvrr\") pod \"node-ca-vp867\" (UID: \"2b0f26ae-1e09-4748-8edc-01ca61e76324\") " pod="openshift-image-registry/node-ca-vp867" May 21 10:30:07.406305 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.405122 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1dcc3698-3bfb-44e1-9a50-e94dc6eebfee-cni-binary-copy\") pod \"multus-bjc58\" (UID: \"1dcc3698-3bfb-44e1-9a50-e94dc6eebfee\") " pod="openshift-multus/multus-bjc58" May 21 10:30:07.406305 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.405124 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/532b9f67-fb6d-47bb-83a4-e7d4f70c189e-iptables-alerter-script\") pod \"iptables-alerter-6575x\" (UID: \"532b9f67-fb6d-47bb-83a4-e7d4f70c189e\") " pod="openshift-network-operator/iptables-alerter-6575x" May 21 10:30:07.406305 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.405195 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/532b9f67-fb6d-47bb-83a4-e7d4f70c189e-host-slash\") pod \"iptables-alerter-6575x\" (UID: \"532b9f67-fb6d-47bb-83a4-e7d4f70c189e\") " pod="openshift-network-operator/iptables-alerter-6575x" May 21 10:30:07.406305 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.405215 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/13bdaed8-f4ef-4751-b367-f343320aae60-host-cni-bin\") pod \"ovnkube-node-jmp49\" (UID: \"13bdaed8-f4ef-4751-b367-f343320aae60\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmp49" May 21 10:30:07.406305 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.405230 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/13bdaed8-f4ef-4751-b367-f343320aae60-env-overrides\") pod \"ovnkube-node-jmp49\" (UID: \"13bdaed8-f4ef-4751-b367-f343320aae60\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmp49" May 21 10:30:07.406305 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.405252 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/da312e42-a265-4201-9a40-29d1d16a9815-system-cni-dir\") pod \"multus-additional-cni-plugins-b6m2m\" (UID: \"da312e42-a265-4201-9a40-29d1d16a9815\") " pod="openshift-multus/multus-additional-cni-plugins-b6m2m" May 21 10:30:07.406882 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.405272 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f-metrics-certs\") pod \"network-metrics-daemon-hnvv7\" (UID: \"a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f\") " pod="openshift-multus/network-metrics-daemon-hnvv7" May 21 10:30:07.406882 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.405315 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-st7kr\" (UniqueName: \"kubernetes.io/projected/a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f-kube-api-access-st7kr\") pod \"network-metrics-daemon-hnvv7\" (UID: \"a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f\") " pod="openshift-multus/network-metrics-daemon-hnvv7" May 21 10:30:07.406882 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.405344 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2b0f26ae-1e09-4748-8edc-01ca61e76324-host\") pod \"node-ca-vp867\" (UID: \"2b0f26ae-1e09-4748-8edc-01ca61e76324\") " pod="openshift-image-registry/node-ca-vp867" May 21 10:30:07.406882 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:07.405375 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 10:30:07.406882 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.405381 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2b0f26ae-1e09-4748-8edc-01ca61e76324-host\") pod \"node-ca-vp867\" (UID: \"2b0f26ae-1e09-4748-8edc-01ca61e76324\") " pod="openshift-image-registry/node-ca-vp867" May 21 10:30:07.406882 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.405438 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/532b9f67-fb6d-47bb-83a4-e7d4f70c189e-host-slash\") pod \"iptables-alerter-6575x\" (UID: \"532b9f67-fb6d-47bb-83a4-e7d4f70c189e\") " pod="openshift-network-operator/iptables-alerter-6575x" May 21 10:30:07.406882 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.405475 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/da312e42-a265-4201-9a40-29d1d16a9815-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-b6m2m\" (UID: \"da312e42-a265-4201-9a40-29d1d16a9815\") " pod="openshift-multus/multus-additional-cni-plugins-b6m2m" May 21 10:30:07.406882 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:07.405491 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f-metrics-certs podName:a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f nodeName:}" failed. No retries permitted until 2026-05-21 10:30:07.905469701 +0000 UTC m=+3.116629816 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f-metrics-certs") pod "network-metrics-daemon-hnvv7" (UID: "a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 10:30:07.406882 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.405483 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/da312e42-a265-4201-9a40-29d1d16a9815-system-cni-dir\") pod \"multus-additional-cni-plugins-b6m2m\" (UID: \"da312e42-a265-4201-9a40-29d1d16a9815\") " pod="openshift-multus/multus-additional-cni-plugins-b6m2m" May 21 10:30:07.406882 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.405379 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gnp4k\" (UniqueName: \"kubernetes.io/projected/532b9f67-fb6d-47bb-83a4-e7d4f70c189e-kube-api-access-gnp4k\") pod \"iptables-alerter-6575x\" (UID: \"532b9f67-fb6d-47bb-83a4-e7d4f70c189e\") " pod="openshift-network-operator/iptables-alerter-6575x" May 21 10:30:07.406882 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.405546 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2b0f26ae-1e09-4748-8edc-01ca61e76324-serviceca\") pod \"node-ca-vp867\" (UID: \"2b0f26ae-1e09-4748-8edc-01ca61e76324\") " pod="openshift-image-registry/node-ca-vp867" May 21 10:30:07.406882 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.405495 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/da312e42-a265-4201-9a40-29d1d16a9815-cni-binary-copy\") pod \"multus-additional-cni-plugins-b6m2m\" (UID: \"da312e42-a265-4201-9a40-29d1d16a9815\") " pod="openshift-multus/multus-additional-cni-plugins-b6m2m" May 21 10:30:07.406882 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.405572 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9c4ae568-a2e3-47d6-aedb-4733f4cf72ad-konnectivity-ca\") pod \"konnectivity-agent-mf2tq\" (UID: \"9c4ae568-a2e3-47d6-aedb-4733f4cf72ad\") " pod="kube-system/konnectivity-agent-mf2tq" May 21 10:30:07.406882 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.405611 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/532b9f67-fb6d-47bb-83a4-e7d4f70c189e-iptables-alerter-script\") pod \"iptables-alerter-6575x\" (UID: \"532b9f67-fb6d-47bb-83a4-e7d4f70c189e\") " pod="openshift-network-operator/iptables-alerter-6575x" May 21 10:30:07.406882 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.405731 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/63386de8-09b5-4de2-bf23-270c4f9636da-etc-sysctl-conf\") pod \"tuned-r74kc\" (UID: \"63386de8-09b5-4de2-bf23-270c4f9636da\") " pod="openshift-cluster-node-tuning-operator/tuned-r74kc" May 21 10:30:07.406882 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.405759 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13bdaed8-f4ef-4751-b367-f343320aae60-var-lib-openvswitch\") pod \"ovnkube-node-jmp49\" (UID: \"13bdaed8-f4ef-4751-b367-f343320aae60\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmp49" May 21 10:30:07.406882 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.405787 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/13bdaed8-f4ef-4751-b367-f343320aae60-node-log\") pod \"ovnkube-node-jmp49\" (UID: \"13bdaed8-f4ef-4751-b367-f343320aae60\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmp49" May 21 10:30:07.407406 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.405847 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/13bdaed8-f4ef-4751-b367-f343320aae60-log-socket\") pod \"ovnkube-node-jmp49\" (UID: \"13bdaed8-f4ef-4751-b367-f343320aae60\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmp49" May 21 10:30:07.407406 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.405881 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1dcc3698-3bfb-44e1-9a50-e94dc6eebfee-cnibin\") pod \"multus-bjc58\" (UID: \"1dcc3698-3bfb-44e1-9a50-e94dc6eebfee\") " pod="openshift-multus/multus-bjc58" May 21 10:30:07.407406 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.405908 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1dcc3698-3bfb-44e1-9a50-e94dc6eebfee-host-run-k8s-cni-cncf-io\") pod \"multus-bjc58\" (UID: \"1dcc3698-3bfb-44e1-9a50-e94dc6eebfee\") " pod="openshift-multus/multus-bjc58" May 21 10:30:07.407406 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.405945 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1dcc3698-3bfb-44e1-9a50-e94dc6eebfee-host-var-lib-cni-bin\") pod \"multus-bjc58\" (UID: \"1dcc3698-3bfb-44e1-9a50-e94dc6eebfee\") " pod="openshift-multus/multus-bjc58" May 21 10:30:07.407406 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.405980 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/13bdaed8-f4ef-4751-b367-f343320aae60-host-run-netns\") pod \"ovnkube-node-jmp49\" (UID: \"13bdaed8-f4ef-4751-b367-f343320aae60\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmp49" May 21 10:30:07.407406 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.405979 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1dcc3698-3bfb-44e1-9a50-e94dc6eebfee-cnibin\") pod \"multus-bjc58\" (UID: \"1dcc3698-3bfb-44e1-9a50-e94dc6eebfee\") " pod="openshift-multus/multus-bjc58" May 21 10:30:07.407406 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.406023 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1dcc3698-3bfb-44e1-9a50-e94dc6eebfee-host-var-lib-cni-bin\") pod \"multus-bjc58\" (UID: \"1dcc3698-3bfb-44e1-9a50-e94dc6eebfee\") " pod="openshift-multus/multus-bjc58" May 21 10:30:07.407406 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.406045 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1dcc3698-3bfb-44e1-9a50-e94dc6eebfee-host-run-k8s-cni-cncf-io\") pod \"multus-bjc58\" (UID: \"1dcc3698-3bfb-44e1-9a50-e94dc6eebfee\") " pod="openshift-multus/multus-bjc58" May 21 10:30:07.407406 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.406128 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9c4ae568-a2e3-47d6-aedb-4733f4cf72ad-konnectivity-ca\") pod \"konnectivity-agent-mf2tq\" (UID: \"9c4ae568-a2e3-47d6-aedb-4733f4cf72ad\") " pod="kube-system/konnectivity-agent-mf2tq" May 21 10:30:07.407406 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.406236 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2b0f26ae-1e09-4748-8edc-01ca61e76324-serviceca\") pod \"node-ca-vp867\" (UID: \"2b0f26ae-1e09-4748-8edc-01ca61e76324\") " pod="openshift-image-registry/node-ca-vp867" May 21 10:30:07.408658 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.408634 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9c4ae568-a2e3-47d6-aedb-4733f4cf72ad-agent-certs\") pod \"konnectivity-agent-mf2tq\" (UID: \"9c4ae568-a2e3-47d6-aedb-4733f4cf72ad\") " pod="kube-system/konnectivity-agent-mf2tq" May 21 10:30:07.414215 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.414192 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvtm2\" (UniqueName: \"kubernetes.io/projected/1dcc3698-3bfb-44e1-9a50-e94dc6eebfee-kube-api-access-hvtm2\") pod \"multus-bjc58\" (UID: \"1dcc3698-3bfb-44e1-9a50-e94dc6eebfee\") " pod="openshift-multus/multus-bjc58" May 21 10:30:07.414763 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.414741 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnw2v\" (UniqueName: \"kubernetes.io/projected/cd0770fc-db63-4ee9-8945-b9f3df987d5b-kube-api-access-pnw2v\") pod \"aws-ebs-csi-driver-node-cdskv\" (UID: \"cd0770fc-db63-4ee9-8945-b9f3df987d5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cdskv" May 21 10:30:07.414763 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.414751 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kj59z\" (UniqueName: \"kubernetes.io/projected/da312e42-a265-4201-9a40-29d1d16a9815-kube-api-access-kj59z\") pod \"multus-additional-cni-plugins-b6m2m\" (UID: \"da312e42-a265-4201-9a40-29d1d16a9815\") " pod="openshift-multus/multus-additional-cni-plugins-b6m2m" May 21 10:30:07.414763 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.414741 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qpkh\" (UniqueName: \"kubernetes.io/projected/0ecce324-6dad-4c21-b5d0-60950c0b12a8-kube-api-access-9qpkh\") pod \"node-resolver-7hg45\" (UID: \"0ecce324-6dad-4c21-b5d0-60950c0b12a8\") " pod="openshift-dns/node-resolver-7hg45" May 21 10:30:07.417284 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.417259 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnp4k\" (UniqueName: \"kubernetes.io/projected/532b9f67-fb6d-47bb-83a4-e7d4f70c189e-kube-api-access-gnp4k\") pod \"iptables-alerter-6575x\" (UID: \"532b9f67-fb6d-47bb-83a4-e7d4f70c189e\") " pod="openshift-network-operator/iptables-alerter-6575x" May 21 10:30:07.417746 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.417729 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrvrr\" (UniqueName: \"kubernetes.io/projected/2b0f26ae-1e09-4748-8edc-01ca61e76324-kube-api-access-zrvrr\") pod \"node-ca-vp867\" (UID: \"2b0f26ae-1e09-4748-8edc-01ca61e76324\") " pod="openshift-image-registry/node-ca-vp867" May 21 10:30:07.418099 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.418078 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-st7kr\" (UniqueName: \"kubernetes.io/projected/a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f-kube-api-access-st7kr\") pod \"network-metrics-daemon-hnvv7\" (UID: \"a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f\") " pod="openshift-multus/network-metrics-daemon-hnvv7" May 21 10:30:07.507237 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.507206 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/13bdaed8-f4ef-4751-b367-f343320aae60-ovnkube-config\") pod \"ovnkube-node-jmp49\" (UID: \"13bdaed8-f4ef-4751-b367-f343320aae60\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmp49" May 21 10:30:07.507237 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.507241 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gnfds\" (UniqueName: \"kubernetes.io/projected/63386de8-09b5-4de2-bf23-270c4f9636da-kube-api-access-gnfds\") pod \"tuned-r74kc\" (UID: \"63386de8-09b5-4de2-bf23-270c4f9636da\") " pod="openshift-cluster-node-tuning-operator/tuned-r74kc" May 21 10:30:07.507453 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.507265 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/63386de8-09b5-4de2-bf23-270c4f9636da-run\") pod \"tuned-r74kc\" (UID: \"63386de8-09b5-4de2-bf23-270c4f9636da\") " pod="openshift-cluster-node-tuning-operator/tuned-r74kc" May 21 10:30:07.507453 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.507290 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/63386de8-09b5-4de2-bf23-270c4f9636da-var-lib-kubelet\") pod \"tuned-r74kc\" (UID: \"63386de8-09b5-4de2-bf23-270c4f9636da\") " pod="openshift-cluster-node-tuning-operator/tuned-r74kc" May 21 10:30:07.507577 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.507560 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/63386de8-09b5-4de2-bf23-270c4f9636da-etc-modprobe-d\") pod \"tuned-r74kc\" (UID: \"63386de8-09b5-4de2-bf23-270c4f9636da\") " pod="openshift-cluster-node-tuning-operator/tuned-r74kc" May 21 10:30:07.507630 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.507603 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/63386de8-09b5-4de2-bf23-270c4f9636da-lib-modules\") pod \"tuned-r74kc\" (UID: \"63386de8-09b5-4de2-bf23-270c4f9636da\") " pod="openshift-cluster-node-tuning-operator/tuned-r74kc" May 21 10:30:07.507676 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.507639 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/63386de8-09b5-4de2-bf23-270c4f9636da-run\") pod \"tuned-r74kc\" (UID: \"63386de8-09b5-4de2-bf23-270c4f9636da\") " pod="openshift-cluster-node-tuning-operator/tuned-r74kc" May 21 10:30:07.507676 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.507662 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/63386de8-09b5-4de2-bf23-270c4f9636da-etc-systemd\") pod \"tuned-r74kc\" (UID: \"63386de8-09b5-4de2-bf23-270c4f9636da\") " pod="openshift-cluster-node-tuning-operator/tuned-r74kc" May 21 10:30:07.507767 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.507696 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/63386de8-09b5-4de2-bf23-270c4f9636da-host\") pod \"tuned-r74kc\" (UID: \"63386de8-09b5-4de2-bf23-270c4f9636da\") " pod="openshift-cluster-node-tuning-operator/tuned-r74kc" May 21 10:30:07.507767 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.507734 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/63386de8-09b5-4de2-bf23-270c4f9636da-var-lib-kubelet\") pod \"tuned-r74kc\" (UID: \"63386de8-09b5-4de2-bf23-270c4f9636da\") " pod="openshift-cluster-node-tuning-operator/tuned-r74kc" May 21 10:30:07.507767 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.507735 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/13bdaed8-f4ef-4751-b367-f343320aae60-host-kubelet\") pod \"ovnkube-node-jmp49\" (UID: \"13bdaed8-f4ef-4751-b367-f343320aae60\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmp49" May 21 10:30:07.507923 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.507784 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/13bdaed8-f4ef-4751-b367-f343320aae60-host-kubelet\") pod \"ovnkube-node-jmp49\" (UID: \"13bdaed8-f4ef-4751-b367-f343320aae60\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmp49" May 21 10:30:07.507923 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.507786 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13bdaed8-f4ef-4751-b367-f343320aae60-run-openvswitch\") pod \"ovnkube-node-jmp49\" (UID: \"13bdaed8-f4ef-4751-b367-f343320aae60\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmp49" May 21 10:30:07.507923 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.507863 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-flnqj\" (UniqueName: \"kubernetes.io/projected/13bdaed8-f4ef-4751-b367-f343320aae60-kube-api-access-flnqj\") pod \"ovnkube-node-jmp49\" (UID: \"13bdaed8-f4ef-4751-b367-f343320aae60\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmp49" May 21 10:30:07.507923 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.507883 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13bdaed8-f4ef-4751-b367-f343320aae60-run-openvswitch\") pod \"ovnkube-node-jmp49\" (UID: \"13bdaed8-f4ef-4751-b367-f343320aae60\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmp49" May 21 10:30:07.507923 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.507899 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/13bdaed8-f4ef-4751-b367-f343320aae60-host-cni-bin\") pod \"ovnkube-node-jmp49\" (UID: \"13bdaed8-f4ef-4751-b367-f343320aae60\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmp49" May 21 10:30:07.508130 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.507944 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/63386de8-09b5-4de2-bf23-270c4f9636da-host\") pod \"tuned-r74kc\" (UID: \"63386de8-09b5-4de2-bf23-270c4f9636da\") " pod="openshift-cluster-node-tuning-operator/tuned-r74kc" May 21 10:30:07.508130 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.507954 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/63386de8-09b5-4de2-bf23-270c4f9636da-lib-modules\") pod \"tuned-r74kc\" (UID: \"63386de8-09b5-4de2-bf23-270c4f9636da\") " pod="openshift-cluster-node-tuning-operator/tuned-r74kc" May 21 10:30:07.508130 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.507982 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/13bdaed8-f4ef-4751-b367-f343320aae60-env-overrides\") pod \"ovnkube-node-jmp49\" (UID: \"13bdaed8-f4ef-4751-b367-f343320aae60\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmp49" May 21 10:30:07.508130 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.508005 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/13bdaed8-f4ef-4751-b367-f343320aae60-host-cni-bin\") pod \"ovnkube-node-jmp49\" (UID: \"13bdaed8-f4ef-4751-b367-f343320aae60\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmp49" May 21 10:30:07.508130 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.508016 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/63386de8-09b5-4de2-bf23-270c4f9636da-etc-systemd\") pod \"tuned-r74kc\" (UID: \"63386de8-09b5-4de2-bf23-270c4f9636da\") " pod="openshift-cluster-node-tuning-operator/tuned-r74kc" May 21 10:30:07.508334 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.508128 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/63386de8-09b5-4de2-bf23-270c4f9636da-etc-modprobe-d\") pod \"tuned-r74kc\" (UID: \"63386de8-09b5-4de2-bf23-270c4f9636da\") " pod="openshift-cluster-node-tuning-operator/tuned-r74kc" May 21 10:30:07.508334 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.508151 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/13bdaed8-f4ef-4751-b367-f343320aae60-ovnkube-config\") pod \"ovnkube-node-jmp49\" (UID: \"13bdaed8-f4ef-4751-b367-f343320aae60\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmp49" May 21 10:30:07.508334 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.508240 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/63386de8-09b5-4de2-bf23-270c4f9636da-etc-sysctl-conf\") pod \"tuned-r74kc\" (UID: \"63386de8-09b5-4de2-bf23-270c4f9636da\") " pod="openshift-cluster-node-tuning-operator/tuned-r74kc" May 21 10:30:07.508334 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.508296 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13bdaed8-f4ef-4751-b367-f343320aae60-var-lib-openvswitch\") pod \"ovnkube-node-jmp49\" (UID: \"13bdaed8-f4ef-4751-b367-f343320aae60\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmp49" May 21 10:30:07.508506 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.508351 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/13bdaed8-f4ef-4751-b367-f343320aae60-node-log\") pod \"ovnkube-node-jmp49\" (UID: \"13bdaed8-f4ef-4751-b367-f343320aae60\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmp49" May 21 10:30:07.508506 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.508385 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/13bdaed8-f4ef-4751-b367-f343320aae60-log-socket\") pod \"ovnkube-node-jmp49\" (UID: \"13bdaed8-f4ef-4751-b367-f343320aae60\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmp49" May 21 10:30:07.508506 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.508420 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/13bdaed8-f4ef-4751-b367-f343320aae60-host-run-netns\") pod \"ovnkube-node-jmp49\" (UID: \"13bdaed8-f4ef-4751-b367-f343320aae60\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmp49" May 21 10:30:07.508506 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.508447 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13bdaed8-f4ef-4751-b367-f343320aae60-etc-openvswitch\") pod \"ovnkube-node-jmp49\" (UID: \"13bdaed8-f4ef-4751-b367-f343320aae60\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmp49" May 21 10:30:07.508506 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.508455 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/63386de8-09b5-4de2-bf23-270c4f9636da-etc-sysctl-conf\") pod \"tuned-r74kc\" (UID: \"63386de8-09b5-4de2-bf23-270c4f9636da\") " pod="openshift-cluster-node-tuning-operator/tuned-r74kc" May 21 10:30:07.508506 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.508478 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63386de8-09b5-4de2-bf23-270c4f9636da-etc-kubernetes\") pod \"tuned-r74kc\" (UID: \"63386de8-09b5-4de2-bf23-270c4f9636da\") " pod="openshift-cluster-node-tuning-operator/tuned-r74kc" May 21 10:30:07.508744 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.508517 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/63386de8-09b5-4de2-bf23-270c4f9636da-etc-tuned\") pod \"tuned-r74kc\" (UID: \"63386de8-09b5-4de2-bf23-270c4f9636da\") " pod="openshift-cluster-node-tuning-operator/tuned-r74kc" May 21 10:30:07.508744 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.508538 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13bdaed8-f4ef-4751-b367-f343320aae60-var-lib-openvswitch\") pod \"ovnkube-node-jmp49\" (UID: \"13bdaed8-f4ef-4751-b367-f343320aae60\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmp49" May 21 10:30:07.508744 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.508549 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13bdaed8-f4ef-4751-b367-f343320aae60-host-run-ovn-kubernetes\") pod \"ovnkube-node-jmp49\" (UID: \"13bdaed8-f4ef-4751-b367-f343320aae60\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmp49" May 21 10:30:07.508744 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.508595 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/13bdaed8-f4ef-4751-b367-f343320aae60-node-log\") pod \"ovnkube-node-jmp49\" (UID: \"13bdaed8-f4ef-4751-b367-f343320aae60\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmp49" May 21 10:30:07.508744 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.508605 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/13bdaed8-f4ef-4751-b367-f343320aae60-env-overrides\") pod \"ovnkube-node-jmp49\" (UID: \"13bdaed8-f4ef-4751-b367-f343320aae60\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmp49" May 21 10:30:07.508744 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.508609 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13bdaed8-f4ef-4751-b367-f343320aae60-host-run-ovn-kubernetes\") pod \"ovnkube-node-jmp49\" (UID: \"13bdaed8-f4ef-4751-b367-f343320aae60\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmp49" May 21 10:30:07.508744 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.508635 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13bdaed8-f4ef-4751-b367-f343320aae60-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jmp49\" (UID: \"13bdaed8-f4ef-4751-b367-f343320aae60\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmp49" May 21 10:30:07.508744 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.508653 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/13bdaed8-f4ef-4751-b367-f343320aae60-host-run-netns\") pod \"ovnkube-node-jmp49\" (UID: \"13bdaed8-f4ef-4751-b367-f343320aae60\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmp49" May 21 10:30:07.508744 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.508674 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63386de8-09b5-4de2-bf23-270c4f9636da-etc-kubernetes\") pod \"tuned-r74kc\" (UID: \"63386de8-09b5-4de2-bf23-270c4f9636da\") " pod="openshift-cluster-node-tuning-operator/tuned-r74kc" May 21 10:30:07.508744 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.508678 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/63386de8-09b5-4de2-bf23-270c4f9636da-tmp\") pod \"tuned-r74kc\" (UID: \"63386de8-09b5-4de2-bf23-270c4f9636da\") " pod="openshift-cluster-node-tuning-operator/tuned-r74kc" May 21 10:30:07.508744 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.508719 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/13bdaed8-f4ef-4751-b367-f343320aae60-log-socket\") pod \"ovnkube-node-jmp49\" (UID: \"13bdaed8-f4ef-4751-b367-f343320aae60\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmp49" May 21 10:30:07.508744 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.508730 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13bdaed8-f4ef-4751-b367-f343320aae60-etc-openvswitch\") pod \"ovnkube-node-jmp49\" (UID: \"13bdaed8-f4ef-4751-b367-f343320aae60\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmp49" May 21 10:30:07.509252 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.509079 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/13bdaed8-f4ef-4751-b367-f343320aae60-run-systemd\") pod \"ovnkube-node-jmp49\" (UID: \"13bdaed8-f4ef-4751-b367-f343320aae60\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmp49" May 21 10:30:07.509252 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.509142 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/13bdaed8-f4ef-4751-b367-f343320aae60-host-cni-netd\") pod \"ovnkube-node-jmp49\" (UID: \"13bdaed8-f4ef-4751-b367-f343320aae60\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmp49" May 21 10:30:07.509252 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.509173 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/13bdaed8-f4ef-4751-b367-f343320aae60-ovn-node-metrics-cert\") pod \"ovnkube-node-jmp49\" (UID: \"13bdaed8-f4ef-4751-b367-f343320aae60\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmp49" May 21 10:30:07.509252 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.509221 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/13bdaed8-f4ef-4751-b367-f343320aae60-run-systemd\") pod \"ovnkube-node-jmp49\" (UID: \"13bdaed8-f4ef-4751-b367-f343320aae60\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmp49" May 21 10:30:07.509465 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.509264 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/13bdaed8-f4ef-4751-b367-f343320aae60-host-cni-netd\") pod \"ovnkube-node-jmp49\" (UID: \"13bdaed8-f4ef-4751-b367-f343320aae60\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmp49" May 21 10:30:07.509939 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.509908 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/63386de8-09b5-4de2-bf23-270c4f9636da-etc-sysconfig\") pod \"tuned-r74kc\" (UID: \"63386de8-09b5-4de2-bf23-270c4f9636da\") " pod="openshift-cluster-node-tuning-operator/tuned-r74kc" May 21 10:30:07.510062 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.509976 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/63386de8-09b5-4de2-bf23-270c4f9636da-etc-sysctl-d\") pod \"tuned-r74kc\" (UID: \"63386de8-09b5-4de2-bf23-270c4f9636da\") " pod="openshift-cluster-node-tuning-operator/tuned-r74kc" May 21 10:30:07.510062 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.510041 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/63386de8-09b5-4de2-bf23-270c4f9636da-etc-sysconfig\") pod \"tuned-r74kc\" (UID: \"63386de8-09b5-4de2-bf23-270c4f9636da\") " pod="openshift-cluster-node-tuning-operator/tuned-r74kc" May 21 10:30:07.510152 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.510084 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13bdaed8-f4ef-4751-b367-f343320aae60-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jmp49\" (UID: \"13bdaed8-f4ef-4751-b367-f343320aae60\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmp49" May 21 10:30:07.510413 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.510196 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/63386de8-09b5-4de2-bf23-270c4f9636da-etc-sysctl-d\") pod \"tuned-r74kc\" (UID: \"63386de8-09b5-4de2-bf23-270c4f9636da\") " pod="openshift-cluster-node-tuning-operator/tuned-r74kc" May 21 10:30:07.510505 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.510324 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/13bdaed8-f4ef-4751-b367-f343320aae60-systemd-units\") pod \"ovnkube-node-jmp49\" (UID: \"13bdaed8-f4ef-4751-b367-f343320aae60\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmp49" May 21 10:30:07.510568 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.510546 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/13bdaed8-f4ef-4751-b367-f343320aae60-host-slash\") pod \"ovnkube-node-jmp49\" (UID: \"13bdaed8-f4ef-4751-b367-f343320aae60\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmp49" May 21 10:30:07.510612 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.510600 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r6rzv\" (UniqueName: \"kubernetes.io/projected/ee605341-c804-4b65-9f94-b0e9c77469cb-kube-api-access-r6rzv\") pod \"network-check-target-s556t\" (UID: \"ee605341-c804-4b65-9f94-b0e9c77469cb\") " pod="openshift-network-diagnostics/network-check-target-s556t" May 21 10:30:07.510663 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.510638 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/63386de8-09b5-4de2-bf23-270c4f9636da-sys\") pod \"tuned-r74kc\" (UID: \"63386de8-09b5-4de2-bf23-270c4f9636da\") " pod="openshift-cluster-node-tuning-operator/tuned-r74kc" May 21 10:30:07.510718 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.510377 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/13bdaed8-f4ef-4751-b367-f343320aae60-systemd-units\") pod \"ovnkube-node-jmp49\" (UID: \"13bdaed8-f4ef-4751-b367-f343320aae60\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmp49" May 21 10:30:07.510960 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.510718 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/13bdaed8-f4ef-4751-b367-f343320aae60-run-ovn\") pod \"ovnkube-node-jmp49\" (UID: \"13bdaed8-f4ef-4751-b367-f343320aae60\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmp49" May 21 10:30:07.510960 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.510741 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/13bdaed8-f4ef-4751-b367-f343320aae60-host-slash\") pod \"ovnkube-node-jmp49\" (UID: \"13bdaed8-f4ef-4751-b367-f343320aae60\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmp49" May 21 10:30:07.510960 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.510776 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/13bdaed8-f4ef-4751-b367-f343320aae60-run-ovn\") pod \"ovnkube-node-jmp49\" (UID: \"13bdaed8-f4ef-4751-b367-f343320aae60\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmp49" May 21 10:30:07.510960 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.510899 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/63386de8-09b5-4de2-bf23-270c4f9636da-sys\") pod \"tuned-r74kc\" (UID: \"63386de8-09b5-4de2-bf23-270c4f9636da\") " pod="openshift-cluster-node-tuning-operator/tuned-r74kc" May 21 10:30:07.511198 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.510812 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/13bdaed8-f4ef-4751-b367-f343320aae60-ovnkube-script-lib\") pod \"ovnkube-node-jmp49\" (UID: \"13bdaed8-f4ef-4751-b367-f343320aae60\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmp49" May 21 10:30:07.512050 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.511635 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/13bdaed8-f4ef-4751-b367-f343320aae60-ovnkube-script-lib\") pod \"ovnkube-node-jmp49\" (UID: \"13bdaed8-f4ef-4751-b367-f343320aae60\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmp49" May 21 10:30:07.512050 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.511775 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/63386de8-09b5-4de2-bf23-270c4f9636da-tmp\") pod \"tuned-r74kc\" (UID: \"63386de8-09b5-4de2-bf23-270c4f9636da\") " pod="openshift-cluster-node-tuning-operator/tuned-r74kc" May 21 10:30:07.512775 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.512742 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/63386de8-09b5-4de2-bf23-270c4f9636da-etc-tuned\") pod \"tuned-r74kc\" (UID: \"63386de8-09b5-4de2-bf23-270c4f9636da\") " pod="openshift-cluster-node-tuning-operator/tuned-r74kc" May 21 10:30:07.514962 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.514941 2563 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 21 10:30:07.515107 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.515086 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/13bdaed8-f4ef-4751-b367-f343320aae60-ovn-node-metrics-cert\") pod \"ovnkube-node-jmp49\" (UID: \"13bdaed8-f4ef-4751-b367-f343320aae60\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmp49" May 21 10:30:07.516213 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.516189 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnfds\" (UniqueName: \"kubernetes.io/projected/63386de8-09b5-4de2-bf23-270c4f9636da-kube-api-access-gnfds\") pod \"tuned-r74kc\" (UID: \"63386de8-09b5-4de2-bf23-270c4f9636da\") " pod="openshift-cluster-node-tuning-operator/tuned-r74kc" May 21 10:30:07.517099 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.517047 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-flnqj\" (UniqueName: \"kubernetes.io/projected/13bdaed8-f4ef-4751-b367-f343320aae60-kube-api-access-flnqj\") pod \"ovnkube-node-jmp49\" (UID: \"13bdaed8-f4ef-4751-b367-f343320aae60\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmp49" May 21 10:30:07.517430 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:07.517412 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 10:30:07.517501 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:07.517433 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 10:30:07.517501 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:07.517444 2563 projected.go:194] Error preparing data for projected volume kube-api-access-r6rzv for pod openshift-network-diagnostics/network-check-target-s556t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 10:30:07.517501 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:07.517496 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ee605341-c804-4b65-9f94-b0e9c77469cb-kube-api-access-r6rzv podName:ee605341-c804-4b65-9f94-b0e9c77469cb nodeName:}" failed. No retries permitted until 2026-05-21 10:30:08.017483592 +0000 UTC m=+3.228643688 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-r6rzv" (UniqueName: "kubernetes.io/projected/ee605341-c804-4b65-9f94-b0e9c77469cb-kube-api-access-r6rzv") pod "network-check-target-s556t" (UID: "ee605341-c804-4b65-9f94-b0e9c77469cb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 10:30:07.590171 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.590131 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7hg45" May 21 10:30:07.602061 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.602019 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vp867" May 21 10:30:07.612926 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.612897 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-b6m2m" May 21 10:30:07.618592 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.618565 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bjc58" May 21 10:30:07.627213 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.627187 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6575x" May 21 10:30:07.635779 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.635747 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mf2tq" May 21 10:30:07.643454 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.643431 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cdskv" May 21 10:30:07.650083 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.650055 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-r74kc" May 21 10:30:07.654724 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.654705 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jmp49" May 21 10:30:07.892016 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.891982 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-6stbn"] May 21 10:30:07.895065 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.895031 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6stbn" May 21 10:30:07.895201 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:07.895122 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6stbn" podUID="7ad7910c-8def-444e-9c74-06fe23c35ef2" May 21 10:30:07.914339 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.914303 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f-metrics-certs\") pod \"network-metrics-daemon-hnvv7\" (UID: \"a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f\") " pod="openshift-multus/network-metrics-daemon-hnvv7" May 21 10:30:07.914516 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.914353 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7ad7910c-8def-444e-9c74-06fe23c35ef2-kubelet-config\") pod \"global-pull-secret-syncer-6stbn\" (UID: \"7ad7910c-8def-444e-9c74-06fe23c35ef2\") " pod="kube-system/global-pull-secret-syncer-6stbn" May 21 10:30:07.914516 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.914376 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7ad7910c-8def-444e-9c74-06fe23c35ef2-dbus\") pod \"global-pull-secret-syncer-6stbn\" (UID: \"7ad7910c-8def-444e-9c74-06fe23c35ef2\") " pod="kube-system/global-pull-secret-syncer-6stbn" May 21 10:30:07.914516 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:07.914404 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7ad7910c-8def-444e-9c74-06fe23c35ef2-original-pull-secret\") pod \"global-pull-secret-syncer-6stbn\" (UID: \"7ad7910c-8def-444e-9c74-06fe23c35ef2\") " pod="kube-system/global-pull-secret-syncer-6stbn" May 21 10:30:07.914516 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:07.914435 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 10:30:07.914516 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:07.914506 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f-metrics-certs podName:a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f nodeName:}" failed. No retries permitted until 2026-05-21 10:30:08.914485768 +0000 UTC m=+4.125645864 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f-metrics-certs") pod "network-metrics-daemon-hnvv7" (UID: "a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 10:30:08.015982 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:08.015949 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7ad7910c-8def-444e-9c74-06fe23c35ef2-kubelet-config\") pod \"global-pull-secret-syncer-6stbn\" (UID: \"7ad7910c-8def-444e-9c74-06fe23c35ef2\") " pod="kube-system/global-pull-secret-syncer-6stbn" May 21 10:30:08.015982 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:08.015987 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7ad7910c-8def-444e-9c74-06fe23c35ef2-dbus\") pod \"global-pull-secret-syncer-6stbn\" (UID: \"7ad7910c-8def-444e-9c74-06fe23c35ef2\") " pod="kube-system/global-pull-secret-syncer-6stbn" May 21 10:30:08.016215 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:08.016017 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7ad7910c-8def-444e-9c74-06fe23c35ef2-original-pull-secret\") pod \"global-pull-secret-syncer-6stbn\" (UID: \"7ad7910c-8def-444e-9c74-06fe23c35ef2\") " pod="kube-system/global-pull-secret-syncer-6stbn" May 21 10:30:08.016215 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:08.016096 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7ad7910c-8def-444e-9c74-06fe23c35ef2-kubelet-config\") pod \"global-pull-secret-syncer-6stbn\" (UID: \"7ad7910c-8def-444e-9c74-06fe23c35ef2\") " pod="kube-system/global-pull-secret-syncer-6stbn" May 21 10:30:08.016215 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:08.016137 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 10:30:08.016215 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:08.016164 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7ad7910c-8def-444e-9c74-06fe23c35ef2-dbus\") pod \"global-pull-secret-syncer-6stbn\" (UID: \"7ad7910c-8def-444e-9c74-06fe23c35ef2\") " pod="kube-system/global-pull-secret-syncer-6stbn" May 21 10:30:08.016215 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:08.016200 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ad7910c-8def-444e-9c74-06fe23c35ef2-original-pull-secret podName:7ad7910c-8def-444e-9c74-06fe23c35ef2 nodeName:}" failed. No retries permitted until 2026-05-21 10:30:08.51617969 +0000 UTC m=+3.727339786 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7ad7910c-8def-444e-9c74-06fe23c35ef2-original-pull-secret") pod "global-pull-secret-syncer-6stbn" (UID: "7ad7910c-8def-444e-9c74-06fe23c35ef2") : object "kube-system"/"original-pull-secret" not registered May 21 10:30:08.117276 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:08.117250 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r6rzv\" (UniqueName: \"kubernetes.io/projected/ee605341-c804-4b65-9f94-b0e9c77469cb-kube-api-access-r6rzv\") pod \"network-check-target-s556t\" (UID: \"ee605341-c804-4b65-9f94-b0e9c77469cb\") " pod="openshift-network-diagnostics/network-check-target-s556t" May 21 10:30:08.117375 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:08.117363 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 10:30:08.117412 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:08.117379 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 10:30:08.117412 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:08.117388 2563 projected.go:194] Error preparing data for projected volume kube-api-access-r6rzv for pod openshift-network-diagnostics/network-check-target-s556t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 10:30:08.117470 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:08.117437 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ee605341-c804-4b65-9f94-b0e9c77469cb-kube-api-access-r6rzv podName:ee605341-c804-4b65-9f94-b0e9c77469cb nodeName:}" failed. No retries permitted until 2026-05-21 10:30:09.117422964 +0000 UTC m=+4.328583063 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-r6rzv" (UniqueName: "kubernetes.io/projected/ee605341-c804-4b65-9f94-b0e9c77469cb-kube-api-access-r6rzv") pod "network-check-target-s556t" (UID: "ee605341-c804-4b65-9f94-b0e9c77469cb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 10:30:08.132246 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:08.132217 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c4ae568_a2e3_47d6_aedb_4733f4cf72ad.slice/crio-5f754bcdc1a1a8511ffd1b0970b9ae4d17a65150c720cedf2fde51f1299bf858 WatchSource:0}: Error finding container 5f754bcdc1a1a8511ffd1b0970b9ae4d17a65150c720cedf2fde51f1299bf858: Status 404 returned error can't find the container with id 5f754bcdc1a1a8511ffd1b0970b9ae4d17a65150c720cedf2fde51f1299bf858 May 21 10:30:08.133366 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:08.133326 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63386de8_09b5_4de2_bf23_270c4f9636da.slice/crio-e047211da22132f579475f4f6c08a1179710db2660bbc50fd8c873f032ae122c WatchSource:0}: Error finding container e047211da22132f579475f4f6c08a1179710db2660bbc50fd8c873f032ae122c: Status 404 returned error can't find the container with id e047211da22132f579475f4f6c08a1179710db2660bbc50fd8c873f032ae122c May 21 10:30:08.134132 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:08.134109 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod532b9f67_fb6d_47bb_83a4_e7d4f70c189e.slice/crio-d737cbd58aa82b4943cf25727a402bbf270bd42d8bdf3c19c5ea437de555383e WatchSource:0}: Error finding container d737cbd58aa82b4943cf25727a402bbf270bd42d8bdf3c19c5ea437de555383e: Status 404 returned error can't find the container with id d737cbd58aa82b4943cf25727a402bbf270bd42d8bdf3c19c5ea437de555383e May 21 10:30:08.135269 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:08.135247 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dcc3698_3bfb_44e1_9a50_e94dc6eebfee.slice/crio-ebb9dbc677ace3270b4bd04a85a3eccfa4e4729a7807f433f55675ce3367cfb2 WatchSource:0}: Error finding container ebb9dbc677ace3270b4bd04a85a3eccfa4e4729a7807f433f55675ce3367cfb2: Status 404 returned error can't find the container with id ebb9dbc677ace3270b4bd04a85a3eccfa4e4729a7807f433f55675ce3367cfb2 May 21 10:30:08.137812 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:08.137790 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda312e42_a265_4201_9a40_29d1d16a9815.slice/crio-f060e2bdc5f4aeb09a4fc2ed082103b409ab286963ecaf456885f5b302fa97de WatchSource:0}: Error finding container f060e2bdc5f4aeb09a4fc2ed082103b409ab286963ecaf456885f5b302fa97de: Status 404 returned error can't find the container with id f060e2bdc5f4aeb09a4fc2ed082103b409ab286963ecaf456885f5b302fa97de May 21 10:30:08.140509 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:08.140489 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ecce324_6dad_4c21_b5d0_60950c0b12a8.slice/crio-e5c1f5c6a6ba69500ed3d456fdd654e5bfd0ec6fcb6da1e319045bda10ddb7d8 WatchSource:0}: Error finding container e5c1f5c6a6ba69500ed3d456fdd654e5bfd0ec6fcb6da1e319045bda10ddb7d8: Status 404 returned error can't find the container with id e5c1f5c6a6ba69500ed3d456fdd654e5bfd0ec6fcb6da1e319045bda10ddb7d8 May 21 10:30:08.145228 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:30:08.145202 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13bdaed8_f4ef_4751_b367_f343320aae60.slice/crio-19f619451a6b5d26fb7755bdca556f6c3872788a94a43f3e4560a1539371b944 WatchSource:0}: Error finding container 19f619451a6b5d26fb7755bdca556f6c3872788a94a43f3e4560a1539371b944: Status 404 returned error can't find the container with id 19f619451a6b5d26fb7755bdca556f6c3872788a94a43f3e4560a1539371b944 May 21 10:30:08.342915 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:08.342876 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 10:25:06 +0000 UTC" deadline="2028-02-28 23:55:14.969831168 +0000 UTC" May 21 10:30:08.342915 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:08.342908 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15565h25m6.626925205s" May 21 10:30:08.403790 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:08.403757 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cdskv" event={"ID":"cd0770fc-db63-4ee9-8945-b9f3df987d5b","Type":"ContainerStarted","Data":"69f49ce6ad6ed8c0522bae5fc45351e92fb2642512a26bdedd42f69dc70c23e1"} May 21 10:30:08.404878 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:08.404849 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vp867" event={"ID":"2b0f26ae-1e09-4748-8edc-01ca61e76324","Type":"ContainerStarted","Data":"7def0148558089e1d11ede95146481122c7e832bab30fa20b82485f6a9ec9efb"} May 21 10:30:08.405799 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:08.405760 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7hg45" event={"ID":"0ecce324-6dad-4c21-b5d0-60950c0b12a8","Type":"ContainerStarted","Data":"e5c1f5c6a6ba69500ed3d456fdd654e5bfd0ec6fcb6da1e319045bda10ddb7d8"} May 21 10:30:08.406836 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:08.406785 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6575x" event={"ID":"532b9f67-fb6d-47bb-83a4-e7d4f70c189e","Type":"ContainerStarted","Data":"d737cbd58aa82b4943cf25727a402bbf270bd42d8bdf3c19c5ea437de555383e"} May 21 10:30:08.407752 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:08.407727 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-r74kc" event={"ID":"63386de8-09b5-4de2-bf23-270c4f9636da","Type":"ContainerStarted","Data":"e047211da22132f579475f4f6c08a1179710db2660bbc50fd8c873f032ae122c"} May 21 10:30:08.408633 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:08.408615 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mf2tq" event={"ID":"9c4ae568-a2e3-47d6-aedb-4733f4cf72ad","Type":"ContainerStarted","Data":"5f754bcdc1a1a8511ffd1b0970b9ae4d17a65150c720cedf2fde51f1299bf858"} May 21 10:30:08.409895 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:08.409876 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-254.ec2.internal" event={"ID":"f1722d85539e90b00c9a8bb5c877e531","Type":"ContainerStarted","Data":"13c298ac18ae7532cb8abc7746ab551e6fcba13514823b542a6e481b7d2d67a5"} May 21 10:30:08.410868 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:08.410845 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jmp49" event={"ID":"13bdaed8-f4ef-4751-b367-f343320aae60","Type":"ContainerStarted","Data":"19f619451a6b5d26fb7755bdca556f6c3872788a94a43f3e4560a1539371b944"} May 21 10:30:08.411590 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:08.411575 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b6m2m" event={"ID":"da312e42-a265-4201-9a40-29d1d16a9815","Type":"ContainerStarted","Data":"f060e2bdc5f4aeb09a4fc2ed082103b409ab286963ecaf456885f5b302fa97de"} May 21 10:30:08.412311 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:08.412293 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bjc58" event={"ID":"1dcc3698-3bfb-44e1-9a50-e94dc6eebfee","Type":"ContainerStarted","Data":"ebb9dbc677ace3270b4bd04a85a3eccfa4e4729a7807f433f55675ce3367cfb2"} May 21 10:30:08.520697 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:08.520658 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7ad7910c-8def-444e-9c74-06fe23c35ef2-original-pull-secret\") pod \"global-pull-secret-syncer-6stbn\" (UID: \"7ad7910c-8def-444e-9c74-06fe23c35ef2\") " pod="kube-system/global-pull-secret-syncer-6stbn" May 21 10:30:08.520860 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:08.520843 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 10:30:08.520919 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:08.520908 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ad7910c-8def-444e-9c74-06fe23c35ef2-original-pull-secret podName:7ad7910c-8def-444e-9c74-06fe23c35ef2 nodeName:}" failed. No retries permitted until 2026-05-21 10:30:09.520893238 +0000 UTC m=+4.732053335 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7ad7910c-8def-444e-9c74-06fe23c35ef2-original-pull-secret") pod "global-pull-secret-syncer-6stbn" (UID: "7ad7910c-8def-444e-9c74-06fe23c35ef2") : object "kube-system"/"original-pull-secret" not registered May 21 10:30:08.923455 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:08.923416 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f-metrics-certs\") pod \"network-metrics-daemon-hnvv7\" (UID: \"a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f\") " pod="openshift-multus/network-metrics-daemon-hnvv7" May 21 10:30:08.923645 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:08.923596 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 10:30:08.923731 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:08.923670 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f-metrics-certs podName:a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f nodeName:}" failed. No retries permitted until 2026-05-21 10:30:10.923650643 +0000 UTC m=+6.134810750 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f-metrics-certs") pod "network-metrics-daemon-hnvv7" (UID: "a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 10:30:09.126663 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:09.125947 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r6rzv\" (UniqueName: \"kubernetes.io/projected/ee605341-c804-4b65-9f94-b0e9c77469cb-kube-api-access-r6rzv\") pod \"network-check-target-s556t\" (UID: \"ee605341-c804-4b65-9f94-b0e9c77469cb\") " pod="openshift-network-diagnostics/network-check-target-s556t" May 21 10:30:09.126663 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:09.126176 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 10:30:09.126663 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:09.126196 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 10:30:09.126663 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:09.126209 2563 projected.go:194] Error preparing data for projected volume kube-api-access-r6rzv for pod openshift-network-diagnostics/network-check-target-s556t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 10:30:09.126663 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:09.126272 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ee605341-c804-4b65-9f94-b0e9c77469cb-kube-api-access-r6rzv podName:ee605341-c804-4b65-9f94-b0e9c77469cb nodeName:}" failed. No retries permitted until 2026-05-21 10:30:11.126254017 +0000 UTC m=+6.337414117 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-r6rzv" (UniqueName: "kubernetes.io/projected/ee605341-c804-4b65-9f94-b0e9c77469cb-kube-api-access-r6rzv") pod "network-check-target-s556t" (UID: "ee605341-c804-4b65-9f94-b0e9c77469cb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 10:30:09.398985 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:09.398951 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6stbn" May 21 10:30:09.399422 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:09.399080 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6stbn" podUID="7ad7910c-8def-444e-9c74-06fe23c35ef2" May 21 10:30:09.399422 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:09.399173 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hnvv7" May 21 10:30:09.399422 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:09.399253 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hnvv7" podUID="a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f" May 21 10:30:09.399422 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:09.399319 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s556t" May 21 10:30:09.399422 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:09.399386 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s556t" podUID="ee605341-c804-4b65-9f94-b0e9c77469cb" May 21 10:30:09.426993 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:09.426958 2563 generic.go:358] "Generic (PLEG): container finished" podID="6b0ff1b7e12fad90bedfc5d0dc087ade" containerID="4d9905480e840eb8a4bba5066578fdfaefe0862facf4ed7099cb71f6bff701a3" exitCode=0 May 21 10:30:09.427547 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:09.427517 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-254.ec2.internal" event={"ID":"6b0ff1b7e12fad90bedfc5d0dc087ade","Type":"ContainerDied","Data":"4d9905480e840eb8a4bba5066578fdfaefe0862facf4ed7099cb71f6bff701a3"} May 21 10:30:09.442490 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:09.442434 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-254.ec2.internal" podStartSLOduration=3.44241473 podStartE2EDuration="3.44241473s" podCreationTimestamp="2026-05-21 10:30:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 10:30:08.424492528 +0000 UTC m=+3.635652643" watchObservedRunningTime="2026-05-21 10:30:09.44241473 +0000 UTC m=+4.653574848" May 21 10:30:09.530104 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:09.529508 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7ad7910c-8def-444e-9c74-06fe23c35ef2-original-pull-secret\") pod \"global-pull-secret-syncer-6stbn\" (UID: \"7ad7910c-8def-444e-9c74-06fe23c35ef2\") " pod="kube-system/global-pull-secret-syncer-6stbn" May 21 10:30:09.530104 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:09.529691 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 10:30:09.530104 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:09.529751 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ad7910c-8def-444e-9c74-06fe23c35ef2-original-pull-secret podName:7ad7910c-8def-444e-9c74-06fe23c35ef2 nodeName:}" failed. No retries permitted until 2026-05-21 10:30:11.529734886 +0000 UTC m=+6.740894992 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7ad7910c-8def-444e-9c74-06fe23c35ef2-original-pull-secret") pod "global-pull-secret-syncer-6stbn" (UID: "7ad7910c-8def-444e-9c74-06fe23c35ef2") : object "kube-system"/"original-pull-secret" not registered May 21 10:30:10.443914 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:10.443220 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-254.ec2.internal" event={"ID":"6b0ff1b7e12fad90bedfc5d0dc087ade","Type":"ContainerStarted","Data":"6e430d429524bee33f80fd39d6e6d2819a820c7116274f846491265b9572520f"} May 21 10:30:10.944875 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:10.944833 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f-metrics-certs\") pod \"network-metrics-daemon-hnvv7\" (UID: \"a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f\") " pod="openshift-multus/network-metrics-daemon-hnvv7" May 21 10:30:10.945051 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:10.945005 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 10:30:10.945107 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:10.945070 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f-metrics-certs podName:a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f nodeName:}" failed. No retries permitted until 2026-05-21 10:30:14.945050319 +0000 UTC m=+10.156210417 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f-metrics-certs") pod "network-metrics-daemon-hnvv7" (UID: "a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 10:30:11.146997 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:11.146956 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r6rzv\" (UniqueName: \"kubernetes.io/projected/ee605341-c804-4b65-9f94-b0e9c77469cb-kube-api-access-r6rzv\") pod \"network-check-target-s556t\" (UID: \"ee605341-c804-4b65-9f94-b0e9c77469cb\") " pod="openshift-network-diagnostics/network-check-target-s556t" May 21 10:30:11.147623 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:11.147186 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 10:30:11.147623 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:11.147209 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 10:30:11.147623 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:11.147223 2563 projected.go:194] Error preparing data for projected volume kube-api-access-r6rzv for pod openshift-network-diagnostics/network-check-target-s556t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 10:30:11.147623 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:11.147281 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ee605341-c804-4b65-9f94-b0e9c77469cb-kube-api-access-r6rzv podName:ee605341-c804-4b65-9f94-b0e9c77469cb nodeName:}" failed. No retries permitted until 2026-05-21 10:30:15.147262864 +0000 UTC m=+10.358422970 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-r6rzv" (UniqueName: "kubernetes.io/projected/ee605341-c804-4b65-9f94-b0e9c77469cb-kube-api-access-r6rzv") pod "network-check-target-s556t" (UID: "ee605341-c804-4b65-9f94-b0e9c77469cb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 10:30:11.396885 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:11.396846 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s556t" May 21 10:30:11.397080 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:11.396974 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s556t" podUID="ee605341-c804-4b65-9f94-b0e9c77469cb" May 21 10:30:11.397182 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:11.397167 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6stbn" May 21 10:30:11.397264 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:11.397247 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6stbn" podUID="7ad7910c-8def-444e-9c74-06fe23c35ef2" May 21 10:30:11.397318 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:11.397306 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hnvv7" May 21 10:30:11.397409 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:11.397381 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hnvv7" podUID="a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f" May 21 10:30:11.551350 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:11.551306 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7ad7910c-8def-444e-9c74-06fe23c35ef2-original-pull-secret\") pod \"global-pull-secret-syncer-6stbn\" (UID: \"7ad7910c-8def-444e-9c74-06fe23c35ef2\") " pod="kube-system/global-pull-secret-syncer-6stbn" May 21 10:30:11.551810 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:11.551480 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 10:30:11.551810 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:11.551543 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ad7910c-8def-444e-9c74-06fe23c35ef2-original-pull-secret podName:7ad7910c-8def-444e-9c74-06fe23c35ef2 nodeName:}" failed. No retries permitted until 2026-05-21 10:30:15.551524944 +0000 UTC m=+10.762685051 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7ad7910c-8def-444e-9c74-06fe23c35ef2-original-pull-secret") pod "global-pull-secret-syncer-6stbn" (UID: "7ad7910c-8def-444e-9c74-06fe23c35ef2") : object "kube-system"/"original-pull-secret" not registered May 21 10:30:13.396491 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:13.396455 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6stbn" May 21 10:30:13.396926 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:13.396585 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6stbn" podUID="7ad7910c-8def-444e-9c74-06fe23c35ef2" May 21 10:30:13.405110 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:13.404313 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hnvv7" May 21 10:30:13.405110 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:13.404675 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hnvv7" podUID="a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f" May 21 10:30:13.405110 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:13.404712 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s556t" May 21 10:30:13.405110 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:13.405055 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s556t" podUID="ee605341-c804-4b65-9f94-b0e9c77469cb" May 21 10:30:14.979312 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:14.979279 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f-metrics-certs\") pod \"network-metrics-daemon-hnvv7\" (UID: \"a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f\") " pod="openshift-multus/network-metrics-daemon-hnvv7" May 21 10:30:14.979716 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:14.979486 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 10:30:14.979716 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:14.979545 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f-metrics-certs podName:a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f nodeName:}" failed. No retries permitted until 2026-05-21 10:30:22.979527261 +0000 UTC m=+18.190687371 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f-metrics-certs") pod "network-metrics-daemon-hnvv7" (UID: "a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 10:30:15.180746 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:15.180152 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r6rzv\" (UniqueName: \"kubernetes.io/projected/ee605341-c804-4b65-9f94-b0e9c77469cb-kube-api-access-r6rzv\") pod \"network-check-target-s556t\" (UID: \"ee605341-c804-4b65-9f94-b0e9c77469cb\") " pod="openshift-network-diagnostics/network-check-target-s556t" May 21 10:30:15.180746 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:15.180298 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 10:30:15.180746 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:15.180319 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 10:30:15.180746 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:15.180332 2563 projected.go:194] Error preparing data for projected volume kube-api-access-r6rzv for pod openshift-network-diagnostics/network-check-target-s556t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 10:30:15.180746 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:15.180419 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ee605341-c804-4b65-9f94-b0e9c77469cb-kube-api-access-r6rzv podName:ee605341-c804-4b65-9f94-b0e9c77469cb nodeName:}" failed. No retries permitted until 2026-05-21 10:30:23.180402138 +0000 UTC m=+18.391562242 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-r6rzv" (UniqueName: "kubernetes.io/projected/ee605341-c804-4b65-9f94-b0e9c77469cb-kube-api-access-r6rzv") pod "network-check-target-s556t" (UID: "ee605341-c804-4b65-9f94-b0e9c77469cb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 10:30:15.397010 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:15.396970 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hnvv7" May 21 10:30:15.397262 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:15.397039 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6stbn" May 21 10:30:15.397262 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:15.397059 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s556t" May 21 10:30:15.397487 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:15.397463 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6stbn" podUID="7ad7910c-8def-444e-9c74-06fe23c35ef2" May 21 10:30:15.397563 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:15.397544 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s556t" podUID="ee605341-c804-4b65-9f94-b0e9c77469cb" May 21 10:30:15.397611 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:15.397356 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hnvv7" podUID="a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f" May 21 10:30:15.582791 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:15.582745 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7ad7910c-8def-444e-9c74-06fe23c35ef2-original-pull-secret\") pod \"global-pull-secret-syncer-6stbn\" (UID: \"7ad7910c-8def-444e-9c74-06fe23c35ef2\") " pod="kube-system/global-pull-secret-syncer-6stbn" May 21 10:30:15.582952 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:15.582914 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 10:30:15.582998 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:15.582984 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ad7910c-8def-444e-9c74-06fe23c35ef2-original-pull-secret podName:7ad7910c-8def-444e-9c74-06fe23c35ef2 nodeName:}" failed. No retries permitted until 2026-05-21 10:30:23.582964966 +0000 UTC m=+18.794125078 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7ad7910c-8def-444e-9c74-06fe23c35ef2-original-pull-secret") pod "global-pull-secret-syncer-6stbn" (UID: "7ad7910c-8def-444e-9c74-06fe23c35ef2") : object "kube-system"/"original-pull-secret" not registered May 21 10:30:17.396319 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:17.396242 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6stbn" May 21 10:30:17.396319 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:17.396263 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hnvv7" May 21 10:30:17.396729 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:17.396351 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6stbn" podUID="7ad7910c-8def-444e-9c74-06fe23c35ef2" May 21 10:30:17.396729 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:17.396242 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s556t" May 21 10:30:17.396729 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:17.396458 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hnvv7" podUID="a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f" May 21 10:30:17.396729 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:17.396550 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s556t" podUID="ee605341-c804-4b65-9f94-b0e9c77469cb" May 21 10:30:19.396333 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:19.396283 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6stbn" May 21 10:30:19.396761 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:19.396292 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s556t" May 21 10:30:19.396761 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:19.396419 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6stbn" podUID="7ad7910c-8def-444e-9c74-06fe23c35ef2" May 21 10:30:19.396761 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:19.396515 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s556t" podUID="ee605341-c804-4b65-9f94-b0e9c77469cb" May 21 10:30:19.396761 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:19.396292 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hnvv7" May 21 10:30:19.396761 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:19.396669 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hnvv7" podUID="a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f" May 21 10:30:21.396966 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:21.396763 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6stbn" May 21 10:30:21.396966 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:21.396780 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hnvv7" May 21 10:30:21.396966 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:21.396911 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s556t" May 21 10:30:21.396966 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:21.396926 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6stbn" podUID="7ad7910c-8def-444e-9c74-06fe23c35ef2" May 21 10:30:21.397561 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:21.397017 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hnvv7" podUID="a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f" May 21 10:30:21.397561 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:21.397105 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s556t" podUID="ee605341-c804-4b65-9f94-b0e9c77469cb" May 21 10:30:23.040726 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:23.040682 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f-metrics-certs\") pod \"network-metrics-daemon-hnvv7\" (UID: \"a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f\") " pod="openshift-multus/network-metrics-daemon-hnvv7" May 21 10:30:23.041207 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:23.040872 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 10:30:23.041207 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:23.040949 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f-metrics-certs podName:a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f nodeName:}" failed. No retries permitted until 2026-05-21 10:30:39.04092715 +0000 UTC m=+34.252087266 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f-metrics-certs") pod "network-metrics-daemon-hnvv7" (UID: "a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 10:30:23.242333 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:23.242284 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r6rzv\" (UniqueName: \"kubernetes.io/projected/ee605341-c804-4b65-9f94-b0e9c77469cb-kube-api-access-r6rzv\") pod \"network-check-target-s556t\" (UID: \"ee605341-c804-4b65-9f94-b0e9c77469cb\") " pod="openshift-network-diagnostics/network-check-target-s556t" May 21 10:30:23.242515 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:23.242471 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 10:30:23.242515 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:23.242495 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 10:30:23.242515 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:23.242509 2563 projected.go:194] Error preparing data for projected volume kube-api-access-r6rzv for pod openshift-network-diagnostics/network-check-target-s556t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 10:30:23.242637 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:23.242568 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ee605341-c804-4b65-9f94-b0e9c77469cb-kube-api-access-r6rzv podName:ee605341-c804-4b65-9f94-b0e9c77469cb nodeName:}" failed. No retries permitted until 2026-05-21 10:30:39.24255051 +0000 UTC m=+34.453710615 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-r6rzv" (UniqueName: "kubernetes.io/projected/ee605341-c804-4b65-9f94-b0e9c77469cb-kube-api-access-r6rzv") pod "network-check-target-s556t" (UID: "ee605341-c804-4b65-9f94-b0e9c77469cb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 10:30:23.396523 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:23.396098 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6stbn" May 21 10:30:23.396523 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:23.396150 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s556t" May 21 10:30:23.396523 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:23.396211 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6stbn" podUID="7ad7910c-8def-444e-9c74-06fe23c35ef2" May 21 10:30:23.396523 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:23.396279 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hnvv7" May 21 10:30:23.396523 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:23.396390 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hnvv7" podUID="a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f" May 21 10:30:23.396523 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:23.396475 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s556t" podUID="ee605341-c804-4b65-9f94-b0e9c77469cb" May 21 10:30:23.644389 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:23.644342 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7ad7910c-8def-444e-9c74-06fe23c35ef2-original-pull-secret\") pod \"global-pull-secret-syncer-6stbn\" (UID: \"7ad7910c-8def-444e-9c74-06fe23c35ef2\") " pod="kube-system/global-pull-secret-syncer-6stbn" May 21 10:30:23.644570 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:23.644511 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 10:30:23.644639 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:23.644575 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ad7910c-8def-444e-9c74-06fe23c35ef2-original-pull-secret podName:7ad7910c-8def-444e-9c74-06fe23c35ef2 nodeName:}" failed. No retries permitted until 2026-05-21 10:30:39.644557586 +0000 UTC m=+34.855717692 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7ad7910c-8def-444e-9c74-06fe23c35ef2-original-pull-secret") pod "global-pull-secret-syncer-6stbn" (UID: "7ad7910c-8def-444e-9c74-06fe23c35ef2") : object "kube-system"/"original-pull-secret" not registered May 21 10:30:25.397776 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:25.397745 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6stbn" May 21 10:30:25.398248 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:25.398000 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s556t" May 21 10:30:25.398248 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:25.398035 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hnvv7" May 21 10:30:25.398248 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:25.398029 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6stbn" podUID="7ad7910c-8def-444e-9c74-06fe23c35ef2" May 21 10:30:25.398248 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:25.398122 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hnvv7" podUID="a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f" May 21 10:30:25.398248 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:25.398203 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s556t" podUID="ee605341-c804-4b65-9f94-b0e9c77469cb" May 21 10:30:27.396556 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:27.396323 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hnvv7" May 21 10:30:27.397488 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:27.396342 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s556t" May 21 10:30:27.397488 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:27.396663 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hnvv7" podUID="a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f" May 21 10:30:27.397488 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:27.396723 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s556t" podUID="ee605341-c804-4b65-9f94-b0e9c77469cb" May 21 10:30:27.397488 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:27.396368 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6stbn" May 21 10:30:27.397488 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:27.396800 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6stbn" podUID="7ad7910c-8def-444e-9c74-06fe23c35ef2" May 21 10:30:27.475187 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:27.475147 2563 generic.go:358] "Generic (PLEG): container finished" podID="da312e42-a265-4201-9a40-29d1d16a9815" containerID="5db14c32875829bbb9a5ef4dc87e6c934a8a87b9ec91b85ba5570c036fd39877" exitCode=0 May 21 10:30:27.475394 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:27.475222 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b6m2m" event={"ID":"da312e42-a265-4201-9a40-29d1d16a9815","Type":"ContainerDied","Data":"5db14c32875829bbb9a5ef4dc87e6c934a8a87b9ec91b85ba5570c036fd39877"} May 21 10:30:27.479019 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:27.477800 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bjc58" event={"ID":"1dcc3698-3bfb-44e1-9a50-e94dc6eebfee","Type":"ContainerStarted","Data":"15001157ef7323e4f86d213eae77798b9d7a2a839da4af9e6f95cd82dcdec759"} May 21 10:30:27.480223 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:27.480197 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cdskv" event={"ID":"cd0770fc-db63-4ee9-8945-b9f3df987d5b","Type":"ContainerStarted","Data":"b1818b113efe1e31d9cd6e3b1816d0a5268f52ac987ed5030a290b82345b8575"} May 21 10:30:27.482460 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:27.482433 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vp867" event={"ID":"2b0f26ae-1e09-4748-8edc-01ca61e76324","Type":"ContainerStarted","Data":"05cfb95931438cfbfb7a83db1bb102151430392ba2db82cd8f61e085b53720a8"} May 21 10:30:27.483874 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:27.483848 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7hg45" event={"ID":"0ecce324-6dad-4c21-b5d0-60950c0b12a8","Type":"ContainerStarted","Data":"f40b194ac782e0d74e60ce8ff571ae025665d498199cc43d1f17ac62cd695542"} May 21 10:30:27.485181 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:27.485156 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-r74kc" event={"ID":"63386de8-09b5-4de2-bf23-270c4f9636da","Type":"ContainerStarted","Data":"f53c91acd2e6d2f67eb3af66d3a19ed24ce939394a8d90c1a03a806fe1636306"} May 21 10:30:27.486435 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:27.486414 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mf2tq" event={"ID":"9c4ae568-a2e3-47d6-aedb-4733f4cf72ad","Type":"ContainerStarted","Data":"d54d92cd8c405eef6e897c7b3c3dce90b82d050dde407430da483fd9e59ad8a4"} May 21 10:30:27.489163 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:27.489142 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jmp49" event={"ID":"13bdaed8-f4ef-4751-b367-f343320aae60","Type":"ContainerStarted","Data":"64e7f7e75e62682901706beb21dc1b8b954b050e0c3f2b6b2d826d21a0654ead"} May 21 10:30:27.489245 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:27.489167 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jmp49" event={"ID":"13bdaed8-f4ef-4751-b367-f343320aae60","Type":"ContainerStarted","Data":"92d22d53c36e5febb7aafde9e9de9cd76212d0f65ee5d0a3f0840e206d4008b3"} May 21 10:30:27.489245 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:27.489177 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jmp49" event={"ID":"13bdaed8-f4ef-4751-b367-f343320aae60","Type":"ContainerStarted","Data":"1e7f1fad8625a4112cbe510a293020240081a413c93028ff39737559846d7f44"} May 21 10:30:27.489245 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:27.489185 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jmp49" event={"ID":"13bdaed8-f4ef-4751-b367-f343320aae60","Type":"ContainerStarted","Data":"137b785a0caf3db69b473de3f658093db614e6ed9961c7062308c3c17c9a3b50"} May 21 10:30:27.489245 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:27.489197 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jmp49" event={"ID":"13bdaed8-f4ef-4751-b367-f343320aae60","Type":"ContainerStarted","Data":"867714f049500c654dfd890fa5abc90fe5290bfdf1278448663be4716d70b337"} May 21 10:30:27.489245 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:27.489209 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jmp49" event={"ID":"13bdaed8-f4ef-4751-b367-f343320aae60","Type":"ContainerStarted","Data":"45b8d61c84d5d8eaee25ad88f154492d6c016e4993ad23bd114c52038df44029"} May 21 10:30:27.512925 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:27.512887 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-254.ec2.internal" podStartSLOduration=21.512876488 podStartE2EDuration="21.512876488s" podCreationTimestamp="2026-05-21 10:30:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 10:30:10.461172928 +0000 UTC m=+5.672333045" watchObservedRunningTime="2026-05-21 10:30:27.512876488 +0000 UTC m=+22.724036603" May 21 10:30:27.527615 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:27.527569 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-vp867" podStartSLOduration=11.94078247 podStartE2EDuration="22.527558641s" podCreationTimestamp="2026-05-21 10:30:05 +0000 UTC" firstStartedPulling="2026-05-21 10:30:08.141694862 +0000 UTC m=+3.352854955" lastFinishedPulling="2026-05-21 10:30:18.728471018 +0000 UTC m=+13.939631126" observedRunningTime="2026-05-21 10:30:27.527481696 +0000 UTC m=+22.738641811" watchObservedRunningTime="2026-05-21 10:30:27.527558641 +0000 UTC m=+22.738718755" May 21 10:30:27.541991 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:27.541949 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-7hg45" podStartSLOduration=4.156541536 podStartE2EDuration="22.541939936s" podCreationTimestamp="2026-05-21 10:30:05 +0000 UTC" firstStartedPulling="2026-05-21 10:30:08.142088093 +0000 UTC m=+3.353248186" lastFinishedPulling="2026-05-21 10:30:26.52748649 +0000 UTC m=+21.738646586" observedRunningTime="2026-05-21 10:30:27.541933948 +0000 UTC m=+22.753094063" watchObservedRunningTime="2026-05-21 10:30:27.541939936 +0000 UTC m=+22.753100050" May 21 10:30:27.561547 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:27.561514 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-bjc58" podStartSLOduration=4.065387659 podStartE2EDuration="22.561504302s" podCreationTimestamp="2026-05-21 10:30:05 +0000 UTC" firstStartedPulling="2026-05-21 10:30:08.137946508 +0000 UTC m=+3.349106602" lastFinishedPulling="2026-05-21 10:30:26.634063135 +0000 UTC m=+21.845223245" observedRunningTime="2026-05-21 10:30:27.561021733 +0000 UTC m=+22.772181847" watchObservedRunningTime="2026-05-21 10:30:27.561504302 +0000 UTC m=+22.772664454" May 21 10:30:27.596752 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:27.596704 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-mf2tq" podStartSLOduration=4.160604716 podStartE2EDuration="22.596693557s" podCreationTimestamp="2026-05-21 10:30:05 +0000 UTC" firstStartedPulling="2026-05-21 10:30:08.133916253 +0000 UTC m=+3.345076347" lastFinishedPulling="2026-05-21 10:30:26.570005095 +0000 UTC m=+21.781165188" observedRunningTime="2026-05-21 10:30:27.57719929 +0000 UTC m=+22.788359405" watchObservedRunningTime="2026-05-21 10:30:27.596693557 +0000 UTC m=+22.807853671" May 21 10:30:27.597115 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:27.597087 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-r74kc" podStartSLOduration=4.155923792 podStartE2EDuration="22.597078905s" podCreationTimestamp="2026-05-21 10:30:05 +0000 UTC" firstStartedPulling="2026-05-21 10:30:08.135779053 +0000 UTC m=+3.346939160" lastFinishedPulling="2026-05-21 10:30:26.576934163 +0000 UTC m=+21.788094273" observedRunningTime="2026-05-21 10:30:27.596133304 +0000 UTC m=+22.807293420" watchObservedRunningTime="2026-05-21 10:30:27.597078905 +0000 UTC m=+22.808239020" May 21 10:30:28.218179 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:28.218143 2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 21 10:30:28.380357 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:28.380211 2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-21T10:30:28.218170435Z","UUID":"b4933743-eafe-4283-99f2-bde3d046b810","Handler":null,"Name":"","Endpoint":""} May 21 10:30:28.382495 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:28.382467 2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 21 10:30:28.382495 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:28.382502 2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 21 10:30:28.491671 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:28.491637 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6575x" event={"ID":"532b9f67-fb6d-47bb-83a4-e7d4f70c189e","Type":"ContainerStarted","Data":"37c71076dca2f23add3cbccb7d08e0f901efba744b98917d43eff40182350e7b"} May 21 10:30:28.493151 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:28.493124 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cdskv" event={"ID":"cd0770fc-db63-4ee9-8945-b9f3df987d5b","Type":"ContainerStarted","Data":"ce815dd2f88f16279e5076c38900b378d90da2b151b8189c8b37c9c75c7d267a"} May 21 10:30:28.507211 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:28.507172 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-6575x" podStartSLOduration=5.117564774 podStartE2EDuration="23.507161273s" podCreationTimestamp="2026-05-21 10:30:05 +0000 UTC" firstStartedPulling="2026-05-21 10:30:08.137895303 +0000 UTC m=+3.349055396" lastFinishedPulling="2026-05-21 10:30:26.527491787 +0000 UTC m=+21.738651895" observedRunningTime="2026-05-21 10:30:28.506699803 +0000 UTC m=+23.717859929" watchObservedRunningTime="2026-05-21 10:30:28.507161273 +0000 UTC m=+23.718321388" May 21 10:30:29.226470 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:29.226232 2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-mf2tq" May 21 10:30:29.226795 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:29.226773 2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-mf2tq" May 21 10:30:29.396372 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:29.396340 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6stbn" May 21 10:30:29.396372 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:29.396361 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hnvv7" May 21 10:30:29.396580 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:29.396353 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s556t" May 21 10:30:29.396580 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:29.396471 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6stbn" podUID="7ad7910c-8def-444e-9c74-06fe23c35ef2" May 21 10:30:29.396675 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:29.396576 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s556t" podUID="ee605341-c804-4b65-9f94-b0e9c77469cb" May 21 10:30:29.396675 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:29.396665 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hnvv7" podUID="a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f" May 21 10:30:29.497842 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:29.497741 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jmp49" event={"ID":"13bdaed8-f4ef-4751-b367-f343320aae60","Type":"ContainerStarted","Data":"23b7eae1521b1a6a5771f7d8c775e63c5c7a26fc8026ee6287f158d18e0ad63e"} May 21 10:30:30.500879 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:30.500845 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cdskv" event={"ID":"cd0770fc-db63-4ee9-8945-b9f3df987d5b","Type":"ContainerStarted","Data":"c82cca5b0151e71b9bd1bacda34a8108dbac42ef60112f5cb2260e243cde87d4"} May 21 10:30:30.501336 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:30.500902 2563 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" May 21 10:30:30.520552 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:30.520508 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cdskv" podStartSLOduration=4.064792085 podStartE2EDuration="25.520493298s" podCreationTimestamp="2026-05-21 10:30:05 +0000 UTC" firstStartedPulling="2026-05-21 10:30:08.143331136 +0000 UTC m=+3.354491244" lastFinishedPulling="2026-05-21 10:30:29.59903236 +0000 UTC m=+24.810192457" observedRunningTime="2026-05-21 10:30:30.520212 +0000 UTC m=+25.731372113" watchObservedRunningTime="2026-05-21 10:30:30.520493298 +0000 UTC m=+25.731653413" May 21 10:30:31.395838 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:31.395788 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6stbn" May 21 10:30:31.395838 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:31.395834 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s556t" May 21 10:30:31.396094 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:31.395942 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6stbn" podUID="7ad7910c-8def-444e-9c74-06fe23c35ef2" May 21 10:30:31.396094 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:31.395944 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hnvv7" May 21 10:30:31.396094 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:31.396000 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s556t" podUID="ee605341-c804-4b65-9f94-b0e9c77469cb" May 21 10:30:31.396094 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:31.396048 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hnvv7" podUID="a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f" May 21 10:30:32.507358 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:32.507090 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jmp49" event={"ID":"13bdaed8-f4ef-4751-b367-f343320aae60","Type":"ContainerStarted","Data":"8e422e93f2c24f571b5c632e16ceb0f2a02043cd9c6cc66eb266d3982c7b3360"} May 21 10:30:32.507956 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:32.507481 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jmp49" May 21 10:30:32.507956 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:32.507511 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jmp49" May 21 10:30:32.507956 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:32.507526 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jmp49" May 21 10:30:32.528273 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:32.528239 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jmp49" May 21 10:30:32.528727 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:32.528710 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jmp49" May 21 10:30:32.543230 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:32.543182 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-jmp49" podStartSLOduration=9.020669359 podStartE2EDuration="27.543164488s" podCreationTimestamp="2026-05-21 10:30:05 +0000 UTC" firstStartedPulling="2026-05-21 10:30:08.146777983 +0000 UTC m=+3.357938089" lastFinishedPulling="2026-05-21 10:30:26.669273108 +0000 UTC m=+21.880433218" observedRunningTime="2026-05-21 10:30:32.542476309 +0000 UTC m=+27.753636436" watchObservedRunningTime="2026-05-21 10:30:32.543164488 +0000 UTC m=+27.754324604" May 21 10:30:33.129920 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:33.129883 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-mf2tq" May 21 10:30:33.130174 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:33.130038 2563 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" May 21 10:30:33.130728 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:33.130703 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-mf2tq" May 21 10:30:33.396637 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:33.396549 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6stbn" May 21 10:30:33.396762 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:33.396687 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6stbn" podUID="7ad7910c-8def-444e-9c74-06fe23c35ef2" May 21 10:30:33.396880 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:33.396859 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hnvv7" May 21 10:30:33.396949 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:33.396912 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s556t" May 21 10:30:33.396982 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:33.396972 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s556t" podUID="ee605341-c804-4b65-9f94-b0e9c77469cb" May 21 10:30:33.397048 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:33.397034 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hnvv7" podUID="a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f" May 21 10:30:33.492037 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:33.492006 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-s556t"] May 21 10:30:33.493951 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:33.493927 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6stbn"] May 21 10:30:33.496724 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:33.496702 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hnvv7"] May 21 10:30:33.509487 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:33.509460 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s556t" May 21 10:30:33.509950 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:33.509566 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6stbn" May 21 10:30:33.509950 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:33.509563 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s556t" podUID="ee605341-c804-4b65-9f94-b0e9c77469cb" May 21 10:30:33.509950 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:33.509638 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6stbn" podUID="7ad7910c-8def-444e-9c74-06fe23c35ef2" May 21 10:30:33.509950 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:33.509892 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hnvv7" May 21 10:30:33.510159 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:33.510069 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hnvv7" podUID="a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f" May 21 10:30:34.512630 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:34.512588 2563 generic.go:358] "Generic (PLEG): container finished" podID="da312e42-a265-4201-9a40-29d1d16a9815" containerID="01507e012afecf0d2159f043e1019f1aa53e28c66bbb350885032e9973aac283" exitCode=0 May 21 10:30:34.513018 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:34.512634 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b6m2m" event={"ID":"da312e42-a265-4201-9a40-29d1d16a9815","Type":"ContainerDied","Data":"01507e012afecf0d2159f043e1019f1aa53e28c66bbb350885032e9973aac283"} May 21 10:30:35.397426 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:35.397397 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6stbn" May 21 10:30:35.397561 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:35.397478 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hnvv7" May 21 10:30:35.397561 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:35.397510 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s556t" May 21 10:30:35.397627 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:35.397543 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6stbn" podUID="7ad7910c-8def-444e-9c74-06fe23c35ef2" May 21 10:30:35.397627 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:35.397569 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s556t" podUID="ee605341-c804-4b65-9f94-b0e9c77469cb" May 21 10:30:35.397727 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:35.397669 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hnvv7" podUID="a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f" May 21 10:30:36.518127 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:36.518043 2563 generic.go:358] "Generic (PLEG): container finished" podID="da312e42-a265-4201-9a40-29d1d16a9815" containerID="88295e7c75cde1edb7c0811dac04f8d2dd7e8d0deaa4effc1c78200257af9f09" exitCode=0 May 21 10:30:36.518127 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:36.518105 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b6m2m" event={"ID":"da312e42-a265-4201-9a40-29d1d16a9815","Type":"ContainerDied","Data":"88295e7c75cde1edb7c0811dac04f8d2dd7e8d0deaa4effc1c78200257af9f09"} May 21 10:30:37.396867 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:37.396752 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s556t" May 21 10:30:37.396867 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:37.396804 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hnvv7" May 21 10:30:37.396867 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:37.396839 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6stbn" May 21 10:30:37.397123 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:37.396932 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hnvv7" podUID="a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f" May 21 10:30:37.397123 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:37.396966 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6stbn" podUID="7ad7910c-8def-444e-9c74-06fe23c35ef2" May 21 10:30:37.397123 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:37.397077 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s556t" podUID="ee605341-c804-4b65-9f94-b0e9c77469cb" May 21 10:30:37.522352 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:37.522317 2563 generic.go:358] "Generic (PLEG): container finished" podID="da312e42-a265-4201-9a40-29d1d16a9815" containerID="d8e2edb488bf64010ef7d56fc12ea4cad32499f0e768fe0d124189b898298241" exitCode=0 May 21 10:30:37.522690 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:37.522369 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b6m2m" event={"ID":"da312e42-a265-4201-9a40-29d1d16a9815","Type":"ContainerDied","Data":"d8e2edb488bf64010ef7d56fc12ea4cad32499f0e768fe0d124189b898298241"} May 21 10:30:39.063870 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:39.063839 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f-metrics-certs\") pod \"network-metrics-daemon-hnvv7\" (UID: \"a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f\") " pod="openshift-multus/network-metrics-daemon-hnvv7" May 21 10:30:39.064372 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:39.063930 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 10:30:39.064372 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:39.063994 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f-metrics-certs podName:a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f nodeName:}" failed. No retries permitted until 2026-05-21 10:31:11.063978088 +0000 UTC m=+66.275138181 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f-metrics-certs") pod "network-metrics-daemon-hnvv7" (UID: "a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 10:30:39.265137 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:39.265103 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r6rzv\" (UniqueName: \"kubernetes.io/projected/ee605341-c804-4b65-9f94-b0e9c77469cb-kube-api-access-r6rzv\") pod \"network-check-target-s556t\" (UID: \"ee605341-c804-4b65-9f94-b0e9c77469cb\") " pod="openshift-network-diagnostics/network-check-target-s556t" May 21 10:30:39.265340 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:39.265303 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 10:30:39.265340 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:39.265324 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 10:30:39.265340 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:39.265334 2563 projected.go:194] Error preparing data for projected volume kube-api-access-r6rzv for pod openshift-network-diagnostics/network-check-target-s556t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 10:30:39.265446 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:39.265392 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ee605341-c804-4b65-9f94-b0e9c77469cb-kube-api-access-r6rzv podName:ee605341-c804-4b65-9f94-b0e9c77469cb nodeName:}" failed. No retries permitted until 2026-05-21 10:31:11.265378691 +0000 UTC m=+66.476538784 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-r6rzv" (UniqueName: "kubernetes.io/projected/ee605341-c804-4b65-9f94-b0e9c77469cb-kube-api-access-r6rzv") pod "network-check-target-s556t" (UID: "ee605341-c804-4b65-9f94-b0e9c77469cb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 10:30:39.395855 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:39.395716 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6stbn" May 21 10:30:39.396008 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:39.395864 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6stbn" podUID="7ad7910c-8def-444e-9c74-06fe23c35ef2" May 21 10:30:39.396008 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:39.395913 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s556t" May 21 10:30:39.396008 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:39.395919 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hnvv7" May 21 10:30:39.396130 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:39.396006 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s556t" podUID="ee605341-c804-4b65-9f94-b0e9c77469cb" May 21 10:30:39.396130 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:39.396105 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hnvv7" podUID="a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f" May 21 10:30:39.668687 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:39.668602 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7ad7910c-8def-444e-9c74-06fe23c35ef2-original-pull-secret\") pod \"global-pull-secret-syncer-6stbn\" (UID: \"7ad7910c-8def-444e-9c74-06fe23c35ef2\") " pod="kube-system/global-pull-secret-syncer-6stbn" May 21 10:30:39.668868 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:39.668747 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 10:30:39.668868 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:39.668831 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ad7910c-8def-444e-9c74-06fe23c35ef2-original-pull-secret podName:7ad7910c-8def-444e-9c74-06fe23c35ef2 nodeName:}" failed. No retries permitted until 2026-05-21 10:31:11.66879999 +0000 UTC m=+66.879960088 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7ad7910c-8def-444e-9c74-06fe23c35ef2-original-pull-secret") pod "global-pull-secret-syncer-6stbn" (UID: "7ad7910c-8def-444e-9c74-06fe23c35ef2") : object "kube-system"/"original-pull-secret" not registered May 21 10:30:40.585328 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:40.585301 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-254.ec2.internal" event="NodeReady" May 21 10:30:40.585889 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:40.585844 2563 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 21 10:30:40.627616 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:40.627573 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-57bfcfdbc9-qcqrf"] May 21 10:30:40.661597 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:40.661564 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-vr89z"] May 21 10:30:40.661782 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:40.661751 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57bfcfdbc9-qcqrf" May 21 10:30:40.666872 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:40.666846 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 21 10:30:40.667014 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:40.666945 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 21 10:30:40.667073 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:40.667033 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 21 10:30:40.667350 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:40.667334 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-9spk4\"" May 21 10:30:40.675782 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:40.675756 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-57bfcfdbc9-qcqrf"] May 21 10:30:40.675782 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:40.675785 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-wk2bh"] May 21 10:30:40.675981 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:40.675930 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vr89z" May 21 10:30:40.678421 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:40.678400 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 21 10:30:40.679036 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:40.679017 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4ntqv\"" May 21 10:30:40.679545 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:40.679530 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 21 10:30:40.680093 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:40.680075 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 21 10:30:40.685954 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:40.685936 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 21 10:30:40.690198 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:40.690177 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vr89z"] May 21 10:30:40.690198 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:40.690201 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wk2bh"] May 21 10:30:40.690326 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:40.690315 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wk2bh" May 21 10:30:40.692478 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:40.692457 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 21 10:30:40.692478 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:40.692478 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 21 10:30:40.692612 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:40.692529 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-j2794\"" May 21 10:30:40.775911 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:40.775874 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bz2vt\" (UniqueName: \"kubernetes.io/projected/9e1df45f-c679-4347-b552-5d1d7a1cafb2-kube-api-access-bz2vt\") pod \"image-registry-57bfcfdbc9-qcqrf\" (UID: \"9e1df45f-c679-4347-b552-5d1d7a1cafb2\") " pod="openshift-image-registry/image-registry-57bfcfdbc9-qcqrf" May 21 10:30:40.776097 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:40.775926 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/02618313-ee56-495f-b166-884fa5528f94-tmp-dir\") pod \"dns-default-wk2bh\" (UID: \"02618313-ee56-495f-b166-884fa5528f94\") " pod="openshift-dns/dns-default-wk2bh" May 21 10:30:40.776097 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:40.775966 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9e1df45f-c679-4347-b552-5d1d7a1cafb2-ca-trust-extracted\") pod \"image-registry-57bfcfdbc9-qcqrf\" (UID: \"9e1df45f-c679-4347-b552-5d1d7a1cafb2\") " pod="openshift-image-registry/image-registry-57bfcfdbc9-qcqrf" May 21 10:30:40.776097 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:40.775994 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9e1df45f-c679-4347-b552-5d1d7a1cafb2-image-registry-private-configuration\") pod \"image-registry-57bfcfdbc9-qcqrf\" (UID: \"9e1df45f-c679-4347-b552-5d1d7a1cafb2\") " pod="openshift-image-registry/image-registry-57bfcfdbc9-qcqrf" May 21 10:30:40.776097 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:40.776021 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9e1df45f-c679-4347-b552-5d1d7a1cafb2-registry-certificates\") pod \"image-registry-57bfcfdbc9-qcqrf\" (UID: \"9e1df45f-c679-4347-b552-5d1d7a1cafb2\") " pod="openshift-image-registry/image-registry-57bfcfdbc9-qcqrf" May 21 10:30:40.776097 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:40.776045 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/02618313-ee56-495f-b166-884fa5528f94-metrics-tls\") pod \"dns-default-wk2bh\" (UID: \"02618313-ee56-495f-b166-884fa5528f94\") " pod="openshift-dns/dns-default-wk2bh" May 21 10:30:40.776097 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:40.776070 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdxhs\" (UniqueName: \"kubernetes.io/projected/02618313-ee56-495f-b166-884fa5528f94-kube-api-access-rdxhs\") pod \"dns-default-wk2bh\" (UID: \"02618313-ee56-495f-b166-884fa5528f94\") " pod="openshift-dns/dns-default-wk2bh" May 21 10:30:40.776097 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:40.776087 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e1df45f-c679-4347-b552-5d1d7a1cafb2-registry-tls\") pod \"image-registry-57bfcfdbc9-qcqrf\" (UID: \"9e1df45f-c679-4347-b552-5d1d7a1cafb2\") " pod="openshift-image-registry/image-registry-57bfcfdbc9-qcqrf" May 21 10:30:40.776097 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:40.776100 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8401ddcb-f0a7-4ca9-98f1-08bd15af8920-cert\") pod \"ingress-canary-vr89z\" (UID: \"8401ddcb-f0a7-4ca9-98f1-08bd15af8920\") " pod="openshift-ingress-canary/ingress-canary-vr89z" May 21 10:30:40.776442 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:40.776164 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9e1df45f-c679-4347-b552-5d1d7a1cafb2-installation-pull-secrets\") pod \"image-registry-57bfcfdbc9-qcqrf\" (UID: \"9e1df45f-c679-4347-b552-5d1d7a1cafb2\") " pod="openshift-image-registry/image-registry-57bfcfdbc9-qcqrf" May 21 10:30:40.776442 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:40.776216 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9e1df45f-c679-4347-b552-5d1d7a1cafb2-trusted-ca\") pod \"image-registry-57bfcfdbc9-qcqrf\" (UID: \"9e1df45f-c679-4347-b552-5d1d7a1cafb2\") " pod="openshift-image-registry/image-registry-57bfcfdbc9-qcqrf" May 21 10:30:40.776442 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:40.776236 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whs7c\" (UniqueName: \"kubernetes.io/projected/8401ddcb-f0a7-4ca9-98f1-08bd15af8920-kube-api-access-whs7c\") pod \"ingress-canary-vr89z\" (UID: \"8401ddcb-f0a7-4ca9-98f1-08bd15af8920\") " pod="openshift-ingress-canary/ingress-canary-vr89z" May 21 10:30:40.776442 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:40.776269 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/02618313-ee56-495f-b166-884fa5528f94-config-volume\") pod \"dns-default-wk2bh\" (UID: \"02618313-ee56-495f-b166-884fa5528f94\") " pod="openshift-dns/dns-default-wk2bh" May 21 10:30:40.776442 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:40.776295 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9e1df45f-c679-4347-b552-5d1d7a1cafb2-bound-sa-token\") pod \"image-registry-57bfcfdbc9-qcqrf\" (UID: \"9e1df45f-c679-4347-b552-5d1d7a1cafb2\") " pod="openshift-image-registry/image-registry-57bfcfdbc9-qcqrf" May 21 10:30:40.876942 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:40.876833 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bz2vt\" (UniqueName: \"kubernetes.io/projected/9e1df45f-c679-4347-b552-5d1d7a1cafb2-kube-api-access-bz2vt\") pod \"image-registry-57bfcfdbc9-qcqrf\" (UID: \"9e1df45f-c679-4347-b552-5d1d7a1cafb2\") " pod="openshift-image-registry/image-registry-57bfcfdbc9-qcqrf" May 21 10:30:40.876942 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:40.876899 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/02618313-ee56-495f-b166-884fa5528f94-tmp-dir\") pod \"dns-default-wk2bh\" (UID: \"02618313-ee56-495f-b166-884fa5528f94\") " pod="openshift-dns/dns-default-wk2bh" May 21 10:30:40.876942 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:40.876926 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9e1df45f-c679-4347-b552-5d1d7a1cafb2-ca-trust-extracted\") pod \"image-registry-57bfcfdbc9-qcqrf\" (UID: \"9e1df45f-c679-4347-b552-5d1d7a1cafb2\") " pod="openshift-image-registry/image-registry-57bfcfdbc9-qcqrf" May 21 10:30:40.876942 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:40.876945 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9e1df45f-c679-4347-b552-5d1d7a1cafb2-image-registry-private-configuration\") pod \"image-registry-57bfcfdbc9-qcqrf\" (UID: \"9e1df45f-c679-4347-b552-5d1d7a1cafb2\") " pod="openshift-image-registry/image-registry-57bfcfdbc9-qcqrf" May 21 10:30:40.877262 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:40.876974 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9e1df45f-c679-4347-b552-5d1d7a1cafb2-registry-certificates\") pod \"image-registry-57bfcfdbc9-qcqrf\" (UID: \"9e1df45f-c679-4347-b552-5d1d7a1cafb2\") " pod="openshift-image-registry/image-registry-57bfcfdbc9-qcqrf" May 21 10:30:40.877262 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:40.876997 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/02618313-ee56-495f-b166-884fa5528f94-metrics-tls\") pod \"dns-default-wk2bh\" (UID: \"02618313-ee56-495f-b166-884fa5528f94\") " pod="openshift-dns/dns-default-wk2bh" May 21 10:30:40.877262 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:40.877018 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rdxhs\" (UniqueName: \"kubernetes.io/projected/02618313-ee56-495f-b166-884fa5528f94-kube-api-access-rdxhs\") pod \"dns-default-wk2bh\" (UID: \"02618313-ee56-495f-b166-884fa5528f94\") " pod="openshift-dns/dns-default-wk2bh" May 21 10:30:40.877262 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:40.877046 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e1df45f-c679-4347-b552-5d1d7a1cafb2-registry-tls\") pod \"image-registry-57bfcfdbc9-qcqrf\" (UID: \"9e1df45f-c679-4347-b552-5d1d7a1cafb2\") " pod="openshift-image-registry/image-registry-57bfcfdbc9-qcqrf" May 21 10:30:40.877262 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:40.877070 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8401ddcb-f0a7-4ca9-98f1-08bd15af8920-cert\") pod \"ingress-canary-vr89z\" (UID: \"8401ddcb-f0a7-4ca9-98f1-08bd15af8920\") " pod="openshift-ingress-canary/ingress-canary-vr89z" May 21 10:30:40.877262 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:40.877095 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9e1df45f-c679-4347-b552-5d1d7a1cafb2-installation-pull-secrets\") pod \"image-registry-57bfcfdbc9-qcqrf\" (UID: \"9e1df45f-c679-4347-b552-5d1d7a1cafb2\") " pod="openshift-image-registry/image-registry-57bfcfdbc9-qcqrf" May 21 10:30:40.877262 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:40.877109 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 10:30:40.877262 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:40.877122 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9e1df45f-c679-4347-b552-5d1d7a1cafb2-trusted-ca\") pod \"image-registry-57bfcfdbc9-qcqrf\" (UID: \"9e1df45f-c679-4347-b552-5d1d7a1cafb2\") " pod="openshift-image-registry/image-registry-57bfcfdbc9-qcqrf" May 21 10:30:40.877262 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:40.877147 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-whs7c\" (UniqueName: \"kubernetes.io/projected/8401ddcb-f0a7-4ca9-98f1-08bd15af8920-kube-api-access-whs7c\") pod \"ingress-canary-vr89z\" (UID: \"8401ddcb-f0a7-4ca9-98f1-08bd15af8920\") " pod="openshift-ingress-canary/ingress-canary-vr89z" May 21 10:30:40.877262 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:40.877186 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02618313-ee56-495f-b166-884fa5528f94-metrics-tls podName:02618313-ee56-495f-b166-884fa5528f94 nodeName:}" failed. No retries permitted until 2026-05-21 10:30:41.377167182 +0000 UTC m=+36.588327295 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/02618313-ee56-495f-b166-884fa5528f94-metrics-tls") pod "dns-default-wk2bh" (UID: "02618313-ee56-495f-b166-884fa5528f94") : secret "dns-default-metrics-tls" not found May 21 10:30:40.877262 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:40.877188 2563 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 10:30:40.877262 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:40.877205 2563 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57bfcfdbc9-qcqrf: secret "image-registry-tls" not found May 21 10:30:40.877262 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:40.877230 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/02618313-ee56-495f-b166-884fa5528f94-config-volume\") pod \"dns-default-wk2bh\" (UID: \"02618313-ee56-495f-b166-884fa5528f94\") " pod="openshift-dns/dns-default-wk2bh" May 21 10:30:40.877804 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:40.877272 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9e1df45f-c679-4347-b552-5d1d7a1cafb2-bound-sa-token\") pod \"image-registry-57bfcfdbc9-qcqrf\" (UID: \"9e1df45f-c679-4347-b552-5d1d7a1cafb2\") " pod="openshift-image-registry/image-registry-57bfcfdbc9-qcqrf" May 21 10:30:40.877804 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:40.877341 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/02618313-ee56-495f-b166-884fa5528f94-tmp-dir\") pod \"dns-default-wk2bh\" (UID: \"02618313-ee56-495f-b166-884fa5528f94\") " pod="openshift-dns/dns-default-wk2bh" May 21 10:30:40.877804 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:40.877465 2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 10:30:40.877804 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:40.877524 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8401ddcb-f0a7-4ca9-98f1-08bd15af8920-cert podName:8401ddcb-f0a7-4ca9-98f1-08bd15af8920 nodeName:}" failed. No retries permitted until 2026-05-21 10:30:41.377508167 +0000 UTC m=+36.588668276 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8401ddcb-f0a7-4ca9-98f1-08bd15af8920-cert") pod "ingress-canary-vr89z" (UID: "8401ddcb-f0a7-4ca9-98f1-08bd15af8920") : secret "canary-serving-cert" not found May 21 10:30:40.877804 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:40.877551 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e1df45f-c679-4347-b552-5d1d7a1cafb2-registry-tls podName:9e1df45f-c679-4347-b552-5d1d7a1cafb2 nodeName:}" failed. No retries permitted until 2026-05-21 10:30:41.377541065 +0000 UTC m=+36.588701173 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9e1df45f-c679-4347-b552-5d1d7a1cafb2-registry-tls") pod "image-registry-57bfcfdbc9-qcqrf" (UID: "9e1df45f-c679-4347-b552-5d1d7a1cafb2") : secret "image-registry-tls" not found May 21 10:30:40.877993 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:40.877872 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/02618313-ee56-495f-b166-884fa5528f94-config-volume\") pod \"dns-default-wk2bh\" (UID: \"02618313-ee56-495f-b166-884fa5528f94\") " pod="openshift-dns/dns-default-wk2bh" May 21 10:30:40.883545 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:40.883513 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9e1df45f-c679-4347-b552-5d1d7a1cafb2-ca-trust-extracted\") pod \"image-registry-57bfcfdbc9-qcqrf\" (UID: \"9e1df45f-c679-4347-b552-5d1d7a1cafb2\") " pod="openshift-image-registry/image-registry-57bfcfdbc9-qcqrf" May 21 10:30:40.883809 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:40.883789 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9e1df45f-c679-4347-b552-5d1d7a1cafb2-registry-certificates\") pod \"image-registry-57bfcfdbc9-qcqrf\" (UID: \"9e1df45f-c679-4347-b552-5d1d7a1cafb2\") " pod="openshift-image-registry/image-registry-57bfcfdbc9-qcqrf" May 21 10:30:40.883903 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:40.883870 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9e1df45f-c679-4347-b552-5d1d7a1cafb2-image-registry-private-configuration\") pod \"image-registry-57bfcfdbc9-qcqrf\" (UID: \"9e1df45f-c679-4347-b552-5d1d7a1cafb2\") " pod="openshift-image-registry/image-registry-57bfcfdbc9-qcqrf" May 21 10:30:40.884034 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:40.884015 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9e1df45f-c679-4347-b552-5d1d7a1cafb2-trusted-ca\") pod \"image-registry-57bfcfdbc9-qcqrf\" (UID: \"9e1df45f-c679-4347-b552-5d1d7a1cafb2\") " pod="openshift-image-registry/image-registry-57bfcfdbc9-qcqrf" May 21 10:30:40.886421 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:40.886394 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9e1df45f-c679-4347-b552-5d1d7a1cafb2-installation-pull-secrets\") pod \"image-registry-57bfcfdbc9-qcqrf\" (UID: \"9e1df45f-c679-4347-b552-5d1d7a1cafb2\") " pod="openshift-image-registry/image-registry-57bfcfdbc9-qcqrf" May 21 10:30:40.887319 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:40.887285 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdxhs\" (UniqueName: \"kubernetes.io/projected/02618313-ee56-495f-b166-884fa5528f94-kube-api-access-rdxhs\") pod \"dns-default-wk2bh\" (UID: \"02618313-ee56-495f-b166-884fa5528f94\") " pod="openshift-dns/dns-default-wk2bh" May 21 10:30:40.887423 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:40.887348 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-whs7c\" (UniqueName: \"kubernetes.io/projected/8401ddcb-f0a7-4ca9-98f1-08bd15af8920-kube-api-access-whs7c\") pod \"ingress-canary-vr89z\" (UID: \"8401ddcb-f0a7-4ca9-98f1-08bd15af8920\") " pod="openshift-ingress-canary/ingress-canary-vr89z" May 21 10:30:40.887488 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:40.887421 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9e1df45f-c679-4347-b552-5d1d7a1cafb2-bound-sa-token\") pod \"image-registry-57bfcfdbc9-qcqrf\" (UID: \"9e1df45f-c679-4347-b552-5d1d7a1cafb2\") " pod="openshift-image-registry/image-registry-57bfcfdbc9-qcqrf" May 21 10:30:40.887692 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:40.887672 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bz2vt\" (UniqueName: \"kubernetes.io/projected/9e1df45f-c679-4347-b552-5d1d7a1cafb2-kube-api-access-bz2vt\") pod \"image-registry-57bfcfdbc9-qcqrf\" (UID: \"9e1df45f-c679-4347-b552-5d1d7a1cafb2\") " pod="openshift-image-registry/image-registry-57bfcfdbc9-qcqrf" May 21 10:30:41.382230 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:41.382039 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/02618313-ee56-495f-b166-884fa5528f94-metrics-tls\") pod \"dns-default-wk2bh\" (UID: \"02618313-ee56-495f-b166-884fa5528f94\") " pod="openshift-dns/dns-default-wk2bh" May 21 10:30:41.382392 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:41.382245 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e1df45f-c679-4347-b552-5d1d7a1cafb2-registry-tls\") pod \"image-registry-57bfcfdbc9-qcqrf\" (UID: \"9e1df45f-c679-4347-b552-5d1d7a1cafb2\") " pod="openshift-image-registry/image-registry-57bfcfdbc9-qcqrf" May 21 10:30:41.382392 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:41.382263 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8401ddcb-f0a7-4ca9-98f1-08bd15af8920-cert\") pod \"ingress-canary-vr89z\" (UID: \"8401ddcb-f0a7-4ca9-98f1-08bd15af8920\") " pod="openshift-ingress-canary/ingress-canary-vr89z" May 21 10:30:41.382392 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:41.382187 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 10:30:41.382392 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:41.382364 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02618313-ee56-495f-b166-884fa5528f94-metrics-tls podName:02618313-ee56-495f-b166-884fa5528f94 nodeName:}" failed. No retries permitted until 2026-05-21 10:30:42.382349251 +0000 UTC m=+37.593509347 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/02618313-ee56-495f-b166-884fa5528f94-metrics-tls") pod "dns-default-wk2bh" (UID: "02618313-ee56-495f-b166-884fa5528f94") : secret "dns-default-metrics-tls" not found May 21 10:30:41.382392 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:41.382379 2563 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 10:30:41.382583 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:41.382399 2563 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57bfcfdbc9-qcqrf: secret "image-registry-tls" not found May 21 10:30:41.382583 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:41.382410 2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 10:30:41.382583 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:41.382453 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e1df45f-c679-4347-b552-5d1d7a1cafb2-registry-tls podName:9e1df45f-c679-4347-b552-5d1d7a1cafb2 nodeName:}" failed. No retries permitted until 2026-05-21 10:30:42.382439604 +0000 UTC m=+37.593599701 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9e1df45f-c679-4347-b552-5d1d7a1cafb2-registry-tls") pod "image-registry-57bfcfdbc9-qcqrf" (UID: "9e1df45f-c679-4347-b552-5d1d7a1cafb2") : secret "image-registry-tls" not found May 21 10:30:41.382583 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:41.382465 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8401ddcb-f0a7-4ca9-98f1-08bd15af8920-cert podName:8401ddcb-f0a7-4ca9-98f1-08bd15af8920 nodeName:}" failed. No retries permitted until 2026-05-21 10:30:42.38245961 +0000 UTC m=+37.593619702 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8401ddcb-f0a7-4ca9-98f1-08bd15af8920-cert") pod "ingress-canary-vr89z" (UID: "8401ddcb-f0a7-4ca9-98f1-08bd15af8920") : secret "canary-serving-cert" not found May 21 10:30:41.396316 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:41.396282 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s556t" May 21 10:30:41.396440 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:41.396400 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6stbn" May 21 10:30:41.396440 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:41.396427 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hnvv7" May 21 10:30:41.399103 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:41.399082 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 21 10:30:41.399231 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:41.399190 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5vwxr\"" May 21 10:30:41.399381 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:41.399364 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 21 10:30:41.399506 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:41.399488 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 21 10:30:41.399761 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:41.399742 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hwkcp\"" May 21 10:30:41.400054 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:41.400036 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 21 10:30:42.389155 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:42.389112 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/02618313-ee56-495f-b166-884fa5528f94-metrics-tls\") pod \"dns-default-wk2bh\" (UID: \"02618313-ee56-495f-b166-884fa5528f94\") " pod="openshift-dns/dns-default-wk2bh" May 21 10:30:42.389549 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:42.389157 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e1df45f-c679-4347-b552-5d1d7a1cafb2-registry-tls\") pod \"image-registry-57bfcfdbc9-qcqrf\" (UID: \"9e1df45f-c679-4347-b552-5d1d7a1cafb2\") " pod="openshift-image-registry/image-registry-57bfcfdbc9-qcqrf" May 21 10:30:42.389549 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:42.389194 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8401ddcb-f0a7-4ca9-98f1-08bd15af8920-cert\") pod \"ingress-canary-vr89z\" (UID: \"8401ddcb-f0a7-4ca9-98f1-08bd15af8920\") " pod="openshift-ingress-canary/ingress-canary-vr89z" May 21 10:30:42.389549 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:42.389267 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 10:30:42.389549 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:42.389275 2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 10:30:42.389549 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:42.389325 2563 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 10:30:42.389549 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:42.389346 2563 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57bfcfdbc9-qcqrf: secret "image-registry-tls" not found May 21 10:30:42.389549 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:42.389338 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8401ddcb-f0a7-4ca9-98f1-08bd15af8920-cert podName:8401ddcb-f0a7-4ca9-98f1-08bd15af8920 nodeName:}" failed. No retries permitted until 2026-05-21 10:30:44.389319636 +0000 UTC m=+39.600479736 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8401ddcb-f0a7-4ca9-98f1-08bd15af8920-cert") pod "ingress-canary-vr89z" (UID: "8401ddcb-f0a7-4ca9-98f1-08bd15af8920") : secret "canary-serving-cert" not found May 21 10:30:42.389549 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:42.389398 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02618313-ee56-495f-b166-884fa5528f94-metrics-tls podName:02618313-ee56-495f-b166-884fa5528f94 nodeName:}" failed. No retries permitted until 2026-05-21 10:30:44.389384939 +0000 UTC m=+39.600545032 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/02618313-ee56-495f-b166-884fa5528f94-metrics-tls") pod "dns-default-wk2bh" (UID: "02618313-ee56-495f-b166-884fa5528f94") : secret "dns-default-metrics-tls" not found May 21 10:30:42.389549 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:42.389408 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e1df45f-c679-4347-b552-5d1d7a1cafb2-registry-tls podName:9e1df45f-c679-4347-b552-5d1d7a1cafb2 nodeName:}" failed. No retries permitted until 2026-05-21 10:30:44.38940234 +0000 UTC m=+39.600562433 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9e1df45f-c679-4347-b552-5d1d7a1cafb2-registry-tls") pod "image-registry-57bfcfdbc9-qcqrf" (UID: "9e1df45f-c679-4347-b552-5d1d7a1cafb2") : secret "image-registry-tls" not found May 21 10:30:44.405268 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:44.405232 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/02618313-ee56-495f-b166-884fa5528f94-metrics-tls\") pod \"dns-default-wk2bh\" (UID: \"02618313-ee56-495f-b166-884fa5528f94\") " pod="openshift-dns/dns-default-wk2bh" May 21 10:30:44.405721 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:44.405287 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e1df45f-c679-4347-b552-5d1d7a1cafb2-registry-tls\") pod \"image-registry-57bfcfdbc9-qcqrf\" (UID: \"9e1df45f-c679-4347-b552-5d1d7a1cafb2\") " pod="openshift-image-registry/image-registry-57bfcfdbc9-qcqrf" May 21 10:30:44.405721 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:44.405314 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8401ddcb-f0a7-4ca9-98f1-08bd15af8920-cert\") pod \"ingress-canary-vr89z\" (UID: \"8401ddcb-f0a7-4ca9-98f1-08bd15af8920\") " pod="openshift-ingress-canary/ingress-canary-vr89z" May 21 10:30:44.405721 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:44.405407 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 10:30:44.405721 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:44.405477 2563 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 10:30:44.405721 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:44.405485 2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 10:30:44.405721 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:44.405499 2563 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57bfcfdbc9-qcqrf: secret "image-registry-tls" not found May 21 10:30:44.405721 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:44.405485 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02618313-ee56-495f-b166-884fa5528f94-metrics-tls podName:02618313-ee56-495f-b166-884fa5528f94 nodeName:}" failed. No retries permitted until 2026-05-21 10:30:48.405464534 +0000 UTC m=+43.616624643 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/02618313-ee56-495f-b166-884fa5528f94-metrics-tls") pod "dns-default-wk2bh" (UID: "02618313-ee56-495f-b166-884fa5528f94") : secret "dns-default-metrics-tls" not found May 21 10:30:44.405721 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:44.405555 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8401ddcb-f0a7-4ca9-98f1-08bd15af8920-cert podName:8401ddcb-f0a7-4ca9-98f1-08bd15af8920 nodeName:}" failed. No retries permitted until 2026-05-21 10:30:48.405543615 +0000 UTC m=+43.616703710 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8401ddcb-f0a7-4ca9-98f1-08bd15af8920-cert") pod "ingress-canary-vr89z" (UID: "8401ddcb-f0a7-4ca9-98f1-08bd15af8920") : secret "canary-serving-cert" not found May 21 10:30:44.405721 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:44.405571 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e1df45f-c679-4347-b552-5d1d7a1cafb2-registry-tls podName:9e1df45f-c679-4347-b552-5d1d7a1cafb2 nodeName:}" failed. No retries permitted until 2026-05-21 10:30:48.405565908 +0000 UTC m=+43.616726001 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9e1df45f-c679-4347-b552-5d1d7a1cafb2-registry-tls") pod "image-registry-57bfcfdbc9-qcqrf" (UID: "9e1df45f-c679-4347-b552-5d1d7a1cafb2") : secret "image-registry-tls" not found May 21 10:30:45.539945 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:45.539864 2563 generic.go:358] "Generic (PLEG): container finished" podID="da312e42-a265-4201-9a40-29d1d16a9815" containerID="bfc419d17cef359b60feabea2fc85de95a1fd2db8134f00d42b7075056845244" exitCode=0 May 21 10:30:45.539945 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:45.539905 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b6m2m" event={"ID":"da312e42-a265-4201-9a40-29d1d16a9815","Type":"ContainerDied","Data":"bfc419d17cef359b60feabea2fc85de95a1fd2db8134f00d42b7075056845244"} May 21 10:30:46.544380 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:46.544344 2563 generic.go:358] "Generic (PLEG): container finished" podID="da312e42-a265-4201-9a40-29d1d16a9815" containerID="0f2b5d53010d89ceebb8cbc51bc397f0ad8f9d6960c8674a9408c14381b0ec8b" exitCode=0 May 21 10:30:46.544735 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:46.544392 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b6m2m" event={"ID":"da312e42-a265-4201-9a40-29d1d16a9815","Type":"ContainerDied","Data":"0f2b5d53010d89ceebb8cbc51bc397f0ad8f9d6960c8674a9408c14381b0ec8b"} May 21 10:30:47.548644 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:47.548612 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b6m2m" event={"ID":"da312e42-a265-4201-9a40-29d1d16a9815","Type":"ContainerStarted","Data":"8210fc531e3322781d8430552077d07a6e5ece0f6b203ac3662506b08e88bee4"} May 21 10:30:47.576418 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:47.576372 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-b6m2m" podStartSLOduration=5.720223137 podStartE2EDuration="42.576359614s" podCreationTimestamp="2026-05-21 10:30:05 +0000 UTC" firstStartedPulling="2026-05-21 10:30:08.140698297 +0000 UTC m=+3.351858406" lastFinishedPulling="2026-05-21 10:30:44.996834789 +0000 UTC m=+40.207994883" observedRunningTime="2026-05-21 10:30:47.575344967 +0000 UTC m=+42.786505081" watchObservedRunningTime="2026-05-21 10:30:47.576359614 +0000 UTC m=+42.787519745" May 21 10:30:48.436905 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:48.436865 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/02618313-ee56-495f-b166-884fa5528f94-metrics-tls\") pod \"dns-default-wk2bh\" (UID: \"02618313-ee56-495f-b166-884fa5528f94\") " pod="openshift-dns/dns-default-wk2bh" May 21 10:30:48.436905 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:48.436909 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e1df45f-c679-4347-b552-5d1d7a1cafb2-registry-tls\") pod \"image-registry-57bfcfdbc9-qcqrf\" (UID: \"9e1df45f-c679-4347-b552-5d1d7a1cafb2\") " pod="openshift-image-registry/image-registry-57bfcfdbc9-qcqrf" May 21 10:30:48.437109 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:48.436928 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8401ddcb-f0a7-4ca9-98f1-08bd15af8920-cert\") pod \"ingress-canary-vr89z\" (UID: \"8401ddcb-f0a7-4ca9-98f1-08bd15af8920\") " pod="openshift-ingress-canary/ingress-canary-vr89z" May 21 10:30:48.437109 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:48.437022 2563 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 10:30:48.437109 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:48.437040 2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 10:30:48.437109 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:48.437048 2563 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57bfcfdbc9-qcqrf: secret "image-registry-tls" not found May 21 10:30:48.437109 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:48.437020 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 10:30:48.437109 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:48.437100 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e1df45f-c679-4347-b552-5d1d7a1cafb2-registry-tls podName:9e1df45f-c679-4347-b552-5d1d7a1cafb2 nodeName:}" failed. No retries permitted until 2026-05-21 10:30:56.43708418 +0000 UTC m=+51.648244274 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9e1df45f-c679-4347-b552-5d1d7a1cafb2-registry-tls") pod "image-registry-57bfcfdbc9-qcqrf" (UID: "9e1df45f-c679-4347-b552-5d1d7a1cafb2") : secret "image-registry-tls" not found May 21 10:30:48.437285 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:48.437123 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8401ddcb-f0a7-4ca9-98f1-08bd15af8920-cert podName:8401ddcb-f0a7-4ca9-98f1-08bd15af8920 nodeName:}" failed. No retries permitted until 2026-05-21 10:30:56.437106703 +0000 UTC m=+51.648266795 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8401ddcb-f0a7-4ca9-98f1-08bd15af8920-cert") pod "ingress-canary-vr89z" (UID: "8401ddcb-f0a7-4ca9-98f1-08bd15af8920") : secret "canary-serving-cert" not found May 21 10:30:48.437285 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:48.437133 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02618313-ee56-495f-b166-884fa5528f94-metrics-tls podName:02618313-ee56-495f-b166-884fa5528f94 nodeName:}" failed. No retries permitted until 2026-05-21 10:30:56.437128074 +0000 UTC m=+51.648288166 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/02618313-ee56-495f-b166-884fa5528f94-metrics-tls") pod "dns-default-wk2bh" (UID: "02618313-ee56-495f-b166-884fa5528f94") : secret "dns-default-metrics-tls" not found May 21 10:30:56.494437 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:56.494393 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/02618313-ee56-495f-b166-884fa5528f94-metrics-tls\") pod \"dns-default-wk2bh\" (UID: \"02618313-ee56-495f-b166-884fa5528f94\") " pod="openshift-dns/dns-default-wk2bh" May 21 10:30:56.494437 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:56.494439 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e1df45f-c679-4347-b552-5d1d7a1cafb2-registry-tls\") pod \"image-registry-57bfcfdbc9-qcqrf\" (UID: \"9e1df45f-c679-4347-b552-5d1d7a1cafb2\") " pod="openshift-image-registry/image-registry-57bfcfdbc9-qcqrf" May 21 10:30:56.495091 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:30:56.494458 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8401ddcb-f0a7-4ca9-98f1-08bd15af8920-cert\") pod \"ingress-canary-vr89z\" (UID: \"8401ddcb-f0a7-4ca9-98f1-08bd15af8920\") " pod="openshift-ingress-canary/ingress-canary-vr89z" May 21 10:30:56.495091 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:56.494548 2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 10:30:56.495091 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:56.494551 2563 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 10:30:56.495091 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:56.494570 2563 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57bfcfdbc9-qcqrf: secret "image-registry-tls" not found May 21 10:30:56.495091 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:56.494548 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 10:30:56.495091 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:56.494603 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8401ddcb-f0a7-4ca9-98f1-08bd15af8920-cert podName:8401ddcb-f0a7-4ca9-98f1-08bd15af8920 nodeName:}" failed. No retries permitted until 2026-05-21 10:31:12.494589455 +0000 UTC m=+67.705749551 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8401ddcb-f0a7-4ca9-98f1-08bd15af8920-cert") pod "ingress-canary-vr89z" (UID: "8401ddcb-f0a7-4ca9-98f1-08bd15af8920") : secret "canary-serving-cert" not found May 21 10:30:56.495091 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:56.494661 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e1df45f-c679-4347-b552-5d1d7a1cafb2-registry-tls podName:9e1df45f-c679-4347-b552-5d1d7a1cafb2 nodeName:}" failed. No retries permitted until 2026-05-21 10:31:12.49463831 +0000 UTC m=+67.705798404 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9e1df45f-c679-4347-b552-5d1d7a1cafb2-registry-tls") pod "image-registry-57bfcfdbc9-qcqrf" (UID: "9e1df45f-c679-4347-b552-5d1d7a1cafb2") : secret "image-registry-tls" not found May 21 10:30:56.495091 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:30:56.494674 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02618313-ee56-495f-b166-884fa5528f94-metrics-tls podName:02618313-ee56-495f-b166-884fa5528f94 nodeName:}" failed. No retries permitted until 2026-05-21 10:31:12.494667918 +0000 UTC m=+67.705828011 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/02618313-ee56-495f-b166-884fa5528f94-metrics-tls") pod "dns-default-wk2bh" (UID: "02618313-ee56-495f-b166-884fa5528f94") : secret "dns-default-metrics-tls" not found May 21 10:31:04.523957 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:31:04.523928 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jmp49" May 21 10:31:11.099067 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:31:11.099007 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f-metrics-certs\") pod \"network-metrics-daemon-hnvv7\" (UID: \"a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f\") " pod="openshift-multus/network-metrics-daemon-hnvv7" May 21 10:31:11.101766 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:31:11.101745 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 21 10:31:11.110094 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:31:11.110078 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 21 10:31:11.110171 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:31:11.110138 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f-metrics-certs podName:a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f nodeName:}" failed. No retries permitted until 2026-05-21 10:32:15.110124552 +0000 UTC m=+130.321284646 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f-metrics-certs") pod "network-metrics-daemon-hnvv7" (UID: "a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f") : secret "metrics-daemon-secret" not found May 21 10:31:11.300952 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:31:11.300907 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r6rzv\" (UniqueName: \"kubernetes.io/projected/ee605341-c804-4b65-9f94-b0e9c77469cb-kube-api-access-r6rzv\") pod \"network-check-target-s556t\" (UID: \"ee605341-c804-4b65-9f94-b0e9c77469cb\") " pod="openshift-network-diagnostics/network-check-target-s556t" May 21 10:31:11.303436 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:31:11.303414 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 21 10:31:11.313608 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:31:11.313583 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 21 10:31:11.324742 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:31:11.324719 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6rzv\" (UniqueName: \"kubernetes.io/projected/ee605341-c804-4b65-9f94-b0e9c77469cb-kube-api-access-r6rzv\") pod \"network-check-target-s556t\" (UID: \"ee605341-c804-4b65-9f94-b0e9c77469cb\") " pod="openshift-network-diagnostics/network-check-target-s556t" May 21 10:31:11.410097 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:31:11.410030 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5vwxr\"" May 21 10:31:11.418257 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:31:11.418236 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s556t" May 21 10:31:11.565575 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:31:11.565543 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-s556t"] May 21 10:31:11.569234 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:31:11.569200 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee605341_c804_4b65_9f94_b0e9c77469cb.slice/crio-46e65575da71ea94f64e156a0d5ac002c87dfa495569dc7fbf49865d8904674f WatchSource:0}: Error finding container 46e65575da71ea94f64e156a0d5ac002c87dfa495569dc7fbf49865d8904674f: Status 404 returned error can't find the container with id 46e65575da71ea94f64e156a0d5ac002c87dfa495569dc7fbf49865d8904674f May 21 10:31:11.592635 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:31:11.592603 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-s556t" event={"ID":"ee605341-c804-4b65-9f94-b0e9c77469cb","Type":"ContainerStarted","Data":"46e65575da71ea94f64e156a0d5ac002c87dfa495569dc7fbf49865d8904674f"} May 21 10:31:11.704528 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:31:11.704424 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7ad7910c-8def-444e-9c74-06fe23c35ef2-original-pull-secret\") pod \"global-pull-secret-syncer-6stbn\" (UID: \"7ad7910c-8def-444e-9c74-06fe23c35ef2\") " pod="kube-system/global-pull-secret-syncer-6stbn" May 21 10:31:11.706918 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:31:11.706900 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 21 10:31:11.717332 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:31:11.717314 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7ad7910c-8def-444e-9c74-06fe23c35ef2-original-pull-secret\") pod \"global-pull-secret-syncer-6stbn\" (UID: \"7ad7910c-8def-444e-9c74-06fe23c35ef2\") " pod="kube-system/global-pull-secret-syncer-6stbn" May 21 10:31:12.013450 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:31:12.013361 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6stbn" May 21 10:31:12.131583 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:31:12.131554 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6stbn"] May 21 10:31:12.134515 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:31:12.134491 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ad7910c_8def_444e_9c74_06fe23c35ef2.slice/crio-77d92614a8dbcf12c19eb8bc56a4ca6bff5c992ee1751929d101c4196d44b7ec WatchSource:0}: Error finding container 77d92614a8dbcf12c19eb8bc56a4ca6bff5c992ee1751929d101c4196d44b7ec: Status 404 returned error can't find the container with id 77d92614a8dbcf12c19eb8bc56a4ca6bff5c992ee1751929d101c4196d44b7ec May 21 10:31:12.511585 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:31:12.511552 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/02618313-ee56-495f-b166-884fa5528f94-metrics-tls\") pod \"dns-default-wk2bh\" (UID: \"02618313-ee56-495f-b166-884fa5528f94\") " pod="openshift-dns/dns-default-wk2bh" May 21 10:31:12.511769 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:31:12.511596 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e1df45f-c679-4347-b552-5d1d7a1cafb2-registry-tls\") pod \"image-registry-57bfcfdbc9-qcqrf\" (UID: \"9e1df45f-c679-4347-b552-5d1d7a1cafb2\") " pod="openshift-image-registry/image-registry-57bfcfdbc9-qcqrf" May 21 10:31:12.511769 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:31:12.511625 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8401ddcb-f0a7-4ca9-98f1-08bd15af8920-cert\") pod \"ingress-canary-vr89z\" (UID: \"8401ddcb-f0a7-4ca9-98f1-08bd15af8920\") " pod="openshift-ingress-canary/ingress-canary-vr89z" May 21 10:31:12.511769 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:31:12.511736 2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 10:31:12.511956 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:31:12.511810 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8401ddcb-f0a7-4ca9-98f1-08bd15af8920-cert podName:8401ddcb-f0a7-4ca9-98f1-08bd15af8920 nodeName:}" failed. No retries permitted until 2026-05-21 10:31:44.511790748 +0000 UTC m=+99.722950860 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8401ddcb-f0a7-4ca9-98f1-08bd15af8920-cert") pod "ingress-canary-vr89z" (UID: "8401ddcb-f0a7-4ca9-98f1-08bd15af8920") : secret "canary-serving-cert" not found May 21 10:31:12.512160 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:31:12.512131 2563 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 10:31:12.512160 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:31:12.512143 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 10:31:12.512160 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:31:12.512156 2563 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57bfcfdbc9-qcqrf: secret "image-registry-tls" not found May 21 10:31:12.512392 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:31:12.512216 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02618313-ee56-495f-b166-884fa5528f94-metrics-tls podName:02618313-ee56-495f-b166-884fa5528f94 nodeName:}" failed. No retries permitted until 2026-05-21 10:31:44.512198762 +0000 UTC m=+99.723358857 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/02618313-ee56-495f-b166-884fa5528f94-metrics-tls") pod "dns-default-wk2bh" (UID: "02618313-ee56-495f-b166-884fa5528f94") : secret "dns-default-metrics-tls" not found May 21 10:31:12.512392 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:31:12.512238 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e1df45f-c679-4347-b552-5d1d7a1cafb2-registry-tls podName:9e1df45f-c679-4347-b552-5d1d7a1cafb2 nodeName:}" failed. No retries permitted until 2026-05-21 10:31:44.512226993 +0000 UTC m=+99.723387092 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9e1df45f-c679-4347-b552-5d1d7a1cafb2-registry-tls") pod "image-registry-57bfcfdbc9-qcqrf" (UID: "9e1df45f-c679-4347-b552-5d1d7a1cafb2") : secret "image-registry-tls" not found May 21 10:31:12.595279 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:31:12.595240 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6stbn" event={"ID":"7ad7910c-8def-444e-9c74-06fe23c35ef2","Type":"ContainerStarted","Data":"77d92614a8dbcf12c19eb8bc56a4ca6bff5c992ee1751929d101c4196d44b7ec"} May 21 10:31:17.606494 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:31:17.606457 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-s556t" event={"ID":"ee605341-c804-4b65-9f94-b0e9c77469cb","Type":"ContainerStarted","Data":"caedd5b3da8a2ae7f3fd3dbab10a41adaa6e28000fd65309fe464a1b4e838486"} May 21 10:31:17.606949 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:31:17.606560 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-s556t" May 21 10:31:17.607873 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:31:17.607853 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6stbn" event={"ID":"7ad7910c-8def-444e-9c74-06fe23c35ef2","Type":"ContainerStarted","Data":"c292bc1c978f3837dcacab8c49f8d2b826b79eaec70a20a0f3051fa49441a856"} May 21 10:31:17.625500 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:31:17.625394 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-s556t" podStartSLOduration=66.912135951 podStartE2EDuration="1m12.62538133s" podCreationTimestamp="2026-05-21 10:30:05 +0000 UTC" firstStartedPulling="2026-05-21 10:31:11.571435417 +0000 UTC m=+66.782595510" lastFinishedPulling="2026-05-21 10:31:17.284680794 +0000 UTC m=+72.495840889" observedRunningTime="2026-05-21 10:31:17.625270808 +0000 UTC m=+72.836430924" watchObservedRunningTime="2026-05-21 10:31:17.62538133 +0000 UTC m=+72.836541443" May 21 10:31:17.640867 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:31:17.640785 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6stbn" podStartSLOduration=65.481543555 podStartE2EDuration="1m10.640774644s" podCreationTimestamp="2026-05-21 10:30:07 +0000 UTC" firstStartedPulling="2026-05-21 10:31:12.136209388 +0000 UTC m=+67.347369481" lastFinishedPulling="2026-05-21 10:31:17.295440475 +0000 UTC m=+72.506600570" observedRunningTime="2026-05-21 10:31:17.640044355 +0000 UTC m=+72.851204471" watchObservedRunningTime="2026-05-21 10:31:17.640774644 +0000 UTC m=+72.851934760" May 21 10:31:44.546577 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:31:44.546538 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/02618313-ee56-495f-b166-884fa5528f94-metrics-tls\") pod \"dns-default-wk2bh\" (UID: \"02618313-ee56-495f-b166-884fa5528f94\") " pod="openshift-dns/dns-default-wk2bh" May 21 10:31:44.546577 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:31:44.546580 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e1df45f-c679-4347-b552-5d1d7a1cafb2-registry-tls\") pod \"image-registry-57bfcfdbc9-qcqrf\" (UID: \"9e1df45f-c679-4347-b552-5d1d7a1cafb2\") " pod="openshift-image-registry/image-registry-57bfcfdbc9-qcqrf" May 21 10:31:44.547060 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:31:44.546599 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8401ddcb-f0a7-4ca9-98f1-08bd15af8920-cert\") pod \"ingress-canary-vr89z\" (UID: \"8401ddcb-f0a7-4ca9-98f1-08bd15af8920\") " pod="openshift-ingress-canary/ingress-canary-vr89z" May 21 10:31:44.547060 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:31:44.546689 2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 10:31:44.547060 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:31:44.546698 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 10:31:44.547060 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:31:44.546738 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8401ddcb-f0a7-4ca9-98f1-08bd15af8920-cert podName:8401ddcb-f0a7-4ca9-98f1-08bd15af8920 nodeName:}" failed. No retries permitted until 2026-05-21 10:32:48.546725545 +0000 UTC m=+163.757885644 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8401ddcb-f0a7-4ca9-98f1-08bd15af8920-cert") pod "ingress-canary-vr89z" (UID: "8401ddcb-f0a7-4ca9-98f1-08bd15af8920") : secret "canary-serving-cert" not found May 21 10:31:44.547060 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:31:44.546770 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02618313-ee56-495f-b166-884fa5528f94-metrics-tls podName:02618313-ee56-495f-b166-884fa5528f94 nodeName:}" failed. No retries permitted until 2026-05-21 10:32:48.546756202 +0000 UTC m=+163.757916295 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/02618313-ee56-495f-b166-884fa5528f94-metrics-tls") pod "dns-default-wk2bh" (UID: "02618313-ee56-495f-b166-884fa5528f94") : secret "dns-default-metrics-tls" not found May 21 10:31:44.547060 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:31:44.546701 2563 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 10:31:44.547060 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:31:44.546790 2563 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57bfcfdbc9-qcqrf: secret "image-registry-tls" not found May 21 10:31:44.547060 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:31:44.546844 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e1df45f-c679-4347-b552-5d1d7a1cafb2-registry-tls podName:9e1df45f-c679-4347-b552-5d1d7a1cafb2 nodeName:}" failed. No retries permitted until 2026-05-21 10:32:48.546835828 +0000 UTC m=+163.757995920 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9e1df45f-c679-4347-b552-5d1d7a1cafb2-registry-tls") pod "image-registry-57bfcfdbc9-qcqrf" (UID: "9e1df45f-c679-4347-b552-5d1d7a1cafb2") : secret "image-registry-tls" not found May 21 10:31:48.612428 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:31:48.612395 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-s556t" May 21 10:32:15.159960 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:15.159917 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f-metrics-certs\") pod \"network-metrics-daemon-hnvv7\" (UID: \"a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f\") " pod="openshift-multus/network-metrics-daemon-hnvv7" May 21 10:32:15.160449 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:32:15.160045 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 21 10:32:15.160449 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:32:15.160102 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f-metrics-certs podName:a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f nodeName:}" failed. No retries permitted until 2026-05-21 10:34:17.160087134 +0000 UTC m=+252.371247232 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f-metrics-certs") pod "network-metrics-daemon-hnvv7" (UID: "a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f") : secret "metrics-daemon-secret" not found May 21 10:32:30.409979 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.409940 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-dfjr4"] May 21 10:32:30.424473 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.424442 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-v6dl9"] May 21 10:32:30.424626 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.424607 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-dfjr4" May 21 10:32:30.427974 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.427955 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-z7wqv"] May 21 10:32:30.428094 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.428080 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-v6dl9" May 21 10:32:30.428788 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.428770 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" May 21 10:32:30.429719 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.429684 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" May 21 10:32:30.430585 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.430566 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-z7wqv" May 21 10:32:30.433420 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.433398 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" May 21 10:32:30.433544 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.433506 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" May 21 10:32:30.433659 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.433514 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-qpgg7\"" May 21 10:32:30.433659 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.433605 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" May 21 10:32:30.434239 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.434205 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" May 21 10:32:30.434335 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.434303 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" May 21 10:32:30.434335 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.434306 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 21 10:32:30.434698 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.434536 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" May 21 10:32:30.434698 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.434582 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 21 10:32:30.434698 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.434650 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-p8682\"" May 21 10:32:30.434921 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.434729 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-66lwl\"" May 21 10:32:30.436786 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.435444 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" May 21 10:32:30.437164 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.437141 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-dfjr4"] May 21 10:32:30.443367 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.443348 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" May 21 10:32:30.443565 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.443545 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" May 21 10:32:30.447157 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.447136 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-v6dl9"] May 21 10:32:30.448445 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.448425 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-z7wqv"] May 21 10:32:30.466205 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.466182 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ab74c7ba-ea27-43e2-924e-aa819aee1362-serving-cert\") pod \"console-operator-76dff48d59-dfjr4\" (UID: \"ab74c7ba-ea27-43e2-924e-aa819aee1362\") " pod="openshift-console-operator/console-operator-76dff48d59-dfjr4" May 21 10:32:30.466336 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.466227 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ab74c7ba-ea27-43e2-924e-aa819aee1362-trusted-ca\") pod \"console-operator-76dff48d59-dfjr4\" (UID: \"ab74c7ba-ea27-43e2-924e-aa819aee1362\") " pod="openshift-console-operator/console-operator-76dff48d59-dfjr4" May 21 10:32:30.466336 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.466254 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkwlz\" (UniqueName: \"kubernetes.io/projected/ab74c7ba-ea27-43e2-924e-aa819aee1362-kube-api-access-lkwlz\") pod \"console-operator-76dff48d59-dfjr4\" (UID: \"ab74c7ba-ea27-43e2-924e-aa819aee1362\") " pod="openshift-console-operator/console-operator-76dff48d59-dfjr4" May 21 10:32:30.466336 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.466299 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a2bbdf6-2335-4148-98db-ff7687939b56-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-v6dl9\" (UID: \"2a2bbdf6-2335-4148-98db-ff7687939b56\") " pod="openshift-insights/insights-operator-78bdfb888c-v6dl9" May 21 10:32:30.466336 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.466326 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2a2bbdf6-2335-4148-98db-ff7687939b56-snapshots\") pod \"insights-operator-78bdfb888c-v6dl9\" (UID: \"2a2bbdf6-2335-4148-98db-ff7687939b56\") " pod="openshift-insights/insights-operator-78bdfb888c-v6dl9" May 21 10:32:30.466505 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.466350 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kk89n\" (UniqueName: \"kubernetes.io/projected/a6f68182-444e-47dc-8fec-5099dcf6df09-kube-api-access-kk89n\") pod \"cluster-samples-operator-697587599-z7wqv\" (UID: \"a6f68182-444e-47dc-8fec-5099dcf6df09\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-z7wqv" May 21 10:32:30.466505 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.466378 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c54cd\" (UniqueName: \"kubernetes.io/projected/2a2bbdf6-2335-4148-98db-ff7687939b56-kube-api-access-c54cd\") pod \"insights-operator-78bdfb888c-v6dl9\" (UID: \"2a2bbdf6-2335-4148-98db-ff7687939b56\") " pod="openshift-insights/insights-operator-78bdfb888c-v6dl9" May 21 10:32:30.466505 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.466401 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a6f68182-444e-47dc-8fec-5099dcf6df09-samples-operator-tls\") pod \"cluster-samples-operator-697587599-z7wqv\" (UID: \"a6f68182-444e-47dc-8fec-5099dcf6df09\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-z7wqv" May 21 10:32:30.466505 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.466459 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ab74c7ba-ea27-43e2-924e-aa819aee1362-config\") pod \"console-operator-76dff48d59-dfjr4\" (UID: \"ab74c7ba-ea27-43e2-924e-aa819aee1362\") " pod="openshift-console-operator/console-operator-76dff48d59-dfjr4" May 21 10:32:30.466505 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.466489 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a2bbdf6-2335-4148-98db-ff7687939b56-tmp\") pod \"insights-operator-78bdfb888c-v6dl9\" (UID: \"2a2bbdf6-2335-4148-98db-ff7687939b56\") " pod="openshift-insights/insights-operator-78bdfb888c-v6dl9" May 21 10:32:30.466759 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.466509 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a2bbdf6-2335-4148-98db-ff7687939b56-service-ca-bundle\") pod \"insights-operator-78bdfb888c-v6dl9\" (UID: \"2a2bbdf6-2335-4148-98db-ff7687939b56\") " pod="openshift-insights/insights-operator-78bdfb888c-v6dl9" May 21 10:32:30.466759 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.466544 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2a2bbdf6-2335-4148-98db-ff7687939b56-serving-cert\") pod \"insights-operator-78bdfb888c-v6dl9\" (UID: \"2a2bbdf6-2335-4148-98db-ff7687939b56\") " pod="openshift-insights/insights-operator-78bdfb888c-v6dl9" May 21 10:32:30.533759 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.533730 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-vm75w"] May 21 10:32:30.537601 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.537585 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-vm75w" May 21 10:32:30.540257 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.540229 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" May 21 10:32:30.540374 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.540360 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" May 21 10:32:30.540486 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.540471 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" May 21 10:32:30.540772 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.540755 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" May 21 10:32:30.540865 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.540852 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-s6c9g\"" May 21 10:32:30.541990 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.541971 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-jh4mw"] May 21 10:32:30.544738 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.544718 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-jh4mw" May 21 10:32:30.547592 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.547574 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" May 21 10:32:30.547592 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.547585 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 21 10:32:30.547729 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.547606 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-wzz9z\"" May 21 10:32:30.547729 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.547583 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" May 21 10:32:30.547729 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.547633 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 21 10:32:30.567383 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.567354 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ab74c7ba-ea27-43e2-924e-aa819aee1362-serving-cert\") pod \"console-operator-76dff48d59-dfjr4\" (UID: \"ab74c7ba-ea27-43e2-924e-aa819aee1362\") " pod="openshift-console-operator/console-operator-76dff48d59-dfjr4" May 21 10:32:30.567505 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.567399 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qst66\" (UniqueName: \"kubernetes.io/projected/93d61278-e692-455e-9018-b65a4200cc0c-kube-api-access-qst66\") pod \"kube-storage-version-migrator-operator-565644f49-vm75w\" (UID: \"93d61278-e692-455e-9018-b65a4200cc0c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-vm75w" May 21 10:32:30.567505 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.567431 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2a2bbdf6-2335-4148-98db-ff7687939b56-snapshots\") pod \"insights-operator-78bdfb888c-v6dl9\" (UID: \"2a2bbdf6-2335-4148-98db-ff7687939b56\") " pod="openshift-insights/insights-operator-78bdfb888c-v6dl9" May 21 10:32:30.567505 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.567468 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a6f68182-444e-47dc-8fec-5099dcf6df09-samples-operator-tls\") pod \"cluster-samples-operator-697587599-z7wqv\" (UID: \"a6f68182-444e-47dc-8fec-5099dcf6df09\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-z7wqv" May 21 10:32:30.567505 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.567495 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/93d61278-e692-455e-9018-b65a4200cc0c-config\") pod \"kube-storage-version-migrator-operator-565644f49-vm75w\" (UID: \"93d61278-e692-455e-9018-b65a4200cc0c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-vm75w" May 21 10:32:30.567687 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.567556 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kk89n\" (UniqueName: \"kubernetes.io/projected/a6f68182-444e-47dc-8fec-5099dcf6df09-kube-api-access-kk89n\") pod \"cluster-samples-operator-697587599-z7wqv\" (UID: \"a6f68182-444e-47dc-8fec-5099dcf6df09\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-z7wqv" May 21 10:32:30.567687 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.567579 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ab74c7ba-ea27-43e2-924e-aa819aee1362-trusted-ca\") pod \"console-operator-76dff48d59-dfjr4\" (UID: \"ab74c7ba-ea27-43e2-924e-aa819aee1362\") " pod="openshift-console-operator/console-operator-76dff48d59-dfjr4" May 21 10:32:30.567687 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:32:30.567592 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 21 10:32:30.567687 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:32:30.567659 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6f68182-444e-47dc-8fec-5099dcf6df09-samples-operator-tls podName:a6f68182-444e-47dc-8fec-5099dcf6df09 nodeName:}" failed. No retries permitted until 2026-05-21 10:32:31.06763841 +0000 UTC m=+146.278798503 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a6f68182-444e-47dc-8fec-5099dcf6df09-samples-operator-tls") pod "cluster-samples-operator-697587599-z7wqv" (UID: "a6f68182-444e-47dc-8fec-5099dcf6df09") : secret "samples-operator-tls" not found May 21 10:32:30.567919 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.567755 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a0b9e259-f4b1-4bd3-b191-fe08dbbd52c5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-jh4mw\" (UID: \"a0b9e259-f4b1-4bd3-b191-fe08dbbd52c5\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-jh4mw" May 21 10:32:30.567919 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.567803 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/93d61278-e692-455e-9018-b65a4200cc0c-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-vm75w\" (UID: \"93d61278-e692-455e-9018-b65a4200cc0c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-vm75w" May 21 10:32:30.567919 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.567868 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a2bbdf6-2335-4148-98db-ff7687939b56-tmp\") pod \"insights-operator-78bdfb888c-v6dl9\" (UID: \"2a2bbdf6-2335-4148-98db-ff7687939b56\") " pod="openshift-insights/insights-operator-78bdfb888c-v6dl9" May 21 10:32:30.568072 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.567919 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a2bbdf6-2335-4148-98db-ff7687939b56-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-v6dl9\" (UID: \"2a2bbdf6-2335-4148-98db-ff7687939b56\") " pod="openshift-insights/insights-operator-78bdfb888c-v6dl9" May 21 10:32:30.568072 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.567952 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c54cd\" (UniqueName: \"kubernetes.io/projected/2a2bbdf6-2335-4148-98db-ff7687939b56-kube-api-access-c54cd\") pod \"insights-operator-78bdfb888c-v6dl9\" (UID: \"2a2bbdf6-2335-4148-98db-ff7687939b56\") " pod="openshift-insights/insights-operator-78bdfb888c-v6dl9" May 21 10:32:30.568072 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.567981 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lkwlz\" (UniqueName: \"kubernetes.io/projected/ab74c7ba-ea27-43e2-924e-aa819aee1362-kube-api-access-lkwlz\") pod \"console-operator-76dff48d59-dfjr4\" (UID: \"ab74c7ba-ea27-43e2-924e-aa819aee1362\") " pod="openshift-console-operator/console-operator-76dff48d59-dfjr4" May 21 10:32:30.568275 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.568139 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2a2bbdf6-2335-4148-98db-ff7687939b56-snapshots\") pod \"insights-operator-78bdfb888c-v6dl9\" (UID: \"2a2bbdf6-2335-4148-98db-ff7687939b56\") " pod="openshift-insights/insights-operator-78bdfb888c-v6dl9" May 21 10:32:30.568275 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.568149 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a2bbdf6-2335-4148-98db-ff7687939b56-tmp\") pod \"insights-operator-78bdfb888c-v6dl9\" (UID: \"2a2bbdf6-2335-4148-98db-ff7687939b56\") " pod="openshift-insights/insights-operator-78bdfb888c-v6dl9" May 21 10:32:30.568275 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.568166 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ab74c7ba-ea27-43e2-924e-aa819aee1362-config\") pod \"console-operator-76dff48d59-dfjr4\" (UID: \"ab74c7ba-ea27-43e2-924e-aa819aee1362\") " pod="openshift-console-operator/console-operator-76dff48d59-dfjr4" May 21 10:32:30.568275 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.568224 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zm5gz\" (UniqueName: \"kubernetes.io/projected/a0b9e259-f4b1-4bd3-b191-fe08dbbd52c5-kube-api-access-zm5gz\") pod \"cluster-monitoring-operator-6c75959455-jh4mw\" (UID: \"a0b9e259-f4b1-4bd3-b191-fe08dbbd52c5\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-jh4mw" May 21 10:32:30.568476 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.568292 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a2bbdf6-2335-4148-98db-ff7687939b56-service-ca-bundle\") pod \"insights-operator-78bdfb888c-v6dl9\" (UID: \"2a2bbdf6-2335-4148-98db-ff7687939b56\") " pod="openshift-insights/insights-operator-78bdfb888c-v6dl9" May 21 10:32:30.568476 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.568320 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a0b9e259-f4b1-4bd3-b191-fe08dbbd52c5-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-jh4mw\" (UID: \"a0b9e259-f4b1-4bd3-b191-fe08dbbd52c5\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-jh4mw" May 21 10:32:30.568476 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.568351 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2a2bbdf6-2335-4148-98db-ff7687939b56-serving-cert\") pod \"insights-operator-78bdfb888c-v6dl9\" (UID: \"2a2bbdf6-2335-4148-98db-ff7687939b56\") " pod="openshift-insights/insights-operator-78bdfb888c-v6dl9" May 21 10:32:30.568476 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.568414 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ab74c7ba-ea27-43e2-924e-aa819aee1362-trusted-ca\") pod \"console-operator-76dff48d59-dfjr4\" (UID: \"ab74c7ba-ea27-43e2-924e-aa819aee1362\") " pod="openshift-console-operator/console-operator-76dff48d59-dfjr4" May 21 10:32:30.568688 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.568676 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a2bbdf6-2335-4148-98db-ff7687939b56-service-ca-bundle\") pod \"insights-operator-78bdfb888c-v6dl9\" (UID: \"2a2bbdf6-2335-4148-98db-ff7687939b56\") " pod="openshift-insights/insights-operator-78bdfb888c-v6dl9" May 21 10:32:30.568808 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.568788 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ab74c7ba-ea27-43e2-924e-aa819aee1362-config\") pod \"console-operator-76dff48d59-dfjr4\" (UID: \"ab74c7ba-ea27-43e2-924e-aa819aee1362\") " pod="openshift-console-operator/console-operator-76dff48d59-dfjr4" May 21 10:32:30.569345 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.569325 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a2bbdf6-2335-4148-98db-ff7687939b56-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-v6dl9\" (UID: \"2a2bbdf6-2335-4148-98db-ff7687939b56\") " pod="openshift-insights/insights-operator-78bdfb888c-v6dl9" May 21 10:32:30.570140 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.570120 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ab74c7ba-ea27-43e2-924e-aa819aee1362-serving-cert\") pod \"console-operator-76dff48d59-dfjr4\" (UID: \"ab74c7ba-ea27-43e2-924e-aa819aee1362\") " pod="openshift-console-operator/console-operator-76dff48d59-dfjr4" May 21 10:32:30.570461 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.570444 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2a2bbdf6-2335-4148-98db-ff7687939b56-serving-cert\") pod \"insights-operator-78bdfb888c-v6dl9\" (UID: \"2a2bbdf6-2335-4148-98db-ff7687939b56\") " pod="openshift-insights/insights-operator-78bdfb888c-v6dl9" May 21 10:32:30.576626 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.576590 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-jh4mw"] May 21 10:32:30.577589 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.577570 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-vm75w"] May 21 10:32:30.589552 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.589519 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kk89n\" (UniqueName: \"kubernetes.io/projected/a6f68182-444e-47dc-8fec-5099dcf6df09-kube-api-access-kk89n\") pod \"cluster-samples-operator-697587599-z7wqv\" (UID: \"a6f68182-444e-47dc-8fec-5099dcf6df09\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-z7wqv" May 21 10:32:30.596212 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.596180 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c54cd\" (UniqueName: \"kubernetes.io/projected/2a2bbdf6-2335-4148-98db-ff7687939b56-kube-api-access-c54cd\") pod \"insights-operator-78bdfb888c-v6dl9\" (UID: \"2a2bbdf6-2335-4148-98db-ff7687939b56\") " pod="openshift-insights/insights-operator-78bdfb888c-v6dl9" May 21 10:32:30.596911 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.596893 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkwlz\" (UniqueName: \"kubernetes.io/projected/ab74c7ba-ea27-43e2-924e-aa819aee1362-kube-api-access-lkwlz\") pod \"console-operator-76dff48d59-dfjr4\" (UID: \"ab74c7ba-ea27-43e2-924e-aa819aee1362\") " pod="openshift-console-operator/console-operator-76dff48d59-dfjr4" May 21 10:32:30.632780 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.632750 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-rz5fs"] May 21 10:32:30.636958 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.636943 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-rz5fs" May 21 10:32:30.644521 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.644500 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" May 21 10:32:30.644719 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.644707 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-nhxxg\"" May 21 10:32:30.644998 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.644984 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" May 21 10:32:30.645039 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.644991 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" May 21 10:32:30.645177 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.645142 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" May 21 10:32:30.648709 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.648688 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-rz5fs"] May 21 10:32:30.671205 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.671129 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qss7j\" (UniqueName: \"kubernetes.io/projected/8864bf9c-55ec-4974-907c-eafac5a2dc6e-kube-api-access-qss7j\") pod \"service-ca-operator-57b5b68b8-rz5fs\" (UID: \"8864bf9c-55ec-4974-907c-eafac5a2dc6e\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-rz5fs" May 21 10:32:30.671205 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.671172 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zm5gz\" (UniqueName: \"kubernetes.io/projected/a0b9e259-f4b1-4bd3-b191-fe08dbbd52c5-kube-api-access-zm5gz\") pod \"cluster-monitoring-operator-6c75959455-jh4mw\" (UID: \"a0b9e259-f4b1-4bd3-b191-fe08dbbd52c5\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-jh4mw" May 21 10:32:30.671205 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.671201 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a0b9e259-f4b1-4bd3-b191-fe08dbbd52c5-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-jh4mw\" (UID: \"a0b9e259-f4b1-4bd3-b191-fe08dbbd52c5\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-jh4mw" May 21 10:32:30.671389 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.671248 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8864bf9c-55ec-4974-907c-eafac5a2dc6e-serving-cert\") pod \"service-ca-operator-57b5b68b8-rz5fs\" (UID: \"8864bf9c-55ec-4974-907c-eafac5a2dc6e\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-rz5fs" May 21 10:32:30.671389 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.671295 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8864bf9c-55ec-4974-907c-eafac5a2dc6e-config\") pod \"service-ca-operator-57b5b68b8-rz5fs\" (UID: \"8864bf9c-55ec-4974-907c-eafac5a2dc6e\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-rz5fs" May 21 10:32:30.671389 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.671357 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qst66\" (UniqueName: \"kubernetes.io/projected/93d61278-e692-455e-9018-b65a4200cc0c-kube-api-access-qst66\") pod \"kube-storage-version-migrator-operator-565644f49-vm75w\" (UID: \"93d61278-e692-455e-9018-b65a4200cc0c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-vm75w" May 21 10:32:30.671477 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.671412 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/93d61278-e692-455e-9018-b65a4200cc0c-config\") pod \"kube-storage-version-migrator-operator-565644f49-vm75w\" (UID: \"93d61278-e692-455e-9018-b65a4200cc0c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-vm75w" May 21 10:32:30.671477 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.671447 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a0b9e259-f4b1-4bd3-b191-fe08dbbd52c5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-jh4mw\" (UID: \"a0b9e259-f4b1-4bd3-b191-fe08dbbd52c5\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-jh4mw" May 21 10:32:30.671577 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.671484 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/93d61278-e692-455e-9018-b65a4200cc0c-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-vm75w\" (UID: \"93d61278-e692-455e-9018-b65a4200cc0c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-vm75w" May 21 10:32:30.671628 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:32:30.671584 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 21 10:32:30.671678 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:32:30.671654 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0b9e259-f4b1-4bd3-b191-fe08dbbd52c5-cluster-monitoring-operator-tls podName:a0b9e259-f4b1-4bd3-b191-fe08dbbd52c5 nodeName:}" failed. No retries permitted until 2026-05-21 10:32:31.171633514 +0000 UTC m=+146.382793610 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a0b9e259-f4b1-4bd3-b191-fe08dbbd52c5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-jh4mw" (UID: "a0b9e259-f4b1-4bd3-b191-fe08dbbd52c5") : secret "cluster-monitoring-operator-tls" not found May 21 10:32:30.672002 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.671980 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a0b9e259-f4b1-4bd3-b191-fe08dbbd52c5-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-jh4mw\" (UID: \"a0b9e259-f4b1-4bd3-b191-fe08dbbd52c5\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-jh4mw" May 21 10:32:30.672078 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.671987 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/93d61278-e692-455e-9018-b65a4200cc0c-config\") pod \"kube-storage-version-migrator-operator-565644f49-vm75w\" (UID: \"93d61278-e692-455e-9018-b65a4200cc0c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-vm75w" May 21 10:32:30.673758 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.673739 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/93d61278-e692-455e-9018-b65a4200cc0c-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-vm75w\" (UID: \"93d61278-e692-455e-9018-b65a4200cc0c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-vm75w" May 21 10:32:30.681459 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.681436 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zm5gz\" (UniqueName: \"kubernetes.io/projected/a0b9e259-f4b1-4bd3-b191-fe08dbbd52c5-kube-api-access-zm5gz\") pod \"cluster-monitoring-operator-6c75959455-jh4mw\" (UID: \"a0b9e259-f4b1-4bd3-b191-fe08dbbd52c5\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-jh4mw" May 21 10:32:30.686640 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.686617 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qst66\" (UniqueName: \"kubernetes.io/projected/93d61278-e692-455e-9018-b65a4200cc0c-kube-api-access-qst66\") pod \"kube-storage-version-migrator-operator-565644f49-vm75w\" (UID: \"93d61278-e692-455e-9018-b65a4200cc0c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-vm75w" May 21 10:32:30.734739 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.734688 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-dfjr4" May 21 10:32:30.744068 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.744043 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-v6dl9" May 21 10:32:30.773192 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.773155 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qss7j\" (UniqueName: \"kubernetes.io/projected/8864bf9c-55ec-4974-907c-eafac5a2dc6e-kube-api-access-qss7j\") pod \"service-ca-operator-57b5b68b8-rz5fs\" (UID: \"8864bf9c-55ec-4974-907c-eafac5a2dc6e\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-rz5fs" May 21 10:32:30.773361 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.773212 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8864bf9c-55ec-4974-907c-eafac5a2dc6e-serving-cert\") pod \"service-ca-operator-57b5b68b8-rz5fs\" (UID: \"8864bf9c-55ec-4974-907c-eafac5a2dc6e\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-rz5fs" May 21 10:32:30.773361 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.773247 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8864bf9c-55ec-4974-907c-eafac5a2dc6e-config\") pod \"service-ca-operator-57b5b68b8-rz5fs\" (UID: \"8864bf9c-55ec-4974-907c-eafac5a2dc6e\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-rz5fs" May 21 10:32:30.774068 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.773994 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8864bf9c-55ec-4974-907c-eafac5a2dc6e-config\") pod \"service-ca-operator-57b5b68b8-rz5fs\" (UID: \"8864bf9c-55ec-4974-907c-eafac5a2dc6e\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-rz5fs" May 21 10:32:30.776027 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.775992 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8864bf9c-55ec-4974-907c-eafac5a2dc6e-serving-cert\") pod \"service-ca-operator-57b5b68b8-rz5fs\" (UID: \"8864bf9c-55ec-4974-907c-eafac5a2dc6e\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-rz5fs" May 21 10:32:30.787926 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.787895 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qss7j\" (UniqueName: \"kubernetes.io/projected/8864bf9c-55ec-4974-907c-eafac5a2dc6e-kube-api-access-qss7j\") pod \"service-ca-operator-57b5b68b8-rz5fs\" (UID: \"8864bf9c-55ec-4974-907c-eafac5a2dc6e\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-rz5fs" May 21 10:32:30.847152 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.847122 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-vm75w" May 21 10:32:30.879729 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.879704 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-dfjr4"] May 21 10:32:30.882070 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:32:30.882046 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab74c7ba_ea27_43e2_924e_aa819aee1362.slice/crio-d338494a34710ead21444066557aa08fa6228f6e552be73abb6160a94c43c9ff WatchSource:0}: Error finding container d338494a34710ead21444066557aa08fa6228f6e552be73abb6160a94c43c9ff: Status 404 returned error can't find the container with id d338494a34710ead21444066557aa08fa6228f6e552be73abb6160a94c43c9ff May 21 10:32:30.890754 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.890709 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-v6dl9"] May 21 10:32:30.894278 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:32:30.894250 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a2bbdf6_2335_4148_98db_ff7687939b56.slice/crio-0df503d15da86f807a376e4e543329abd3f9d0f6a32372e44307a430665ccaa2 WatchSource:0}: Error finding container 0df503d15da86f807a376e4e543329abd3f9d0f6a32372e44307a430665ccaa2: Status 404 returned error can't find the container with id 0df503d15da86f807a376e4e543329abd3f9d0f6a32372e44307a430665ccaa2 May 21 10:32:30.945402 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.945367 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-rz5fs" May 21 10:32:30.982364 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:30.982330 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-vm75w"] May 21 10:32:30.986678 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:32:30.986646 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93d61278_e692_455e_9018_b65a4200cc0c.slice/crio-ddce413c7f29d6165a4c0fb454141711cea0dcfc6253053179234d3a1f372b59 WatchSource:0}: Error finding container ddce413c7f29d6165a4c0fb454141711cea0dcfc6253053179234d3a1f372b59: Status 404 returned error can't find the container with id ddce413c7f29d6165a4c0fb454141711cea0dcfc6253053179234d3a1f372b59 May 21 10:32:31.074612 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:31.074577 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-rz5fs"] May 21 10:32:31.075735 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:31.075670 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a6f68182-444e-47dc-8fec-5099dcf6df09-samples-operator-tls\") pod \"cluster-samples-operator-697587599-z7wqv\" (UID: \"a6f68182-444e-47dc-8fec-5099dcf6df09\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-z7wqv" May 21 10:32:31.075852 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:32:31.075834 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 21 10:32:31.075911 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:32:31.075901 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6f68182-444e-47dc-8fec-5099dcf6df09-samples-operator-tls podName:a6f68182-444e-47dc-8fec-5099dcf6df09 nodeName:}" failed. No retries permitted until 2026-05-21 10:32:32.075882588 +0000 UTC m=+147.287042690 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a6f68182-444e-47dc-8fec-5099dcf6df09-samples-operator-tls") pod "cluster-samples-operator-697587599-z7wqv" (UID: "a6f68182-444e-47dc-8fec-5099dcf6df09") : secret "samples-operator-tls" not found May 21 10:32:31.077562 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:32:31.077536 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8864bf9c_55ec_4974_907c_eafac5a2dc6e.slice/crio-82606b641dcd8e6eeca882a6c1eaa934e36f8ea30e8d61eb033fc5e52f6a978c WatchSource:0}: Error finding container 82606b641dcd8e6eeca882a6c1eaa934e36f8ea30e8d61eb033fc5e52f6a978c: Status 404 returned error can't find the container with id 82606b641dcd8e6eeca882a6c1eaa934e36f8ea30e8d61eb033fc5e52f6a978c May 21 10:32:31.176399 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:31.176355 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a0b9e259-f4b1-4bd3-b191-fe08dbbd52c5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-jh4mw\" (UID: \"a0b9e259-f4b1-4bd3-b191-fe08dbbd52c5\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-jh4mw" May 21 10:32:31.176564 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:32:31.176480 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 21 10:32:31.176564 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:32:31.176538 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0b9e259-f4b1-4bd3-b191-fe08dbbd52c5-cluster-monitoring-operator-tls podName:a0b9e259-f4b1-4bd3-b191-fe08dbbd52c5 nodeName:}" failed. No retries permitted until 2026-05-21 10:32:32.17652244 +0000 UTC m=+147.387682536 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a0b9e259-f4b1-4bd3-b191-fe08dbbd52c5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-jh4mw" (UID: "a0b9e259-f4b1-4bd3-b191-fe08dbbd52c5") : secret "cluster-monitoring-operator-tls" not found May 21 10:32:31.749412 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:31.749317 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-rz5fs" event={"ID":"8864bf9c-55ec-4974-907c-eafac5a2dc6e","Type":"ContainerStarted","Data":"82606b641dcd8e6eeca882a6c1eaa934e36f8ea30e8d61eb033fc5e52f6a978c"} May 21 10:32:31.750640 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:31.750568 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-vm75w" event={"ID":"93d61278-e692-455e-9018-b65a4200cc0c","Type":"ContainerStarted","Data":"ddce413c7f29d6165a4c0fb454141711cea0dcfc6253053179234d3a1f372b59"} May 21 10:32:31.752229 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:31.752170 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-dfjr4" event={"ID":"ab74c7ba-ea27-43e2-924e-aa819aee1362","Type":"ContainerStarted","Data":"d338494a34710ead21444066557aa08fa6228f6e552be73abb6160a94c43c9ff"} May 21 10:32:31.754192 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:31.754159 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-v6dl9" event={"ID":"2a2bbdf6-2335-4148-98db-ff7687939b56","Type":"ContainerStarted","Data":"0df503d15da86f807a376e4e543329abd3f9d0f6a32372e44307a430665ccaa2"} May 21 10:32:32.084221 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:32.084180 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a6f68182-444e-47dc-8fec-5099dcf6df09-samples-operator-tls\") pod \"cluster-samples-operator-697587599-z7wqv\" (UID: \"a6f68182-444e-47dc-8fec-5099dcf6df09\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-z7wqv" May 21 10:32:32.084432 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:32:32.084414 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 21 10:32:32.084502 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:32:32.084487 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6f68182-444e-47dc-8fec-5099dcf6df09-samples-operator-tls podName:a6f68182-444e-47dc-8fec-5099dcf6df09 nodeName:}" failed. No retries permitted until 2026-05-21 10:32:34.084465763 +0000 UTC m=+149.295625873 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a6f68182-444e-47dc-8fec-5099dcf6df09-samples-operator-tls") pod "cluster-samples-operator-697587599-z7wqv" (UID: "a6f68182-444e-47dc-8fec-5099dcf6df09") : secret "samples-operator-tls" not found May 21 10:32:32.186024 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:32.185368 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a0b9e259-f4b1-4bd3-b191-fe08dbbd52c5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-jh4mw\" (UID: \"a0b9e259-f4b1-4bd3-b191-fe08dbbd52c5\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-jh4mw" May 21 10:32:32.186024 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:32:32.185580 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 21 10:32:32.186024 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:32:32.185649 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0b9e259-f4b1-4bd3-b191-fe08dbbd52c5-cluster-monitoring-operator-tls podName:a0b9e259-f4b1-4bd3-b191-fe08dbbd52c5 nodeName:}" failed. No retries permitted until 2026-05-21 10:32:34.185629089 +0000 UTC m=+149.396789188 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a0b9e259-f4b1-4bd3-b191-fe08dbbd52c5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-jh4mw" (UID: "a0b9e259-f4b1-4bd3-b191-fe08dbbd52c5") : secret "cluster-monitoring-operator-tls" not found May 21 10:32:34.102937 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:34.102893 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a6f68182-444e-47dc-8fec-5099dcf6df09-samples-operator-tls\") pod \"cluster-samples-operator-697587599-z7wqv\" (UID: \"a6f68182-444e-47dc-8fec-5099dcf6df09\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-z7wqv" May 21 10:32:34.103336 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:32:34.103062 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 21 10:32:34.103336 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:32:34.103149 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6f68182-444e-47dc-8fec-5099dcf6df09-samples-operator-tls podName:a6f68182-444e-47dc-8fec-5099dcf6df09 nodeName:}" failed. No retries permitted until 2026-05-21 10:32:38.10312445 +0000 UTC m=+153.314284544 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a6f68182-444e-47dc-8fec-5099dcf6df09-samples-operator-tls") pod "cluster-samples-operator-697587599-z7wqv" (UID: "a6f68182-444e-47dc-8fec-5099dcf6df09") : secret "samples-operator-tls" not found May 21 10:32:34.204301 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:34.204256 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a0b9e259-f4b1-4bd3-b191-fe08dbbd52c5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-jh4mw\" (UID: \"a0b9e259-f4b1-4bd3-b191-fe08dbbd52c5\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-jh4mw" May 21 10:32:34.204456 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:32:34.204387 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 21 10:32:34.204497 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:32:34.204458 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0b9e259-f4b1-4bd3-b191-fe08dbbd52c5-cluster-monitoring-operator-tls podName:a0b9e259-f4b1-4bd3-b191-fe08dbbd52c5 nodeName:}" failed. No retries permitted until 2026-05-21 10:32:38.204443086 +0000 UTC m=+153.415603179 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a0b9e259-f4b1-4bd3-b191-fe08dbbd52c5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-jh4mw" (UID: "a0b9e259-f4b1-4bd3-b191-fe08dbbd52c5") : secret "cluster-monitoring-operator-tls" not found May 21 10:32:34.581920 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:34.581897 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-v86fl"] May 21 10:32:34.585422 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:34.585403 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-v86fl" May 21 10:32:34.588041 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:34.588015 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" May 21 10:32:34.588396 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:34.588378 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-tcw2p\"" May 21 10:32:34.588490 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:34.588383 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" May 21 10:32:34.608493 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:34.607605 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-v86fl"] May 21 10:32:34.608493 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:34.608103 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/303b296c-d038-4deb-9908-21685ef908d3-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-v86fl\" (UID: \"303b296c-d038-4deb-9908-21685ef908d3\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-v86fl" May 21 10:32:34.608493 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:34.608177 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/303b296c-d038-4deb-9908-21685ef908d3-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-v86fl\" (UID: \"303b296c-d038-4deb-9908-21685ef908d3\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-v86fl" May 21 10:32:34.710969 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:34.710943 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/303b296c-d038-4deb-9908-21685ef908d3-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-v86fl\" (UID: \"303b296c-d038-4deb-9908-21685ef908d3\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-v86fl" May 21 10:32:34.711052 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:34.711014 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/303b296c-d038-4deb-9908-21685ef908d3-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-v86fl\" (UID: \"303b296c-d038-4deb-9908-21685ef908d3\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-v86fl" May 21 10:32:34.711193 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:32:34.711180 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 10:32:34.711245 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:32:34.711236 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/303b296c-d038-4deb-9908-21685ef908d3-networking-console-plugin-cert podName:303b296c-d038-4deb-9908-21685ef908d3 nodeName:}" failed. No retries permitted until 2026-05-21 10:32:35.211214886 +0000 UTC m=+150.422374983 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/303b296c-d038-4deb-9908-21685ef908d3-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-v86fl" (UID: "303b296c-d038-4deb-9908-21685ef908d3") : secret "networking-console-plugin-cert" not found May 21 10:32:34.712621 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:34.712597 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/303b296c-d038-4deb-9908-21685ef908d3-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-v86fl\" (UID: \"303b296c-d038-4deb-9908-21685ef908d3\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-v86fl" May 21 10:32:34.763697 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:34.762684 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-rz5fs" event={"ID":"8864bf9c-55ec-4974-907c-eafac5a2dc6e","Type":"ContainerStarted","Data":"c28b2acb51a24c09406144d68ad754e266823d3fca1a716328275075e659d638"} May 21 10:32:34.765202 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:34.765160 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-vm75w" event={"ID":"93d61278-e692-455e-9018-b65a4200cc0c","Type":"ContainerStarted","Data":"2acbbab30daf911d5f5b464079132578f6a8c563c92b5a897912e0c5b1611de8"} May 21 10:32:34.767277 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:34.767216 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-dfjr4" event={"ID":"ab74c7ba-ea27-43e2-924e-aa819aee1362","Type":"ContainerStarted","Data":"18cb301468239e36e9fcdc12a62bb321e889255007f7be080c979e4a2dfe324f"} May 21 10:32:34.767398 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:34.767390 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-dfjr4" May 21 10:32:34.768664 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:34.768353 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-v6dl9" event={"ID":"2a2bbdf6-2335-4148-98db-ff7687939b56","Type":"ContainerStarted","Data":"5118fe4a92063e4865fd6dc7c0485c42e7037ef878a3635f002ccf34fdbc569b"} May 21 10:32:34.769052 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:34.768851 2563 patch_prober.go:28] interesting pod/console-operator-76dff48d59-dfjr4 container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.9:8443/readyz\": dial tcp 10.132.0.9:8443: connect: connection refused" start-of-body= May 21 10:32:34.769052 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:34.768889 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-76dff48d59-dfjr4" podUID="ab74c7ba-ea27-43e2-924e-aa819aee1362" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.9:8443/readyz\": dial tcp 10.132.0.9:8443: connect: connection refused" May 21 10:32:34.782225 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:34.782171 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-rz5fs" podStartSLOduration=1.256405507 podStartE2EDuration="4.782153723s" podCreationTimestamp="2026-05-21 10:32:30 +0000 UTC" firstStartedPulling="2026-05-21 10:32:31.079318081 +0000 UTC m=+146.290478178" lastFinishedPulling="2026-05-21 10:32:34.605066288 +0000 UTC m=+149.816226394" observedRunningTime="2026-05-21 10:32:34.781288518 +0000 UTC m=+149.992448636" watchObservedRunningTime="2026-05-21 10:32:34.782153723 +0000 UTC m=+149.993313837" May 21 10:32:34.826132 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:34.826030 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-vm75w" podStartSLOduration=1.215113014 podStartE2EDuration="4.82601726s" podCreationTimestamp="2026-05-21 10:32:30 +0000 UTC" firstStartedPulling="2026-05-21 10:32:30.9888692 +0000 UTC m=+146.200029301" lastFinishedPulling="2026-05-21 10:32:34.599773454 +0000 UTC m=+149.810933547" observedRunningTime="2026-05-21 10:32:34.82517154 +0000 UTC m=+150.036331654" watchObservedRunningTime="2026-05-21 10:32:34.82601726 +0000 UTC m=+150.037177373" May 21 10:32:34.826680 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:34.826656 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-78bdfb888c-v6dl9" podStartSLOduration=1.126094951 podStartE2EDuration="4.826648802s" podCreationTimestamp="2026-05-21 10:32:30 +0000 UTC" firstStartedPulling="2026-05-21 10:32:30.896104416 +0000 UTC m=+146.107264515" lastFinishedPulling="2026-05-21 10:32:34.596658259 +0000 UTC m=+149.807818366" observedRunningTime="2026-05-21 10:32:34.801103918 +0000 UTC m=+150.012264038" watchObservedRunningTime="2026-05-21 10:32:34.826648802 +0000 UTC m=+150.037808911" May 21 10:32:34.849117 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:34.849075 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-76dff48d59-dfjr4" podStartSLOduration=1.136305321 podStartE2EDuration="4.849062519s" podCreationTimestamp="2026-05-21 10:32:30 +0000 UTC" firstStartedPulling="2026-05-21 10:32:30.883903469 +0000 UTC m=+146.095063564" lastFinishedPulling="2026-05-21 10:32:34.596660669 +0000 UTC m=+149.807820762" observedRunningTime="2026-05-21 10:32:34.848342476 +0000 UTC m=+150.059502593" watchObservedRunningTime="2026-05-21 10:32:34.849062519 +0000 UTC m=+150.060222634" May 21 10:32:35.216695 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:35.216601 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/303b296c-d038-4deb-9908-21685ef908d3-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-v86fl\" (UID: \"303b296c-d038-4deb-9908-21685ef908d3\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-v86fl" May 21 10:32:35.217076 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:32:35.216784 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 10:32:35.217076 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:32:35.216876 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/303b296c-d038-4deb-9908-21685ef908d3-networking-console-plugin-cert podName:303b296c-d038-4deb-9908-21685ef908d3 nodeName:}" failed. No retries permitted until 2026-05-21 10:32:36.216858065 +0000 UTC m=+151.428018157 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/303b296c-d038-4deb-9908-21685ef908d3-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-v86fl" (UID: "303b296c-d038-4deb-9908-21685ef908d3") : secret "networking-console-plugin-cert" not found May 21 10:32:35.776121 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:35.776093 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-dfjr4_ab74c7ba-ea27-43e2-924e-aa819aee1362/console-operator/0.log" May 21 10:32:35.776312 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:35.776134 2563 generic.go:358] "Generic (PLEG): container finished" podID="ab74c7ba-ea27-43e2-924e-aa819aee1362" containerID="18cb301468239e36e9fcdc12a62bb321e889255007f7be080c979e4a2dfe324f" exitCode=255 May 21 10:32:35.776312 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:35.776170 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-dfjr4" event={"ID":"ab74c7ba-ea27-43e2-924e-aa819aee1362","Type":"ContainerDied","Data":"18cb301468239e36e9fcdc12a62bb321e889255007f7be080c979e4a2dfe324f"} May 21 10:32:35.776785 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:35.776768 2563 scope.go:117] "RemoveContainer" containerID="18cb301468239e36e9fcdc12a62bb321e889255007f7be080c979e4a2dfe324f" May 21 10:32:36.226028 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:36.225986 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/303b296c-d038-4deb-9908-21685ef908d3-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-v86fl\" (UID: \"303b296c-d038-4deb-9908-21685ef908d3\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-v86fl" May 21 10:32:36.226439 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:32:36.226097 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 10:32:36.226439 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:32:36.226155 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/303b296c-d038-4deb-9908-21685ef908d3-networking-console-plugin-cert podName:303b296c-d038-4deb-9908-21685ef908d3 nodeName:}" failed. No retries permitted until 2026-05-21 10:32:38.226140688 +0000 UTC m=+153.437300780 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/303b296c-d038-4deb-9908-21685ef908d3-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-v86fl" (UID: "303b296c-d038-4deb-9908-21685ef908d3") : secret "networking-console-plugin-cert" not found May 21 10:32:36.779758 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:36.779731 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-dfjr4_ab74c7ba-ea27-43e2-924e-aa819aee1362/console-operator/1.log" May 21 10:32:36.780093 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:36.780077 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-dfjr4_ab74c7ba-ea27-43e2-924e-aa819aee1362/console-operator/0.log" May 21 10:32:36.780163 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:36.780111 2563 generic.go:358] "Generic (PLEG): container finished" podID="ab74c7ba-ea27-43e2-924e-aa819aee1362" containerID="b4a7232616c116173c8360ed86262133fc0ac7dcdae196b4d9a19b690fd28520" exitCode=255 May 21 10:32:36.780213 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:36.780166 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-dfjr4" event={"ID":"ab74c7ba-ea27-43e2-924e-aa819aee1362","Type":"ContainerDied","Data":"b4a7232616c116173c8360ed86262133fc0ac7dcdae196b4d9a19b690fd28520"} May 21 10:32:36.780213 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:36.780203 2563 scope.go:117] "RemoveContainer" containerID="18cb301468239e36e9fcdc12a62bb321e889255007f7be080c979e4a2dfe324f" May 21 10:32:36.780481 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:36.780459 2563 scope.go:117] "RemoveContainer" containerID="b4a7232616c116173c8360ed86262133fc0ac7dcdae196b4d9a19b690fd28520" May 21 10:32:36.780681 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:32:36.780659 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-dfjr4_openshift-console-operator(ab74c7ba-ea27-43e2-924e-aa819aee1362)\"" pod="openshift-console-operator/console-operator-76dff48d59-dfjr4" podUID="ab74c7ba-ea27-43e2-924e-aa819aee1362" May 21 10:32:37.519616 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:37.519579 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-7ck29"] May 21 10:32:37.523766 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:37.523740 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-7ck29" May 21 10:32:37.529199 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:37.529183 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" May 21 10:32:37.530021 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:37.529998 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" May 21 10:32:37.530112 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:37.530036 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-rxdpz\"" May 21 10:32:37.539014 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:37.538979 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-7ck29"] May 21 10:32:37.638661 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:37.638624 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nc724\" (UniqueName: \"kubernetes.io/projected/7610c1ec-51a2-4a1a-8a01-a297d8439b2f-kube-api-access-nc724\") pod \"migrator-b985f5d89-7ck29\" (UID: \"7610c1ec-51a2-4a1a-8a01-a297d8439b2f\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-7ck29" May 21 10:32:37.739956 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:37.739923 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nc724\" (UniqueName: \"kubernetes.io/projected/7610c1ec-51a2-4a1a-8a01-a297d8439b2f-kube-api-access-nc724\") pod \"migrator-b985f5d89-7ck29\" (UID: \"7610c1ec-51a2-4a1a-8a01-a297d8439b2f\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-7ck29" May 21 10:32:37.751566 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:37.751536 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nc724\" (UniqueName: \"kubernetes.io/projected/7610c1ec-51a2-4a1a-8a01-a297d8439b2f-kube-api-access-nc724\") pod \"migrator-b985f5d89-7ck29\" (UID: \"7610c1ec-51a2-4a1a-8a01-a297d8439b2f\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-7ck29" May 21 10:32:37.784023 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:37.783959 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-dfjr4_ab74c7ba-ea27-43e2-924e-aa819aee1362/console-operator/1.log" May 21 10:32:37.784324 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:37.784305 2563 scope.go:117] "RemoveContainer" containerID="b4a7232616c116173c8360ed86262133fc0ac7dcdae196b4d9a19b690fd28520" May 21 10:32:37.784576 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:32:37.784548 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-dfjr4_openshift-console-operator(ab74c7ba-ea27-43e2-924e-aa819aee1362)\"" pod="openshift-console-operator/console-operator-76dff48d59-dfjr4" podUID="ab74c7ba-ea27-43e2-924e-aa819aee1362" May 21 10:32:37.832231 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:37.832204 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-7ck29" May 21 10:32:37.883902 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:37.883878 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7hg45_0ecce324-6dad-4c21-b5d0-60950c0b12a8/dns-node-resolver/0.log" May 21 10:32:37.969444 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:37.969405 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-7ck29"] May 21 10:32:37.973056 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:32:37.973026 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7610c1ec_51a2_4a1a_8a01_a297d8439b2f.slice/crio-49df4ee44df32887d99e740e33d3e022504ef3e54bdc0b4eb86b9c14e420e66f WatchSource:0}: Error finding container 49df4ee44df32887d99e740e33d3e022504ef3e54bdc0b4eb86b9c14e420e66f: Status 404 returned error can't find the container with id 49df4ee44df32887d99e740e33d3e022504ef3e54bdc0b4eb86b9c14e420e66f May 21 10:32:38.144087 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:38.144055 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a6f68182-444e-47dc-8fec-5099dcf6df09-samples-operator-tls\") pod \"cluster-samples-operator-697587599-z7wqv\" (UID: \"a6f68182-444e-47dc-8fec-5099dcf6df09\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-z7wqv" May 21 10:32:38.144245 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:32:38.144214 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 21 10:32:38.144297 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:32:38.144287 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6f68182-444e-47dc-8fec-5099dcf6df09-samples-operator-tls podName:a6f68182-444e-47dc-8fec-5099dcf6df09 nodeName:}" failed. No retries permitted until 2026-05-21 10:32:46.14426792 +0000 UTC m=+161.355428037 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a6f68182-444e-47dc-8fec-5099dcf6df09-samples-operator-tls") pod "cluster-samples-operator-697587599-z7wqv" (UID: "a6f68182-444e-47dc-8fec-5099dcf6df09") : secret "samples-operator-tls" not found May 21 10:32:38.245521 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:38.245490 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/303b296c-d038-4deb-9908-21685ef908d3-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-v86fl\" (UID: \"303b296c-d038-4deb-9908-21685ef908d3\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-v86fl" May 21 10:32:38.245691 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:38.245532 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a0b9e259-f4b1-4bd3-b191-fe08dbbd52c5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-jh4mw\" (UID: \"a0b9e259-f4b1-4bd3-b191-fe08dbbd52c5\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-jh4mw" May 21 10:32:38.245691 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:32:38.245633 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 10:32:38.245691 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:32:38.245642 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 21 10:32:38.245831 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:32:38.245695 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/303b296c-d038-4deb-9908-21685ef908d3-networking-console-plugin-cert podName:303b296c-d038-4deb-9908-21685ef908d3 nodeName:}" failed. No retries permitted until 2026-05-21 10:32:42.245673384 +0000 UTC m=+157.456833478 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/303b296c-d038-4deb-9908-21685ef908d3-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-v86fl" (UID: "303b296c-d038-4deb-9908-21685ef908d3") : secret "networking-console-plugin-cert" not found May 21 10:32:38.245831 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:32:38.245715 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0b9e259-f4b1-4bd3-b191-fe08dbbd52c5-cluster-monitoring-operator-tls podName:a0b9e259-f4b1-4bd3-b191-fe08dbbd52c5 nodeName:}" failed. No retries permitted until 2026-05-21 10:32:46.24570502 +0000 UTC m=+161.456865116 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a0b9e259-f4b1-4bd3-b191-fe08dbbd52c5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-jh4mw" (UID: "a0b9e259-f4b1-4bd3-b191-fe08dbbd52c5") : secret "cluster-monitoring-operator-tls" not found May 21 10:32:38.788114 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:38.788079 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-7ck29" event={"ID":"7610c1ec-51a2-4a1a-8a01-a297d8439b2f","Type":"ContainerStarted","Data":"49df4ee44df32887d99e740e33d3e022504ef3e54bdc0b4eb86b9c14e420e66f"} May 21 10:32:39.084606 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:39.084577 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vp867_2b0f26ae-1e09-4748-8edc-01ca61e76324/node-ca/0.log" May 21 10:32:39.792256 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:39.792217 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-7ck29" event={"ID":"7610c1ec-51a2-4a1a-8a01-a297d8439b2f","Type":"ContainerStarted","Data":"b9ffb031623c9d3d7f7a0ce054daff131dd9c6bc5ce0a58e27cb70cf5b1beb87"} May 21 10:32:39.792256 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:39.792256 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-7ck29" event={"ID":"7610c1ec-51a2-4a1a-8a01-a297d8439b2f","Type":"ContainerStarted","Data":"e177ec5fb4bc91e8249ac9876efe195b615ae97eec3c0aa3c60dd0edd1680374"} May 21 10:32:39.820642 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:39.820594 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-7ck29" podStartSLOduration=1.64778745 podStartE2EDuration="2.820580871s" podCreationTimestamp="2026-05-21 10:32:37 +0000 UTC" firstStartedPulling="2026-05-21 10:32:37.974847361 +0000 UTC m=+153.186007454" lastFinishedPulling="2026-05-21 10:32:39.147640778 +0000 UTC m=+154.358800875" observedRunningTime="2026-05-21 10:32:39.82045456 +0000 UTC m=+155.031614676" watchObservedRunningTime="2026-05-21 10:32:39.820580871 +0000 UTC m=+155.031741000" May 21 10:32:40.735753 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:40.735703 2563 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-dfjr4" May 21 10:32:40.736131 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:40.736116 2563 scope.go:117] "RemoveContainer" containerID="b4a7232616c116173c8360ed86262133fc0ac7dcdae196b4d9a19b690fd28520" May 21 10:32:40.736289 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:32:40.736273 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-dfjr4_openshift-console-operator(ab74c7ba-ea27-43e2-924e-aa819aee1362)\"" pod="openshift-console-operator/console-operator-76dff48d59-dfjr4" podUID="ab74c7ba-ea27-43e2-924e-aa819aee1362" May 21 10:32:42.279046 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:42.279005 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/303b296c-d038-4deb-9908-21685ef908d3-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-v86fl\" (UID: \"303b296c-d038-4deb-9908-21685ef908d3\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-v86fl" May 21 10:32:42.279447 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:32:42.279154 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 10:32:42.279447 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:32:42.279235 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/303b296c-d038-4deb-9908-21685ef908d3-networking-console-plugin-cert podName:303b296c-d038-4deb-9908-21685ef908d3 nodeName:}" failed. No retries permitted until 2026-05-21 10:32:50.279218745 +0000 UTC m=+165.490378837 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/303b296c-d038-4deb-9908-21685ef908d3-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-v86fl" (UID: "303b296c-d038-4deb-9908-21685ef908d3") : secret "networking-console-plugin-cert" not found May 21 10:32:43.674227 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:32:43.674182 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-57bfcfdbc9-qcqrf" podUID="9e1df45f-c679-4347-b552-5d1d7a1cafb2" May 21 10:32:43.685364 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:32:43.685331 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-vr89z" podUID="8401ddcb-f0a7-4ca9-98f1-08bd15af8920" May 21 10:32:43.698586 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:32:43.698566 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-wk2bh" podUID="02618313-ee56-495f-b166-884fa5528f94" May 21 10:32:43.801312 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:43.801280 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vr89z" May 21 10:32:43.801481 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:43.801280 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57bfcfdbc9-qcqrf" May 21 10:32:44.419385 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:32:44.419344 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-hnvv7" podUID="a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f" May 21 10:32:44.767721 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:44.767622 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-dfjr4" May 21 10:32:44.768101 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:44.768060 2563 scope.go:117] "RemoveContainer" containerID="b4a7232616c116173c8360ed86262133fc0ac7dcdae196b4d9a19b690fd28520" May 21 10:32:44.768241 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:32:44.768224 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-dfjr4_openshift-console-operator(ab74c7ba-ea27-43e2-924e-aa819aee1362)\"" pod="openshift-console-operator/console-operator-76dff48d59-dfjr4" podUID="ab74c7ba-ea27-43e2-924e-aa819aee1362" May 21 10:32:46.211130 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:46.211095 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a6f68182-444e-47dc-8fec-5099dcf6df09-samples-operator-tls\") pod \"cluster-samples-operator-697587599-z7wqv\" (UID: \"a6f68182-444e-47dc-8fec-5099dcf6df09\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-z7wqv" May 21 10:32:46.213689 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:46.213665 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a6f68182-444e-47dc-8fec-5099dcf6df09-samples-operator-tls\") pod \"cluster-samples-operator-697587599-z7wqv\" (UID: \"a6f68182-444e-47dc-8fec-5099dcf6df09\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-z7wqv" May 21 10:32:46.311655 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:46.311604 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a0b9e259-f4b1-4bd3-b191-fe08dbbd52c5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-jh4mw\" (UID: \"a0b9e259-f4b1-4bd3-b191-fe08dbbd52c5\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-jh4mw" May 21 10:32:46.311847 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:32:46.311750 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 21 10:32:46.311847 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:32:46.311839 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0b9e259-f4b1-4bd3-b191-fe08dbbd52c5-cluster-monitoring-operator-tls podName:a0b9e259-f4b1-4bd3-b191-fe08dbbd52c5 nodeName:}" failed. No retries permitted until 2026-05-21 10:33:02.311800961 +0000 UTC m=+177.522961059 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a0b9e259-f4b1-4bd3-b191-fe08dbbd52c5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-jh4mw" (UID: "a0b9e259-f4b1-4bd3-b191-fe08dbbd52c5") : secret "cluster-monitoring-operator-tls" not found May 21 10:32:46.350554 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:46.350524 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-z7wqv" May 21 10:32:46.489755 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:46.489677 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-z7wqv"] May 21 10:32:46.809052 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:46.809019 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-z7wqv" event={"ID":"a6f68182-444e-47dc-8fec-5099dcf6df09","Type":"ContainerStarted","Data":"68720dedadcada2d302732d966bc1187381ca07acec9e6f2256b5020eb0f2235"} May 21 10:32:48.633157 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:48.633116 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/02618313-ee56-495f-b166-884fa5528f94-metrics-tls\") pod \"dns-default-wk2bh\" (UID: \"02618313-ee56-495f-b166-884fa5528f94\") " pod="openshift-dns/dns-default-wk2bh" May 21 10:32:48.633157 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:48.633162 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8401ddcb-f0a7-4ca9-98f1-08bd15af8920-cert\") pod \"ingress-canary-vr89z\" (UID: \"8401ddcb-f0a7-4ca9-98f1-08bd15af8920\") " pod="openshift-ingress-canary/ingress-canary-vr89z" May 21 10:32:48.633659 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:48.633251 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e1df45f-c679-4347-b552-5d1d7a1cafb2-registry-tls\") pod \"image-registry-57bfcfdbc9-qcqrf\" (UID: \"9e1df45f-c679-4347-b552-5d1d7a1cafb2\") " pod="openshift-image-registry/image-registry-57bfcfdbc9-qcqrf" May 21 10:32:48.635629 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:48.635606 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/02618313-ee56-495f-b166-884fa5528f94-metrics-tls\") pod \"dns-default-wk2bh\" (UID: \"02618313-ee56-495f-b166-884fa5528f94\") " pod="openshift-dns/dns-default-wk2bh" May 21 10:32:48.635858 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:48.635838 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8401ddcb-f0a7-4ca9-98f1-08bd15af8920-cert\") pod \"ingress-canary-vr89z\" (UID: \"8401ddcb-f0a7-4ca9-98f1-08bd15af8920\") " pod="openshift-ingress-canary/ingress-canary-vr89z" May 21 10:32:48.635913 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:48.635838 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e1df45f-c679-4347-b552-5d1d7a1cafb2-registry-tls\") pod \"image-registry-57bfcfdbc9-qcqrf\" (UID: \"9e1df45f-c679-4347-b552-5d1d7a1cafb2\") " pod="openshift-image-registry/image-registry-57bfcfdbc9-qcqrf" May 21 10:32:48.815592 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:48.815554 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-z7wqv" event={"ID":"a6f68182-444e-47dc-8fec-5099dcf6df09","Type":"ContainerStarted","Data":"96d08c6d2007495852bdaa0fcef0b261340ef574e25123f01ca8b9a6b4b0a158"} May 21 10:32:48.815592 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:48.815595 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-z7wqv" event={"ID":"a6f68182-444e-47dc-8fec-5099dcf6df09","Type":"ContainerStarted","Data":"1a83cff794e73b7ad8b0feb3459a4d4ce1cce4ff02df320fab826e545b85345a"} May 21 10:32:48.905992 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:48.905914 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4ntqv\"" May 21 10:32:48.906130 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:48.906069 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-9spk4\"" May 21 10:32:48.913137 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:48.913115 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vr89z" May 21 10:32:48.913224 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:48.913144 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57bfcfdbc9-qcqrf" May 21 10:32:49.090283 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:49.090223 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-z7wqv" podStartSLOduration=17.398814504 podStartE2EDuration="19.09020688s" podCreationTimestamp="2026-05-21 10:32:30 +0000 UTC" firstStartedPulling="2026-05-21 10:32:46.535624119 +0000 UTC m=+161.746784212" lastFinishedPulling="2026-05-21 10:32:48.227016493 +0000 UTC m=+163.438176588" observedRunningTime="2026-05-21 10:32:48.850193974 +0000 UTC m=+164.061354088" watchObservedRunningTime="2026-05-21 10:32:49.09020688 +0000 UTC m=+164.301366995" May 21 10:32:49.091082 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:49.091054 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vr89z"] May 21 10:32:49.093787 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:49.093768 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-57bfcfdbc9-qcqrf"] May 21 10:32:49.095191 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:32:49.095168 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8401ddcb_f0a7_4ca9_98f1_08bd15af8920.slice/crio-a6191cf441179191c1d40764193ecfe5249124ea7423e0971cff503d7238794f WatchSource:0}: Error finding container a6191cf441179191c1d40764193ecfe5249124ea7423e0971cff503d7238794f: Status 404 returned error can't find the container with id a6191cf441179191c1d40764193ecfe5249124ea7423e0971cff503d7238794f May 21 10:32:49.095787 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:32:49.095724 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e1df45f_c679_4347_b552_5d1d7a1cafb2.slice/crio-e96d54fb8dbbd058e0fb6a709f20036c461e3cd6a8f25d09dfeeaa2b35f1c7c3 WatchSource:0}: Error finding container e96d54fb8dbbd058e0fb6a709f20036c461e3cd6a8f25d09dfeeaa2b35f1c7c3: Status 404 returned error can't find the container with id e96d54fb8dbbd058e0fb6a709f20036c461e3cd6a8f25d09dfeeaa2b35f1c7c3 May 21 10:32:49.819557 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:49.819520 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vr89z" event={"ID":"8401ddcb-f0a7-4ca9-98f1-08bd15af8920","Type":"ContainerStarted","Data":"a6191cf441179191c1d40764193ecfe5249124ea7423e0971cff503d7238794f"} May 21 10:32:49.821057 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:49.821020 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57bfcfdbc9-qcqrf" event={"ID":"9e1df45f-c679-4347-b552-5d1d7a1cafb2","Type":"ContainerStarted","Data":"ab91fb00dd1a4dbd6ced8d76e85fc37f10bef60d03ba21ccc8aa69aaead2805b"} May 21 10:32:49.821057 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:49.821059 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57bfcfdbc9-qcqrf" event={"ID":"9e1df45f-c679-4347-b552-5d1d7a1cafb2","Type":"ContainerStarted","Data":"e96d54fb8dbbd058e0fb6a709f20036c461e3cd6a8f25d09dfeeaa2b35f1c7c3"} May 21 10:32:49.821248 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:49.821096 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-57bfcfdbc9-qcqrf" May 21 10:32:49.867276 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:49.867214 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-57bfcfdbc9-qcqrf" podStartSLOduration=164.867194375 podStartE2EDuration="2m44.867194375s" podCreationTimestamp="2026-05-21 10:30:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 10:32:49.866030576 +0000 UTC m=+165.077190692" watchObservedRunningTime="2026-05-21 10:32:49.867194375 +0000 UTC m=+165.078354492" May 21 10:32:50.346977 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:50.346940 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/303b296c-d038-4deb-9908-21685ef908d3-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-v86fl\" (UID: \"303b296c-d038-4deb-9908-21685ef908d3\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-v86fl" May 21 10:32:50.349498 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:50.349467 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/303b296c-d038-4deb-9908-21685ef908d3-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-v86fl\" (UID: \"303b296c-d038-4deb-9908-21685ef908d3\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-v86fl" May 21 10:32:50.494230 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:50.494187 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-v86fl" May 21 10:32:51.057552 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:51.057516 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-v86fl"] May 21 10:32:51.061252 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:32:51.061221 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod303b296c_d038_4deb_9908_21685ef908d3.slice/crio-c9137aaa69c8f4d3ce0bcd666193ee56d3cc5f7ba01b33b1b00915d3547710e3 WatchSource:0}: Error finding container c9137aaa69c8f4d3ce0bcd666193ee56d3cc5f7ba01b33b1b00915d3547710e3: Status 404 returned error can't find the container with id c9137aaa69c8f4d3ce0bcd666193ee56d3cc5f7ba01b33b1b00915d3547710e3 May 21 10:32:51.827929 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:51.827890 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vr89z" event={"ID":"8401ddcb-f0a7-4ca9-98f1-08bd15af8920","Type":"ContainerStarted","Data":"c4e2277e204067a5acc17ac8fa72cf1610d2c4c7e6b2c69aad9989ca59d59c20"} May 21 10:32:51.828813 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:51.828791 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-v86fl" event={"ID":"303b296c-d038-4deb-9908-21685ef908d3","Type":"ContainerStarted","Data":"c9137aaa69c8f4d3ce0bcd666193ee56d3cc5f7ba01b33b1b00915d3547710e3"} May 21 10:32:51.859364 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:51.859312 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-vr89z" podStartSLOduration=129.987515432 podStartE2EDuration="2m11.859299443s" podCreationTimestamp="2026-05-21 10:30:40 +0000 UTC" firstStartedPulling="2026-05-21 10:32:49.097050803 +0000 UTC m=+164.308210897" lastFinishedPulling="2026-05-21 10:32:50.968834803 +0000 UTC m=+166.179994908" observedRunningTime="2026-05-21 10:32:51.858008084 +0000 UTC m=+167.069168200" watchObservedRunningTime="2026-05-21 10:32:51.859299443 +0000 UTC m=+167.070459558" May 21 10:32:52.832912 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:52.832875 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-v86fl" event={"ID":"303b296c-d038-4deb-9908-21685ef908d3","Type":"ContainerStarted","Data":"204b158ae589835c7bb143fdcd18765f7878f4c8f156748bef28f7c7375d1ed2"} May 21 10:32:52.863369 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:52.863323 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-v86fl" podStartSLOduration=17.644465549 podStartE2EDuration="18.863307762s" podCreationTimestamp="2026-05-21 10:32:34 +0000 UTC" firstStartedPulling="2026-05-21 10:32:51.063488151 +0000 UTC m=+166.274648244" lastFinishedPulling="2026-05-21 10:32:52.282330364 +0000 UTC m=+167.493490457" observedRunningTime="2026-05-21 10:32:52.86197114 +0000 UTC m=+168.073131254" watchObservedRunningTime="2026-05-21 10:32:52.863307762 +0000 UTC m=+168.074467876" May 21 10:32:55.397231 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:55.397192 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hnvv7" May 21 10:32:56.396226 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:56.396195 2563 scope.go:117] "RemoveContainer" containerID="b4a7232616c116173c8360ed86262133fc0ac7dcdae196b4d9a19b690fd28520" May 21 10:32:56.844735 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:56.844709 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-dfjr4_ab74c7ba-ea27-43e2-924e-aa819aee1362/console-operator/1.log" May 21 10:32:56.845138 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:56.844788 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-dfjr4" event={"ID":"ab74c7ba-ea27-43e2-924e-aa819aee1362","Type":"ContainerStarted","Data":"321e0e9a785b2d8837f3e0b577dd109a7cbbae846982c600dd2e893f42c5b01b"} May 21 10:32:56.845138 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:56.845091 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-dfjr4" May 21 10:32:56.985514 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:56.985480 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-76dff48d59-dfjr4" May 21 10:32:58.396175 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:58.396140 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wk2bh" May 21 10:32:58.399086 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:58.399064 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-j2794\"" May 21 10:32:58.407318 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:58.407302 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wk2bh" May 21 10:32:58.539743 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:58.539709 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wk2bh"] May 21 10:32:58.542446 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:32:58.542416 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02618313_ee56_495f_b166_884fa5528f94.slice/crio-21abe094a610d5eef2c3d0d0154dd5d25fa773b3ac040633e01583a12c3a431d WatchSource:0}: Error finding container 21abe094a610d5eef2c3d0d0154dd5d25fa773b3ac040633e01583a12c3a431d: Status 404 returned error can't find the container with id 21abe094a610d5eef2c3d0d0154dd5d25fa773b3ac040633e01583a12c3a431d May 21 10:32:58.851493 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:58.851460 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wk2bh" event={"ID":"02618313-ee56-495f-b166-884fa5528f94","Type":"ContainerStarted","Data":"21abe094a610d5eef2c3d0d0154dd5d25fa773b3ac040633e01583a12c3a431d"} May 21 10:32:59.858804 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:32:59.858772 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wk2bh" event={"ID":"02618313-ee56-495f-b166-884fa5528f94","Type":"ContainerStarted","Data":"98310590abe3bd1b3e3e0dcddfb66f6dac050c1bcf8f5e54bb8765720a43d2b9"} May 21 10:33:00.118635 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:00.118604 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-br4rg"] May 21 10:33:00.121939 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:00.121917 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-br4rg" May 21 10:33:00.126857 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:00.126837 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-w9dw4\"" May 21 10:33:00.126985 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:00.126922 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 21 10:33:00.131664 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:00.131648 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 21 10:33:00.149079 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:00.149045 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-57bd96b888-dn5pr"] May 21 10:33:00.152017 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:00.152003 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-dn5pr" May 21 10:33:00.156567 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:00.156551 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-ndwvq\"" May 21 10:33:00.156769 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:00.156751 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" May 21 10:33:00.157350 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:00.157334 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" May 21 10:33:00.175873 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:00.175851 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-br4rg"] May 21 10:33:00.181601 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:00.181583 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-dn5pr"] May 21 10:33:00.223790 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:00.223761 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4ee53fd8-6b82-4922-809a-b0f6b384e649-data-volume\") pod \"insights-runtime-extractor-br4rg\" (UID: \"4ee53fd8-6b82-4922-809a-b0f6b384e649\") " pod="openshift-insights/insights-runtime-extractor-br4rg" May 21 10:33:00.223931 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:00.223838 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4ee53fd8-6b82-4922-809a-b0f6b384e649-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-br4rg\" (UID: \"4ee53fd8-6b82-4922-809a-b0f6b384e649\") " pod="openshift-insights/insights-runtime-extractor-br4rg" May 21 10:33:00.223931 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:00.223879 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4ee53fd8-6b82-4922-809a-b0f6b384e649-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-br4rg\" (UID: \"4ee53fd8-6b82-4922-809a-b0f6b384e649\") " pod="openshift-insights/insights-runtime-extractor-br4rg" May 21 10:33:00.223931 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:00.223910 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4c92j\" (UniqueName: \"kubernetes.io/projected/4ee53fd8-6b82-4922-809a-b0f6b384e649-kube-api-access-4c92j\") pod \"insights-runtime-extractor-br4rg\" (UID: \"4ee53fd8-6b82-4922-809a-b0f6b384e649\") " pod="openshift-insights/insights-runtime-extractor-br4rg" May 21 10:33:00.224081 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:00.224002 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cp6d7\" (UniqueName: \"kubernetes.io/projected/61f2708c-7bab-43fb-be8b-c752aeba4358-kube-api-access-cp6d7\") pod \"downloads-57bd96b888-dn5pr\" (UID: \"61f2708c-7bab-43fb-be8b-c752aeba4358\") " pod="openshift-console/downloads-57bd96b888-dn5pr" May 21 10:33:00.224150 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:00.224088 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4ee53fd8-6b82-4922-809a-b0f6b384e649-crio-socket\") pod \"insights-runtime-extractor-br4rg\" (UID: \"4ee53fd8-6b82-4922-809a-b0f6b384e649\") " pod="openshift-insights/insights-runtime-extractor-br4rg" May 21 10:33:00.324998 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:00.324964 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4ee53fd8-6b82-4922-809a-b0f6b384e649-data-volume\") pod \"insights-runtime-extractor-br4rg\" (UID: \"4ee53fd8-6b82-4922-809a-b0f6b384e649\") " pod="openshift-insights/insights-runtime-extractor-br4rg" May 21 10:33:00.325172 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:00.325006 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4ee53fd8-6b82-4922-809a-b0f6b384e649-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-br4rg\" (UID: \"4ee53fd8-6b82-4922-809a-b0f6b384e649\") " pod="openshift-insights/insights-runtime-extractor-br4rg" May 21 10:33:00.325172 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:00.325028 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4ee53fd8-6b82-4922-809a-b0f6b384e649-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-br4rg\" (UID: \"4ee53fd8-6b82-4922-809a-b0f6b384e649\") " pod="openshift-insights/insights-runtime-extractor-br4rg" May 21 10:33:00.325172 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:00.325050 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4c92j\" (UniqueName: \"kubernetes.io/projected/4ee53fd8-6b82-4922-809a-b0f6b384e649-kube-api-access-4c92j\") pod \"insights-runtime-extractor-br4rg\" (UID: \"4ee53fd8-6b82-4922-809a-b0f6b384e649\") " pod="openshift-insights/insights-runtime-extractor-br4rg" May 21 10:33:00.325172 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:00.325105 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cp6d7\" (UniqueName: \"kubernetes.io/projected/61f2708c-7bab-43fb-be8b-c752aeba4358-kube-api-access-cp6d7\") pod \"downloads-57bd96b888-dn5pr\" (UID: \"61f2708c-7bab-43fb-be8b-c752aeba4358\") " pod="openshift-console/downloads-57bd96b888-dn5pr" May 21 10:33:00.325172 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:00.325138 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4ee53fd8-6b82-4922-809a-b0f6b384e649-crio-socket\") pod \"insights-runtime-extractor-br4rg\" (UID: \"4ee53fd8-6b82-4922-809a-b0f6b384e649\") " pod="openshift-insights/insights-runtime-extractor-br4rg" May 21 10:33:00.325407 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:00.325219 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4ee53fd8-6b82-4922-809a-b0f6b384e649-crio-socket\") pod \"insights-runtime-extractor-br4rg\" (UID: \"4ee53fd8-6b82-4922-809a-b0f6b384e649\") " pod="openshift-insights/insights-runtime-extractor-br4rg" May 21 10:33:00.325407 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:00.325379 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4ee53fd8-6b82-4922-809a-b0f6b384e649-data-volume\") pod \"insights-runtime-extractor-br4rg\" (UID: \"4ee53fd8-6b82-4922-809a-b0f6b384e649\") " pod="openshift-insights/insights-runtime-extractor-br4rg" May 21 10:33:00.325584 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:00.325569 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4ee53fd8-6b82-4922-809a-b0f6b384e649-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-br4rg\" (UID: \"4ee53fd8-6b82-4922-809a-b0f6b384e649\") " pod="openshift-insights/insights-runtime-extractor-br4rg" May 21 10:33:00.327463 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:00.327446 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4ee53fd8-6b82-4922-809a-b0f6b384e649-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-br4rg\" (UID: \"4ee53fd8-6b82-4922-809a-b0f6b384e649\") " pod="openshift-insights/insights-runtime-extractor-br4rg" May 21 10:33:00.368107 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:00.368075 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4c92j\" (UniqueName: \"kubernetes.io/projected/4ee53fd8-6b82-4922-809a-b0f6b384e649-kube-api-access-4c92j\") pod \"insights-runtime-extractor-br4rg\" (UID: \"4ee53fd8-6b82-4922-809a-b0f6b384e649\") " pod="openshift-insights/insights-runtime-extractor-br4rg" May 21 10:33:00.369938 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:00.369882 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cp6d7\" (UniqueName: \"kubernetes.io/projected/61f2708c-7bab-43fb-be8b-c752aeba4358-kube-api-access-cp6d7\") pod \"downloads-57bd96b888-dn5pr\" (UID: \"61f2708c-7bab-43fb-be8b-c752aeba4358\") " pod="openshift-console/downloads-57bd96b888-dn5pr" May 21 10:33:00.430430 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:00.430401 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-br4rg" May 21 10:33:00.460240 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:00.460204 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-dn5pr" May 21 10:33:00.580007 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:00.579985 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-br4rg"] May 21 10:33:00.582342 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:33:00.582318 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ee53fd8_6b82_4922_809a_b0f6b384e649.slice/crio-e51e58e579dbcc6f7838e27cf2c0568f8cb192d670d10bceb0a2a9462df1c45b WatchSource:0}: Error finding container e51e58e579dbcc6f7838e27cf2c0568f8cb192d670d10bceb0a2a9462df1c45b: Status 404 returned error can't find the container with id e51e58e579dbcc6f7838e27cf2c0568f8cb192d670d10bceb0a2a9462df1c45b May 21 10:33:00.623511 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:00.623475 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-dn5pr"] May 21 10:33:00.625798 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:33:00.625768 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61f2708c_7bab_43fb_be8b_c752aeba4358.slice/crio-e63287bc343765e14f3a3000c69693c031a12979bc51e4f1d3df637035d65946 WatchSource:0}: Error finding container e63287bc343765e14f3a3000c69693c031a12979bc51e4f1d3df637035d65946: Status 404 returned error can't find the container with id e63287bc343765e14f3a3000c69693c031a12979bc51e4f1d3df637035d65946 May 21 10:33:00.862995 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:00.862960 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-dn5pr" event={"ID":"61f2708c-7bab-43fb-be8b-c752aeba4358","Type":"ContainerStarted","Data":"e63287bc343765e14f3a3000c69693c031a12979bc51e4f1d3df637035d65946"} May 21 10:33:00.864199 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:00.864175 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-br4rg" event={"ID":"4ee53fd8-6b82-4922-809a-b0f6b384e649","Type":"ContainerStarted","Data":"50b52a2637eef8747c02231d27a9db6da3ed13771f8fc52dfbb52816721f55c0"} May 21 10:33:00.864314 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:00.864207 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-br4rg" event={"ID":"4ee53fd8-6b82-4922-809a-b0f6b384e649","Type":"ContainerStarted","Data":"e51e58e579dbcc6f7838e27cf2c0568f8cb192d670d10bceb0a2a9462df1c45b"} May 21 10:33:00.865650 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:00.865630 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wk2bh" event={"ID":"02618313-ee56-495f-b166-884fa5528f94","Type":"ContainerStarted","Data":"ca99a02145e2b26f53f8871140388a529e7a2b2f409ac843a388ec0214b1aea1"} May 21 10:33:00.865805 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:00.865793 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-wk2bh" May 21 10:33:00.908434 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:00.908341 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-wk2bh" podStartSLOduration=139.699537424 podStartE2EDuration="2m20.908326917s" podCreationTimestamp="2026-05-21 10:30:40 +0000 UTC" firstStartedPulling="2026-05-21 10:32:58.544202903 +0000 UTC m=+173.755362997" lastFinishedPulling="2026-05-21 10:32:59.752992383 +0000 UTC m=+174.964152490" observedRunningTime="2026-05-21 10:33:00.90761224 +0000 UTC m=+176.118772355" watchObservedRunningTime="2026-05-21 10:33:00.908326917 +0000 UTC m=+176.119487031" May 21 10:33:01.870239 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:01.870192 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-br4rg" event={"ID":"4ee53fd8-6b82-4922-809a-b0f6b384e649","Type":"ContainerStarted","Data":"ba5979345c9642e4b0b932533c4204734fb1b1332f0b004f4e02b8a1dfab89eb"} May 21 10:33:02.339595 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:02.339496 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a0b9e259-f4b1-4bd3-b191-fe08dbbd52c5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-jh4mw\" (UID: \"a0b9e259-f4b1-4bd3-b191-fe08dbbd52c5\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-jh4mw" May 21 10:33:02.342614 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:02.342580 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a0b9e259-f4b1-4bd3-b191-fe08dbbd52c5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-jh4mw\" (UID: \"a0b9e259-f4b1-4bd3-b191-fe08dbbd52c5\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-jh4mw" May 21 10:33:02.353449 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:02.353419 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-jh4mw" May 21 10:33:02.561228 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:02.560768 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-jh4mw"] May 21 10:33:02.564538 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:33:02.564509 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0b9e259_f4b1_4bd3_b191_fe08dbbd52c5.slice/crio-4ca32165dd8dfa6ed851d0827007bd3a01429a5e50d3d6bd34ec3ad35f67bd60 WatchSource:0}: Error finding container 4ca32165dd8dfa6ed851d0827007bd3a01429a5e50d3d6bd34ec3ad35f67bd60: Status 404 returned error can't find the container with id 4ca32165dd8dfa6ed851d0827007bd3a01429a5e50d3d6bd34ec3ad35f67bd60 May 21 10:33:02.874146 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:02.874107 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-jh4mw" event={"ID":"a0b9e259-f4b1-4bd3-b191-fe08dbbd52c5","Type":"ContainerStarted","Data":"4ca32165dd8dfa6ed851d0827007bd3a01429a5e50d3d6bd34ec3ad35f67bd60"} May 21 10:33:03.879869 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:03.879806 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-br4rg" event={"ID":"4ee53fd8-6b82-4922-809a-b0f6b384e649","Type":"ContainerStarted","Data":"ddf54492e26f830976c4ef5425386fd85f3fde50ce6ec82b17cc13d1abadae37"} May 21 10:33:03.908645 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:03.908582 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-br4rg" podStartSLOduration=0.999603374 podStartE2EDuration="3.908567908s" podCreationTimestamp="2026-05-21 10:33:00 +0000 UTC" firstStartedPulling="2026-05-21 10:33:00.640053443 +0000 UTC m=+175.851213537" lastFinishedPulling="2026-05-21 10:33:03.549017964 +0000 UTC m=+178.760178071" observedRunningTime="2026-05-21 10:33:03.906949117 +0000 UTC m=+179.118109232" watchObservedRunningTime="2026-05-21 10:33:03.908567908 +0000 UTC m=+179.119728017" May 21 10:33:05.887007 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:05.886913 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-jh4mw" event={"ID":"a0b9e259-f4b1-4bd3-b191-fe08dbbd52c5","Type":"ContainerStarted","Data":"e3e9e1aa8588287d0bb202d75937725fa103b07577006a32a55cba71760f6b40"} May 21 10:33:05.920370 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:05.920313 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-jh4mw" podStartSLOduration=33.172393919 podStartE2EDuration="35.92029536s" podCreationTimestamp="2026-05-21 10:32:30 +0000 UTC" firstStartedPulling="2026-05-21 10:33:02.566674311 +0000 UTC m=+177.777834407" lastFinishedPulling="2026-05-21 10:33:05.314575741 +0000 UTC m=+180.525735848" observedRunningTime="2026-05-21 10:33:05.918387478 +0000 UTC m=+181.129547598" watchObservedRunningTime="2026-05-21 10:33:05.92029536 +0000 UTC m=+181.131455479" May 21 10:33:08.918562 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:08.918515 2563 patch_prober.go:28] interesting pod/image-registry-57bfcfdbc9-qcqrf container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 21 10:33:08.919058 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:08.918578 2563 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-57bfcfdbc9-qcqrf" podUID="9e1df45f-c679-4347-b552-5d1d7a1cafb2" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 21 10:33:10.226771 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:10.226736 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-4hncc"] May 21 10:33:10.231270 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:10.231252 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-4hncc" May 21 10:33:10.233710 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:10.233681 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-8g8vq\"" May 21 10:33:10.233831 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:10.233782 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" May 21 10:33:10.234692 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:10.234670 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" May 21 10:33:10.234797 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:10.234693 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 21 10:33:10.242606 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:10.242581 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-4hncc"] May 21 10:33:10.304759 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:10.304718 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/32f0efb7-2a1c-4e9c-af6d-9082a850183e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-4hncc\" (UID: \"32f0efb7-2a1c-4e9c-af6d-9082a850183e\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-4hncc" May 21 10:33:10.304941 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:10.304772 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/32f0efb7-2a1c-4e9c-af6d-9082a850183e-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-4hncc\" (UID: \"32f0efb7-2a1c-4e9c-af6d-9082a850183e\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-4hncc" May 21 10:33:10.304941 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:10.304901 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/32f0efb7-2a1c-4e9c-af6d-9082a850183e-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-4hncc\" (UID: \"32f0efb7-2a1c-4e9c-af6d-9082a850183e\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-4hncc" May 21 10:33:10.305054 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:10.305033 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngs59\" (UniqueName: \"kubernetes.io/projected/32f0efb7-2a1c-4e9c-af6d-9082a850183e-kube-api-access-ngs59\") pod \"prometheus-operator-7779bbdd78-4hncc\" (UID: \"32f0efb7-2a1c-4e9c-af6d-9082a850183e\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-4hncc" May 21 10:33:10.406328 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:10.406293 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ngs59\" (UniqueName: \"kubernetes.io/projected/32f0efb7-2a1c-4e9c-af6d-9082a850183e-kube-api-access-ngs59\") pod \"prometheus-operator-7779bbdd78-4hncc\" (UID: \"32f0efb7-2a1c-4e9c-af6d-9082a850183e\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-4hncc" May 21 10:33:10.406510 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:10.406342 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/32f0efb7-2a1c-4e9c-af6d-9082a850183e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-4hncc\" (UID: \"32f0efb7-2a1c-4e9c-af6d-9082a850183e\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-4hncc" May 21 10:33:10.406510 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:10.406382 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/32f0efb7-2a1c-4e9c-af6d-9082a850183e-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-4hncc\" (UID: \"32f0efb7-2a1c-4e9c-af6d-9082a850183e\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-4hncc" May 21 10:33:10.406510 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:10.406468 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/32f0efb7-2a1c-4e9c-af6d-9082a850183e-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-4hncc\" (UID: \"32f0efb7-2a1c-4e9c-af6d-9082a850183e\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-4hncc" May 21 10:33:10.406659 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:33:10.406562 2563 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found May 21 10:33:10.406659 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:33:10.406642 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32f0efb7-2a1c-4e9c-af6d-9082a850183e-prometheus-operator-tls podName:32f0efb7-2a1c-4e9c-af6d-9082a850183e nodeName:}" failed. No retries permitted until 2026-05-21 10:33:10.90662246 +0000 UTC m=+186.117782564 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/32f0efb7-2a1c-4e9c-af6d-9082a850183e-prometheus-operator-tls") pod "prometheus-operator-7779bbdd78-4hncc" (UID: "32f0efb7-2a1c-4e9c-af6d-9082a850183e") : secret "prometheus-operator-tls" not found May 21 10:33:10.407276 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:10.407245 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/32f0efb7-2a1c-4e9c-af6d-9082a850183e-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-4hncc\" (UID: \"32f0efb7-2a1c-4e9c-af6d-9082a850183e\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-4hncc" May 21 10:33:10.409275 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:10.409251 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/32f0efb7-2a1c-4e9c-af6d-9082a850183e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-4hncc\" (UID: \"32f0efb7-2a1c-4e9c-af6d-9082a850183e\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-4hncc" May 21 10:33:10.429121 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:10.429093 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngs59\" (UniqueName: \"kubernetes.io/projected/32f0efb7-2a1c-4e9c-af6d-9082a850183e-kube-api-access-ngs59\") pod \"prometheus-operator-7779bbdd78-4hncc\" (UID: \"32f0efb7-2a1c-4e9c-af6d-9082a850183e\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-4hncc" May 21 10:33:10.828666 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:10.828638 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-57bfcfdbc9-qcqrf" May 21 10:33:10.873137 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:10.873105 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-wk2bh" May 21 10:33:10.912873 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:10.912514 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/32f0efb7-2a1c-4e9c-af6d-9082a850183e-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-4hncc\" (UID: \"32f0efb7-2a1c-4e9c-af6d-9082a850183e\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-4hncc" May 21 10:33:10.915853 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:10.915803 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/32f0efb7-2a1c-4e9c-af6d-9082a850183e-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-4hncc\" (UID: \"32f0efb7-2a1c-4e9c-af6d-9082a850183e\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-4hncc" May 21 10:33:11.142957 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:11.142872 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-4hncc" May 21 10:33:11.284759 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:11.284720 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-4hncc"] May 21 10:33:11.288869 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:33:11.288836 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32f0efb7_2a1c_4e9c_af6d_9082a850183e.slice/crio-21540557a2a824bf894d710255fc8faa5decced3d06b9ded7e7226f951253225 WatchSource:0}: Error finding container 21540557a2a824bf894d710255fc8faa5decced3d06b9ded7e7226f951253225: Status 404 returned error can't find the container with id 21540557a2a824bf894d710255fc8faa5decced3d06b9ded7e7226f951253225 May 21 10:33:11.906700 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:11.906654 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-4hncc" event={"ID":"32f0efb7-2a1c-4e9c-af6d-9082a850183e","Type":"ContainerStarted","Data":"21540557a2a824bf894d710255fc8faa5decced3d06b9ded7e7226f951253225"} May 21 10:33:19.933328 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:19.933256 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-4hncc" event={"ID":"32f0efb7-2a1c-4e9c-af6d-9082a850183e","Type":"ContainerStarted","Data":"2593aae78d11d2c5cbf3db6ee6f59a86b98e880a8a7111313014bc0c4ccfae98"} May 21 10:33:19.933328 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:19.933302 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-4hncc" event={"ID":"32f0efb7-2a1c-4e9c-af6d-9082a850183e","Type":"ContainerStarted","Data":"78f3c8a754c455a6a7e83781413b317e90a9ab8cfc2609278a7c4d2873bdd69e"} May 21 10:33:19.935402 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:19.935368 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-dn5pr" event={"ID":"61f2708c-7bab-43fb-be8b-c752aeba4358","Type":"ContainerStarted","Data":"de560ca6156b4541bcd51950e521cc2a3034c83b7661b88eb3579a59b8c7dd51"} May 21 10:33:19.935768 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:19.935745 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-57bd96b888-dn5pr" May 21 10:33:19.952065 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:19.952042 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-57bd96b888-dn5pr" May 21 10:33:20.030697 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:20.030625 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-57bd96b888-dn5pr" podStartSLOduration=1.27760159 podStartE2EDuration="20.030609617s" podCreationTimestamp="2026-05-21 10:33:00 +0000 UTC" firstStartedPulling="2026-05-21 10:33:00.627498515 +0000 UTC m=+175.838658611" lastFinishedPulling="2026-05-21 10:33:19.380506533 +0000 UTC m=+194.591666638" observedRunningTime="2026-05-21 10:33:20.02744831 +0000 UTC m=+195.238608444" watchObservedRunningTime="2026-05-21 10:33:20.030609617 +0000 UTC m=+195.241769731" May 21 10:33:20.031050 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:20.031011 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7779bbdd78-4hncc" podStartSLOduration=1.9834547150000001 podStartE2EDuration="10.031003388s" podCreationTimestamp="2026-05-21 10:33:10 +0000 UTC" firstStartedPulling="2026-05-21 10:33:11.291015247 +0000 UTC m=+186.502175339" lastFinishedPulling="2026-05-21 10:33:19.338563916 +0000 UTC m=+194.549724012" observedRunningTime="2026-05-21 10:33:19.968623731 +0000 UTC m=+195.179783847" watchObservedRunningTime="2026-05-21 10:33:20.031003388 +0000 UTC m=+195.242163503" May 21 10:33:21.898802 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:21.898764 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-xpzq9"] May 21 10:33:21.918566 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:21.918531 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xpzq9" May 21 10:33:21.935100 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:21.935074 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 21 10:33:21.935216 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:21.935199 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 21 10:33:21.935298 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:21.935203 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 21 10:33:21.935382 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:21.935362 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-l8f84\"" May 21 10:33:22.116188 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:22.116141 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbfjm\" (UniqueName: \"kubernetes.io/projected/f73eb484-906d-4f7b-8a4c-0ae9f4bbbde9-kube-api-access-dbfjm\") pod \"node-exporter-xpzq9\" (UID: \"f73eb484-906d-4f7b-8a4c-0ae9f4bbbde9\") " pod="openshift-monitoring/node-exporter-xpzq9" May 21 10:33:22.116352 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:22.116206 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f73eb484-906d-4f7b-8a4c-0ae9f4bbbde9-node-exporter-textfile\") pod \"node-exporter-xpzq9\" (UID: \"f73eb484-906d-4f7b-8a4c-0ae9f4bbbde9\") " pod="openshift-monitoring/node-exporter-xpzq9" May 21 10:33:22.116352 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:22.116332 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f73eb484-906d-4f7b-8a4c-0ae9f4bbbde9-metrics-client-ca\") pod \"node-exporter-xpzq9\" (UID: \"f73eb484-906d-4f7b-8a4c-0ae9f4bbbde9\") " pod="openshift-monitoring/node-exporter-xpzq9" May 21 10:33:22.116464 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:22.116383 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f73eb484-906d-4f7b-8a4c-0ae9f4bbbde9-node-exporter-accelerators-collector-config\") pod \"node-exporter-xpzq9\" (UID: \"f73eb484-906d-4f7b-8a4c-0ae9f4bbbde9\") " pod="openshift-monitoring/node-exporter-xpzq9" May 21 10:33:22.116464 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:22.116434 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f73eb484-906d-4f7b-8a4c-0ae9f4bbbde9-root\") pod \"node-exporter-xpzq9\" (UID: \"f73eb484-906d-4f7b-8a4c-0ae9f4bbbde9\") " pod="openshift-monitoring/node-exporter-xpzq9" May 21 10:33:22.116464 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:22.116458 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f73eb484-906d-4f7b-8a4c-0ae9f4bbbde9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xpzq9\" (UID: \"f73eb484-906d-4f7b-8a4c-0ae9f4bbbde9\") " pod="openshift-monitoring/node-exporter-xpzq9" May 21 10:33:22.116592 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:22.116516 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f73eb484-906d-4f7b-8a4c-0ae9f4bbbde9-node-exporter-wtmp\") pod \"node-exporter-xpzq9\" (UID: \"f73eb484-906d-4f7b-8a4c-0ae9f4bbbde9\") " pod="openshift-monitoring/node-exporter-xpzq9" May 21 10:33:22.116592 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:22.116545 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f73eb484-906d-4f7b-8a4c-0ae9f4bbbde9-sys\") pod \"node-exporter-xpzq9\" (UID: \"f73eb484-906d-4f7b-8a4c-0ae9f4bbbde9\") " pod="openshift-monitoring/node-exporter-xpzq9" May 21 10:33:22.116592 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:22.116566 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f73eb484-906d-4f7b-8a4c-0ae9f4bbbde9-node-exporter-tls\") pod \"node-exporter-xpzq9\" (UID: \"f73eb484-906d-4f7b-8a4c-0ae9f4bbbde9\") " pod="openshift-monitoring/node-exporter-xpzq9" May 21 10:33:22.217587 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:22.217498 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f73eb484-906d-4f7b-8a4c-0ae9f4bbbde9-node-exporter-wtmp\") pod \"node-exporter-xpzq9\" (UID: \"f73eb484-906d-4f7b-8a4c-0ae9f4bbbde9\") " pod="openshift-monitoring/node-exporter-xpzq9" May 21 10:33:22.217587 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:22.217542 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f73eb484-906d-4f7b-8a4c-0ae9f4bbbde9-sys\") pod \"node-exporter-xpzq9\" (UID: \"f73eb484-906d-4f7b-8a4c-0ae9f4bbbde9\") " pod="openshift-monitoring/node-exporter-xpzq9" May 21 10:33:22.217587 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:22.217568 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f73eb484-906d-4f7b-8a4c-0ae9f4bbbde9-node-exporter-tls\") pod \"node-exporter-xpzq9\" (UID: \"f73eb484-906d-4f7b-8a4c-0ae9f4bbbde9\") " pod="openshift-monitoring/node-exporter-xpzq9" May 21 10:33:22.217899 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:22.217602 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dbfjm\" (UniqueName: \"kubernetes.io/projected/f73eb484-906d-4f7b-8a4c-0ae9f4bbbde9-kube-api-access-dbfjm\") pod \"node-exporter-xpzq9\" (UID: \"f73eb484-906d-4f7b-8a4c-0ae9f4bbbde9\") " pod="openshift-monitoring/node-exporter-xpzq9" May 21 10:33:22.217899 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:22.217626 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f73eb484-906d-4f7b-8a4c-0ae9f4bbbde9-sys\") pod \"node-exporter-xpzq9\" (UID: \"f73eb484-906d-4f7b-8a4c-0ae9f4bbbde9\") " pod="openshift-monitoring/node-exporter-xpzq9" May 21 10:33:22.217899 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:22.217630 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f73eb484-906d-4f7b-8a4c-0ae9f4bbbde9-node-exporter-textfile\") pod \"node-exporter-xpzq9\" (UID: \"f73eb484-906d-4f7b-8a4c-0ae9f4bbbde9\") " pod="openshift-monitoring/node-exporter-xpzq9" May 21 10:33:22.217899 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:22.217700 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f73eb484-906d-4f7b-8a4c-0ae9f4bbbde9-node-exporter-wtmp\") pod \"node-exporter-xpzq9\" (UID: \"f73eb484-906d-4f7b-8a4c-0ae9f4bbbde9\") " pod="openshift-monitoring/node-exporter-xpzq9" May 21 10:33:22.217899 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:22.217752 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f73eb484-906d-4f7b-8a4c-0ae9f4bbbde9-metrics-client-ca\") pod \"node-exporter-xpzq9\" (UID: \"f73eb484-906d-4f7b-8a4c-0ae9f4bbbde9\") " pod="openshift-monitoring/node-exporter-xpzq9" May 21 10:33:22.217899 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:22.217794 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f73eb484-906d-4f7b-8a4c-0ae9f4bbbde9-node-exporter-accelerators-collector-config\") pod \"node-exporter-xpzq9\" (UID: \"f73eb484-906d-4f7b-8a4c-0ae9f4bbbde9\") " pod="openshift-monitoring/node-exporter-xpzq9" May 21 10:33:22.217899 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:22.217877 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f73eb484-906d-4f7b-8a4c-0ae9f4bbbde9-root\") pod \"node-exporter-xpzq9\" (UID: \"f73eb484-906d-4f7b-8a4c-0ae9f4bbbde9\") " pod="openshift-monitoring/node-exporter-xpzq9" May 21 10:33:22.218214 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:22.217908 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f73eb484-906d-4f7b-8a4c-0ae9f4bbbde9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xpzq9\" (UID: \"f73eb484-906d-4f7b-8a4c-0ae9f4bbbde9\") " pod="openshift-monitoring/node-exporter-xpzq9" May 21 10:33:22.218214 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:22.217975 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f73eb484-906d-4f7b-8a4c-0ae9f4bbbde9-node-exporter-textfile\") pod \"node-exporter-xpzq9\" (UID: \"f73eb484-906d-4f7b-8a4c-0ae9f4bbbde9\") " pod="openshift-monitoring/node-exporter-xpzq9" May 21 10:33:22.218214 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:22.218037 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f73eb484-906d-4f7b-8a4c-0ae9f4bbbde9-root\") pod \"node-exporter-xpzq9\" (UID: \"f73eb484-906d-4f7b-8a4c-0ae9f4bbbde9\") " pod="openshift-monitoring/node-exporter-xpzq9" May 21 10:33:22.218362 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:22.218340 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f73eb484-906d-4f7b-8a4c-0ae9f4bbbde9-metrics-client-ca\") pod \"node-exporter-xpzq9\" (UID: \"f73eb484-906d-4f7b-8a4c-0ae9f4bbbde9\") " pod="openshift-monitoring/node-exporter-xpzq9" May 21 10:33:22.218762 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:22.218736 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f73eb484-906d-4f7b-8a4c-0ae9f4bbbde9-node-exporter-accelerators-collector-config\") pod \"node-exporter-xpzq9\" (UID: \"f73eb484-906d-4f7b-8a4c-0ae9f4bbbde9\") " pod="openshift-monitoring/node-exporter-xpzq9" May 21 10:33:22.220779 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:22.220647 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f73eb484-906d-4f7b-8a4c-0ae9f4bbbde9-node-exporter-tls\") pod \"node-exporter-xpzq9\" (UID: \"f73eb484-906d-4f7b-8a4c-0ae9f4bbbde9\") " pod="openshift-monitoring/node-exporter-xpzq9" May 21 10:33:22.220779 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:22.220757 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f73eb484-906d-4f7b-8a4c-0ae9f4bbbde9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xpzq9\" (UID: \"f73eb484-906d-4f7b-8a4c-0ae9f4bbbde9\") " pod="openshift-monitoring/node-exporter-xpzq9" May 21 10:33:22.245442 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:22.245416 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbfjm\" (UniqueName: \"kubernetes.io/projected/f73eb484-906d-4f7b-8a4c-0ae9f4bbbde9-kube-api-access-dbfjm\") pod \"node-exporter-xpzq9\" (UID: \"f73eb484-906d-4f7b-8a4c-0ae9f4bbbde9\") " pod="openshift-monitoring/node-exporter-xpzq9" May 21 10:33:22.507848 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:22.507745 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-57bfcfdbc9-qcqrf"] May 21 10:33:22.529856 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:22.529812 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xpzq9" May 21 10:33:22.540346 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:33:22.540313 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf73eb484_906d_4f7b_8a4c_0ae9f4bbbde9.slice/crio-41b7e04b58871aedbf013adf656f419966cba83b55f1089bb569fbb76271f15e WatchSource:0}: Error finding container 41b7e04b58871aedbf013adf656f419966cba83b55f1089bb569fbb76271f15e: Status 404 returned error can't find the container with id 41b7e04b58871aedbf013adf656f419966cba83b55f1089bb569fbb76271f15e May 21 10:33:22.954531 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:22.954491 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xpzq9" event={"ID":"f73eb484-906d-4f7b-8a4c-0ae9f4bbbde9","Type":"ContainerStarted","Data":"41b7e04b58871aedbf013adf656f419966cba83b55f1089bb569fbb76271f15e"} May 21 10:33:24.961717 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:24.961677 2563 generic.go:358] "Generic (PLEG): container finished" podID="f73eb484-906d-4f7b-8a4c-0ae9f4bbbde9" containerID="1dd4023769916e99ae73193d9e470895c5fa8dac087deb26703125ca8ff27341" exitCode=0 May 21 10:33:24.962228 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:24.961750 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xpzq9" event={"ID":"f73eb484-906d-4f7b-8a4c-0ae9f4bbbde9","Type":"ContainerDied","Data":"1dd4023769916e99ae73193d9e470895c5fa8dac087deb26703125ca8ff27341"} May 21 10:33:25.966658 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:25.966619 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xpzq9" event={"ID":"f73eb484-906d-4f7b-8a4c-0ae9f4bbbde9","Type":"ContainerStarted","Data":"a8faa237e1f8bb3ba336746c7edfef8a5ae3ea69c18cf9c3e57d86b177936f0f"} May 21 10:33:25.966658 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:25.966663 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xpzq9" event={"ID":"f73eb484-906d-4f7b-8a4c-0ae9f4bbbde9","Type":"ContainerStarted","Data":"ebb509849e594c87da413cb6fb442fa70fe5af53fd5eb8e23b09a4d501fa869e"} May 21 10:33:25.988528 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:25.988483 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-xpzq9" podStartSLOduration=3.507896392 podStartE2EDuration="4.988468191s" podCreationTimestamp="2026-05-21 10:33:21 +0000 UTC" firstStartedPulling="2026-05-21 10:33:22.542266919 +0000 UTC m=+197.753427013" lastFinishedPulling="2026-05-21 10:33:24.022838709 +0000 UTC m=+199.233998812" observedRunningTime="2026-05-21 10:33:25.986457011 +0000 UTC m=+201.197617139" watchObservedRunningTime="2026-05-21 10:33:25.988468191 +0000 UTC m=+201.199628306" May 21 10:33:26.428323 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:26.428287 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-z5hnr"] May 21 10:33:26.457965 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:26.457928 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-z5hnr"] May 21 10:33:26.458142 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:26.458069 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-z5hnr" May 21 10:33:26.461434 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:26.461383 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" May 21 10:33:26.461434 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:26.461394 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-wpkqc\"" May 21 10:33:26.557859 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:26.557800 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a1eb6ae0-304e-4914-9853-9f3d5b95409c-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-z5hnr\" (UID: \"a1eb6ae0-304e-4914-9853-9f3d5b95409c\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-z5hnr" May 21 10:33:26.659322 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:26.659283 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a1eb6ae0-304e-4914-9853-9f3d5b95409c-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-z5hnr\" (UID: \"a1eb6ae0-304e-4914-9853-9f3d5b95409c\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-z5hnr" May 21 10:33:26.659499 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:33:26.659429 2563 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found May 21 10:33:26.659574 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:33:26.659499 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1eb6ae0-304e-4914-9853-9f3d5b95409c-monitoring-plugin-cert podName:a1eb6ae0-304e-4914-9853-9f3d5b95409c nodeName:}" failed. No retries permitted until 2026-05-21 10:33:27.159482924 +0000 UTC m=+202.370643032 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/a1eb6ae0-304e-4914-9853-9f3d5b95409c-monitoring-plugin-cert") pod "monitoring-plugin-665c9c8584-z5hnr" (UID: "a1eb6ae0-304e-4914-9853-9f3d5b95409c") : secret "monitoring-plugin-cert" not found May 21 10:33:27.163200 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:27.163156 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a1eb6ae0-304e-4914-9853-9f3d5b95409c-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-z5hnr\" (UID: \"a1eb6ae0-304e-4914-9853-9f3d5b95409c\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-z5hnr" May 21 10:33:27.166209 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:27.166183 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a1eb6ae0-304e-4914-9853-9f3d5b95409c-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-z5hnr\" (UID: \"a1eb6ae0-304e-4914-9853-9f3d5b95409c\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-z5hnr" May 21 10:33:27.369284 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:27.369240 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-z5hnr" May 21 10:33:27.519507 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:27.519470 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-z5hnr"] May 21 10:33:27.522806 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:33:27.522778 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1eb6ae0_304e_4914_9853_9f3d5b95409c.slice/crio-4ebda3d46d446316070ddc7a1b77d6de373e19b79d10b0166fa914d3cec970e4 WatchSource:0}: Error finding container 4ebda3d46d446316070ddc7a1b77d6de373e19b79d10b0166fa914d3cec970e4: Status 404 returned error can't find the container with id 4ebda3d46d446316070ddc7a1b77d6de373e19b79d10b0166fa914d3cec970e4 May 21 10:33:27.974075 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:27.974029 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-z5hnr" event={"ID":"a1eb6ae0-304e-4914-9853-9f3d5b95409c","Type":"ContainerStarted","Data":"4ebda3d46d446316070ddc7a1b77d6de373e19b79d10b0166fa914d3cec970e4"} May 21 10:33:28.114078 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:28.114036 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 10:33:28.140637 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:28.140600 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 10:33:28.140812 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:28.140799 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 21 10:33:28.146043 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:28.146018 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 21 10:33:28.146230 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:28.146208 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 21 10:33:28.146456 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:28.146229 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 21 10:33:28.147039 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:28.146777 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 21 10:33:28.147198 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:28.147177 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-ccjvneqdm66jb\"" May 21 10:33:28.147291 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:28.147015 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 21 10:33:28.147353 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:28.147143 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 21 10:33:28.147430 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:28.147014 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 21 10:33:28.147619 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:28.147601 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" May 21 10:33:28.147705 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:28.147610 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-gqpvp\"" May 21 10:33:28.148050 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:28.148031 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 21 10:33:28.148160 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:28.148120 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 21 10:33:28.148449 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:28.148432 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 21 10:33:28.148538 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:28.148448 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 21 10:33:28.155349 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:28.155329 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 21 10:33:28.171467 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:28.171431 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3a54fb5d-8ca7-490c-aa54-223c65efae28-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3a54fb5d-8ca7-490c-aa54-223c65efae28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 10:33:28.171948 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:28.171927 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3a54fb5d-8ca7-490c-aa54-223c65efae28-web-config\") pod \"prometheus-k8s-0\" (UID: \"3a54fb5d-8ca7-490c-aa54-223c65efae28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 10:33:28.172103 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:28.172069 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3a54fb5d-8ca7-490c-aa54-223c65efae28-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3a54fb5d-8ca7-490c-aa54-223c65efae28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 10:33:28.172225 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:28.172104 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a54fb5d-8ca7-490c-aa54-223c65efae28-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3a54fb5d-8ca7-490c-aa54-223c65efae28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 10:33:28.172225 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:28.172134 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3a54fb5d-8ca7-490c-aa54-223c65efae28-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3a54fb5d-8ca7-490c-aa54-223c65efae28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 10:33:28.172225 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:28.172174 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3a54fb5d-8ca7-490c-aa54-223c65efae28-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3a54fb5d-8ca7-490c-aa54-223c65efae28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 10:33:28.172225 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:28.172201 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a54fb5d-8ca7-490c-aa54-223c65efae28-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3a54fb5d-8ca7-490c-aa54-223c65efae28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 10:33:28.172441 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:28.172260 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3a54fb5d-8ca7-490c-aa54-223c65efae28-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3a54fb5d-8ca7-490c-aa54-223c65efae28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 10:33:28.172441 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:28.172289 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a54fb5d-8ca7-490c-aa54-223c65efae28-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3a54fb5d-8ca7-490c-aa54-223c65efae28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 10:33:28.172441 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:28.172322 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3a54fb5d-8ca7-490c-aa54-223c65efae28-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3a54fb5d-8ca7-490c-aa54-223c65efae28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 10:33:28.172441 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:28.172360 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3a54fb5d-8ca7-490c-aa54-223c65efae28-config\") pod \"prometheus-k8s-0\" (UID: \"3a54fb5d-8ca7-490c-aa54-223c65efae28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 10:33:28.172441 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:28.172386 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3a54fb5d-8ca7-490c-aa54-223c65efae28-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3a54fb5d-8ca7-490c-aa54-223c65efae28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 10:33:28.172441 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:28.172432 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3a54fb5d-8ca7-490c-aa54-223c65efae28-config-out\") pod \"prometheus-k8s-0\" (UID: \"3a54fb5d-8ca7-490c-aa54-223c65efae28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 10:33:28.172743 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:28.172457 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3a54fb5d-8ca7-490c-aa54-223c65efae28-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3a54fb5d-8ca7-490c-aa54-223c65efae28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 10:33:28.172743 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:28.172480 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a54fb5d-8ca7-490c-aa54-223c65efae28-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3a54fb5d-8ca7-490c-aa54-223c65efae28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 10:33:28.172743 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:28.172506 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3a54fb5d-8ca7-490c-aa54-223c65efae28-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3a54fb5d-8ca7-490c-aa54-223c65efae28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 10:33:28.172743 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:28.172529 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srkvj\" (UniqueName: \"kubernetes.io/projected/3a54fb5d-8ca7-490c-aa54-223c65efae28-kube-api-access-srkvj\") pod \"prometheus-k8s-0\" (UID: \"3a54fb5d-8ca7-490c-aa54-223c65efae28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 10:33:28.172743 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:28.172556 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3a54fb5d-8ca7-490c-aa54-223c65efae28-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3a54fb5d-8ca7-490c-aa54-223c65efae28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 10:33:28.273340 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:28.273246 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3a54fb5d-8ca7-490c-aa54-223c65efae28-config\") pod \"prometheus-k8s-0\" (UID: \"3a54fb5d-8ca7-490c-aa54-223c65efae28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 10:33:28.273340 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:28.273299 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3a54fb5d-8ca7-490c-aa54-223c65efae28-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3a54fb5d-8ca7-490c-aa54-223c65efae28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 10:33:28.273561 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:28.273516 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3a54fb5d-8ca7-490c-aa54-223c65efae28-config-out\") pod \"prometheus-k8s-0\" (UID: \"3a54fb5d-8ca7-490c-aa54-223c65efae28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 10:33:28.273610 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:28.273562 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3a54fb5d-8ca7-490c-aa54-223c65efae28-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3a54fb5d-8ca7-490c-aa54-223c65efae28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 10:33:28.273610 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:28.273590 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a54fb5d-8ca7-490c-aa54-223c65efae28-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3a54fb5d-8ca7-490c-aa54-223c65efae28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 10:33:28.273717 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:28.273617 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3a54fb5d-8ca7-490c-aa54-223c65efae28-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3a54fb5d-8ca7-490c-aa54-223c65efae28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 10:33:28.273717 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:28.273644 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-srkvj\" (UniqueName: \"kubernetes.io/projected/3a54fb5d-8ca7-490c-aa54-223c65efae28-kube-api-access-srkvj\") pod \"prometheus-k8s-0\" (UID: \"3a54fb5d-8ca7-490c-aa54-223c65efae28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 10:33:28.273717 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:28.273691 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3a54fb5d-8ca7-490c-aa54-223c65efae28-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3a54fb5d-8ca7-490c-aa54-223c65efae28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 10:33:28.273864 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:28.273725 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3a54fb5d-8ca7-490c-aa54-223c65efae28-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3a54fb5d-8ca7-490c-aa54-223c65efae28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 10:33:28.273864 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:28.273750 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3a54fb5d-8ca7-490c-aa54-223c65efae28-web-config\") pod \"prometheus-k8s-0\" (UID: \"3a54fb5d-8ca7-490c-aa54-223c65efae28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 10:33:28.273864 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:28.273779 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3a54fb5d-8ca7-490c-aa54-223c65efae28-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3a54fb5d-8ca7-490c-aa54-223c65efae28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 10:33:28.273864 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:28.273801 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a54fb5d-8ca7-490c-aa54-223c65efae28-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3a54fb5d-8ca7-490c-aa54-223c65efae28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 10:33:28.273864 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:28.273852 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3a54fb5d-8ca7-490c-aa54-223c65efae28-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3a54fb5d-8ca7-490c-aa54-223c65efae28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 10:33:28.274079 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:28.273939 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3a54fb5d-8ca7-490c-aa54-223c65efae28-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3a54fb5d-8ca7-490c-aa54-223c65efae28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 10:33:28.274079 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:28.273963 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a54fb5d-8ca7-490c-aa54-223c65efae28-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3a54fb5d-8ca7-490c-aa54-223c65efae28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 10:33:28.274079 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:28.274020 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3a54fb5d-8ca7-490c-aa54-223c65efae28-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3a54fb5d-8ca7-490c-aa54-223c65efae28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 10:33:28.274079 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:28.274048 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a54fb5d-8ca7-490c-aa54-223c65efae28-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3a54fb5d-8ca7-490c-aa54-223c65efae28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 10:33:28.274262 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:28.274081 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3a54fb5d-8ca7-490c-aa54-223c65efae28-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3a54fb5d-8ca7-490c-aa54-223c65efae28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 10:33:28.274945 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:28.274920 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a54fb5d-8ca7-490c-aa54-223c65efae28-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3a54fb5d-8ca7-490c-aa54-223c65efae28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 10:33:28.275278 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:28.275254 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a54fb5d-8ca7-490c-aa54-223c65efae28-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3a54fb5d-8ca7-490c-aa54-223c65efae28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 10:33:28.278479 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:28.278183 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3a54fb5d-8ca7-490c-aa54-223c65efae28-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3a54fb5d-8ca7-490c-aa54-223c65efae28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 10:33:28.278900 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:28.278876 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/3a54fb5d-8ca7-490c-aa54-223c65efae28-config\") pod \"prometheus-k8s-0\" (UID: \"3a54fb5d-8ca7-490c-aa54-223c65efae28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 10:33:28.279524 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:28.279500 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a54fb5d-8ca7-490c-aa54-223c65efae28-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3a54fb5d-8ca7-490c-aa54-223c65efae28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 10:33:28.281052 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:28.281030 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3a54fb5d-8ca7-490c-aa54-223c65efae28-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3a54fb5d-8ca7-490c-aa54-223c65efae28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 10:33:28.284308 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:28.282006 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3a54fb5d-8ca7-490c-aa54-223c65efae28-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3a54fb5d-8ca7-490c-aa54-223c65efae28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 10:33:28.284308 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:28.282162 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3a54fb5d-8ca7-490c-aa54-223c65efae28-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3a54fb5d-8ca7-490c-aa54-223c65efae28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 10:33:28.284308 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:28.282769 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3a54fb5d-8ca7-490c-aa54-223c65efae28-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3a54fb5d-8ca7-490c-aa54-223c65efae28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 10:33:28.284308 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:28.283453 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a54fb5d-8ca7-490c-aa54-223c65efae28-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3a54fb5d-8ca7-490c-aa54-223c65efae28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 10:33:28.284308 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:28.284282 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3a54fb5d-8ca7-490c-aa54-223c65efae28-web-config\") pod \"prometheus-k8s-0\" (UID: \"3a54fb5d-8ca7-490c-aa54-223c65efae28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 10:33:28.285201 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:28.285139 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3a54fb5d-8ca7-490c-aa54-223c65efae28-config-out\") pod \"prometheus-k8s-0\" (UID: \"3a54fb5d-8ca7-490c-aa54-223c65efae28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 10:33:28.285607 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:28.285564 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3a54fb5d-8ca7-490c-aa54-223c65efae28-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3a54fb5d-8ca7-490c-aa54-223c65efae28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 10:33:28.285912 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:28.285888 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3a54fb5d-8ca7-490c-aa54-223c65efae28-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3a54fb5d-8ca7-490c-aa54-223c65efae28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 10:33:28.287051 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:28.287000 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-srkvj\" (UniqueName: \"kubernetes.io/projected/3a54fb5d-8ca7-490c-aa54-223c65efae28-kube-api-access-srkvj\") pod \"prometheus-k8s-0\" (UID: \"3a54fb5d-8ca7-490c-aa54-223c65efae28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 10:33:28.287918 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:28.287767 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3a54fb5d-8ca7-490c-aa54-223c65efae28-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3a54fb5d-8ca7-490c-aa54-223c65efae28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 10:33:28.288608 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:28.288177 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3a54fb5d-8ca7-490c-aa54-223c65efae28-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3a54fb5d-8ca7-490c-aa54-223c65efae28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 10:33:28.290319 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:28.290292 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3a54fb5d-8ca7-490c-aa54-223c65efae28-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3a54fb5d-8ca7-490c-aa54-223c65efae28\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 10:33:28.457483 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:28.456959 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 21 10:33:28.643875 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:28.643842 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 10:33:28.647444 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:33:28.647415 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a54fb5d_8ca7_490c_aa54_223c65efae28.slice/crio-d338694856ec6f9bd5abf56368c5a7275b69de96f5abe0231c1a58f96d3dbcc5 WatchSource:0}: Error finding container d338694856ec6f9bd5abf56368c5a7275b69de96f5abe0231c1a58f96d3dbcc5: Status 404 returned error can't find the container with id d338694856ec6f9bd5abf56368c5a7275b69de96f5abe0231c1a58f96d3dbcc5 May 21 10:33:28.978114 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:28.978064 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3a54fb5d-8ca7-490c-aa54-223c65efae28","Type":"ContainerStarted","Data":"d338694856ec6f9bd5abf56368c5a7275b69de96f5abe0231c1a58f96d3dbcc5"} May 21 10:33:29.983579 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:29.983497 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-z5hnr" event={"ID":"a1eb6ae0-304e-4914-9853-9f3d5b95409c","Type":"ContainerStarted","Data":"599ed296c9de238d37181b75763a1cd17d28222376e840153512e5de67ce98cb"} May 21 10:33:29.983989 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:29.983750 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-z5hnr" May 21 10:33:29.988983 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:29.988951 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-z5hnr" May 21 10:33:30.005201 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:30.005150 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-665c9c8584-z5hnr" podStartSLOduration=1.902746006 podStartE2EDuration="4.005138595s" podCreationTimestamp="2026-05-21 10:33:26 +0000 UTC" firstStartedPulling="2026-05-21 10:33:27.525267765 +0000 UTC m=+202.736427860" lastFinishedPulling="2026-05-21 10:33:29.627660357 +0000 UTC m=+204.838820449" observedRunningTime="2026-05-21 10:33:30.004224131 +0000 UTC m=+205.215384247" watchObservedRunningTime="2026-05-21 10:33:30.005138595 +0000 UTC m=+205.216298704" May 21 10:33:30.988033 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:30.987952 2563 generic.go:358] "Generic (PLEG): container finished" podID="3a54fb5d-8ca7-490c-aa54-223c65efae28" containerID="e4b2489b0660a21994a841ad8e21f23ee33dfca4e43e11fe0e619d9382f0755f" exitCode=0 May 21 10:33:30.988033 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:30.987993 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3a54fb5d-8ca7-490c-aa54-223c65efae28","Type":"ContainerDied","Data":"e4b2489b0660a21994a841ad8e21f23ee33dfca4e43e11fe0e619d9382f0755f"} May 21 10:33:35.003454 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:35.003420 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3a54fb5d-8ca7-490c-aa54-223c65efae28","Type":"ContainerStarted","Data":"f4034ac30c226629b45156a150ccedb068011ca28dc2f807a4c9fba206111568"} May 21 10:33:35.003880 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:35.003463 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3a54fb5d-8ca7-490c-aa54-223c65efae28","Type":"ContainerStarted","Data":"d2350ad3955ffb70b0227d29f62d2ca165aa07538dbdea17c6d1861cc44907b1"} May 21 10:33:38.015973 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:38.015933 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3a54fb5d-8ca7-490c-aa54-223c65efae28","Type":"ContainerStarted","Data":"a8c28da413cb365ce0188fa99899a04f0f4757a551585719963e0ac9e79ff9f8"} May 21 10:33:38.016411 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:38.015979 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3a54fb5d-8ca7-490c-aa54-223c65efae28","Type":"ContainerStarted","Data":"176513bc3ccabe12e0f9566ae5cce2cf42f7af08b9f64d348b348ecc6f86a8aa"} May 21 10:33:38.016411 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:38.015994 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3a54fb5d-8ca7-490c-aa54-223c65efae28","Type":"ContainerStarted","Data":"1054c67bede267b741a3b38f18be28d944f42a36c4eed1cf15aed0552074ccda"} May 21 10:33:38.016411 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:38.016007 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3a54fb5d-8ca7-490c-aa54-223c65efae28","Type":"ContainerStarted","Data":"f9536844b7a606aead757cafc3db6fbab3d4027c2333b3b28150dd19e18e6897"} May 21 10:33:38.045718 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:38.045664 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.5813892470000002 podStartE2EDuration="10.045646832s" podCreationTimestamp="2026-05-21 10:33:28 +0000 UTC" firstStartedPulling="2026-05-21 10:33:28.650160537 +0000 UTC m=+203.861320632" lastFinishedPulling="2026-05-21 10:33:37.114418121 +0000 UTC m=+212.325578217" observedRunningTime="2026-05-21 10:33:38.043996199 +0000 UTC m=+213.255156325" watchObservedRunningTime="2026-05-21 10:33:38.045646832 +0000 UTC m=+213.256806945" May 21 10:33:38.458536 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:38.458498 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 21 10:33:42.033504 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:42.033465 2563 generic.go:358] "Generic (PLEG): container finished" podID="93d61278-e692-455e-9018-b65a4200cc0c" containerID="2acbbab30daf911d5f5b464079132578f6a8c563c92b5a897912e0c5b1611de8" exitCode=0 May 21 10:33:42.033892 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:42.033532 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-vm75w" event={"ID":"93d61278-e692-455e-9018-b65a4200cc0c","Type":"ContainerDied","Data":"2acbbab30daf911d5f5b464079132578f6a8c563c92b5a897912e0c5b1611de8"} May 21 10:33:42.033892 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:42.033862 2563 scope.go:117] "RemoveContainer" containerID="2acbbab30daf911d5f5b464079132578f6a8c563c92b5a897912e0c5b1611de8" May 21 10:33:43.038635 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:43.038597 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-vm75w" event={"ID":"93d61278-e692-455e-9018-b65a4200cc0c","Type":"ContainerStarted","Data":"325aab66e5f64f9b142ada19f5df522d642fd79d5f337cf13336c80ace983621"} May 21 10:33:47.534414 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:47.534375 2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-57bfcfdbc9-qcqrf" podUID="9e1df45f-c679-4347-b552-5d1d7a1cafb2" containerName="registry" containerID="cri-o://ab91fb00dd1a4dbd6ced8d76e85fc37f10bef60d03ba21ccc8aa69aaead2805b" gracePeriod=30 May 21 10:33:47.790948 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:47.790875 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57bfcfdbc9-qcqrf" May 21 10:33:47.952535 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:47.952501 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e1df45f-c679-4347-b552-5d1d7a1cafb2-registry-tls\") pod \"9e1df45f-c679-4347-b552-5d1d7a1cafb2\" (UID: \"9e1df45f-c679-4347-b552-5d1d7a1cafb2\") " May 21 10:33:47.952704 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:47.952563 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9e1df45f-c679-4347-b552-5d1d7a1cafb2-registry-certificates\") pod \"9e1df45f-c679-4347-b552-5d1d7a1cafb2\" (UID: \"9e1df45f-c679-4347-b552-5d1d7a1cafb2\") " May 21 10:33:47.952704 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:47.952594 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9e1df45f-c679-4347-b552-5d1d7a1cafb2-bound-sa-token\") pod \"9e1df45f-c679-4347-b552-5d1d7a1cafb2\" (UID: \"9e1df45f-c679-4347-b552-5d1d7a1cafb2\") " May 21 10:33:47.952704 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:47.952647 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9e1df45f-c679-4347-b552-5d1d7a1cafb2-ca-trust-extracted\") pod \"9e1df45f-c679-4347-b552-5d1d7a1cafb2\" (UID: \"9e1df45f-c679-4347-b552-5d1d7a1cafb2\") " May 21 10:33:47.952704 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:47.952669 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9e1df45f-c679-4347-b552-5d1d7a1cafb2-trusted-ca\") pod \"9e1df45f-c679-4347-b552-5d1d7a1cafb2\" (UID: \"9e1df45f-c679-4347-b552-5d1d7a1cafb2\") " May 21 10:33:47.952704 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:47.952702 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9e1df45f-c679-4347-b552-5d1d7a1cafb2-installation-pull-secrets\") pod \"9e1df45f-c679-4347-b552-5d1d7a1cafb2\" (UID: \"9e1df45f-c679-4347-b552-5d1d7a1cafb2\") " May 21 10:33:47.952962 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:47.952732 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9e1df45f-c679-4347-b552-5d1d7a1cafb2-image-registry-private-configuration\") pod \"9e1df45f-c679-4347-b552-5d1d7a1cafb2\" (UID: \"9e1df45f-c679-4347-b552-5d1d7a1cafb2\") " May 21 10:33:47.952962 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:47.952762 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bz2vt\" (UniqueName: \"kubernetes.io/projected/9e1df45f-c679-4347-b552-5d1d7a1cafb2-kube-api-access-bz2vt\") pod \"9e1df45f-c679-4347-b552-5d1d7a1cafb2\" (UID: \"9e1df45f-c679-4347-b552-5d1d7a1cafb2\") " May 21 10:33:47.953337 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:47.953070 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e1df45f-c679-4347-b552-5d1d7a1cafb2-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "9e1df45f-c679-4347-b552-5d1d7a1cafb2" (UID: "9e1df45f-c679-4347-b552-5d1d7a1cafb2"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 10:33:47.953337 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:47.953112 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e1df45f-c679-4347-b552-5d1d7a1cafb2-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "9e1df45f-c679-4347-b552-5d1d7a1cafb2" (UID: "9e1df45f-c679-4347-b552-5d1d7a1cafb2"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 10:33:47.955762 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:47.955611 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e1df45f-c679-4347-b552-5d1d7a1cafb2-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "9e1df45f-c679-4347-b552-5d1d7a1cafb2" (UID: "9e1df45f-c679-4347-b552-5d1d7a1cafb2"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 10:33:47.955762 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:47.955653 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e1df45f-c679-4347-b552-5d1d7a1cafb2-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "9e1df45f-c679-4347-b552-5d1d7a1cafb2" (UID: "9e1df45f-c679-4347-b552-5d1d7a1cafb2"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 10:33:47.955762 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:47.955659 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e1df45f-c679-4347-b552-5d1d7a1cafb2-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "9e1df45f-c679-4347-b552-5d1d7a1cafb2" (UID: "9e1df45f-c679-4347-b552-5d1d7a1cafb2"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 10:33:47.955762 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:47.955741 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e1df45f-c679-4347-b552-5d1d7a1cafb2-kube-api-access-bz2vt" (OuterVolumeSpecName: "kube-api-access-bz2vt") pod "9e1df45f-c679-4347-b552-5d1d7a1cafb2" (UID: "9e1df45f-c679-4347-b552-5d1d7a1cafb2"). InnerVolumeSpecName "kube-api-access-bz2vt". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 10:33:47.956422 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:47.956125 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e1df45f-c679-4347-b552-5d1d7a1cafb2-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "9e1df45f-c679-4347-b552-5d1d7a1cafb2" (UID: "9e1df45f-c679-4347-b552-5d1d7a1cafb2"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 10:33:47.963902 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:47.963874 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e1df45f-c679-4347-b552-5d1d7a1cafb2-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "9e1df45f-c679-4347-b552-5d1d7a1cafb2" (UID: "9e1df45f-c679-4347-b552-5d1d7a1cafb2"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 10:33:48.052035 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:48.051955 2563 generic.go:358] "Generic (PLEG): container finished" podID="9e1df45f-c679-4347-b552-5d1d7a1cafb2" containerID="ab91fb00dd1a4dbd6ced8d76e85fc37f10bef60d03ba21ccc8aa69aaead2805b" exitCode=0 May 21 10:33:48.052035 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:48.052025 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57bfcfdbc9-qcqrf" event={"ID":"9e1df45f-c679-4347-b552-5d1d7a1cafb2","Type":"ContainerDied","Data":"ab91fb00dd1a4dbd6ced8d76e85fc37f10bef60d03ba21ccc8aa69aaead2805b"} May 21 10:33:48.052205 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:48.052033 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57bfcfdbc9-qcqrf" May 21 10:33:48.052205 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:48.052058 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57bfcfdbc9-qcqrf" event={"ID":"9e1df45f-c679-4347-b552-5d1d7a1cafb2","Type":"ContainerDied","Data":"e96d54fb8dbbd058e0fb6a709f20036c461e3cd6a8f25d09dfeeaa2b35f1c7c3"} May 21 10:33:48.052205 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:48.052080 2563 scope.go:117] "RemoveContainer" containerID="ab91fb00dd1a4dbd6ced8d76e85fc37f10bef60d03ba21ccc8aa69aaead2805b" May 21 10:33:48.053986 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:48.053963 2563 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9e1df45f-c679-4347-b552-5d1d7a1cafb2-ca-trust-extracted\") on node \"ip-10-0-140-254.ec2.internal\" DevicePath \"\"" May 21 10:33:48.054070 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:48.053994 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9e1df45f-c679-4347-b552-5d1d7a1cafb2-trusted-ca\") on node \"ip-10-0-140-254.ec2.internal\" DevicePath \"\"" May 21 10:33:48.054070 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:48.054010 2563 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9e1df45f-c679-4347-b552-5d1d7a1cafb2-installation-pull-secrets\") on node \"ip-10-0-140-254.ec2.internal\" DevicePath \"\"" May 21 10:33:48.054070 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:48.054027 2563 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9e1df45f-c679-4347-b552-5d1d7a1cafb2-image-registry-private-configuration\") on node \"ip-10-0-140-254.ec2.internal\" DevicePath \"\"" May 21 10:33:48.054070 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:48.054043 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bz2vt\" (UniqueName: \"kubernetes.io/projected/9e1df45f-c679-4347-b552-5d1d7a1cafb2-kube-api-access-bz2vt\") on node \"ip-10-0-140-254.ec2.internal\" DevicePath \"\"" May 21 10:33:48.054070 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:48.054056 2563 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e1df45f-c679-4347-b552-5d1d7a1cafb2-registry-tls\") on node \"ip-10-0-140-254.ec2.internal\" DevicePath \"\"" May 21 10:33:48.054244 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:48.054069 2563 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9e1df45f-c679-4347-b552-5d1d7a1cafb2-registry-certificates\") on node \"ip-10-0-140-254.ec2.internal\" DevicePath \"\"" May 21 10:33:48.054244 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:48.054084 2563 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9e1df45f-c679-4347-b552-5d1d7a1cafb2-bound-sa-token\") on node \"ip-10-0-140-254.ec2.internal\" DevicePath \"\"" May 21 10:33:48.060209 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:48.060194 2563 scope.go:117] "RemoveContainer" containerID="ab91fb00dd1a4dbd6ced8d76e85fc37f10bef60d03ba21ccc8aa69aaead2805b" May 21 10:33:48.060452 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:33:48.060434 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab91fb00dd1a4dbd6ced8d76e85fc37f10bef60d03ba21ccc8aa69aaead2805b\": container with ID starting with ab91fb00dd1a4dbd6ced8d76e85fc37f10bef60d03ba21ccc8aa69aaead2805b not found: ID does not exist" containerID="ab91fb00dd1a4dbd6ced8d76e85fc37f10bef60d03ba21ccc8aa69aaead2805b" May 21 10:33:48.060499 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:48.060460 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab91fb00dd1a4dbd6ced8d76e85fc37f10bef60d03ba21ccc8aa69aaead2805b"} err="failed to get container status \"ab91fb00dd1a4dbd6ced8d76e85fc37f10bef60d03ba21ccc8aa69aaead2805b\": rpc error: code = NotFound desc = could not find container \"ab91fb00dd1a4dbd6ced8d76e85fc37f10bef60d03ba21ccc8aa69aaead2805b\": container with ID starting with ab91fb00dd1a4dbd6ced8d76e85fc37f10bef60d03ba21ccc8aa69aaead2805b not found: ID does not exist" May 21 10:33:48.082762 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:48.082734 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-57bfcfdbc9-qcqrf"] May 21 10:33:48.087802 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:48.087780 2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-57bfcfdbc9-qcqrf"] May 21 10:33:49.400178 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:33:49.400143 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e1df45f-c679-4347-b552-5d1d7a1cafb2" path="/var/lib/kubelet/pods/9e1df45f-c679-4347-b552-5d1d7a1cafb2/volumes" May 21 10:34:05.101171 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:34:05.101142 2563 generic.go:358] "Generic (PLEG): container finished" podID="8864bf9c-55ec-4974-907c-eafac5a2dc6e" containerID="c28b2acb51a24c09406144d68ad754e266823d3fca1a716328275075e659d638" exitCode=0 May 21 10:34:05.101438 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:34:05.101194 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-rz5fs" event={"ID":"8864bf9c-55ec-4974-907c-eafac5a2dc6e","Type":"ContainerDied","Data":"c28b2acb51a24c09406144d68ad754e266823d3fca1a716328275075e659d638"} May 21 10:34:05.101477 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:34:05.101457 2563 scope.go:117] "RemoveContainer" containerID="c28b2acb51a24c09406144d68ad754e266823d3fca1a716328275075e659d638" May 21 10:34:06.105262 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:34:06.105233 2563 generic.go:358] "Generic (PLEG): container finished" podID="2a2bbdf6-2335-4148-98db-ff7687939b56" containerID="5118fe4a92063e4865fd6dc7c0485c42e7037ef878a3635f002ccf34fdbc569b" exitCode=0 May 21 10:34:06.105664 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:34:06.105303 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-v6dl9" event={"ID":"2a2bbdf6-2335-4148-98db-ff7687939b56","Type":"ContainerDied","Data":"5118fe4a92063e4865fd6dc7c0485c42e7037ef878a3635f002ccf34fdbc569b"} May 21 10:34:06.105740 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:34:06.105666 2563 scope.go:117] "RemoveContainer" containerID="5118fe4a92063e4865fd6dc7c0485c42e7037ef878a3635f002ccf34fdbc569b" May 21 10:34:06.107044 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:34:06.107012 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-rz5fs" event={"ID":"8864bf9c-55ec-4974-907c-eafac5a2dc6e","Type":"ContainerStarted","Data":"4c319a5178820a8c34a7ac79a7b8cb60050aa4852c0778f92e2d46a371ddad14"} May 21 10:34:07.111971 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:34:07.111935 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-v6dl9" event={"ID":"2a2bbdf6-2335-4148-98db-ff7687939b56","Type":"ContainerStarted","Data":"d3969396d1a78e48135b3ed90c70b06f0fca6d5900063080792ebe0e57c34e85"} May 21 10:34:17.194988 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:34:17.194948 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f-metrics-certs\") pod \"network-metrics-daemon-hnvv7\" (UID: \"a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f\") " pod="openshift-multus/network-metrics-daemon-hnvv7" May 21 10:34:17.197587 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:34:17.197552 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f-metrics-certs\") pod \"network-metrics-daemon-hnvv7\" (UID: \"a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f\") " pod="openshift-multus/network-metrics-daemon-hnvv7" May 21 10:34:17.301164 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:34:17.301134 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hwkcp\"" May 21 10:34:17.308740 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:34:17.308717 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hnvv7" May 21 10:34:17.476078 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:34:17.476003 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hnvv7"] May 21 10:34:17.479172 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:34:17.479137 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda39d7dc9_3e5b_42b5_94fd_cb58369f5a9f.slice/crio-777dc1c2b72568fd0ef595aebea256a7714d0987116331c035c20e999c609582 WatchSource:0}: Error finding container 777dc1c2b72568fd0ef595aebea256a7714d0987116331c035c20e999c609582: Status 404 returned error can't find the container with id 777dc1c2b72568fd0ef595aebea256a7714d0987116331c035c20e999c609582 May 21 10:34:18.144705 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:34:18.144659 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hnvv7" event={"ID":"a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f","Type":"ContainerStarted","Data":"777dc1c2b72568fd0ef595aebea256a7714d0987116331c035c20e999c609582"} May 21 10:34:19.149382 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:34:19.149351 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hnvv7" event={"ID":"a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f","Type":"ContainerStarted","Data":"fb2574b7de8fd3d8d089eb9a4426a667b358b39669a9418314fbb1e490a02c01"} May 21 10:34:19.149747 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:34:19.149390 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hnvv7" event={"ID":"a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f","Type":"ContainerStarted","Data":"a978fbdb22319fac5ad7a45a9b438f5a8f27a0abce3b91ee3c9538d2046ba39f"} May 21 10:34:19.166755 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:34:19.166696 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-hnvv7" podStartSLOduration=252.900540004 podStartE2EDuration="4m14.166675841s" podCreationTimestamp="2026-05-21 10:30:05 +0000 UTC" firstStartedPulling="2026-05-21 10:34:17.480915395 +0000 UTC m=+252.692075488" lastFinishedPulling="2026-05-21 10:34:18.747051218 +0000 UTC m=+253.958211325" observedRunningTime="2026-05-21 10:34:19.165130935 +0000 UTC m=+254.376291051" watchObservedRunningTime="2026-05-21 10:34:19.166675841 +0000 UTC m=+254.377835956" May 21 10:34:28.458648 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:34:28.458540 2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 21 10:34:28.478638 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:34:28.478599 2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 21 10:34:29.198179 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:34:29.198151 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 21 10:35:05.306637 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:35:05.306605 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-dfjr4_ab74c7ba-ea27-43e2-924e-aa819aee1362/console-operator/1.log" May 21 10:35:05.307262 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:35:05.306961 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-dfjr4_ab74c7ba-ea27-43e2-924e-aa819aee1362/console-operator/1.log" May 21 10:35:05.316261 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:35:05.316239 2563 kubelet.go:1628] "Image garbage collection succeeded" May 21 10:36:52.005783 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:36:52.005746 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-bq884"] May 21 10:36:52.006269 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:36:52.006060 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e1df45f-c679-4347-b552-5d1d7a1cafb2" containerName="registry" May 21 10:36:52.006269 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:36:52.006072 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e1df45f-c679-4347-b552-5d1d7a1cafb2" containerName="registry" May 21 10:36:52.006269 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:36:52.006123 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="9e1df45f-c679-4347-b552-5d1d7a1cafb2" containerName="registry" May 21 10:36:52.009063 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:36:52.009047 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-bq884" May 21 10:36:52.011610 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:36:52.011585 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" May 21 10:36:52.012295 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:36:52.012275 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-mbjxm\"" May 21 10:36:52.012358 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:36:52.012284 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" May 21 10:36:52.017614 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:36:52.017590 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-bq884"] May 21 10:36:52.080891 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:36:52.080849 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7ad0ce2e-c4d1-4216-a229-8faf99f84d0b-bound-sa-token\") pod \"cert-manager-79c8d999ff-bq884\" (UID: \"7ad0ce2e-c4d1-4216-a229-8faf99f84d0b\") " pod="cert-manager/cert-manager-79c8d999ff-bq884" May 21 10:36:52.081063 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:36:52.080932 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtkvq\" (UniqueName: \"kubernetes.io/projected/7ad0ce2e-c4d1-4216-a229-8faf99f84d0b-kube-api-access-mtkvq\") pod \"cert-manager-79c8d999ff-bq884\" (UID: \"7ad0ce2e-c4d1-4216-a229-8faf99f84d0b\") " pod="cert-manager/cert-manager-79c8d999ff-bq884" May 21 10:36:52.182198 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:36:52.182155 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7ad0ce2e-c4d1-4216-a229-8faf99f84d0b-bound-sa-token\") pod \"cert-manager-79c8d999ff-bq884\" (UID: \"7ad0ce2e-c4d1-4216-a229-8faf99f84d0b\") " pod="cert-manager/cert-manager-79c8d999ff-bq884" May 21 10:36:52.182355 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:36:52.182235 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mtkvq\" (UniqueName: \"kubernetes.io/projected/7ad0ce2e-c4d1-4216-a229-8faf99f84d0b-kube-api-access-mtkvq\") pod \"cert-manager-79c8d999ff-bq884\" (UID: \"7ad0ce2e-c4d1-4216-a229-8faf99f84d0b\") " pod="cert-manager/cert-manager-79c8d999ff-bq884" May 21 10:36:52.192252 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:36:52.192218 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7ad0ce2e-c4d1-4216-a229-8faf99f84d0b-bound-sa-token\") pod \"cert-manager-79c8d999ff-bq884\" (UID: \"7ad0ce2e-c4d1-4216-a229-8faf99f84d0b\") " pod="cert-manager/cert-manager-79c8d999ff-bq884" May 21 10:36:52.192380 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:36:52.192345 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtkvq\" (UniqueName: \"kubernetes.io/projected/7ad0ce2e-c4d1-4216-a229-8faf99f84d0b-kube-api-access-mtkvq\") pod \"cert-manager-79c8d999ff-bq884\" (UID: \"7ad0ce2e-c4d1-4216-a229-8faf99f84d0b\") " pod="cert-manager/cert-manager-79c8d999ff-bq884" May 21 10:36:52.340606 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:36:52.340572 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-bq884" May 21 10:36:52.470352 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:36:52.470301 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-bq884"] May 21 10:36:52.474748 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:36:52.474718 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7ad0ce2e_c4d1_4216_a229_8faf99f84d0b.slice/crio-7ad03020764901a916cd2ac1f13352610115bef9acd91005a9f409012449015d WatchSource:0}: Error finding container 7ad03020764901a916cd2ac1f13352610115bef9acd91005a9f409012449015d: Status 404 returned error can't find the container with id 7ad03020764901a916cd2ac1f13352610115bef9acd91005a9f409012449015d May 21 10:36:52.476998 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:36:52.476980 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 10:36:52.604662 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:36:52.604577 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-bq884" event={"ID":"7ad0ce2e-c4d1-4216-a229-8faf99f84d0b","Type":"ContainerStarted","Data":"7ad03020764901a916cd2ac1f13352610115bef9acd91005a9f409012449015d"} May 21 10:36:56.619342 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:36:56.619301 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-bq884" event={"ID":"7ad0ce2e-c4d1-4216-a229-8faf99f84d0b","Type":"ContainerStarted","Data":"bb998c4c907df95112b1b6e137788933a96d27cc70b3906b59dd30fc779ccb28"} May 21 10:36:56.637534 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:36:56.637472 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-bq884" podStartSLOduration=2.359972328 podStartE2EDuration="5.637454524s" podCreationTimestamp="2026-05-21 10:36:51 +0000 UTC" firstStartedPulling="2026-05-21 10:36:52.477143158 +0000 UTC m=+407.688303251" lastFinishedPulling="2026-05-21 10:36:55.754625349 +0000 UTC m=+410.965785447" observedRunningTime="2026-05-21 10:36:56.635779392 +0000 UTC m=+411.846939519" watchObservedRunningTime="2026-05-21 10:36:56.637454524 +0000 UTC m=+411.848614639" May 21 10:37:02.850773 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:02.850729 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-bgmxq"] May 21 10:37:02.854319 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:02.854302 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-bgmxq" May 21 10:37:02.856684 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:02.856658 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" May 21 10:37:02.856806 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:02.856660 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-ml42k\"" May 21 10:37:02.857468 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:02.857452 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" May 21 10:37:02.863847 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:02.863800 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-bgmxq"] May 21 10:37:02.980181 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:02.980132 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpnxp\" (UniqueName: \"kubernetes.io/projected/db6ed736-c484-4682-8a54-579df216b618-kube-api-access-bpnxp\") pod \"openshift-lws-operator-bfc7f696d-bgmxq\" (UID: \"db6ed736-c484-4682-8a54-579df216b618\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-bgmxq" May 21 10:37:02.980366 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:02.980225 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db6ed736-c484-4682-8a54-579df216b618-tmp\") pod \"openshift-lws-operator-bfc7f696d-bgmxq\" (UID: \"db6ed736-c484-4682-8a54-579df216b618\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-bgmxq" May 21 10:37:03.081515 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:03.081461 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db6ed736-c484-4682-8a54-579df216b618-tmp\") pod \"openshift-lws-operator-bfc7f696d-bgmxq\" (UID: \"db6ed736-c484-4682-8a54-579df216b618\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-bgmxq" May 21 10:37:03.081676 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:03.081556 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bpnxp\" (UniqueName: \"kubernetes.io/projected/db6ed736-c484-4682-8a54-579df216b618-kube-api-access-bpnxp\") pod \"openshift-lws-operator-bfc7f696d-bgmxq\" (UID: \"db6ed736-c484-4682-8a54-579df216b618\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-bgmxq" May 21 10:37:03.081907 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:03.081887 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db6ed736-c484-4682-8a54-579df216b618-tmp\") pod \"openshift-lws-operator-bfc7f696d-bgmxq\" (UID: \"db6ed736-c484-4682-8a54-579df216b618\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-bgmxq" May 21 10:37:03.090312 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:03.090281 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpnxp\" (UniqueName: \"kubernetes.io/projected/db6ed736-c484-4682-8a54-579df216b618-kube-api-access-bpnxp\") pod \"openshift-lws-operator-bfc7f696d-bgmxq\" (UID: \"db6ed736-c484-4682-8a54-579df216b618\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-bgmxq" May 21 10:37:03.164750 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:03.164660 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-bgmxq" May 21 10:37:03.296910 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:03.296762 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-bgmxq"] May 21 10:37:03.299850 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:37:03.299802 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddb6ed736_c484_4682_8a54_579df216b618.slice/crio-cc5fe99b31223e312d5f0773e04e5618de580b927270d192f76b25e191277017 WatchSource:0}: Error finding container cc5fe99b31223e312d5f0773e04e5618de580b927270d192f76b25e191277017: Status 404 returned error can't find the container with id cc5fe99b31223e312d5f0773e04e5618de580b927270d192f76b25e191277017 May 21 10:37:03.639363 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:03.639322 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-bgmxq" event={"ID":"db6ed736-c484-4682-8a54-579df216b618","Type":"ContainerStarted","Data":"cc5fe99b31223e312d5f0773e04e5618de580b927270d192f76b25e191277017"} May 21 10:37:06.650149 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:06.650104 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-bgmxq" event={"ID":"db6ed736-c484-4682-8a54-579df216b618","Type":"ContainerStarted","Data":"bc6e68cb8b9c16856a4ae2aa8b2c555ff10ead9247a3aed523bc7dedf7fb126d"} May 21 10:37:06.668299 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:06.668234 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-bgmxq" podStartSLOduration=2.080383103 podStartE2EDuration="4.668214919s" podCreationTimestamp="2026-05-21 10:37:02 +0000 UTC" firstStartedPulling="2026-05-21 10:37:03.301720248 +0000 UTC m=+418.512880341" lastFinishedPulling="2026-05-21 10:37:05.889552053 +0000 UTC m=+421.100712157" observedRunningTime="2026-05-21 10:37:06.667459882 +0000 UTC m=+421.878619997" watchObservedRunningTime="2026-05-21 10:37:06.668214919 +0000 UTC m=+421.879375035" May 21 10:37:19.615077 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:19.615042 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-9b6f47d4-q7s96"] May 21 10:37:19.621978 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:19.621950 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-9b6f47d4-q7s96" May 21 10:37:19.624929 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:19.624906 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" May 21 10:37:19.625773 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:19.625748 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" May 21 10:37:19.625905 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:19.625788 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" May 21 10:37:19.625905 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:19.625850 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-25h9w\"" May 21 10:37:19.646696 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:19.646674 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-9b6f47d4-q7s96"] May 21 10:37:19.724343 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:19.724299 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qh6kv\" (UniqueName: \"kubernetes.io/projected/f40a213c-82a5-475b-ae82-8345f31a5e8c-kube-api-access-qh6kv\") pod \"lws-controller-manager-9b6f47d4-q7s96\" (UID: \"f40a213c-82a5-475b-ae82-8345f31a5e8c\") " pod="openshift-lws-operator/lws-controller-manager-9b6f47d4-q7s96" May 21 10:37:19.724343 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:19.724350 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f40a213c-82a5-475b-ae82-8345f31a5e8c-manager-config\") pod \"lws-controller-manager-9b6f47d4-q7s96\" (UID: \"f40a213c-82a5-475b-ae82-8345f31a5e8c\") " pod="openshift-lws-operator/lws-controller-manager-9b6f47d4-q7s96" May 21 10:37:19.724580 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:19.724371 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f40a213c-82a5-475b-ae82-8345f31a5e8c-cert\") pod \"lws-controller-manager-9b6f47d4-q7s96\" (UID: \"f40a213c-82a5-475b-ae82-8345f31a5e8c\") " pod="openshift-lws-operator/lws-controller-manager-9b6f47d4-q7s96" May 21 10:37:19.724580 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:19.724455 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f40a213c-82a5-475b-ae82-8345f31a5e8c-metrics-cert\") pod \"lws-controller-manager-9b6f47d4-q7s96\" (UID: \"f40a213c-82a5-475b-ae82-8345f31a5e8c\") " pod="openshift-lws-operator/lws-controller-manager-9b6f47d4-q7s96" May 21 10:37:19.825116 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:19.825081 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qh6kv\" (UniqueName: \"kubernetes.io/projected/f40a213c-82a5-475b-ae82-8345f31a5e8c-kube-api-access-qh6kv\") pod \"lws-controller-manager-9b6f47d4-q7s96\" (UID: \"f40a213c-82a5-475b-ae82-8345f31a5e8c\") " pod="openshift-lws-operator/lws-controller-manager-9b6f47d4-q7s96" May 21 10:37:19.825116 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:19.825122 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f40a213c-82a5-475b-ae82-8345f31a5e8c-manager-config\") pod \"lws-controller-manager-9b6f47d4-q7s96\" (UID: \"f40a213c-82a5-475b-ae82-8345f31a5e8c\") " pod="openshift-lws-operator/lws-controller-manager-9b6f47d4-q7s96" May 21 10:37:19.825364 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:19.825141 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f40a213c-82a5-475b-ae82-8345f31a5e8c-cert\") pod \"lws-controller-manager-9b6f47d4-q7s96\" (UID: \"f40a213c-82a5-475b-ae82-8345f31a5e8c\") " pod="openshift-lws-operator/lws-controller-manager-9b6f47d4-q7s96" May 21 10:37:19.825364 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:19.825176 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f40a213c-82a5-475b-ae82-8345f31a5e8c-metrics-cert\") pod \"lws-controller-manager-9b6f47d4-q7s96\" (UID: \"f40a213c-82a5-475b-ae82-8345f31a5e8c\") " pod="openshift-lws-operator/lws-controller-manager-9b6f47d4-q7s96" May 21 10:37:19.825736 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:19.825706 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f40a213c-82a5-475b-ae82-8345f31a5e8c-manager-config\") pod \"lws-controller-manager-9b6f47d4-q7s96\" (UID: \"f40a213c-82a5-475b-ae82-8345f31a5e8c\") " pod="openshift-lws-operator/lws-controller-manager-9b6f47d4-q7s96" May 21 10:37:19.827779 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:19.827759 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f40a213c-82a5-475b-ae82-8345f31a5e8c-metrics-cert\") pod \"lws-controller-manager-9b6f47d4-q7s96\" (UID: \"f40a213c-82a5-475b-ae82-8345f31a5e8c\") " pod="openshift-lws-operator/lws-controller-manager-9b6f47d4-q7s96" May 21 10:37:19.827779 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:19.827775 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f40a213c-82a5-475b-ae82-8345f31a5e8c-cert\") pod \"lws-controller-manager-9b6f47d4-q7s96\" (UID: \"f40a213c-82a5-475b-ae82-8345f31a5e8c\") " pod="openshift-lws-operator/lws-controller-manager-9b6f47d4-q7s96" May 21 10:37:19.852220 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:19.852193 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qh6kv\" (UniqueName: \"kubernetes.io/projected/f40a213c-82a5-475b-ae82-8345f31a5e8c-kube-api-access-qh6kv\") pod \"lws-controller-manager-9b6f47d4-q7s96\" (UID: \"f40a213c-82a5-475b-ae82-8345f31a5e8c\") " pod="openshift-lws-operator/lws-controller-manager-9b6f47d4-q7s96" May 21 10:37:19.931209 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:19.931116 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-9b6f47d4-q7s96" May 21 10:37:20.112127 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:20.112101 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-9b6f47d4-q7s96"] May 21 10:37:20.114126 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:37:20.114100 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf40a213c_82a5_475b_ae82_8345f31a5e8c.slice/crio-430502fc9047b4e702f828e4987d4b4a950201918f1ab256285ac9a6ad4ebdc6 WatchSource:0}: Error finding container 430502fc9047b4e702f828e4987d4b4a950201918f1ab256285ac9a6ad4ebdc6: Status 404 returned error can't find the container with id 430502fc9047b4e702f828e4987d4b4a950201918f1ab256285ac9a6ad4ebdc6 May 21 10:37:20.696942 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:20.696905 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-9b6f47d4-q7s96" event={"ID":"f40a213c-82a5-475b-ae82-8345f31a5e8c","Type":"ContainerStarted","Data":"430502fc9047b4e702f828e4987d4b4a950201918f1ab256285ac9a6ad4ebdc6"} May 21 10:37:21.931628 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:21.931587 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5fc5c76ccc-lbgql"] May 21 10:37:21.938734 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:21.938691 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5fc5c76ccc-lbgql" May 21 10:37:21.941364 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:21.941337 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 21 10:37:21.942582 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:21.942557 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 21 10:37:21.943070 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:21.943044 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 21 10:37:21.943554 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:21.943535 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-7hxq7\"" May 21 10:37:21.944864 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:21.944840 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 21 10:37:21.964730 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:21.964703 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5fc5c76ccc-lbgql"] May 21 10:37:22.045069 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:22.045039 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/105d99ba-1564-45a8-93f8-f11cc756a5ed-webhook-cert\") pod \"opendatahub-operator-controller-manager-5fc5c76ccc-lbgql\" (UID: \"105d99ba-1564-45a8-93f8-f11cc756a5ed\") " pod="opendatahub/opendatahub-operator-controller-manager-5fc5c76ccc-lbgql" May 21 10:37:22.045257 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:22.045102 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/105d99ba-1564-45a8-93f8-f11cc756a5ed-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5fc5c76ccc-lbgql\" (UID: \"105d99ba-1564-45a8-93f8-f11cc756a5ed\") " pod="opendatahub/opendatahub-operator-controller-manager-5fc5c76ccc-lbgql" May 21 10:37:22.045257 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:22.045145 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2k9m\" (UniqueName: \"kubernetes.io/projected/105d99ba-1564-45a8-93f8-f11cc756a5ed-kube-api-access-m2k9m\") pod \"opendatahub-operator-controller-manager-5fc5c76ccc-lbgql\" (UID: \"105d99ba-1564-45a8-93f8-f11cc756a5ed\") " pod="opendatahub/opendatahub-operator-controller-manager-5fc5c76ccc-lbgql" May 21 10:37:22.145683 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:22.145656 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/105d99ba-1564-45a8-93f8-f11cc756a5ed-webhook-cert\") pod \"opendatahub-operator-controller-manager-5fc5c76ccc-lbgql\" (UID: \"105d99ba-1564-45a8-93f8-f11cc756a5ed\") " pod="opendatahub/opendatahub-operator-controller-manager-5fc5c76ccc-lbgql" May 21 10:37:22.145799 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:22.145726 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/105d99ba-1564-45a8-93f8-f11cc756a5ed-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5fc5c76ccc-lbgql\" (UID: \"105d99ba-1564-45a8-93f8-f11cc756a5ed\") " pod="opendatahub/opendatahub-operator-controller-manager-5fc5c76ccc-lbgql" May 21 10:37:22.145799 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:22.145760 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m2k9m\" (UniqueName: \"kubernetes.io/projected/105d99ba-1564-45a8-93f8-f11cc756a5ed-kube-api-access-m2k9m\") pod \"opendatahub-operator-controller-manager-5fc5c76ccc-lbgql\" (UID: \"105d99ba-1564-45a8-93f8-f11cc756a5ed\") " pod="opendatahub/opendatahub-operator-controller-manager-5fc5c76ccc-lbgql" May 21 10:37:22.148432 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:22.148409 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/105d99ba-1564-45a8-93f8-f11cc756a5ed-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5fc5c76ccc-lbgql\" (UID: \"105d99ba-1564-45a8-93f8-f11cc756a5ed\") " pod="opendatahub/opendatahub-operator-controller-manager-5fc5c76ccc-lbgql" May 21 10:37:22.149187 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:22.149166 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/105d99ba-1564-45a8-93f8-f11cc756a5ed-webhook-cert\") pod \"opendatahub-operator-controller-manager-5fc5c76ccc-lbgql\" (UID: \"105d99ba-1564-45a8-93f8-f11cc756a5ed\") " pod="opendatahub/opendatahub-operator-controller-manager-5fc5c76ccc-lbgql" May 21 10:37:22.160437 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:22.160414 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2k9m\" (UniqueName: \"kubernetes.io/projected/105d99ba-1564-45a8-93f8-f11cc756a5ed-kube-api-access-m2k9m\") pod \"opendatahub-operator-controller-manager-5fc5c76ccc-lbgql\" (UID: \"105d99ba-1564-45a8-93f8-f11cc756a5ed\") " pod="opendatahub/opendatahub-operator-controller-manager-5fc5c76ccc-lbgql" May 21 10:37:22.250988 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:22.250900 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5fc5c76ccc-lbgql" May 21 10:37:22.382270 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:22.382238 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5fc5c76ccc-lbgql"] May 21 10:37:22.385441 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:37:22.385413 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod105d99ba_1564_45a8_93f8_f11cc756a5ed.slice/crio-2863957d376ff4793894ce0a197383d368e0276ba7114d70f522239802e2f8a0 WatchSource:0}: Error finding container 2863957d376ff4793894ce0a197383d368e0276ba7114d70f522239802e2f8a0: Status 404 returned error can't find the container with id 2863957d376ff4793894ce0a197383d368e0276ba7114d70f522239802e2f8a0 May 21 10:37:22.704458 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:22.704417 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5fc5c76ccc-lbgql" event={"ID":"105d99ba-1564-45a8-93f8-f11cc756a5ed","Type":"ContainerStarted","Data":"2863957d376ff4793894ce0a197383d368e0276ba7114d70f522239802e2f8a0"} May 21 10:37:22.705746 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:22.705709 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-9b6f47d4-q7s96" event={"ID":"f40a213c-82a5-475b-ae82-8345f31a5e8c","Type":"ContainerStarted","Data":"68d7ce4930dbe9af68952267c2cc3afe95c1676623a53a5ef288ebd6afd98da8"} May 21 10:37:22.705979 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:22.705966 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-9b6f47d4-q7s96" May 21 10:37:22.725228 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:22.725181 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-9b6f47d4-q7s96" podStartSLOduration=1.7702061279999999 podStartE2EDuration="3.725168359s" podCreationTimestamp="2026-05-21 10:37:19 +0000 UTC" firstStartedPulling="2026-05-21 10:37:20.115894516 +0000 UTC m=+435.327054609" lastFinishedPulling="2026-05-21 10:37:22.070856746 +0000 UTC m=+437.282016840" observedRunningTime="2026-05-21 10:37:22.723320993 +0000 UTC m=+437.934481108" watchObservedRunningTime="2026-05-21 10:37:22.725168359 +0000 UTC m=+437.936328473" May 21 10:37:26.721352 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:26.721315 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5fc5c76ccc-lbgql" event={"ID":"105d99ba-1564-45a8-93f8-f11cc756a5ed","Type":"ContainerStarted","Data":"20bcfb3ba71051696e8ce09c2b17713cbc9277abca3c40898d6a0b4c85bac87d"} May 21 10:37:26.721766 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:26.721409 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5fc5c76ccc-lbgql" May 21 10:37:26.746179 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:26.746134 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5fc5c76ccc-lbgql" podStartSLOduration=2.366920114 podStartE2EDuration="5.746117838s" podCreationTimestamp="2026-05-21 10:37:21 +0000 UTC" firstStartedPulling="2026-05-21 10:37:22.387172319 +0000 UTC m=+437.598332414" lastFinishedPulling="2026-05-21 10:37:25.766370045 +0000 UTC m=+440.977530138" observedRunningTime="2026-05-21 10:37:26.745087167 +0000 UTC m=+441.956247284" watchObservedRunningTime="2026-05-21 10:37:26.746117838 +0000 UTC m=+441.957277953" May 21 10:37:33.711961 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:33.711929 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-9b6f47d4-q7s96" May 21 10:37:37.727063 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:37.727026 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5fc5c76ccc-lbgql" May 21 10:37:46.795280 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:46.795247 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-798cbbc998-5mjmj"] May 21 10:37:46.798853 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:46.798831 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-798cbbc998-5mjmj" May 21 10:37:46.805054 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:46.803717 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 21 10:37:46.805054 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:46.803895 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" May 21 10:37:46.805054 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:46.804695 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-mgn78\"" May 21 10:37:46.805054 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:46.804965 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 21 10:37:46.811118 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:46.810899 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" May 21 10:37:46.812763 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:46.812740 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-798cbbc998-5mjmj"] May 21 10:37:46.959881 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:46.959846 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a317f86-9873-4a6a-a020-f3a1a4a08b71-tmp\") pod \"kube-auth-proxy-798cbbc998-5mjmj\" (UID: \"7a317f86-9873-4a6a-a020-f3a1a4a08b71\") " pod="openshift-ingress/kube-auth-proxy-798cbbc998-5mjmj" May 21 10:37:46.960058 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:46.959928 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rb8nd\" (UniqueName: \"kubernetes.io/projected/7a317f86-9873-4a6a-a020-f3a1a4a08b71-kube-api-access-rb8nd\") pod \"kube-auth-proxy-798cbbc998-5mjmj\" (UID: \"7a317f86-9873-4a6a-a020-f3a1a4a08b71\") " pod="openshift-ingress/kube-auth-proxy-798cbbc998-5mjmj" May 21 10:37:46.960058 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:46.959996 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7a317f86-9873-4a6a-a020-f3a1a4a08b71-tls-certs\") pod \"kube-auth-proxy-798cbbc998-5mjmj\" (UID: \"7a317f86-9873-4a6a-a020-f3a1a4a08b71\") " pod="openshift-ingress/kube-auth-proxy-798cbbc998-5mjmj" May 21 10:37:47.061251 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:47.061220 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a317f86-9873-4a6a-a020-f3a1a4a08b71-tmp\") pod \"kube-auth-proxy-798cbbc998-5mjmj\" (UID: \"7a317f86-9873-4a6a-a020-f3a1a4a08b71\") " pod="openshift-ingress/kube-auth-proxy-798cbbc998-5mjmj" May 21 10:37:47.061409 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:47.061274 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rb8nd\" (UniqueName: \"kubernetes.io/projected/7a317f86-9873-4a6a-a020-f3a1a4a08b71-kube-api-access-rb8nd\") pod \"kube-auth-proxy-798cbbc998-5mjmj\" (UID: \"7a317f86-9873-4a6a-a020-f3a1a4a08b71\") " pod="openshift-ingress/kube-auth-proxy-798cbbc998-5mjmj" May 21 10:37:47.061409 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:47.061346 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7a317f86-9873-4a6a-a020-f3a1a4a08b71-tls-certs\") pod \"kube-auth-proxy-798cbbc998-5mjmj\" (UID: \"7a317f86-9873-4a6a-a020-f3a1a4a08b71\") " pod="openshift-ingress/kube-auth-proxy-798cbbc998-5mjmj" May 21 10:37:47.063859 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:47.063809 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a317f86-9873-4a6a-a020-f3a1a4a08b71-tmp\") pod \"kube-auth-proxy-798cbbc998-5mjmj\" (UID: \"7a317f86-9873-4a6a-a020-f3a1a4a08b71\") " pod="openshift-ingress/kube-auth-proxy-798cbbc998-5mjmj" May 21 10:37:47.064079 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:47.064058 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7a317f86-9873-4a6a-a020-f3a1a4a08b71-tls-certs\") pod \"kube-auth-proxy-798cbbc998-5mjmj\" (UID: \"7a317f86-9873-4a6a-a020-f3a1a4a08b71\") " pod="openshift-ingress/kube-auth-proxy-798cbbc998-5mjmj" May 21 10:37:47.074622 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:47.074600 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rb8nd\" (UniqueName: \"kubernetes.io/projected/7a317f86-9873-4a6a-a020-f3a1a4a08b71-kube-api-access-rb8nd\") pod \"kube-auth-proxy-798cbbc998-5mjmj\" (UID: \"7a317f86-9873-4a6a-a020-f3a1a4a08b71\") " pod="openshift-ingress/kube-auth-proxy-798cbbc998-5mjmj" May 21 10:37:47.113563 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:47.113535 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-798cbbc998-5mjmj" May 21 10:37:47.273736 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:47.273704 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-798cbbc998-5mjmj"] May 21 10:37:47.274627 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:37:47.274598 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a317f86_9873_4a6a_a020_f3a1a4a08b71.slice/crio-bc67b62381f777d6806926c984969d604f7d584a2b13dd7967eecbb6f9d8f445 WatchSource:0}: Error finding container bc67b62381f777d6806926c984969d604f7d584a2b13dd7967eecbb6f9d8f445: Status 404 returned error can't find the container with id bc67b62381f777d6806926c984969d604f7d584a2b13dd7967eecbb6f9d8f445 May 21 10:37:47.791310 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:47.791271 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-798cbbc998-5mjmj" event={"ID":"7a317f86-9873-4a6a-a020-f3a1a4a08b71","Type":"ContainerStarted","Data":"bc67b62381f777d6806926c984969d604f7d584a2b13dd7967eecbb6f9d8f445"} May 21 10:37:50.804073 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:50.803980 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-798cbbc998-5mjmj" event={"ID":"7a317f86-9873-4a6a-a020-f3a1a4a08b71","Type":"ContainerStarted","Data":"e98513cbbd54bafca168ac594d3fa2a1cc7e21cfa3d087effd0fce9885123f62"} May 21 10:37:50.821103 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:37:50.821057 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-798cbbc998-5mjmj" podStartSLOduration=1.5586528309999998 podStartE2EDuration="4.821043082s" podCreationTimestamp="2026-05-21 10:37:46 +0000 UTC" firstStartedPulling="2026-05-21 10:37:47.276304057 +0000 UTC m=+462.487464154" lastFinishedPulling="2026-05-21 10:37:50.538694312 +0000 UTC m=+465.749854405" observedRunningTime="2026-05-21 10:37:50.820218515 +0000 UTC m=+466.031378631" watchObservedRunningTime="2026-05-21 10:37:50.821043082 +0000 UTC m=+466.032203196" May 21 10:40:05.332508 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:40:05.332470 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-dfjr4_ab74c7ba-ea27-43e2-924e-aa819aee1362/console-operator/1.log" May 21 10:40:05.333591 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:40:05.333568 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-dfjr4_ab74c7ba-ea27-43e2-924e-aa819aee1362/console-operator/1.log" May 21 10:40:17.625539 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:40:17.625504 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 10:40:17.628763 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:40:17.628748 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-d5dx2" May 21 10:40:17.631208 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:40:17.631190 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 21 10:40:17.631976 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:40:17.631955 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 21 10:40:17.632064 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:40:17.631984 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" May 21 10:40:17.632064 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:40:17.631955 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-w62hv\"" May 21 10:40:17.636227 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:40:17.636205 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 10:40:17.668785 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:40:17.668756 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 10:40:17.708735 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:40:17.708708 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/067a08b6-2fdd-471e-841a-3d1825b0a7da-config-file\") pod \"limitador-limitador-78c99df468-d5dx2\" (UID: \"067a08b6-2fdd-471e-841a-3d1825b0a7da\") " pod="kuadrant-system/limitador-limitador-78c99df468-d5dx2" May 21 10:40:17.708879 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:40:17.708758 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwwcg\" (UniqueName: \"kubernetes.io/projected/067a08b6-2fdd-471e-841a-3d1825b0a7da-kube-api-access-jwwcg\") pod \"limitador-limitador-78c99df468-d5dx2\" (UID: \"067a08b6-2fdd-471e-841a-3d1825b0a7da\") " pod="kuadrant-system/limitador-limitador-78c99df468-d5dx2" May 21 10:40:17.810141 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:40:17.810110 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/067a08b6-2fdd-471e-841a-3d1825b0a7da-config-file\") pod \"limitador-limitador-78c99df468-d5dx2\" (UID: \"067a08b6-2fdd-471e-841a-3d1825b0a7da\") " pod="kuadrant-system/limitador-limitador-78c99df468-d5dx2" May 21 10:40:17.810328 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:40:17.810172 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jwwcg\" (UniqueName: \"kubernetes.io/projected/067a08b6-2fdd-471e-841a-3d1825b0a7da-kube-api-access-jwwcg\") pod \"limitador-limitador-78c99df468-d5dx2\" (UID: \"067a08b6-2fdd-471e-841a-3d1825b0a7da\") " pod="kuadrant-system/limitador-limitador-78c99df468-d5dx2" May 21 10:40:17.810758 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:40:17.810735 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/067a08b6-2fdd-471e-841a-3d1825b0a7da-config-file\") pod \"limitador-limitador-78c99df468-d5dx2\" (UID: \"067a08b6-2fdd-471e-841a-3d1825b0a7da\") " pod="kuadrant-system/limitador-limitador-78c99df468-d5dx2" May 21 10:40:17.819011 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:40:17.818972 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwwcg\" (UniqueName: \"kubernetes.io/projected/067a08b6-2fdd-471e-841a-3d1825b0a7da-kube-api-access-jwwcg\") pod \"limitador-limitador-78c99df468-d5dx2\" (UID: \"067a08b6-2fdd-471e-841a-3d1825b0a7da\") " pod="kuadrant-system/limitador-limitador-78c99df468-d5dx2" May 21 10:40:17.939675 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:40:17.939602 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-d5dx2" May 21 10:40:18.064669 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:40:18.064633 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-9qdj2"] May 21 10:40:18.069146 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:40:18.069114 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-9qdj2" May 21 10:40:18.071680 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:40:18.071653 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-9qdj2"] May 21 10:40:18.071680 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:40:18.071665 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-c2pl4\"" May 21 10:40:18.077267 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:40:18.077152 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 10:40:18.079704 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:40:18.079679 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod067a08b6_2fdd_471e_841a_3d1825b0a7da.slice/crio-181ab27ec72e3da37dacd1dc999c4ca857eeeb8490d83f4d16e6d14331b83063 WatchSource:0}: Error finding container 181ab27ec72e3da37dacd1dc999c4ca857eeeb8490d83f4d16e6d14331b83063: Status 404 returned error can't find the container with id 181ab27ec72e3da37dacd1dc999c4ca857eeeb8490d83f4d16e6d14331b83063 May 21 10:40:18.112717 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:40:18.112687 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwjrh\" (UniqueName: \"kubernetes.io/projected/2318016f-5809-4d04-9d0f-c91934387149-kube-api-access-cwjrh\") pod \"authorino-f99f4b5cd-9qdj2\" (UID: \"2318016f-5809-4d04-9d0f-c91934387149\") " pod="kuadrant-system/authorino-f99f4b5cd-9qdj2" May 21 10:40:18.214170 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:40:18.214089 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cwjrh\" (UniqueName: \"kubernetes.io/projected/2318016f-5809-4d04-9d0f-c91934387149-kube-api-access-cwjrh\") pod \"authorino-f99f4b5cd-9qdj2\" (UID: \"2318016f-5809-4d04-9d0f-c91934387149\") " pod="kuadrant-system/authorino-f99f4b5cd-9qdj2" May 21 10:40:18.228874 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:40:18.228844 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwjrh\" (UniqueName: \"kubernetes.io/projected/2318016f-5809-4d04-9d0f-c91934387149-kube-api-access-cwjrh\") pod \"authorino-f99f4b5cd-9qdj2\" (UID: \"2318016f-5809-4d04-9d0f-c91934387149\") " pod="kuadrant-system/authorino-f99f4b5cd-9qdj2" May 21 10:40:18.283700 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:40:18.283664 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-d5dx2" event={"ID":"067a08b6-2fdd-471e-841a-3d1825b0a7da","Type":"ContainerStarted","Data":"181ab27ec72e3da37dacd1dc999c4ca857eeeb8490d83f4d16e6d14331b83063"} May 21 10:40:18.388165 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:40:18.388137 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-9qdj2" May 21 10:40:18.549442 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:40:18.548764 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-9qdj2"] May 21 10:40:18.554091 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:40:18.554059 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2318016f_5809_4d04_9d0f_c91934387149.slice/crio-578cbba7fdd6a3ca7736121b85e24fd5107486f1faafaec9e1b2b0e4f9f378f0 WatchSource:0}: Error finding container 578cbba7fdd6a3ca7736121b85e24fd5107486f1faafaec9e1b2b0e4f9f378f0: Status 404 returned error can't find the container with id 578cbba7fdd6a3ca7736121b85e24fd5107486f1faafaec9e1b2b0e4f9f378f0 May 21 10:40:19.290010 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:40:19.289974 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-9qdj2" event={"ID":"2318016f-5809-4d04-9d0f-c91934387149","Type":"ContainerStarted","Data":"578cbba7fdd6a3ca7736121b85e24fd5107486f1faafaec9e1b2b0e4f9f378f0"} May 21 10:40:23.305843 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:40:23.305785 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-d5dx2" event={"ID":"067a08b6-2fdd-471e-841a-3d1825b0a7da","Type":"ContainerStarted","Data":"6c3758d1c1afff8306f76be4cfc9d00209708de17fa94b86e40916e2c860de2b"} May 21 10:40:23.306302 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:40:23.306039 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-78c99df468-d5dx2" May 21 10:40:23.307182 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:40:23.307158 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-9qdj2" event={"ID":"2318016f-5809-4d04-9d0f-c91934387149","Type":"ContainerStarted","Data":"b9da3cee974ea5ef635be1a4bfdae50e67ca450a4e76ae08006bb860e3836a30"} May 21 10:40:23.324124 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:40:23.324077 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-78c99df468-d5dx2" podStartSLOduration=2.0635766110000002 podStartE2EDuration="6.324063541s" podCreationTimestamp="2026-05-21 10:40:17 +0000 UTC" firstStartedPulling="2026-05-21 10:40:18.081487332 +0000 UTC m=+613.292647425" lastFinishedPulling="2026-05-21 10:40:22.341974259 +0000 UTC m=+617.553134355" observedRunningTime="2026-05-21 10:40:23.322677582 +0000 UTC m=+618.533837697" watchObservedRunningTime="2026-05-21 10:40:23.324063541 +0000 UTC m=+618.535223655" May 21 10:40:23.337780 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:40:23.337730 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-f99f4b5cd-9qdj2" podStartSLOduration=1.543941483 podStartE2EDuration="5.337716341s" podCreationTimestamp="2026-05-21 10:40:18 +0000 UTC" firstStartedPulling="2026-05-21 10:40:18.555845283 +0000 UTC m=+613.767005393" lastFinishedPulling="2026-05-21 10:40:22.349620149 +0000 UTC m=+617.560780251" observedRunningTime="2026-05-21 10:40:23.336175661 +0000 UTC m=+618.547335817" watchObservedRunningTime="2026-05-21 10:40:23.337716341 +0000 UTC m=+618.548876456" May 21 10:40:23.743865 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:40:23.743776 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-9qdj2"] May 21 10:40:25.316589 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:40:25.316549 2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-f99f4b5cd-9qdj2" podUID="2318016f-5809-4d04-9d0f-c91934387149" containerName="authorino" containerID="cri-o://b9da3cee974ea5ef635be1a4bfdae50e67ca450a4e76ae08006bb860e3836a30" gracePeriod=30 May 21 10:40:25.563966 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:40:25.563946 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-9qdj2" May 21 10:40:25.680574 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:40:25.680496 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cwjrh\" (UniqueName: \"kubernetes.io/projected/2318016f-5809-4d04-9d0f-c91934387149-kube-api-access-cwjrh\") pod \"2318016f-5809-4d04-9d0f-c91934387149\" (UID: \"2318016f-5809-4d04-9d0f-c91934387149\") " May 21 10:40:25.682799 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:40:25.682777 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2318016f-5809-4d04-9d0f-c91934387149-kube-api-access-cwjrh" (OuterVolumeSpecName: "kube-api-access-cwjrh") pod "2318016f-5809-4d04-9d0f-c91934387149" (UID: "2318016f-5809-4d04-9d0f-c91934387149"). InnerVolumeSpecName "kube-api-access-cwjrh". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 10:40:25.781914 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:40:25.781862 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cwjrh\" (UniqueName: \"kubernetes.io/projected/2318016f-5809-4d04-9d0f-c91934387149-kube-api-access-cwjrh\") on node \"ip-10-0-140-254.ec2.internal\" DevicePath \"\"" May 21 10:40:26.321156 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:40:26.321122 2563 generic.go:358] "Generic (PLEG): container finished" podID="2318016f-5809-4d04-9d0f-c91934387149" containerID="b9da3cee974ea5ef635be1a4bfdae50e67ca450a4e76ae08006bb860e3836a30" exitCode=0 May 21 10:40:26.321590 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:40:26.321169 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-9qdj2" May 21 10:40:26.321590 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:40:26.321211 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-9qdj2" event={"ID":"2318016f-5809-4d04-9d0f-c91934387149","Type":"ContainerDied","Data":"b9da3cee974ea5ef635be1a4bfdae50e67ca450a4e76ae08006bb860e3836a30"} May 21 10:40:26.321590 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:40:26.321256 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-9qdj2" event={"ID":"2318016f-5809-4d04-9d0f-c91934387149","Type":"ContainerDied","Data":"578cbba7fdd6a3ca7736121b85e24fd5107486f1faafaec9e1b2b0e4f9f378f0"} May 21 10:40:26.321590 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:40:26.321277 2563 scope.go:117] "RemoveContainer" containerID="b9da3cee974ea5ef635be1a4bfdae50e67ca450a4e76ae08006bb860e3836a30" May 21 10:40:26.329367 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:40:26.329349 2563 scope.go:117] "RemoveContainer" containerID="b9da3cee974ea5ef635be1a4bfdae50e67ca450a4e76ae08006bb860e3836a30" May 21 10:40:26.329619 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:40:26.329604 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9da3cee974ea5ef635be1a4bfdae50e67ca450a4e76ae08006bb860e3836a30\": container with ID starting with b9da3cee974ea5ef635be1a4bfdae50e67ca450a4e76ae08006bb860e3836a30 not found: ID does not exist" containerID="b9da3cee974ea5ef635be1a4bfdae50e67ca450a4e76ae08006bb860e3836a30" May 21 10:40:26.329662 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:40:26.329626 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9da3cee974ea5ef635be1a4bfdae50e67ca450a4e76ae08006bb860e3836a30"} err="failed to get container status \"b9da3cee974ea5ef635be1a4bfdae50e67ca450a4e76ae08006bb860e3836a30\": rpc error: code = NotFound desc = could not find container \"b9da3cee974ea5ef635be1a4bfdae50e67ca450a4e76ae08006bb860e3836a30\": container with ID starting with b9da3cee974ea5ef635be1a4bfdae50e67ca450a4e76ae08006bb860e3836a30 not found: ID does not exist" May 21 10:40:26.342918 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:40:26.342895 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-9qdj2"] May 21 10:40:26.349211 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:40:26.349190 2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-9qdj2"] May 21 10:40:27.401072 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:40:27.401039 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2318016f-5809-4d04-9d0f-c91934387149" path="/var/lib/kubelet/pods/2318016f-5809-4d04-9d0f-c91934387149/volumes" May 21 10:40:34.313943 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:40:34.313910 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-78c99df468-d5dx2" May 21 10:40:51.698481 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:40:51.698443 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-56fdd757f5-49c7p"] May 21 10:40:51.705912 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:40:51.698764 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2318016f-5809-4d04-9d0f-c91934387149" containerName="authorino" May 21 10:40:51.705912 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:40:51.698775 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="2318016f-5809-4d04-9d0f-c91934387149" containerName="authorino" May 21 10:40:51.705912 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:40:51.698857 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="2318016f-5809-4d04-9d0f-c91934387149" containerName="authorino" May 21 10:40:51.706108 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:40:51.705915 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56fdd757f5-49c7p" May 21 10:40:51.708762 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:40:51.708731 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56fdd757f5-49c7p"] May 21 10:40:51.709167 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:40:51.709142 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-c2pl4\"" May 21 10:40:51.709271 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:40:51.709174 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" May 21 10:40:51.739047 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:40:51.739016 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56fdd757f5-49c7p"] May 21 10:40:51.739249 ip-10-0-140-254 kubenswrapper[2563]: E0521 10:40:51.739230 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-pzz8h tls-cert], unattached volumes=[], failed to process volumes=[kube-api-access-pzz8h tls-cert]: context canceled" pod="kuadrant-system/authorino-56fdd757f5-49c7p" podUID="7cbba012-9a62-4cb5-baea-2be8b5717474" May 21 10:40:51.799270 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:40:51.799240 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7cbba012-9a62-4cb5-baea-2be8b5717474-tls-cert\") pod \"authorino-56fdd757f5-49c7p\" (UID: \"7cbba012-9a62-4cb5-baea-2be8b5717474\") " pod="kuadrant-system/authorino-56fdd757f5-49c7p" May 21 10:40:51.799408 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:40:51.799293 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzz8h\" (UniqueName: \"kubernetes.io/projected/7cbba012-9a62-4cb5-baea-2be8b5717474-kube-api-access-pzz8h\") pod \"authorino-56fdd757f5-49c7p\" (UID: \"7cbba012-9a62-4cb5-baea-2be8b5717474\") " pod="kuadrant-system/authorino-56fdd757f5-49c7p" May 21 10:40:51.900353 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:40:51.900319 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pzz8h\" (UniqueName: \"kubernetes.io/projected/7cbba012-9a62-4cb5-baea-2be8b5717474-kube-api-access-pzz8h\") pod \"authorino-56fdd757f5-49c7p\" (UID: \"7cbba012-9a62-4cb5-baea-2be8b5717474\") " pod="kuadrant-system/authorino-56fdd757f5-49c7p" May 21 10:40:51.900506 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:40:51.900386 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7cbba012-9a62-4cb5-baea-2be8b5717474-tls-cert\") pod \"authorino-56fdd757f5-49c7p\" (UID: \"7cbba012-9a62-4cb5-baea-2be8b5717474\") " pod="kuadrant-system/authorino-56fdd757f5-49c7p" May 21 10:40:51.902864 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:40:51.902844 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7cbba012-9a62-4cb5-baea-2be8b5717474-tls-cert\") pod \"authorino-56fdd757f5-49c7p\" (UID: \"7cbba012-9a62-4cb5-baea-2be8b5717474\") " pod="kuadrant-system/authorino-56fdd757f5-49c7p" May 21 10:40:51.911509 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:40:51.911488 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzz8h\" (UniqueName: \"kubernetes.io/projected/7cbba012-9a62-4cb5-baea-2be8b5717474-kube-api-access-pzz8h\") pod \"authorino-56fdd757f5-49c7p\" (UID: \"7cbba012-9a62-4cb5-baea-2be8b5717474\") " pod="kuadrant-system/authorino-56fdd757f5-49c7p" May 21 10:40:52.403852 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:40:52.403807 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56fdd757f5-49c7p" May 21 10:40:52.408630 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:40:52.408607 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56fdd757f5-49c7p" May 21 10:40:52.506131 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:40:52.506094 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pzz8h\" (UniqueName: \"kubernetes.io/projected/7cbba012-9a62-4cb5-baea-2be8b5717474-kube-api-access-pzz8h\") pod \"7cbba012-9a62-4cb5-baea-2be8b5717474\" (UID: \"7cbba012-9a62-4cb5-baea-2be8b5717474\") " May 21 10:40:52.506283 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:40:52.506151 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7cbba012-9a62-4cb5-baea-2be8b5717474-tls-cert\") pod \"7cbba012-9a62-4cb5-baea-2be8b5717474\" (UID: \"7cbba012-9a62-4cb5-baea-2be8b5717474\") " May 21 10:40:52.508549 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:40:52.508520 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7cbba012-9a62-4cb5-baea-2be8b5717474-kube-api-access-pzz8h" (OuterVolumeSpecName: "kube-api-access-pzz8h") pod "7cbba012-9a62-4cb5-baea-2be8b5717474" (UID: "7cbba012-9a62-4cb5-baea-2be8b5717474"). InnerVolumeSpecName "kube-api-access-pzz8h". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 10:40:52.508671 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:40:52.508530 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7cbba012-9a62-4cb5-baea-2be8b5717474-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "7cbba012-9a62-4cb5-baea-2be8b5717474" (UID: "7cbba012-9a62-4cb5-baea-2be8b5717474"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 10:40:52.607212 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:40:52.607169 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pzz8h\" (UniqueName: \"kubernetes.io/projected/7cbba012-9a62-4cb5-baea-2be8b5717474-kube-api-access-pzz8h\") on node \"ip-10-0-140-254.ec2.internal\" DevicePath \"\"" May 21 10:40:52.607212 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:40:52.607206 2563 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7cbba012-9a62-4cb5-baea-2be8b5717474-tls-cert\") on node \"ip-10-0-140-254.ec2.internal\" DevicePath \"\"" May 21 10:40:53.406537 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:40:53.406516 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56fdd757f5-49c7p" May 21 10:40:53.434597 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:40:53.434562 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56fdd757f5-49c7p"] May 21 10:40:53.437293 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:40:53.437266 2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-56fdd757f5-49c7p"] May 21 10:40:55.400957 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:40:55.400927 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7cbba012-9a62-4cb5-baea-2be8b5717474" path="/var/lib/kubelet/pods/7cbba012-9a62-4cb5-baea-2be8b5717474/volumes" May 21 10:41:42.300803 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:41:42.300768 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 10:42:00.546855 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:42:00.546744 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 10:42:05.538380 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:42:05.538347 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 10:42:09.436650 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:42:09.436612 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 10:42:20.129282 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:42:20.129247 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 10:42:48.028715 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:42:48.028679 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 10:42:56.295976 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:42:56.295940 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6d9486c74-vww5f"] May 21 10:42:56.299266 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:42:56.299250 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d9486c74-vww5f" May 21 10:42:56.302320 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:42:56.302298 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" May 21 10:42:56.302443 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:42:56.302306 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-c2pl4\"" May 21 10:42:56.306288 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:42:56.305923 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d9486c74-vww5f"] May 21 10:42:56.333692 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:42:56.333658 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qqtv\" (UniqueName: \"kubernetes.io/projected/c5e176aa-dc37-4fbe-9030-0ce8bb991727-kube-api-access-2qqtv\") pod \"authorino-6d9486c74-vww5f\" (UID: \"c5e176aa-dc37-4fbe-9030-0ce8bb991727\") " pod="kuadrant-system/authorino-6d9486c74-vww5f" May 21 10:42:56.333878 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:42:56.333713 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c5e176aa-dc37-4fbe-9030-0ce8bb991727-tls-cert\") pod \"authorino-6d9486c74-vww5f\" (UID: \"c5e176aa-dc37-4fbe-9030-0ce8bb991727\") " pod="kuadrant-system/authorino-6d9486c74-vww5f" May 21 10:42:56.434328 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:42:56.434291 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2qqtv\" (UniqueName: \"kubernetes.io/projected/c5e176aa-dc37-4fbe-9030-0ce8bb991727-kube-api-access-2qqtv\") pod \"authorino-6d9486c74-vww5f\" (UID: \"c5e176aa-dc37-4fbe-9030-0ce8bb991727\") " pod="kuadrant-system/authorino-6d9486c74-vww5f" May 21 10:42:56.434509 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:42:56.434348 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c5e176aa-dc37-4fbe-9030-0ce8bb991727-tls-cert\") pod \"authorino-6d9486c74-vww5f\" (UID: \"c5e176aa-dc37-4fbe-9030-0ce8bb991727\") " pod="kuadrant-system/authorino-6d9486c74-vww5f" May 21 10:42:56.436883 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:42:56.436853 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c5e176aa-dc37-4fbe-9030-0ce8bb991727-tls-cert\") pod \"authorino-6d9486c74-vww5f\" (UID: \"c5e176aa-dc37-4fbe-9030-0ce8bb991727\") " pod="kuadrant-system/authorino-6d9486c74-vww5f" May 21 10:42:56.443369 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:42:56.443345 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qqtv\" (UniqueName: \"kubernetes.io/projected/c5e176aa-dc37-4fbe-9030-0ce8bb991727-kube-api-access-2qqtv\") pod \"authorino-6d9486c74-vww5f\" (UID: \"c5e176aa-dc37-4fbe-9030-0ce8bb991727\") " pod="kuadrant-system/authorino-6d9486c74-vww5f" May 21 10:42:56.608401 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:42:56.608352 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d9486c74-vww5f" May 21 10:42:56.732604 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:42:56.732581 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d9486c74-vww5f"] May 21 10:42:56.734708 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:42:56.734676 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc5e176aa_dc37_4fbe_9030_0ce8bb991727.slice/crio-a7e7f31f5ee42befb8409c5f0512b529cd541534461b80ea86332d7a5f9a2bcb WatchSource:0}: Error finding container a7e7f31f5ee42befb8409c5f0512b529cd541534461b80ea86332d7a5f9a2bcb: Status 404 returned error can't find the container with id a7e7f31f5ee42befb8409c5f0512b529cd541534461b80ea86332d7a5f9a2bcb May 21 10:42:56.736065 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:42:56.736048 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 10:42:56.816004 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:42:56.815973 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6d9486c74-vww5f" event={"ID":"c5e176aa-dc37-4fbe-9030-0ce8bb991727","Type":"ContainerStarted","Data":"a7e7f31f5ee42befb8409c5f0512b529cd541534461b80ea86332d7a5f9a2bcb"} May 21 10:42:57.822010 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:42:57.821972 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6d9486c74-vww5f" event={"ID":"c5e176aa-dc37-4fbe-9030-0ce8bb991727","Type":"ContainerStarted","Data":"071a376ee04d68574a5f9c3b3f5371a31b96edbdbf725b2fb3867da83169d64a"} May 21 10:42:57.839207 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:42:57.839031 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-6d9486c74-vww5f" podStartSLOduration=1.3071368159999999 podStartE2EDuration="1.839012038s" podCreationTimestamp="2026-05-21 10:42:56 +0000 UTC" firstStartedPulling="2026-05-21 10:42:56.736168431 +0000 UTC m=+771.947328524" lastFinishedPulling="2026-05-21 10:42:57.268043638 +0000 UTC m=+772.479203746" observedRunningTime="2026-05-21 10:42:57.838543122 +0000 UTC m=+773.049703254" watchObservedRunningTime="2026-05-21 10:42:57.839012038 +0000 UTC m=+773.050172154" May 21 10:43:11.330291 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:43:11.330252 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 10:43:18.772208 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:43:18.772165 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 10:43:23.736792 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:43:23.736710 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 10:43:30.529867 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:43:30.529813 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 10:43:40.436943 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:43:40.436906 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 10:43:48.460374 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:43:48.460336 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 10:44:00.140568 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:44:00.140535 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 10:44:08.276978 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:44:08.276935 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 10:44:19.280416 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:44:19.280379 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 10:45:00.155434 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:45:00.155392 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29656005-h7dw9"] May 21 10:45:00.158805 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:45:00.158785 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29656005-h7dw9" May 21 10:45:00.164259 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:45:00.164231 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-5twcx\"" May 21 10:45:00.184430 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:45:00.184395 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29656005-h7dw9"] May 21 10:45:00.278842 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:45:00.278789 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4j58f\" (UniqueName: \"kubernetes.io/projected/748f2541-1678-47bd-a85e-51ad81d9a673-kube-api-access-4j58f\") pod \"maas-api-key-cleanup-29656005-h7dw9\" (UID: \"748f2541-1678-47bd-a85e-51ad81d9a673\") " pod="opendatahub/maas-api-key-cleanup-29656005-h7dw9" May 21 10:45:00.380225 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:45:00.380180 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4j58f\" (UniqueName: \"kubernetes.io/projected/748f2541-1678-47bd-a85e-51ad81d9a673-kube-api-access-4j58f\") pod \"maas-api-key-cleanup-29656005-h7dw9\" (UID: \"748f2541-1678-47bd-a85e-51ad81d9a673\") " pod="opendatahub/maas-api-key-cleanup-29656005-h7dw9" May 21 10:45:00.390109 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:45:00.390081 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4j58f\" (UniqueName: \"kubernetes.io/projected/748f2541-1678-47bd-a85e-51ad81d9a673-kube-api-access-4j58f\") pod \"maas-api-key-cleanup-29656005-h7dw9\" (UID: \"748f2541-1678-47bd-a85e-51ad81d9a673\") " pod="opendatahub/maas-api-key-cleanup-29656005-h7dw9" May 21 10:45:00.468969 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:45:00.468888 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29656005-h7dw9" May 21 10:45:00.601446 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:45:00.601422 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29656005-h7dw9"] May 21 10:45:00.603842 ip-10-0-140-254 kubenswrapper[2563]: W0521 10:45:00.603797 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod748f2541_1678_47bd_a85e_51ad81d9a673.slice/crio-6c42375b909a70a065e1d7f49c6285eacd1253e0f5e3380afaa204fab56e0f8f WatchSource:0}: Error finding container 6c42375b909a70a065e1d7f49c6285eacd1253e0f5e3380afaa204fab56e0f8f: Status 404 returned error can't find the container with id 6c42375b909a70a065e1d7f49c6285eacd1253e0f5e3380afaa204fab56e0f8f May 21 10:45:01.230866 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:45:01.230802 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29656005-h7dw9" event={"ID":"748f2541-1678-47bd-a85e-51ad81d9a673","Type":"ContainerStarted","Data":"6c42375b909a70a065e1d7f49c6285eacd1253e0f5e3380afaa204fab56e0f8f"} May 21 10:45:04.242575 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:45:04.242542 2563 generic.go:358] "Generic (PLEG): container finished" podID="748f2541-1678-47bd-a85e-51ad81d9a673" containerID="ecfdddf8b94a1ea5cf20fed04014d18956e20f28c70619b4486ffee2d508f3e6" exitCode=0 May 21 10:45:04.242955 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:45:04.242596 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29656005-h7dw9" event={"ID":"748f2541-1678-47bd-a85e-51ad81d9a673","Type":"ContainerDied","Data":"ecfdddf8b94a1ea5cf20fed04014d18956e20f28c70619b4486ffee2d508f3e6"} May 21 10:45:05.372343 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:45:05.372320 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-dfjr4_ab74c7ba-ea27-43e2-924e-aa819aee1362/console-operator/1.log" May 21 10:45:05.373507 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:45:05.373487 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-dfjr4_ab74c7ba-ea27-43e2-924e-aa819aee1362/console-operator/1.log" May 21 10:45:05.382409 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:45:05.382391 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29656005-h7dw9" May 21 10:45:05.526587 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:45:05.526502 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4j58f\" (UniqueName: \"kubernetes.io/projected/748f2541-1678-47bd-a85e-51ad81d9a673-kube-api-access-4j58f\") pod \"748f2541-1678-47bd-a85e-51ad81d9a673\" (UID: \"748f2541-1678-47bd-a85e-51ad81d9a673\") " May 21 10:45:05.529152 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:45:05.529125 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/748f2541-1678-47bd-a85e-51ad81d9a673-kube-api-access-4j58f" (OuterVolumeSpecName: "kube-api-access-4j58f") pod "748f2541-1678-47bd-a85e-51ad81d9a673" (UID: "748f2541-1678-47bd-a85e-51ad81d9a673"). InnerVolumeSpecName "kube-api-access-4j58f". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 10:45:05.627717 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:45:05.627673 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4j58f\" (UniqueName: \"kubernetes.io/projected/748f2541-1678-47bd-a85e-51ad81d9a673-kube-api-access-4j58f\") on node \"ip-10-0-140-254.ec2.internal\" DevicePath \"\"" May 21 10:45:06.249794 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:45:06.249764 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29656005-h7dw9" May 21 10:45:06.250001 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:45:06.249800 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29656005-h7dw9" event={"ID":"748f2541-1678-47bd-a85e-51ad81d9a673","Type":"ContainerDied","Data":"6c42375b909a70a065e1d7f49c6285eacd1253e0f5e3380afaa204fab56e0f8f"} May 21 10:45:06.250001 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:45:06.249860 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6c42375b909a70a065e1d7f49c6285eacd1253e0f5e3380afaa204fab56e0f8f" May 21 10:45:31.633675 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:45:31.633640 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 10:45:47.630618 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:45:47.630578 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 10:46:26.935175 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:46:26.935088 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 10:46:43.231594 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:46:43.231555 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 10:46:58.440721 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:46:58.440685 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 10:47:14.831435 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:47:14.831396 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 10:48:10.124608 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:48:10.124528 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 10:48:19.325865 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:48:19.325806 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 10:48:35.520126 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:48:35.520092 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 10:48:43.826526 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:48:43.826482 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 10:49:01.935578 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:49:01.935544 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 10:49:09.125650 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:49:09.125609 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 10:49:41.842303 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:49:41.842220 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 10:49:50.835892 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:49:50.835852 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 10:49:59.429406 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:49:59.429373 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 10:50:05.394760 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:50:05.394733 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-dfjr4_ab74c7ba-ea27-43e2-924e-aa819aee1362/console-operator/1.log" May 21 10:50:05.398358 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:50:05.398337 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-dfjr4_ab74c7ba-ea27-43e2-924e-aa819aee1362/console-operator/1.log" May 21 10:50:07.732062 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:50:07.732031 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 10:50:16.529136 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:50:16.529105 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 10:50:32.831999 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:50:32.831965 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 10:50:46.235182 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:50:46.235144 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 10:51:33.331545 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:51:33.331508 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 10:51:37.939602 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:51:37.939561 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 10:51:46.432896 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:51:46.432856 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 10:51:55.528946 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:51:55.528910 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 10:52:03.931304 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:52:03.931263 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 10:52:13.325804 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:52:13.325756 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 10:52:22.346685 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:52:22.346654 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 10:52:30.135328 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:52:30.135292 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 10:52:38.932869 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:52:38.932835 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 10:52:48.036562 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:52:48.036526 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 10:52:57.537836 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:52:57.537774 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 10:53:05.143333 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:53:05.143298 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 10:53:14.845866 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:53:14.845812 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 10:53:23.027132 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:53:23.027093 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 10:53:32.430198 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:53:32.430150 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 10:53:40.033991 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:53:40.033951 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 10:53:50.134486 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:53:50.134445 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 10:53:57.741122 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:53:57.741038 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 10:55:05.418782 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:55:05.418746 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-dfjr4_ab74c7ba-ea27-43e2-924e-aa819aee1362/console-operator/1.log" May 21 10:55:05.421891 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:55:05.421868 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-dfjr4_ab74c7ba-ea27-43e2-924e-aa819aee1362/console-operator/1.log" May 21 10:56:16.816128 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:56:16.816089 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 10:56:21.631763 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:56:21.631724 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 10:56:47.540022 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:56:47.539984 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 10:56:54.194540 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:56:54.194447 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 10:57:04.643903 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:57:04.643863 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 10:57:15.084556 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:57:15.084519 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 10:57:23.153232 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:57:23.153195 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 10:57:34.336889 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:57:34.336852 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 10:57:43.128093 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:57:43.128051 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 10:57:52.738890 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:57:52.738837 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 10:58:02.935544 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:58:02.935502 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 10:58:13.144901 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:58:13.144864 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 10:58:22.255269 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:58:22.255235 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 10:58:54.632528 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:58:54.632487 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 10:59:38.029178 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:59:38.029143 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 10:59:46.326694 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:59:46.326639 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 10:59:55.334435 ip-10-0-140-254 kubenswrapper[2563]: I0521 10:59:55.334358 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 11:00:00.137103 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:00:00.137070 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29656020-t2cgp"] May 21 11:00:00.137485 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:00:00.137422 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="748f2541-1678-47bd-a85e-51ad81d9a673" containerName="cleanup" May 21 11:00:00.137485 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:00:00.137433 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="748f2541-1678-47bd-a85e-51ad81d9a673" containerName="cleanup" May 21 11:00:00.137485 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:00:00.137485 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="748f2541-1678-47bd-a85e-51ad81d9a673" containerName="cleanup" May 21 11:00:00.140291 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:00:00.140275 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29656020-t2cgp" May 21 11:00:00.143986 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:00:00.143968 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-5twcx\"" May 21 11:00:00.156973 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:00:00.156951 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29656020-t2cgp"] May 21 11:00:00.251094 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:00:00.251057 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvdw6\" (UniqueName: \"kubernetes.io/projected/ecaf6f3d-866c-468f-a2df-6a005d9bf87c-kube-api-access-lvdw6\") pod \"maas-api-key-cleanup-29656020-t2cgp\" (UID: \"ecaf6f3d-866c-468f-a2df-6a005d9bf87c\") " pod="opendatahub/maas-api-key-cleanup-29656020-t2cgp" May 21 11:00:00.351947 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:00:00.351920 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lvdw6\" (UniqueName: \"kubernetes.io/projected/ecaf6f3d-866c-468f-a2df-6a005d9bf87c-kube-api-access-lvdw6\") pod \"maas-api-key-cleanup-29656020-t2cgp\" (UID: \"ecaf6f3d-866c-468f-a2df-6a005d9bf87c\") " pod="opendatahub/maas-api-key-cleanup-29656020-t2cgp" May 21 11:00:00.361392 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:00:00.361370 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvdw6\" (UniqueName: \"kubernetes.io/projected/ecaf6f3d-866c-468f-a2df-6a005d9bf87c-kube-api-access-lvdw6\") pod \"maas-api-key-cleanup-29656020-t2cgp\" (UID: \"ecaf6f3d-866c-468f-a2df-6a005d9bf87c\") " pod="opendatahub/maas-api-key-cleanup-29656020-t2cgp" May 21 11:00:00.450715 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:00:00.450636 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29656020-t2cgp" May 21 11:00:00.578480 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:00:00.578454 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29656020-t2cgp"] May 21 11:00:00.581282 ip-10-0-140-254 kubenswrapper[2563]: W0521 11:00:00.581251 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecaf6f3d_866c_468f_a2df_6a005d9bf87c.slice/crio-09753e160e22b2fe3c8a3fd70282b2225dd49ed15d7d58c1afec268896cd76d0 WatchSource:0}: Error finding container 09753e160e22b2fe3c8a3fd70282b2225dd49ed15d7d58c1afec268896cd76d0: Status 404 returned error can't find the container with id 09753e160e22b2fe3c8a3fd70282b2225dd49ed15d7d58c1afec268896cd76d0 May 21 11:00:00.583325 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:00:00.583308 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 11:00:01.173565 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:00:01.173530 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29656020-t2cgp" event={"ID":"ecaf6f3d-866c-468f-a2df-6a005d9bf87c","Type":"ContainerStarted","Data":"c0ebcfa8138a896254f28007996a079a99a3328b33646f03923f5bd2baafd534"} May 21 11:00:01.173928 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:00:01.173570 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29656020-t2cgp" event={"ID":"ecaf6f3d-866c-468f-a2df-6a005d9bf87c","Type":"ContainerStarted","Data":"09753e160e22b2fe3c8a3fd70282b2225dd49ed15d7d58c1afec268896cd76d0"} May 21 11:00:01.191298 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:00:01.191244 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29656020-t2cgp" podStartSLOduration=1.191227877 podStartE2EDuration="1.191227877s" podCreationTimestamp="2026-05-21 11:00:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 11:00:01.189744063 +0000 UTC m=+1796.400904176" watchObservedRunningTime="2026-05-21 11:00:01.191227877 +0000 UTC m=+1796.402387992" May 21 11:00:02.178527 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:00:02.178492 2563 generic.go:358] "Generic (PLEG): container finished" podID="ecaf6f3d-866c-468f-a2df-6a005d9bf87c" containerID="c0ebcfa8138a896254f28007996a079a99a3328b33646f03923f5bd2baafd534" exitCode=0 May 21 11:00:02.178932 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:00:02.178535 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29656020-t2cgp" event={"ID":"ecaf6f3d-866c-468f-a2df-6a005d9bf87c","Type":"ContainerDied","Data":"c0ebcfa8138a896254f28007996a079a99a3328b33646f03923f5bd2baafd534"} May 21 11:00:03.304994 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:00:03.304969 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29656020-t2cgp" May 21 11:00:03.377201 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:00:03.377168 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lvdw6\" (UniqueName: \"kubernetes.io/projected/ecaf6f3d-866c-468f-a2df-6a005d9bf87c-kube-api-access-lvdw6\") pod \"ecaf6f3d-866c-468f-a2df-6a005d9bf87c\" (UID: \"ecaf6f3d-866c-468f-a2df-6a005d9bf87c\") " May 21 11:00:03.379248 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:00:03.379226 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ecaf6f3d-866c-468f-a2df-6a005d9bf87c-kube-api-access-lvdw6" (OuterVolumeSpecName: "kube-api-access-lvdw6") pod "ecaf6f3d-866c-468f-a2df-6a005d9bf87c" (UID: "ecaf6f3d-866c-468f-a2df-6a005d9bf87c"). InnerVolumeSpecName "kube-api-access-lvdw6". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 11:00:03.478304 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:00:03.478240 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lvdw6\" (UniqueName: \"kubernetes.io/projected/ecaf6f3d-866c-468f-a2df-6a005d9bf87c-kube-api-access-lvdw6\") on node \"ip-10-0-140-254.ec2.internal\" DevicePath \"\"" May 21 11:00:04.186583 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:00:04.186544 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29656020-t2cgp" event={"ID":"ecaf6f3d-866c-468f-a2df-6a005d9bf87c","Type":"ContainerDied","Data":"09753e160e22b2fe3c8a3fd70282b2225dd49ed15d7d58c1afec268896cd76d0"} May 21 11:00:04.186583 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:00:04.186570 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29656020-t2cgp" May 21 11:00:04.186583 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:00:04.186581 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="09753e160e22b2fe3c8a3fd70282b2225dd49ed15d7d58c1afec268896cd76d0" May 21 11:00:04.453401 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:00:04.453321 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 11:00:05.446389 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:00:05.446358 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-dfjr4_ab74c7ba-ea27-43e2-924e-aa819aee1362/console-operator/1.log" May 21 11:00:05.450835 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:00:05.450793 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-dfjr4_ab74c7ba-ea27-43e2-924e-aa819aee1362/console-operator/1.log" May 21 11:00:12.640968 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:00:12.640930 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 11:00:24.234997 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:00:24.234952 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 11:00:32.149740 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:00:32.149703 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 11:00:39.033545 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:00:39.033510 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 11:00:48.750519 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:00:48.746598 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 11:00:56.966409 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:00:56.966373 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 11:01:05.736605 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:01:05.736570 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 11:01:16.334804 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:01:16.334764 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 11:01:33.742439 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:01:33.742350 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 11:01:41.931344 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:01:41.931307 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 11:01:51.952653 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:01:51.952614 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 11:02:02.145758 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:02:02.145718 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 11:02:18.538116 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:02:18.538077 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 11:02:27.134013 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:02:27.133969 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 11:02:36.125951 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:02:36.125915 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 11:02:44.026969 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:02:44.026933 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 11:02:54.727322 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:02:54.727240 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 11:03:03.042958 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:03:03.042919 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 11:03:11.128899 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:03:11.128863 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 11:03:22.253235 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:03:22.253203 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 11:03:31.333240 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:03:31.333199 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 11:03:45.333763 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:03:45.333721 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 11:03:54.353538 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:03:54.353493 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 11:04:02.638230 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:04:02.638189 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 11:04:10.639981 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:04:10.639939 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 11:04:19.030380 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:04:19.030334 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 11:04:34.945433 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:04:34.945333 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 11:04:43.632504 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:04:43.632462 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 11:04:52.444157 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:04:52.444116 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 11:05:01.443298 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:05:01.443259 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 11:05:05.475267 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:05:05.475237 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-dfjr4_ab74c7ba-ea27-43e2-924e-aa819aee1362/console-operator/1.log" May 21 11:05:05.477355 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:05:05.477332 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-dfjr4_ab74c7ba-ea27-43e2-924e-aa819aee1362/console-operator/1.log" May 21 11:05:24.633008 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:05:24.632961 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 11:05:37.335892 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:05:37.335852 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-d5dx2"] May 21 11:05:38.992003 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:05:38.991964 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6d9486c74-vww5f_c5e176aa-dc37-4fbe-9030-0ce8bb991727/authorino/0.log" May 21 11:05:43.511773 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:05:43.511740 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29656005-h7dw9_748f2541-1678-47bd-a85e-51ad81d9a673/cleanup/0.log" May 21 11:05:43.620735 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:05:43.620702 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29656020-t2cgp_ecaf6f3d-866c-468f-a2df-6a005d9bf87c/cleanup/0.log" May 21 11:05:44.194705 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:05:44.194677 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5fc5c76ccc-lbgql_105d99ba-1564-45a8-93f8-f11cc756a5ed/manager/0.log" May 21 11:05:45.549752 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:05:45.549716 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6d9486c74-vww5f_c5e176aa-dc37-4fbe-9030-0ce8bb991727/authorino/0.log" May 21 11:05:46.220936 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:05:46.220907 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-d5dx2_067a08b6-2fdd-471e-841a-3d1825b0a7da/limitador/0.log" May 21 11:05:46.883884 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:05:46.883853 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-798cbbc998-5mjmj_7a317f86-9873-4a6a-a020-f3a1a4a08b71/kube-auth-proxy/0.log" May 21 11:05:52.530802 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:05:52.530722 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-sjg6n/must-gather-whdrs"] May 21 11:05:52.531184 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:05:52.531102 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecaf6f3d-866c-468f-a2df-6a005d9bf87c" containerName="cleanup" May 21 11:05:52.531184 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:05:52.531114 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecaf6f3d-866c-468f-a2df-6a005d9bf87c" containerName="cleanup" May 21 11:05:52.531184 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:05:52.531175 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="ecaf6f3d-866c-468f-a2df-6a005d9bf87c" containerName="cleanup" May 21 11:05:52.534383 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:05:52.534359 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sjg6n/must-gather-whdrs" May 21 11:05:52.538386 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:05:52.538361 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-sjg6n\"/\"default-dockercfg-cs654\"" May 21 11:05:52.538872 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:05:52.538855 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sjg6n\"/\"openshift-service-ca.crt\"" May 21 11:05:52.539593 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:05:52.539568 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sjg6n\"/\"kube-root-ca.crt\"" May 21 11:05:52.569601 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:05:52.569560 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sjg6n/must-gather-whdrs"] May 21 11:05:52.696161 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:05:52.696123 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtklh\" (UniqueName: \"kubernetes.io/projected/e72ac702-9f9f-4d20-a6cd-56dae83a7c0b-kube-api-access-mtklh\") pod \"must-gather-whdrs\" (UID: \"e72ac702-9f9f-4d20-a6cd-56dae83a7c0b\") " pod="openshift-must-gather-sjg6n/must-gather-whdrs" May 21 11:05:52.696342 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:05:52.696217 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e72ac702-9f9f-4d20-a6cd-56dae83a7c0b-must-gather-output\") pod \"must-gather-whdrs\" (UID: \"e72ac702-9f9f-4d20-a6cd-56dae83a7c0b\") " pod="openshift-must-gather-sjg6n/must-gather-whdrs" May 21 11:05:52.796959 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:05:52.796862 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e72ac702-9f9f-4d20-a6cd-56dae83a7c0b-must-gather-output\") pod \"must-gather-whdrs\" (UID: \"e72ac702-9f9f-4d20-a6cd-56dae83a7c0b\") " pod="openshift-must-gather-sjg6n/must-gather-whdrs" May 21 11:05:52.796959 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:05:52.796929 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mtklh\" (UniqueName: \"kubernetes.io/projected/e72ac702-9f9f-4d20-a6cd-56dae83a7c0b-kube-api-access-mtklh\") pod \"must-gather-whdrs\" (UID: \"e72ac702-9f9f-4d20-a6cd-56dae83a7c0b\") " pod="openshift-must-gather-sjg6n/must-gather-whdrs" May 21 11:05:52.797186 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:05:52.797164 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e72ac702-9f9f-4d20-a6cd-56dae83a7c0b-must-gather-output\") pod \"must-gather-whdrs\" (UID: \"e72ac702-9f9f-4d20-a6cd-56dae83a7c0b\") " pod="openshift-must-gather-sjg6n/must-gather-whdrs" May 21 11:05:52.807705 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:05:52.807665 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtklh\" (UniqueName: \"kubernetes.io/projected/e72ac702-9f9f-4d20-a6cd-56dae83a7c0b-kube-api-access-mtklh\") pod \"must-gather-whdrs\" (UID: \"e72ac702-9f9f-4d20-a6cd-56dae83a7c0b\") " pod="openshift-must-gather-sjg6n/must-gather-whdrs" May 21 11:05:52.843799 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:05:52.843756 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sjg6n/must-gather-whdrs" May 21 11:05:52.988659 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:05:52.988633 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sjg6n/must-gather-whdrs"] May 21 11:05:52.991750 ip-10-0-140-254 kubenswrapper[2563]: W0521 11:05:52.991721 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode72ac702_9f9f_4d20_a6cd_56dae83a7c0b.slice/crio-6dbb7c49853ade0d96fafffeb956c45db85fc98212da13bacb3c1eb31e00627c WatchSource:0}: Error finding container 6dbb7c49853ade0d96fafffeb956c45db85fc98212da13bacb3c1eb31e00627c: Status 404 returned error can't find the container with id 6dbb7c49853ade0d96fafffeb956c45db85fc98212da13bacb3c1eb31e00627c May 21 11:05:52.993695 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:05:52.993678 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 11:05:53.381531 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:05:53.381493 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sjg6n/must-gather-whdrs" event={"ID":"e72ac702-9f9f-4d20-a6cd-56dae83a7c0b","Type":"ContainerStarted","Data":"6dbb7c49853ade0d96fafffeb956c45db85fc98212da13bacb3c1eb31e00627c"} May 21 11:05:54.388193 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:05:54.388137 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sjg6n/must-gather-whdrs" event={"ID":"e72ac702-9f9f-4d20-a6cd-56dae83a7c0b","Type":"ContainerStarted","Data":"06f31d545de44000daeecac80d500d895ba482c34912adaa08a0241ebea4ac9e"} May 21 11:05:54.388193 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:05:54.388197 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sjg6n/must-gather-whdrs" event={"ID":"e72ac702-9f9f-4d20-a6cd-56dae83a7c0b","Type":"ContainerStarted","Data":"d8a60abdb66dbb5e3a64b90134e767feac2771b296bc39b7fabd27a17c833fda"} May 21 11:05:54.405281 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:05:54.405215 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-sjg6n/must-gather-whdrs" podStartSLOduration=1.5536844699999999 podStartE2EDuration="2.405192288s" podCreationTimestamp="2026-05-21 11:05:52 +0000 UTC" firstStartedPulling="2026-05-21 11:05:52.993812468 +0000 UTC m=+2148.204972561" lastFinishedPulling="2026-05-21 11:05:53.845320282 +0000 UTC m=+2149.056480379" observedRunningTime="2026-05-21 11:05:54.403719323 +0000 UTC m=+2149.614879442" watchObservedRunningTime="2026-05-21 11:05:54.405192288 +0000 UTC m=+2149.616352437" May 21 11:05:55.527691 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:05:55.527656 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6stbn_7ad7910c-8def-444e-9c74-06fe23c35ef2/global-pull-secret-syncer/0.log" May 21 11:05:55.665229 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:05:55.665191 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-mf2tq_9c4ae568-a2e3-47d6-aedb-4733f4cf72ad/konnectivity-agent/0.log" May 21 11:05:55.768352 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:05:55.768300 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-254.ec2.internal_f1722d85539e90b00c9a8bb5c877e531/haproxy/0.log" May 21 11:06:00.099086 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:06:00.098745 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6d9486c74-vww5f_c5e176aa-dc37-4fbe-9030-0ce8bb991727/authorino/0.log" May 21 11:06:00.371490 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:06:00.371390 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-d5dx2_067a08b6-2fdd-471e-841a-3d1825b0a7da/limitador/0.log" May 21 11:06:02.179898 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:06:02.178997 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-jh4mw_a0b9e259-f4b1-4bd3-b191-fe08dbbd52c5/cluster-monitoring-operator/0.log" May 21 11:06:02.303699 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:06:02.303665 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-665c9c8584-z5hnr_a1eb6ae0-304e-4914-9853-9f3d5b95409c/monitoring-plugin/0.log" May 21 11:06:02.481209 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:06:02.481130 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xpzq9_f73eb484-906d-4f7b-8a4c-0ae9f4bbbde9/node-exporter/0.log" May 21 11:06:02.505661 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:06:02.505627 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xpzq9_f73eb484-906d-4f7b-8a4c-0ae9f4bbbde9/kube-rbac-proxy/0.log" May 21 11:06:02.530998 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:06:02.530966 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xpzq9_f73eb484-906d-4f7b-8a4c-0ae9f4bbbde9/init-textfile/0.log" May 21 11:06:02.645202 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:06:02.645162 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3a54fb5d-8ca7-490c-aa54-223c65efae28/prometheus/0.log" May 21 11:06:02.667669 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:06:02.667635 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3a54fb5d-8ca7-490c-aa54-223c65efae28/config-reloader/0.log" May 21 11:06:02.690195 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:06:02.690164 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3a54fb5d-8ca7-490c-aa54-223c65efae28/thanos-sidecar/0.log" May 21 11:06:02.712098 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:06:02.712066 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3a54fb5d-8ca7-490c-aa54-223c65efae28/kube-rbac-proxy-web/0.log" May 21 11:06:02.740386 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:06:02.740291 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3a54fb5d-8ca7-490c-aa54-223c65efae28/kube-rbac-proxy/0.log" May 21 11:06:02.768077 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:06:02.768027 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3a54fb5d-8ca7-490c-aa54-223c65efae28/kube-rbac-proxy-thanos/0.log" May 21 11:06:02.793461 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:06:02.793430 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3a54fb5d-8ca7-490c-aa54-223c65efae28/init-config-reloader/0.log" May 21 11:06:02.832972 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:06:02.832934 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-4hncc_32f0efb7-2a1c-4e9c-af6d-9082a850183e/prometheus-operator/0.log" May 21 11:06:02.856608 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:06:02.856574 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-4hncc_32f0efb7-2a1c-4e9c-af6d-9082a850183e/kube-rbac-proxy/0.log" May 21 11:06:04.233454 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:06:04.233418 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d4d8f94f9-v86fl_303b296c-d038-4deb-9908-21685ef908d3/networking-console-plugin/0.log" May 21 11:06:04.490143 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:06:04.490052 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-sjg6n/perf-node-gather-daemonset-q8trh"] May 21 11:06:04.494397 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:06:04.494368 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sjg6n/perf-node-gather-daemonset-q8trh" May 21 11:06:04.506071 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:06:04.504054 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sjg6n/perf-node-gather-daemonset-q8trh"] May 21 11:06:04.613599 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:06:04.613333 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5pz6\" (UniqueName: \"kubernetes.io/projected/7357b089-bde1-4f33-b8cd-e21050f52a92-kube-api-access-t5pz6\") pod \"perf-node-gather-daemonset-q8trh\" (UID: \"7357b089-bde1-4f33-b8cd-e21050f52a92\") " pod="openshift-must-gather-sjg6n/perf-node-gather-daemonset-q8trh" May 21 11:06:04.613599 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:06:04.613410 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7357b089-bde1-4f33-b8cd-e21050f52a92-lib-modules\") pod \"perf-node-gather-daemonset-q8trh\" (UID: \"7357b089-bde1-4f33-b8cd-e21050f52a92\") " pod="openshift-must-gather-sjg6n/perf-node-gather-daemonset-q8trh" May 21 11:06:04.613599 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:06:04.613443 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7357b089-bde1-4f33-b8cd-e21050f52a92-proc\") pod \"perf-node-gather-daemonset-q8trh\" (UID: \"7357b089-bde1-4f33-b8cd-e21050f52a92\") " pod="openshift-must-gather-sjg6n/perf-node-gather-daemonset-q8trh" May 21 11:06:04.613599 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:06:04.613469 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7357b089-bde1-4f33-b8cd-e21050f52a92-podres\") pod \"perf-node-gather-daemonset-q8trh\" (UID: \"7357b089-bde1-4f33-b8cd-e21050f52a92\") " pod="openshift-must-gather-sjg6n/perf-node-gather-daemonset-q8trh" May 21 11:06:04.613599 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:06:04.613504 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7357b089-bde1-4f33-b8cd-e21050f52a92-sys\") pod \"perf-node-gather-daemonset-q8trh\" (UID: \"7357b089-bde1-4f33-b8cd-e21050f52a92\") " pod="openshift-must-gather-sjg6n/perf-node-gather-daemonset-q8trh" May 21 11:06:04.714898 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:06:04.714864 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t5pz6\" (UniqueName: \"kubernetes.io/projected/7357b089-bde1-4f33-b8cd-e21050f52a92-kube-api-access-t5pz6\") pod \"perf-node-gather-daemonset-q8trh\" (UID: \"7357b089-bde1-4f33-b8cd-e21050f52a92\") " pod="openshift-must-gather-sjg6n/perf-node-gather-daemonset-q8trh" May 21 11:06:04.715101 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:06:04.714930 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7357b089-bde1-4f33-b8cd-e21050f52a92-lib-modules\") pod \"perf-node-gather-daemonset-q8trh\" (UID: \"7357b089-bde1-4f33-b8cd-e21050f52a92\") " pod="openshift-must-gather-sjg6n/perf-node-gather-daemonset-q8trh" May 21 11:06:04.715101 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:06:04.714954 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7357b089-bde1-4f33-b8cd-e21050f52a92-proc\") pod \"perf-node-gather-daemonset-q8trh\" (UID: \"7357b089-bde1-4f33-b8cd-e21050f52a92\") " pod="openshift-must-gather-sjg6n/perf-node-gather-daemonset-q8trh" May 21 11:06:04.715101 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:06:04.714980 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7357b089-bde1-4f33-b8cd-e21050f52a92-podres\") pod \"perf-node-gather-daemonset-q8trh\" (UID: \"7357b089-bde1-4f33-b8cd-e21050f52a92\") " pod="openshift-must-gather-sjg6n/perf-node-gather-daemonset-q8trh" May 21 11:06:04.715101 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:06:04.715007 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7357b089-bde1-4f33-b8cd-e21050f52a92-sys\") pod \"perf-node-gather-daemonset-q8trh\" (UID: \"7357b089-bde1-4f33-b8cd-e21050f52a92\") " pod="openshift-must-gather-sjg6n/perf-node-gather-daemonset-q8trh" May 21 11:06:04.715276 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:06:04.715130 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7357b089-bde1-4f33-b8cd-e21050f52a92-sys\") pod \"perf-node-gather-daemonset-q8trh\" (UID: \"7357b089-bde1-4f33-b8cd-e21050f52a92\") " pod="openshift-must-gather-sjg6n/perf-node-gather-daemonset-q8trh" May 21 11:06:04.715276 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:06:04.715139 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7357b089-bde1-4f33-b8cd-e21050f52a92-proc\") pod \"perf-node-gather-daemonset-q8trh\" (UID: \"7357b089-bde1-4f33-b8cd-e21050f52a92\") " pod="openshift-must-gather-sjg6n/perf-node-gather-daemonset-q8trh" May 21 11:06:04.715276 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:06:04.715146 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7357b089-bde1-4f33-b8cd-e21050f52a92-lib-modules\") pod \"perf-node-gather-daemonset-q8trh\" (UID: \"7357b089-bde1-4f33-b8cd-e21050f52a92\") " pod="openshift-must-gather-sjg6n/perf-node-gather-daemonset-q8trh" May 21 11:06:04.715276 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:06:04.715207 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7357b089-bde1-4f33-b8cd-e21050f52a92-podres\") pod \"perf-node-gather-daemonset-q8trh\" (UID: \"7357b089-bde1-4f33-b8cd-e21050f52a92\") " pod="openshift-must-gather-sjg6n/perf-node-gather-daemonset-q8trh" May 21 11:06:04.725042 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:06:04.725012 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5pz6\" (UniqueName: \"kubernetes.io/projected/7357b089-bde1-4f33-b8cd-e21050f52a92-kube-api-access-t5pz6\") pod \"perf-node-gather-daemonset-q8trh\" (UID: \"7357b089-bde1-4f33-b8cd-e21050f52a92\") " pod="openshift-must-gather-sjg6n/perf-node-gather-daemonset-q8trh" May 21 11:06:04.787876 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:06:04.787779 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-dfjr4_ab74c7ba-ea27-43e2-924e-aa819aee1362/console-operator/1.log" May 21 11:06:04.794438 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:06:04.794383 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-dfjr4_ab74c7ba-ea27-43e2-924e-aa819aee1362/console-operator/2.log" May 21 11:06:04.808898 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:06:04.808441 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sjg6n/perf-node-gather-daemonset-q8trh" May 21 11:06:04.983569 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:06:04.983535 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sjg6n/perf-node-gather-daemonset-q8trh"] May 21 11:06:04.987077 ip-10-0-140-254 kubenswrapper[2563]: W0521 11:06:04.987042 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7357b089_bde1_4f33_b8cd_e21050f52a92.slice/crio-ea5a21965c6e285861d4f3c3aa5bbec0d55c47cc3e90fca4bdf54b69de0960e3 WatchSource:0}: Error finding container ea5a21965c6e285861d4f3c3aa5bbec0d55c47cc3e90fca4bdf54b69de0960e3: Status 404 returned error can't find the container with id ea5a21965c6e285861d4f3c3aa5bbec0d55c47cc3e90fca4bdf54b69de0960e3 May 21 11:06:05.328765 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:06:05.328734 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-57bd96b888-dn5pr_61f2708c-7bab-43fb-be8b-c752aeba4358/download-server/0.log" May 21 11:06:05.465181 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:06:05.465071 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sjg6n/perf-node-gather-daemonset-q8trh" event={"ID":"7357b089-bde1-4f33-b8cd-e21050f52a92","Type":"ContainerStarted","Data":"9192e60bf14347b56e1e35c5b0f0d95471875c59663eb85efd88ae7d81b7e9ba"} May 21 11:06:05.465181 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:06:05.465112 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sjg6n/perf-node-gather-daemonset-q8trh" event={"ID":"7357b089-bde1-4f33-b8cd-e21050f52a92","Type":"ContainerStarted","Data":"ea5a21965c6e285861d4f3c3aa5bbec0d55c47cc3e90fca4bdf54b69de0960e3"} May 21 11:06:05.465181 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:06:05.465157 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-sjg6n/perf-node-gather-daemonset-q8trh" May 21 11:06:05.483463 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:06:05.483401 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-sjg6n/perf-node-gather-daemonset-q8trh" podStartSLOduration=1.4833837939999999 podStartE2EDuration="1.483383794s" podCreationTimestamp="2026-05-21 11:06:04 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 11:06:05.482953666 +0000 UTC m=+2160.694113783" watchObservedRunningTime="2026-05-21 11:06:05.483383794 +0000 UTC m=+2160.694543910" May 21 11:06:06.762923 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:06:06.762887 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wk2bh_02618313-ee56-495f-b166-884fa5528f94/dns/0.log" May 21 11:06:06.783675 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:06:06.783642 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wk2bh_02618313-ee56-495f-b166-884fa5528f94/kube-rbac-proxy/0.log" May 21 11:06:06.806541 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:06:06.806505 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7hg45_0ecce324-6dad-4c21-b5d0-60950c0b12a8/dns-node-resolver/0.log" May 21 11:06:07.371328 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:06:07.371295 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vp867_2b0f26ae-1e09-4748-8edc-01ca61e76324/node-ca/0.log" May 21 11:06:08.423491 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:06:08.423456 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-798cbbc998-5mjmj_7a317f86-9873-4a6a-a020-f3a1a4a08b71/kube-auth-proxy/0.log" May 21 11:06:09.173808 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:06:09.173776 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vr89z_8401ddcb-f0a7-4ca9-98f1-08bd15af8920/serve-healthcheck-canary/0.log" May 21 11:06:09.636981 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:06:09.636946 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-v6dl9_2a2bbdf6-2335-4148-98db-ff7687939b56/insights-operator/0.log" May 21 11:06:09.637478 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:06:09.637458 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-v6dl9_2a2bbdf6-2335-4148-98db-ff7687939b56/insights-operator/1.log" May 21 11:06:09.662620 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:06:09.662591 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-br4rg_4ee53fd8-6b82-4922-809a-b0f6b384e649/kube-rbac-proxy/0.log" May 21 11:06:09.689185 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:06:09.689155 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-br4rg_4ee53fd8-6b82-4922-809a-b0f6b384e649/exporter/0.log" May 21 11:06:09.714595 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:06:09.714566 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-br4rg_4ee53fd8-6b82-4922-809a-b0f6b384e649/extractor/0.log" May 21 11:06:11.480094 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:06:11.480066 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-sjg6n/perf-node-gather-daemonset-q8trh" May 21 11:06:11.937656 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:06:11.937623 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29656005-h7dw9_748f2541-1678-47bd-a85e-51ad81d9a673/cleanup/0.log" May 21 11:06:11.961067 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:06:11.961037 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29656020-t2cgp_ecaf6f3d-866c-468f-a2df-6a005d9bf87c/cleanup/0.log" May 21 11:06:12.187359 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:06:12.187333 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5fc5c76ccc-lbgql_105d99ba-1564-45a8-93f8-f11cc756a5ed/manager/0.log" May 21 11:06:13.528884 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:06:13.528850 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-9b6f47d4-q7s96_f40a213c-82a5-475b-ae82-8345f31a5e8c/manager/0.log" May 21 11:06:13.553969 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:06:13.553941 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-bfc7f696d-bgmxq_db6ed736-c484-4682-8a54-579df216b618/openshift-lws-operator/0.log" May 21 11:06:18.134805 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:06:18.134776 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-7ck29_7610c1ec-51a2-4a1a-8a01-a297d8439b2f/migrator/0.log" May 21 11:06:18.154306 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:06:18.154274 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-7ck29_7610c1ec-51a2-4a1a-8a01-a297d8439b2f/graceful-termination/0.log" May 21 11:06:18.547897 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:06:18.547766 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-vm75w_93d61278-e692-455e-9018-b65a4200cc0c/kube-storage-version-migrator-operator/1.log" May 21 11:06:18.548658 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:06:18.548638 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-vm75w_93d61278-e692-455e-9018-b65a4200cc0c/kube-storage-version-migrator-operator/0.log" May 21 11:06:19.697176 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:06:19.697142 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b6m2m_da312e42-a265-4201-9a40-29d1d16a9815/kube-multus-additional-cni-plugins/0.log" May 21 11:06:19.743490 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:06:19.743460 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b6m2m_da312e42-a265-4201-9a40-29d1d16a9815/egress-router-binary-copy/0.log" May 21 11:06:19.777053 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:06:19.777017 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b6m2m_da312e42-a265-4201-9a40-29d1d16a9815/cni-plugins/0.log" May 21 11:06:19.806788 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:06:19.806754 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b6m2m_da312e42-a265-4201-9a40-29d1d16a9815/bond-cni-plugin/0.log" May 21 11:06:19.837663 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:06:19.837630 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b6m2m_da312e42-a265-4201-9a40-29d1d16a9815/routeoverride-cni/0.log" May 21 11:06:19.862933 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:06:19.862898 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b6m2m_da312e42-a265-4201-9a40-29d1d16a9815/whereabouts-cni-bincopy/0.log" May 21 11:06:19.890160 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:06:19.890127 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b6m2m_da312e42-a265-4201-9a40-29d1d16a9815/whereabouts-cni/0.log" May 21 11:06:20.275763 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:06:20.275731 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-bjc58_1dcc3698-3bfb-44e1-9a50-e94dc6eebfee/kube-multus/0.log" May 21 11:06:20.464367 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:06:20.464337 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-hnvv7_a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f/network-metrics-daemon/0.log" May 21 11:06:20.486631 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:06:20.486601 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-hnvv7_a39d7dc9-3e5b-42b5-94fd-cb58369f5a9f/kube-rbac-proxy/0.log" May 21 11:06:21.631337 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:06:21.631281 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jmp49_13bdaed8-f4ef-4751-b367-f343320aae60/ovn-controller/0.log" May 21 11:06:21.667153 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:06:21.667122 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jmp49_13bdaed8-f4ef-4751-b367-f343320aae60/ovn-acl-logging/0.log" May 21 11:06:21.691549 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:06:21.691521 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jmp49_13bdaed8-f4ef-4751-b367-f343320aae60/kube-rbac-proxy-node/0.log" May 21 11:06:21.724087 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:06:21.724055 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jmp49_13bdaed8-f4ef-4751-b367-f343320aae60/kube-rbac-proxy-ovn-metrics/0.log" May 21 11:06:21.751421 ip-10-0-140-254 kubenswrapper[2563]: I0521 11:06:21.751378 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jmp49_13bdaed8-f4ef-4751-b367-f343320aae60/northd/0.log"