May 21 03:19:31.824173 ip-10-0-128-161 systemd[1]: Starting Kubernetes Kubelet... May 21 03:19:32.330469 ip-10-0-128-161 kubenswrapper[2574]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 03:19:32.330469 ip-10-0-128-161 kubenswrapper[2574]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 21 03:19:32.330469 ip-10-0-128-161 kubenswrapper[2574]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 03:19:32.330469 ip-10-0-128-161 kubenswrapper[2574]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 21 03:19:32.330469 ip-10-0-128-161 kubenswrapper[2574]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 03:19:32.333422 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.333330 2574 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 21 03:19:32.337829 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.337815 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 03:19:32.337829 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.337830 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 03:19:32.337901 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.337834 2574 feature_gate.go:328] unrecognized feature gate: Example2 May 21 03:19:32.337901 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.337837 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 03:19:32.337901 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.337852 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 03:19:32.337901 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.337856 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 03:19:32.337901 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.337859 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 03:19:32.337901 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.337862 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 03:19:32.337901 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.337864 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 03:19:32.337901 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.337867 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 03:19:32.337901 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.337870 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 03:19:32.337901 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.337873 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 03:19:32.337901 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.337876 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 03:19:32.337901 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.337879 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 03:19:32.337901 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.337881 2574 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 03:19:32.337901 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.337884 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 03:19:32.337901 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.337886 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 03:19:32.337901 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.337889 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 03:19:32.337901 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.337899 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 03:19:32.337901 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.337901 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 03:19:32.337901 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.337904 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 03:19:32.337901 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.337907 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 03:19:32.338370 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.337909 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 03:19:32.338370 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.337912 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 03:19:32.338370 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.337915 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 03:19:32.338370 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.337918 2574 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 03:19:32.338370 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.337921 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 03:19:32.338370 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.337923 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 03:19:32.338370 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.337926 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 03:19:32.338370 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.337928 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 03:19:32.338370 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.337931 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 03:19:32.338370 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.337933 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 03:19:32.338370 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.337936 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 03:19:32.338370 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.337939 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 03:19:32.338370 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.337941 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 03:19:32.338370 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.337944 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 03:19:32.338370 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.337946 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 03:19:32.338370 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.337949 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 03:19:32.338370 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.337951 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 03:19:32.338370 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.337954 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 03:19:32.338370 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.337957 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 03:19:32.338868 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.337960 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 03:19:32.338868 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.337964 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 03:19:32.338868 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.337967 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 03:19:32.338868 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.337970 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 03:19:32.338868 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.337973 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 03:19:32.338868 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.337975 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 03:19:32.338868 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.337978 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 03:19:32.338868 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.337980 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 03:19:32.338868 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.337982 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 03:19:32.338868 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.337986 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 03:19:32.338868 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.337989 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 03:19:32.338868 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.337991 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 03:19:32.338868 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.337994 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 03:19:32.338868 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.337996 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 03:19:32.338868 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.338001 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 03:19:32.338868 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.338004 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 03:19:32.338868 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.338006 2574 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 03:19:32.338868 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.338009 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 03:19:32.338868 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.338011 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 03:19:32.339372 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.338014 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 03:19:32.339372 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.338017 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 03:19:32.339372 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.338019 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 03:19:32.339372 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.338022 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 03:19:32.339372 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.338025 2574 feature_gate.go:328] unrecognized feature gate: Example May 21 03:19:32.339372 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.338028 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 03:19:32.339372 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.338030 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 03:19:32.339372 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.338033 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 03:19:32.339372 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.338035 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 03:19:32.339372 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.338038 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 03:19:32.339372 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.338040 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 03:19:32.339372 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.338043 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 03:19:32.339372 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.338045 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 03:19:32.339372 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.338047 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 03:19:32.339372 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.338052 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 03:19:32.339372 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.338056 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 03:19:32.339372 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.338059 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 03:19:32.339372 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.338062 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 03:19:32.339372 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.338064 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 03:19:32.339372 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.338067 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 03:19:32.340222 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.338069 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 03:19:32.340222 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.338072 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 03:19:32.340222 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.338075 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 03:19:32.340222 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.338078 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 03:19:32.340222 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.338081 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 03:19:32.340222 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.338083 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 03:19:32.340781 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.340627 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 03:19:32.340781 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.340782 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 03:19:32.340838 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.340786 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 03:19:32.340838 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.340789 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 03:19:32.340838 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.340794 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 03:19:32.340838 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.340797 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 03:19:32.340838 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.340800 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 03:19:32.340838 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.340803 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 03:19:32.340838 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.340806 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 03:19:32.340838 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.340808 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 03:19:32.340838 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.340811 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 03:19:32.340838 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.340813 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 03:19:32.340838 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.340816 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 03:19:32.340838 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.340819 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 03:19:32.340838 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.340821 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 03:19:32.340838 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.340824 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 03:19:32.340838 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.340826 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 03:19:32.340838 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.340829 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 03:19:32.340838 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.340831 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 03:19:32.340838 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.340834 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 03:19:32.340838 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.340836 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 03:19:32.340838 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.340839 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 03:19:32.341341 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.340855 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 03:19:32.341341 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.340858 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 03:19:32.341341 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.340860 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 03:19:32.341341 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.340863 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 03:19:32.341341 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.340870 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 03:19:32.341341 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.340873 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 03:19:32.341341 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.340875 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 03:19:32.341341 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.340878 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 03:19:32.341341 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.340881 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 03:19:32.341341 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.340883 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 03:19:32.341341 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.340886 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 03:19:32.341341 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.340888 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 03:19:32.341341 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.340891 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 03:19:32.341341 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.340896 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 03:19:32.341341 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.340898 2574 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 03:19:32.341341 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.340901 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 03:19:32.341341 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.340903 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 03:19:32.341341 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.340906 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 03:19:32.341341 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.340908 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 03:19:32.341341 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.340911 2574 feature_gate.go:328] unrecognized feature gate: Example2 May 21 03:19:32.341833 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.340913 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 03:19:32.341833 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.340916 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 03:19:32.341833 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.340918 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 03:19:32.341833 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.340920 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 03:19:32.341833 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.340923 2574 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 03:19:32.341833 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.340925 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 03:19:32.341833 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.340927 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 03:19:32.341833 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.340932 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 03:19:32.341833 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.340934 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 03:19:32.341833 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.340936 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 03:19:32.341833 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.340939 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 03:19:32.341833 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.340941 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 03:19:32.341833 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.340943 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 03:19:32.341833 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.340947 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 03:19:32.341833 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.340949 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 03:19:32.341833 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.340952 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 03:19:32.341833 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.340955 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 03:19:32.341833 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.340958 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 03:19:32.341833 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.340962 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 03:19:32.342344 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.340966 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 03:19:32.342344 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.340968 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 03:19:32.342344 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.340971 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 03:19:32.342344 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.340973 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 03:19:32.342344 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.340976 2574 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 03:19:32.342344 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.340979 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 03:19:32.342344 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.340981 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 03:19:32.342344 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.340984 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 03:19:32.342344 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.340986 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 03:19:32.342344 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.340989 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 03:19:32.342344 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.340991 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 03:19:32.342344 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.340995 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 03:19:32.342344 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.340998 2574 feature_gate.go:328] unrecognized feature gate: Example May 21 03:19:32.342344 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.341000 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 03:19:32.342344 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.341002 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 03:19:32.342344 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.341005 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 03:19:32.342344 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.341007 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 03:19:32.342344 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.341010 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 03:19:32.342344 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.341013 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 03:19:32.342799 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.341017 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 03:19:32.342799 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.341022 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 03:19:32.342799 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.341025 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 03:19:32.342799 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.341028 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 03:19:32.342799 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.341031 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 03:19:32.342799 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.341034 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 03:19:32.342799 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342556 2574 flags.go:64] FLAG: --address="0.0.0.0" May 21 03:19:32.342799 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342567 2574 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 21 03:19:32.342799 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342575 2574 flags.go:64] FLAG: --anonymous-auth="true" May 21 03:19:32.342799 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342580 2574 flags.go:64] FLAG: --application-metrics-count-limit="100" May 21 03:19:32.342799 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342584 2574 flags.go:64] FLAG: --authentication-token-webhook="false" May 21 03:19:32.342799 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342588 2574 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 21 03:19:32.342799 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342592 2574 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 21 03:19:32.342799 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342597 2574 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 21 03:19:32.342799 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342600 2574 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 21 03:19:32.342799 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342603 2574 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 21 03:19:32.342799 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342606 2574 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 21 03:19:32.342799 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342610 2574 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 21 03:19:32.342799 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342613 2574 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 21 03:19:32.342799 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342615 2574 flags.go:64] FLAG: --cgroup-root="" May 21 03:19:32.342799 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342618 2574 flags.go:64] FLAG: --cgroups-per-qos="true" May 21 03:19:32.342799 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342621 2574 flags.go:64] FLAG: --client-ca-file="" May 21 03:19:32.343358 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342624 2574 flags.go:64] FLAG: --cloud-config="" May 21 03:19:32.343358 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342626 2574 flags.go:64] FLAG: --cloud-provider="external" May 21 03:19:32.343358 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342629 2574 flags.go:64] FLAG: --cluster-dns="[]" May 21 03:19:32.343358 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342634 2574 flags.go:64] FLAG: --cluster-domain="" May 21 03:19:32.343358 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342636 2574 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 21 03:19:32.343358 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342639 2574 flags.go:64] FLAG: --config-dir="" May 21 03:19:32.343358 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342642 2574 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 21 03:19:32.343358 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342645 2574 flags.go:64] FLAG: --container-log-max-files="5" May 21 03:19:32.343358 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342649 2574 flags.go:64] FLAG: --container-log-max-size="10Mi" May 21 03:19:32.343358 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342653 2574 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 21 03:19:32.343358 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342656 2574 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 21 03:19:32.343358 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342661 2574 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 21 03:19:32.343358 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342664 2574 flags.go:64] FLAG: --contention-profiling="false" May 21 03:19:32.343358 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342667 2574 flags.go:64] FLAG: --cpu-cfs-quota="true" May 21 03:19:32.343358 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342669 2574 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 21 03:19:32.343358 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342673 2574 flags.go:64] FLAG: --cpu-manager-policy="none" May 21 03:19:32.343358 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342676 2574 flags.go:64] FLAG: --cpu-manager-policy-options="" May 21 03:19:32.343358 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342681 2574 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 21 03:19:32.343358 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342684 2574 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 21 03:19:32.343358 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342686 2574 flags.go:64] FLAG: --enable-debugging-handlers="true" May 21 03:19:32.343358 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342689 2574 flags.go:64] FLAG: --enable-load-reader="false" May 21 03:19:32.343358 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342692 2574 flags.go:64] FLAG: --enable-server="true" May 21 03:19:32.343358 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342695 2574 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 21 03:19:32.343358 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342700 2574 flags.go:64] FLAG: --event-burst="100" May 21 03:19:32.343358 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342718 2574 flags.go:64] FLAG: --event-qps="50" May 21 03:19:32.343989 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342722 2574 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 21 03:19:32.343989 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342725 2574 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 21 03:19:32.343989 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342729 2574 flags.go:64] FLAG: --eviction-hard="" May 21 03:19:32.343989 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342733 2574 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 21 03:19:32.343989 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342736 2574 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 21 03:19:32.343989 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342739 2574 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 21 03:19:32.343989 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342742 2574 flags.go:64] FLAG: --eviction-soft="" May 21 03:19:32.343989 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342745 2574 flags.go:64] FLAG: --eviction-soft-grace-period="" May 21 03:19:32.343989 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342747 2574 flags.go:64] FLAG: --exit-on-lock-contention="false" May 21 03:19:32.343989 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342750 2574 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 21 03:19:32.343989 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342754 2574 flags.go:64] FLAG: --experimental-mounter-path="" May 21 03:19:32.343989 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342757 2574 flags.go:64] FLAG: --fail-cgroupv1="false" May 21 03:19:32.343989 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342760 2574 flags.go:64] FLAG: --fail-swap-on="true" May 21 03:19:32.343989 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342762 2574 flags.go:64] FLAG: --feature-gates="" May 21 03:19:32.343989 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342766 2574 flags.go:64] FLAG: --file-check-frequency="20s" May 21 03:19:32.343989 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342769 2574 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 21 03:19:32.343989 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342772 2574 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 21 03:19:32.343989 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342776 2574 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 21 03:19:32.343989 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342780 2574 flags.go:64] FLAG: --healthz-port="10248" May 21 03:19:32.343989 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342783 2574 flags.go:64] FLAG: --help="false" May 21 03:19:32.343989 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342786 2574 flags.go:64] FLAG: --hostname-override="ip-10-0-128-161.ec2.internal" May 21 03:19:32.343989 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342789 2574 flags.go:64] FLAG: --housekeeping-interval="10s" May 21 03:19:32.343989 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342792 2574 flags.go:64] FLAG: --http-check-frequency="20s" May 21 03:19:32.343989 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342795 2574 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 21 03:19:32.345603 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342798 2574 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 21 03:19:32.345603 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342802 2574 flags.go:64] FLAG: --image-gc-high-threshold="85" May 21 03:19:32.345603 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342804 2574 flags.go:64] FLAG: --image-gc-low-threshold="80" May 21 03:19:32.345603 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342807 2574 flags.go:64] FLAG: --image-service-endpoint="" May 21 03:19:32.345603 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342810 2574 flags.go:64] FLAG: --kernel-memcg-notification="false" May 21 03:19:32.345603 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342813 2574 flags.go:64] FLAG: --kube-api-burst="100" May 21 03:19:32.345603 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342816 2574 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 21 03:19:32.345603 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342819 2574 flags.go:64] FLAG: --kube-api-qps="50" May 21 03:19:32.345603 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342822 2574 flags.go:64] FLAG: --kube-reserved="" May 21 03:19:32.345603 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342825 2574 flags.go:64] FLAG: --kube-reserved-cgroup="" May 21 03:19:32.345603 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342828 2574 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 21 03:19:32.345603 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342831 2574 flags.go:64] FLAG: --kubelet-cgroups="" May 21 03:19:32.345603 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342834 2574 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 21 03:19:32.345603 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342836 2574 flags.go:64] FLAG: --lock-file="" May 21 03:19:32.345603 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342839 2574 flags.go:64] FLAG: --log-cadvisor-usage="false" May 21 03:19:32.345603 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342860 2574 flags.go:64] FLAG: --log-flush-frequency="5s" May 21 03:19:32.345603 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342863 2574 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 21 03:19:32.345603 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342869 2574 flags.go:64] FLAG: --log-json-split-stream="false" May 21 03:19:32.345603 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342872 2574 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 21 03:19:32.345603 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342875 2574 flags.go:64] FLAG: --log-text-split-stream="false" May 21 03:19:32.345603 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342878 2574 flags.go:64] FLAG: --logging-format="text" May 21 03:19:32.345603 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342881 2574 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 21 03:19:32.345603 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342885 2574 flags.go:64] FLAG: --make-iptables-util-chains="true" May 21 03:19:32.345603 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342888 2574 flags.go:64] FLAG: --manifest-url="" May 21 03:19:32.346208 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342890 2574 flags.go:64] FLAG: --manifest-url-header="" May 21 03:19:32.346208 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342901 2574 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 21 03:19:32.346208 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342905 2574 flags.go:64] FLAG: --max-open-files="1000000" May 21 03:19:32.346208 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342910 2574 flags.go:64] FLAG: --max-pods="110" May 21 03:19:32.346208 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342913 2574 flags.go:64] FLAG: --maximum-dead-containers="-1" May 21 03:19:32.346208 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342915 2574 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 21 03:19:32.346208 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342918 2574 flags.go:64] FLAG: --memory-manager-policy="None" May 21 03:19:32.346208 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342921 2574 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 21 03:19:32.346208 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342925 2574 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 21 03:19:32.346208 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342927 2574 flags.go:64] FLAG: --node-ip="0.0.0.0" May 21 03:19:32.346208 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342930 2574 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 21 03:19:32.346208 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342939 2574 flags.go:64] FLAG: --node-status-max-images="50" May 21 03:19:32.346208 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342942 2574 flags.go:64] FLAG: --node-status-update-frequency="10s" May 21 03:19:32.346208 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342945 2574 flags.go:64] FLAG: --oom-score-adj="-999" May 21 03:19:32.346208 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342947 2574 flags.go:64] FLAG: --pod-cidr="" May 21 03:19:32.346208 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342950 2574 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 21 03:19:32.346208 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342956 2574 flags.go:64] FLAG: --pod-manifest-path="" May 21 03:19:32.346208 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342959 2574 flags.go:64] FLAG: --pod-max-pids="-1" May 21 03:19:32.346208 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342962 2574 flags.go:64] FLAG: --pods-per-core="0" May 21 03:19:32.346208 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342965 2574 flags.go:64] FLAG: --port="10250" May 21 03:19:32.346208 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342968 2574 flags.go:64] FLAG: --protect-kernel-defaults="false" May 21 03:19:32.346208 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342971 2574 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02a824d3222ad2fec" May 21 03:19:32.346208 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342974 2574 flags.go:64] FLAG: --qos-reserved="" May 21 03:19:32.346208 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342977 2574 flags.go:64] FLAG: --read-only-port="10255" May 21 03:19:32.346773 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342980 2574 flags.go:64] FLAG: --register-node="true" May 21 03:19:32.346773 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342982 2574 flags.go:64] FLAG: --register-schedulable="true" May 21 03:19:32.346773 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342986 2574 flags.go:64] FLAG: --register-with-taints="" May 21 03:19:32.346773 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342995 2574 flags.go:64] FLAG: --registry-burst="10" May 21 03:19:32.346773 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.342997 2574 flags.go:64] FLAG: --registry-qps="5" May 21 03:19:32.346773 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.343000 2574 flags.go:64] FLAG: --reserved-cpus="" May 21 03:19:32.346773 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.343003 2574 flags.go:64] FLAG: --reserved-memory="" May 21 03:19:32.346773 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.343007 2574 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 21 03:19:32.346773 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.343010 2574 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 21 03:19:32.346773 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.343013 2574 flags.go:64] FLAG: --rotate-certificates="false" May 21 03:19:32.346773 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.343015 2574 flags.go:64] FLAG: --rotate-server-certificates="false" May 21 03:19:32.346773 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.343019 2574 flags.go:64] FLAG: --runonce="false" May 21 03:19:32.346773 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.343022 2574 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 21 03:19:32.346773 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.343025 2574 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 21 03:19:32.346773 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.343028 2574 flags.go:64] FLAG: --seccomp-default="false" May 21 03:19:32.346773 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.343031 2574 flags.go:64] FLAG: --serialize-image-pulls="true" May 21 03:19:32.346773 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.343034 2574 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 21 03:19:32.346773 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.343037 2574 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 21 03:19:32.346773 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.343040 2574 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 21 03:19:32.346773 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.343043 2574 flags.go:64] FLAG: --storage-driver-password="root" May 21 03:19:32.346773 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.343045 2574 flags.go:64] FLAG: --storage-driver-secure="false" May 21 03:19:32.346773 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.343048 2574 flags.go:64] FLAG: --storage-driver-table="stats" May 21 03:19:32.346773 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.343051 2574 flags.go:64] FLAG: --storage-driver-user="root" May 21 03:19:32.346773 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.343053 2574 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 21 03:19:32.346773 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.343056 2574 flags.go:64] FLAG: --sync-frequency="1m0s" May 21 03:19:32.346773 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.343059 2574 flags.go:64] FLAG: --system-cgroups="" May 21 03:19:32.347402 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.343062 2574 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 21 03:19:32.347402 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.343068 2574 flags.go:64] FLAG: --system-reserved-cgroup="" May 21 03:19:32.347402 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.343071 2574 flags.go:64] FLAG: --tls-cert-file="" May 21 03:19:32.347402 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.343074 2574 flags.go:64] FLAG: --tls-cipher-suites="[]" May 21 03:19:32.347402 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.343078 2574 flags.go:64] FLAG: --tls-min-version="" May 21 03:19:32.347402 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.343081 2574 flags.go:64] FLAG: --tls-private-key-file="" May 21 03:19:32.347402 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.343084 2574 flags.go:64] FLAG: --topology-manager-policy="none" May 21 03:19:32.347402 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.343087 2574 flags.go:64] FLAG: --topology-manager-policy-options="" May 21 03:19:32.347402 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.343090 2574 flags.go:64] FLAG: --topology-manager-scope="container" May 21 03:19:32.347402 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.343093 2574 flags.go:64] FLAG: --v="2" May 21 03:19:32.347402 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.343097 2574 flags.go:64] FLAG: --version="false" May 21 03:19:32.347402 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.343101 2574 flags.go:64] FLAG: --vmodule="" May 21 03:19:32.347402 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.343105 2574 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 21 03:19:32.347402 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.343108 2574 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 21 03:19:32.347402 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343201 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 03:19:32.347402 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343205 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 03:19:32.347402 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343208 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 03:19:32.347402 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343211 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 03:19:32.347402 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343215 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 03:19:32.347402 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343218 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 03:19:32.347402 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343220 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 03:19:32.347402 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343223 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 03:19:32.347402 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343225 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 03:19:32.347976 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343228 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 03:19:32.347976 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343230 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 03:19:32.347976 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343233 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 03:19:32.347976 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343235 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 03:19:32.347976 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343237 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 03:19:32.347976 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343240 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 03:19:32.347976 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343242 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 03:19:32.347976 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343245 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 03:19:32.347976 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343247 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 03:19:32.347976 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343249 2574 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 03:19:32.347976 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343252 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 03:19:32.347976 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343254 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 03:19:32.347976 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343257 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 03:19:32.347976 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343260 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 03:19:32.347976 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343262 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 03:19:32.347976 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343265 2574 feature_gate.go:328] unrecognized feature gate: Example May 21 03:19:32.347976 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343267 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 03:19:32.347976 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343276 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 03:19:32.347976 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343279 2574 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 03:19:32.347976 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343282 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 03:19:32.348478 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343284 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 03:19:32.348478 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343286 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 03:19:32.348478 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343289 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 03:19:32.348478 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343292 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 03:19:32.348478 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343294 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 03:19:32.348478 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343296 2574 feature_gate.go:328] unrecognized feature gate: Example2 May 21 03:19:32.348478 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343299 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 03:19:32.348478 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343302 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 03:19:32.348478 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343305 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 03:19:32.348478 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343307 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 03:19:32.348478 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343310 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 03:19:32.348478 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343312 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 03:19:32.348478 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343314 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 03:19:32.348478 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343317 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 03:19:32.348478 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343319 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 03:19:32.348478 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343321 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 03:19:32.348478 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343324 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 03:19:32.348478 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343326 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 03:19:32.348478 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343328 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 03:19:32.348478 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343331 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 03:19:32.349020 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343333 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 03:19:32.349020 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343336 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 03:19:32.349020 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343338 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 03:19:32.349020 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343341 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 03:19:32.349020 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343343 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 03:19:32.349020 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343345 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 03:19:32.349020 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343348 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 03:19:32.349020 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343350 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 03:19:32.349020 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343353 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 03:19:32.349020 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343357 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 03:19:32.349020 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343359 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 03:19:32.349020 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343362 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 03:19:32.349020 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343364 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 03:19:32.349020 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343367 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 03:19:32.349020 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343370 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 03:19:32.349020 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343372 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 03:19:32.349020 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343375 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 03:19:32.349020 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343377 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 03:19:32.349020 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343380 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 03:19:32.349493 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343382 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 03:19:32.349493 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343385 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 03:19:32.349493 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343388 2574 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 03:19:32.349493 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343390 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 03:19:32.349493 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343393 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 03:19:32.349493 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343395 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 03:19:32.349493 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343398 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 03:19:32.349493 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343400 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 03:19:32.349493 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343402 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 03:19:32.349493 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343405 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 03:19:32.349493 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343407 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 03:19:32.349493 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343409 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 03:19:32.349493 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343412 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 03:19:32.349493 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343414 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 03:19:32.349493 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343416 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 03:19:32.349493 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343420 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 03:19:32.349493 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343425 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 03:19:32.349493 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.343428 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 03:19:32.349943 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.343433 2574 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 03:19:32.351170 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.351150 2574 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 21 03:19:32.351210 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.351171 2574 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 21 03:19:32.351240 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351218 2574 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 03:19:32.351240 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351223 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 03:19:32.351240 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351226 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 03:19:32.351240 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351230 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 03:19:32.351240 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351233 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 03:19:32.351240 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351236 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 03:19:32.351240 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351239 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 03:19:32.351240 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351242 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 03:19:32.351443 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351245 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 03:19:32.351443 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351248 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 03:19:32.351443 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351251 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 03:19:32.351443 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351253 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 03:19:32.351443 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351256 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 03:19:32.351443 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351258 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 03:19:32.351443 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351261 2574 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 03:19:32.351443 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351263 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 03:19:32.351443 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351266 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 03:19:32.351443 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351268 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 03:19:32.351443 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351272 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 03:19:32.351443 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351277 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 03:19:32.351443 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351280 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 03:19:32.351443 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351282 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 03:19:32.351443 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351285 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 03:19:32.351443 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351287 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 03:19:32.351443 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351290 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 03:19:32.351443 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351292 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 03:19:32.351443 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351295 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 03:19:32.351980 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351297 2574 feature_gate.go:328] unrecognized feature gate: Example May 21 03:19:32.351980 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351300 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 03:19:32.351980 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351302 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 03:19:32.351980 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351305 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 03:19:32.351980 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351308 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 03:19:32.351980 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351310 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 03:19:32.351980 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351313 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 03:19:32.351980 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351315 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 03:19:32.351980 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351318 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 03:19:32.351980 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351320 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 03:19:32.351980 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351322 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 03:19:32.351980 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351325 2574 feature_gate.go:328] unrecognized feature gate: Example2 May 21 03:19:32.351980 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351328 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 03:19:32.351980 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351330 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 03:19:32.351980 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351333 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 03:19:32.351980 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351336 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 03:19:32.351980 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351339 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 03:19:32.351980 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351341 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 03:19:32.351980 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351344 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 03:19:32.351980 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351346 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 03:19:32.352468 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351349 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 03:19:32.352468 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351351 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 03:19:32.352468 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351354 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 03:19:32.352468 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351356 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 03:19:32.352468 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351359 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 03:19:32.352468 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351361 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 03:19:32.352468 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351364 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 03:19:32.352468 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351366 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 03:19:32.352468 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351368 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 03:19:32.352468 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351372 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 03:19:32.352468 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351376 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 03:19:32.352468 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351378 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 03:19:32.352468 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351381 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 03:19:32.352468 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351383 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 03:19:32.352468 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351386 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 03:19:32.352468 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351388 2574 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 03:19:32.352468 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351391 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 03:19:32.352468 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351394 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 03:19:32.352468 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351397 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 03:19:32.352947 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351399 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 03:19:32.352947 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351402 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 03:19:32.352947 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351404 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 03:19:32.352947 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351407 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 03:19:32.352947 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351409 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 03:19:32.352947 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351412 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 03:19:32.352947 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351414 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 03:19:32.352947 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351417 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 03:19:32.352947 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351420 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 03:19:32.352947 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351423 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 03:19:32.352947 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351425 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 03:19:32.352947 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351428 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 03:19:32.352947 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351430 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 03:19:32.352947 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351433 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 03:19:32.352947 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351435 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 03:19:32.352947 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351437 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 03:19:32.352947 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351440 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 03:19:32.352947 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351442 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 03:19:32.352947 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351445 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 03:19:32.353406 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351448 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 03:19:32.353406 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.351453 2574 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 03:19:32.353406 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351561 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 03:19:32.353406 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351566 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 03:19:32.353406 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351569 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 03:19:32.353406 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351572 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 03:19:32.353406 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351575 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 03:19:32.353406 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351578 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 03:19:32.353406 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351580 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 03:19:32.353406 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351583 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 03:19:32.353406 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351586 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 03:19:32.353406 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351588 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 03:19:32.353406 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351592 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 03:19:32.353406 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351594 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 03:19:32.353406 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351597 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 03:19:32.353406 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351600 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 03:19:32.353828 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351602 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 03:19:32.353828 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351604 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 03:19:32.353828 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351607 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 03:19:32.353828 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351611 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 03:19:32.353828 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351615 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 03:19:32.353828 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351618 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 03:19:32.353828 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351621 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 03:19:32.353828 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351623 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 03:19:32.353828 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351626 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 03:19:32.353828 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351629 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 03:19:32.353828 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351631 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 03:19:32.353828 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351634 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 03:19:32.353828 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351636 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 03:19:32.353828 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351639 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 03:19:32.353828 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351642 2574 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 03:19:32.353828 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351644 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 03:19:32.353828 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351648 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 03:19:32.353828 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351651 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 03:19:32.353828 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351654 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 03:19:32.354332 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351657 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 03:19:32.354332 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351660 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 03:19:32.354332 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351663 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 03:19:32.354332 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351665 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 03:19:32.354332 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351668 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 03:19:32.354332 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351671 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 03:19:32.354332 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351673 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 03:19:32.354332 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351676 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 03:19:32.354332 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351678 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 03:19:32.354332 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351681 2574 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 03:19:32.354332 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351684 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 03:19:32.354332 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351686 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 03:19:32.354332 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351689 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 03:19:32.354332 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351691 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 03:19:32.354332 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351693 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 03:19:32.354332 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351696 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 03:19:32.354332 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351698 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 03:19:32.354332 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351701 2574 feature_gate.go:328] unrecognized feature gate: Example May 21 03:19:32.354332 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351703 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 03:19:32.354332 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351706 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 03:19:32.354807 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351708 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 03:19:32.354807 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351711 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 03:19:32.354807 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351713 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 03:19:32.354807 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351716 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 03:19:32.354807 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351718 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 03:19:32.354807 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351721 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 03:19:32.354807 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351723 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 03:19:32.354807 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351726 2574 feature_gate.go:328] unrecognized feature gate: Example2 May 21 03:19:32.354807 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351728 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 03:19:32.354807 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351731 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 03:19:32.354807 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351733 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 03:19:32.354807 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351735 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 03:19:32.354807 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351738 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 03:19:32.354807 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351740 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 03:19:32.354807 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351743 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 03:19:32.354807 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351745 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 03:19:32.354807 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351748 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 03:19:32.354807 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351750 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 03:19:32.354807 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351752 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 03:19:32.354807 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351755 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 03:19:32.355304 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351758 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 03:19:32.355304 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351760 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 03:19:32.355304 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351763 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 03:19:32.355304 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351773 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 03:19:32.355304 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351776 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 03:19:32.355304 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351778 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 03:19:32.355304 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351781 2574 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 03:19:32.355304 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351783 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 03:19:32.355304 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351785 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 03:19:32.355304 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351788 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 03:19:32.355304 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351791 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 03:19:32.355304 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351793 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 03:19:32.355304 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:32.351796 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 03:19:32.355304 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.351801 2574 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 03:19:32.355304 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.352620 2574 server.go:962] "Client rotation is on, will bootstrap in background" May 21 03:19:32.355680 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.354930 2574 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 21 03:19:32.355949 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.355937 2574 server.go:1019] "Starting client certificate rotation" May 21 03:19:32.356103 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.356083 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 21 03:19:32.356165 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.356138 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 21 03:19:32.384261 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.384240 2574 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 21 03:19:32.386153 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.386126 2574 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 21 03:19:32.407083 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.407060 2574 log.go:25] "Validated CRI v1 runtime API" May 21 03:19:32.413438 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.413415 2574 log.go:25] "Validated CRI v1 image API" May 21 03:19:32.414831 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.414813 2574 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 21 03:19:32.417560 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.417538 2574 fs.go:135] Filesystem UUIDs: map[334bc200-faa6-48da-9266-c0805cff074b:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 ea648d22-3fd0-4759-99a5-d5605af838c2:/dev/nvme0n1p3] May 21 03:19:32.417631 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.417559 2574 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 21 03:19:32.422369 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.422349 2574 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 21 03:19:32.422515 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.422352 2574 manager.go:217] Machine: {Timestamp:2026-05-21 03:19:32.421731151 +0000 UTC m=+0.464500059 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3068991 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec241ca7fb3d34a8baba30083c316468 SystemUUID:ec241ca7-fb3d-34a8-baba-30083c316468 BootID:33460faf-29e2-4027-a046-f261674ee661 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:97:86:57:88:e1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:97:86:57:88:e1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a2:a1:6a:ca:96:d0 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 21 03:19:32.423279 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.423266 2574 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 21 03:19:32.423428 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.423414 2574 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 21 03:19:32.426572 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.426545 2574 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 21 03:19:32.426756 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.426577 2574 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-161.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 21 03:19:32.426801 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.426766 2574 topology_manager.go:138] "Creating topology manager with none policy" May 21 03:19:32.426801 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.426776 2574 container_manager_linux.go:306] "Creating device plugin manager" May 21 03:19:32.426801 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.426784 2574 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 21 03:19:32.428612 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.428599 2574 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 21 03:19:32.431278 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.431266 2574 state_mem.go:36] "Initialized new in-memory state store" May 21 03:19:32.431395 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.431386 2574 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 21 03:19:32.434117 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.434106 2574 kubelet.go:491] "Attempting to sync node with API server" May 21 03:19:32.434166 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.434122 2574 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 21 03:19:32.434166 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.434136 2574 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 21 03:19:32.434166 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.434147 2574 kubelet.go:397] "Adding apiserver pod source" May 21 03:19:32.434166 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.434160 2574 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 21 03:19:32.435448 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.435435 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 21 03:19:32.435494 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.435454 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 21 03:19:32.438994 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.438979 2574 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 21 03:19:32.441705 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.441678 2574 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 21 03:19:32.442645 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.442634 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 21 03:19:32.442686 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.442652 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 21 03:19:32.442686 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.442658 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 21 03:19:32.442686 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.442664 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 21 03:19:32.442686 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.442672 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 21 03:19:32.442686 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.442678 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 21 03:19:32.442686 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.442684 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 21 03:19:32.442686 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.442689 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 21 03:19:32.442907 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.442696 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 21 03:19:32.442907 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.442701 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 21 03:19:32.442907 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.442710 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 21 03:19:32.443167 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.443158 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 21 03:19:32.444152 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.444143 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 21 03:19:32.444152 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.444153 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 21 03:19:32.447405 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.447391 2574 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 21 03:19:32.447569 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.447430 2574 server.go:1295] "Started kubelet" May 21 03:19:32.447569 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.447499 2574 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 21 03:19:32.447569 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:32.447557 2574 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-161.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 21 03:19:32.447683 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:32.447558 2574 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 21 03:19:32.448015 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.447964 2574 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 21 03:19:32.448122 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.448036 2574 server_v1.go:47] "podresources" method="list" useActivePods=true May 21 03:19:32.448399 ip-10-0-128-161 systemd[1]: Started Kubernetes Kubelet. May 21 03:19:32.449744 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.449715 2574 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 21 03:19:32.450521 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.450504 2574 server.go:317] "Adding debug handlers to kubelet server" May 21 03:19:32.456461 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.456442 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dqbpk" May 21 03:19:32.457149 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:32.457134 2574 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 21 03:19:32.459470 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.459431 2574 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-161.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 21 03:19:32.459571 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.459522 2574 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 21 03:19:32.459571 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.459533 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 21 03:19:32.459668 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.459639 2574 volume_manager.go:295] "The desired_state_of_world populator starts" May 21 03:19:32.459668 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.459652 2574 volume_manager.go:297] "Starting Kubelet Volume Manager" May 21 03:19:32.459754 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:32.458263 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-161.ec2.internal.18b17674f2a783db default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-161.ec2.internal,UID:ip-10-0-128-161.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-161.ec2.internal,},FirstTimestamp:2026-05-21 03:19:32.447405019 +0000 UTC m=+0.490173925,LastTimestamp:2026-05-21 03:19:32.447405019 +0000 UTC m=+0.490173925,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-161.ec2.internal,}" May 21 03:19:32.460336 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.460320 2574 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 21 03:19:32.460428 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.460389 2574 reconstruct.go:97] "Volume reconstruction finished" May 21 03:19:32.460428 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.460397 2574 reconciler.go:26] "Reconciler: start to sync state" May 21 03:19:32.460428 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.460409 2574 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 21 03:19:32.460428 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.460425 2574 factory.go:55] Registering systemd factory May 21 03:19:32.460428 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.460432 2574 factory.go:223] Registration of the systemd container factory successfully May 21 03:19:32.460658 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.460624 2574 factory.go:153] Registering CRI-O factory May 21 03:19:32.460658 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.460639 2574 factory.go:223] Registration of the crio container factory successfully May 21 03:19:32.460658 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.460658 2574 factory.go:103] Registering Raw factory May 21 03:19:32.460790 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.460675 2574 manager.go:1196] Started watching for new ooms in manager May 21 03:19:32.461081 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.461068 2574 manager.go:319] Starting recovery of all containers May 21 03:19:32.462157 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:32.462134 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-161.ec2.internal\" not found" May 21 03:19:32.462387 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:32.462359 2574 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-161.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" May 21 03:19:32.465899 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.464190 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dqbpk" May 21 03:19:32.469828 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:32.469649 2574 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" May 21 03:19:32.472070 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.472052 2574 manager.go:324] Recovery completed May 21 03:19:32.476788 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.476775 2574 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 03:19:32.478619 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.478605 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-161.ec2.internal" event="NodeHasSufficientMemory" May 21 03:19:32.478682 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.478634 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-161.ec2.internal" event="NodeHasNoDiskPressure" May 21 03:19:32.478682 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.478644 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-161.ec2.internal" event="NodeHasSufficientPID" May 21 03:19:32.479233 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.479209 2574 cpu_manager.go:222] "Starting CPU manager" policy="none" May 21 03:19:32.479233 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.479231 2574 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 21 03:19:32.479342 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.479248 2574 state_mem.go:36] "Initialized new in-memory state store" May 21 03:19:32.483159 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.483146 2574 policy_none.go:49] "None policy: Start" May 21 03:19:32.483204 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.483163 2574 memory_manager.go:186] "Starting memorymanager" policy="None" May 21 03:19:32.483204 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.483173 2574 state_mem.go:35] "Initializing new in-memory state store" May 21 03:19:32.523697 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.523672 2574 manager.go:341] "Starting Device Plugin manager" May 21 03:19:32.523813 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:32.523729 2574 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 21 03:19:32.523813 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.523744 2574 server.go:85] "Starting device plugin registration server" May 21 03:19:32.524063 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.524051 2574 eviction_manager.go:189] "Eviction manager: starting control loop" May 21 03:19:32.552455 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.524071 2574 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 21 03:19:32.552455 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.524229 2574 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 21 03:19:32.552455 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.524308 2574 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 21 03:19:32.552455 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.524317 2574 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 21 03:19:32.552455 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:32.524827 2574 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 21 03:19:32.552455 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:32.524883 2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-161.ec2.internal\" not found" May 21 03:19:32.582975 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.582907 2574 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 21 03:19:32.584301 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.584287 2574 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 21 03:19:32.584358 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.584312 2574 status_manager.go:230] "Starting to sync pod status with apiserver" May 21 03:19:32.584358 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.584333 2574 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 21 03:19:32.584358 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.584343 2574 kubelet.go:2451] "Starting kubelet main sync loop" May 21 03:19:32.584462 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:32.584390 2574 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 21 03:19:32.587321 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.587305 2574 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 21 03:19:32.625212 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.625184 2574 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 03:19:32.626311 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.626296 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-161.ec2.internal" event="NodeHasSufficientMemory" May 21 03:19:32.626354 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.626329 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-161.ec2.internal" event="NodeHasNoDiskPressure" May 21 03:19:32.626354 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.626346 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-161.ec2.internal" event="NodeHasSufficientPID" May 21 03:19:32.626418 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.626370 2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-161.ec2.internal" May 21 03:19:32.634765 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.634750 2574 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-161.ec2.internal" May 21 03:19:32.634814 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:32.634774 2574 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-161.ec2.internal\": node \"ip-10-0-128-161.ec2.internal\" not found" May 21 03:19:32.661448 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:32.661424 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-161.ec2.internal\" not found" May 21 03:19:32.684923 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.684877 2574 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-128-161.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-161.ec2.internal"] May 21 03:19:32.685056 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.684957 2574 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 03:19:32.685907 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.685892 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-161.ec2.internal" event="NodeHasSufficientMemory" May 21 03:19:32.685987 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.685925 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-161.ec2.internal" event="NodeHasNoDiskPressure" May 21 03:19:32.685987 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.685941 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-161.ec2.internal" event="NodeHasSufficientPID" May 21 03:19:32.688350 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.688334 2574 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 03:19:32.688515 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.688499 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-161.ec2.internal" May 21 03:19:32.688557 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.688530 2574 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 03:19:32.689088 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.689075 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-161.ec2.internal" event="NodeHasSufficientMemory" May 21 03:19:32.689160 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.689100 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-161.ec2.internal" event="NodeHasNoDiskPressure" May 21 03:19:32.689160 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.689113 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-161.ec2.internal" event="NodeHasSufficientPID" May 21 03:19:32.689160 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.689133 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-161.ec2.internal" event="NodeHasSufficientMemory" May 21 03:19:32.689160 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.689156 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-161.ec2.internal" event="NodeHasNoDiskPressure" May 21 03:19:32.689327 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.689169 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-161.ec2.internal" event="NodeHasSufficientPID" May 21 03:19:32.691941 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.691925 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-161.ec2.internal" May 21 03:19:32.692025 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.691956 2574 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 03:19:32.692601 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.692588 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-161.ec2.internal" event="NodeHasSufficientMemory" May 21 03:19:32.692658 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.692613 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-161.ec2.internal" event="NodeHasNoDiskPressure" May 21 03:19:32.692658 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.692625 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-161.ec2.internal" event="NodeHasSufficientPID" May 21 03:19:32.723900 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:32.723871 2574 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-161.ec2.internal\" not found" node="ip-10-0-128-161.ec2.internal" May 21 03:19:32.728439 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:32.728420 2574 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-161.ec2.internal\" not found" node="ip-10-0-128-161.ec2.internal" May 21 03:19:32.761395 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.761369 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b3204d4e276a6036a6def62b77dcf7af-config\") pod \"kube-apiserver-proxy-ip-10-0-128-161.ec2.internal\" (UID: \"b3204d4e276a6036a6def62b77dcf7af\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-161.ec2.internal" May 21 03:19:32.761395 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.761398 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8b79a830b6f70433eb778f4f12409255-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-161.ec2.internal\" (UID: \"8b79a830b6f70433eb778f4f12409255\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-161.ec2.internal" May 21 03:19:32.762361 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:32.762344 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-161.ec2.internal\" not found" May 21 03:19:32.862210 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.862135 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b3204d4e276a6036a6def62b77dcf7af-config\") pod \"kube-apiserver-proxy-ip-10-0-128-161.ec2.internal\" (UID: \"b3204d4e276a6036a6def62b77dcf7af\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-161.ec2.internal" May 21 03:19:32.862210 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.862196 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8b79a830b6f70433eb778f4f12409255-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-161.ec2.internal\" (UID: \"8b79a830b6f70433eb778f4f12409255\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-161.ec2.internal" May 21 03:19:32.862330 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.862222 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b79a830b6f70433eb778f4f12409255-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-161.ec2.internal\" (UID: \"8b79a830b6f70433eb778f4f12409255\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-161.ec2.internal" May 21 03:19:32.862330 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.862145 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b3204d4e276a6036a6def62b77dcf7af-config\") pod \"kube-apiserver-proxy-ip-10-0-128-161.ec2.internal\" (UID: \"b3204d4e276a6036a6def62b77dcf7af\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-161.ec2.internal" May 21 03:19:32.862330 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.862277 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8b79a830b6f70433eb778f4f12409255-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-161.ec2.internal\" (UID: \"8b79a830b6f70433eb778f4f12409255\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-161.ec2.internal" May 21 03:19:32.863146 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:32.863125 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-161.ec2.internal\" not found" May 21 03:19:32.962809 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.962767 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b79a830b6f70433eb778f4f12409255-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-161.ec2.internal\" (UID: \"8b79a830b6f70433eb778f4f12409255\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-161.ec2.internal" May 21 03:19:32.962925 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:32.962838 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b79a830b6f70433eb778f4f12409255-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-161.ec2.internal\" (UID: \"8b79a830b6f70433eb778f4f12409255\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-161.ec2.internal" May 21 03:19:32.963832 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:32.963813 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-161.ec2.internal\" not found" May 21 03:19:33.026071 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.026045 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-161.ec2.internal" May 21 03:19:33.030820 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.030798 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-161.ec2.internal" May 21 03:19:33.064407 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:33.064380 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-161.ec2.internal\" not found" May 21 03:19:33.164823 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:33.164791 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-161.ec2.internal\" not found" May 21 03:19:33.265316 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:33.265279 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-161.ec2.internal\" not found" May 21 03:19:33.356722 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.356692 2574 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 21 03:19:33.357288 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.356818 2574 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 21 03:19:33.366114 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:33.366093 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-161.ec2.internal\" not found" May 21 03:19:33.393386 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.393362 2574 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 21 03:19:33.433560 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.433511 2574 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 21 03:19:33.435445 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.434935 2574 apiserver.go:52] "Watching apiserver" May 21 03:19:33.442258 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.442237 2574 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 21 03:19:33.444047 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.444028 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-8nncl","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6gmv","openshift-dns/node-resolver-gqltp","openshift-multus/multus-additional-cni-plugins-k7gbn","openshift-multus/multus-pppx8","openshift-multus/network-metrics-daemon-7vr9p","openshift-network-operator/iptables-alerter-vwjdc","kube-system/global-pull-secret-syncer-vt8z9","openshift-cluster-node-tuning-operator/tuned-vfdck","openshift-image-registry/node-ca-5zqvw","openshift-network-diagnostics/network-check-target-skpvq","openshift-ovn-kubernetes/ovnkube-node-tqqk8"] May 21 03:19:33.448597 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.448580 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8nncl" May 21 03:19:33.448698 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.448683 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6gmv" May 21 03:19:33.451228 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.451213 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-k7gbn" May 21 03:19:33.453317 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.453304 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pppx8" May 21 03:19:33.454526 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.454513 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 21 03:19:33.454694 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.454682 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 21 03:19:33.454744 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.454685 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 21 03:19:33.454744 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.454708 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-kkfnr\"" May 21 03:19:33.455355 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.455343 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 21 03:19:33.455565 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.455552 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7vr9p" May 21 03:19:33.455616 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:33.455600 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7vr9p" podUID="1a03c959-a5a9-44f4-89f3-d604f293b8a0" May 21 03:19:33.455716 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.455701 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 21 03:19:33.455763 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.455732 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 21 03:19:33.455821 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.455779 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 21 03:19:33.455821 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.455787 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 21 03:19:33.455821 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.455803 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-s6zgd\"" May 21 03:19:33.455956 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.455899 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 21 03:19:33.456485 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.456473 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-whh2n\"" May 21 03:19:33.456827 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.456816 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 21 03:19:33.457782 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.457769 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vfdck" May 21 03:19:33.459667 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.459652 2574 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-161.ec2.internal" May 21 03:19:33.459667 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.459661 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 21 03:19:33.459826 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.459812 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-clx5z\"" May 21 03:19:33.459953 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.459939 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5zqvw" May 21 03:19:33.461457 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.461104 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 21 03:19:33.461457 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.461222 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 21 03:19:33.463487 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.463454 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-4zvfz\"" May 21 03:19:33.463634 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.463617 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 21 03:19:33.464121 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.464103 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 21 03:19:33.464183 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.464127 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-skpvq" May 21 03:19:33.464282 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:33.464258 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-skpvq" podUID="168bd0e1-6421-4c11-8ef2-8caf34170ae9" May 21 03:19:33.464338 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.464271 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 21 03:19:33.464338 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.464321 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 21 03:19:33.464540 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.464524 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-8tq2p\"" May 21 03:19:33.465154 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.465135 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j55xx\" (UniqueName: \"kubernetes.io/projected/4a110770-ece5-4091-a30a-46b820e75cae-kube-api-access-j55xx\") pod \"multus-pppx8\" (UID: \"4a110770-ece5-4091-a30a-46b820e75cae\") " pod="openshift-multus/multus-pppx8" May 21 03:19:33.465242 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.465161 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/87a77bd0-28c8-408f-9bdd-17c8bb0ae511-etc-modprobe-d\") pod \"tuned-vfdck\" (UID: \"87a77bd0-28c8-408f-9bdd-17c8bb0ae511\") " pod="openshift-cluster-node-tuning-operator/tuned-vfdck" May 21 03:19:33.465242 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.465181 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/70d7280d-5779-4c48-b698-9ce8a698bdeb-os-release\") pod \"multus-additional-cni-plugins-k7gbn\" (UID: \"70d7280d-5779-4c48-b698-9ce8a698bdeb\") " pod="openshift-multus/multus-additional-cni-plugins-k7gbn" May 21 03:19:33.465242 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.465208 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/70d7280d-5779-4c48-b698-9ce8a698bdeb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-k7gbn\" (UID: \"70d7280d-5779-4c48-b698-9ce8a698bdeb\") " pod="openshift-multus/multus-additional-cni-plugins-k7gbn" May 21 03:19:33.465242 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.465232 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4a110770-ece5-4091-a30a-46b820e75cae-multus-conf-dir\") pod \"multus-pppx8\" (UID: \"4a110770-ece5-4091-a30a-46b820e75cae\") " pod="openshift-multus/multus-pppx8" May 21 03:19:33.465404 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.465248 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4a110770-ece5-4091-a30a-46b820e75cae-multus-daemon-config\") pod \"multus-pppx8\" (UID: \"4a110770-ece5-4091-a30a-46b820e75cae\") " pod="openshift-multus/multus-pppx8" May 21 03:19:33.465404 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.465263 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82c9f\" (UniqueName: \"kubernetes.io/projected/1a03c959-a5a9-44f4-89f3-d604f293b8a0-kube-api-access-82c9f\") pod \"network-metrics-daemon-7vr9p\" (UID: \"1a03c959-a5a9-44f4-89f3-d604f293b8a0\") " pod="openshift-multus/network-metrics-daemon-7vr9p" May 21 03:19:33.465404 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.465280 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/87a77bd0-28c8-408f-9bdd-17c8bb0ae511-etc-systemd\") pod \"tuned-vfdck\" (UID: \"87a77bd0-28c8-408f-9bdd-17c8bb0ae511\") " pod="openshift-cluster-node-tuning-operator/tuned-vfdck" May 21 03:19:33.465404 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.465299 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/87a77bd0-28c8-408f-9bdd-17c8bb0ae511-sys\") pod \"tuned-vfdck\" (UID: \"87a77bd0-28c8-408f-9bdd-17c8bb0ae511\") " pod="openshift-cluster-node-tuning-operator/tuned-vfdck" May 21 03:19:33.465404 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.465313 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/87a77bd0-28c8-408f-9bdd-17c8bb0ae511-var-lib-kubelet\") pod \"tuned-vfdck\" (UID: \"87a77bd0-28c8-408f-9bdd-17c8bb0ae511\") " pod="openshift-cluster-node-tuning-operator/tuned-vfdck" May 21 03:19:33.465404 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.465327 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1abd0f75-c601-4162-b828-a203307febed-serviceca\") pod \"node-ca-5zqvw\" (UID: \"1abd0f75-c601-4162-b828-a203307febed\") " pod="openshift-image-registry/node-ca-5zqvw" May 21 03:19:33.465404 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.465342 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4a110770-ece5-4091-a30a-46b820e75cae-hostroot\") pod \"multus-pppx8\" (UID: \"4a110770-ece5-4091-a30a-46b820e75cae\") " pod="openshift-multus/multus-pppx8" May 21 03:19:33.465404 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.465370 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/87a77bd0-28c8-408f-9bdd-17c8bb0ae511-etc-sysctl-d\") pod \"tuned-vfdck\" (UID: \"87a77bd0-28c8-408f-9bdd-17c8bb0ae511\") " pod="openshift-cluster-node-tuning-operator/tuned-vfdck" May 21 03:19:33.465404 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.465386 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/74fe87f5-634c-48e6-85b9-357a3b4d02f9-agent-certs\") pod \"konnectivity-agent-8nncl\" (UID: \"74fe87f5-634c-48e6-85b9-357a3b4d02f9\") " pod="kube-system/konnectivity-agent-8nncl" May 21 03:19:33.465404 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.465400 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b19e3ebd-ec1e-4bdd-b766-79a3c736fe56-sys-fs\") pod \"aws-ebs-csi-driver-node-t6gmv\" (UID: \"b19e3ebd-ec1e-4bdd-b766-79a3c736fe56\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6gmv" May 21 03:19:33.465736 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.465413 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69kbd\" (UniqueName: \"kubernetes.io/projected/b19e3ebd-ec1e-4bdd-b766-79a3c736fe56-kube-api-access-69kbd\") pod \"aws-ebs-csi-driver-node-t6gmv\" (UID: \"b19e3ebd-ec1e-4bdd-b766-79a3c736fe56\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6gmv" May 21 03:19:33.465736 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.465435 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4a110770-ece5-4091-a30a-46b820e75cae-multus-socket-dir-parent\") pod \"multus-pppx8\" (UID: \"4a110770-ece5-4091-a30a-46b820e75cae\") " pod="openshift-multus/multus-pppx8" May 21 03:19:33.465736 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.465465 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4a110770-ece5-4091-a30a-46b820e75cae-host-run-k8s-cni-cncf-io\") pod \"multus-pppx8\" (UID: \"4a110770-ece5-4091-a30a-46b820e75cae\") " pod="openshift-multus/multus-pppx8" May 21 03:19:33.465736 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.465495 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/87a77bd0-28c8-408f-9bdd-17c8bb0ae511-etc-sysconfig\") pod \"tuned-vfdck\" (UID: \"87a77bd0-28c8-408f-9bdd-17c8bb0ae511\") " pod="openshift-cluster-node-tuning-operator/tuned-vfdck" May 21 03:19:33.465736 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.465522 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f628q\" (UniqueName: \"kubernetes.io/projected/168bd0e1-6421-4c11-8ef2-8caf34170ae9-kube-api-access-f628q\") pod \"network-check-target-skpvq\" (UID: \"168bd0e1-6421-4c11-8ef2-8caf34170ae9\") " pod="openshift-network-diagnostics/network-check-target-skpvq" May 21 03:19:33.465736 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.465542 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/74fe87f5-634c-48e6-85b9-357a3b4d02f9-konnectivity-ca\") pod \"konnectivity-agent-8nncl\" (UID: \"74fe87f5-634c-48e6-85b9-357a3b4d02f9\") " pod="kube-system/konnectivity-agent-8nncl" May 21 03:19:33.465736 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.465557 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b19e3ebd-ec1e-4bdd-b766-79a3c736fe56-socket-dir\") pod \"aws-ebs-csi-driver-node-t6gmv\" (UID: \"b19e3ebd-ec1e-4bdd-b766-79a3c736fe56\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6gmv" May 21 03:19:33.465736 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.465595 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/87a77bd0-28c8-408f-9bdd-17c8bb0ae511-etc-kubernetes\") pod \"tuned-vfdck\" (UID: \"87a77bd0-28c8-408f-9bdd-17c8bb0ae511\") " pod="openshift-cluster-node-tuning-operator/tuned-vfdck" May 21 03:19:33.465736 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.465618 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/87a77bd0-28c8-408f-9bdd-17c8bb0ae511-run\") pod \"tuned-vfdck\" (UID: \"87a77bd0-28c8-408f-9bdd-17c8bb0ae511\") " pod="openshift-cluster-node-tuning-operator/tuned-vfdck" May 21 03:19:33.465736 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.465634 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/70d7280d-5779-4c48-b698-9ce8a698bdeb-cni-binary-copy\") pod \"multus-additional-cni-plugins-k7gbn\" (UID: \"70d7280d-5779-4c48-b698-9ce8a698bdeb\") " pod="openshift-multus/multus-additional-cni-plugins-k7gbn" May 21 03:19:33.465736 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.465657 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1abd0f75-c601-4162-b828-a203307febed-host\") pod \"node-ca-5zqvw\" (UID: \"1abd0f75-c601-4162-b828-a203307febed\") " pod="openshift-image-registry/node-ca-5zqvw" May 21 03:19:33.465736 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.465672 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4a110770-ece5-4091-a30a-46b820e75cae-os-release\") pod \"multus-pppx8\" (UID: \"4a110770-ece5-4091-a30a-46b820e75cae\") " pod="openshift-multus/multus-pppx8" May 21 03:19:33.465736 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.465686 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/87a77bd0-28c8-408f-9bdd-17c8bb0ae511-etc-sysctl-conf\") pod \"tuned-vfdck\" (UID: \"87a77bd0-28c8-408f-9bdd-17c8bb0ae511\") " pod="openshift-cluster-node-tuning-operator/tuned-vfdck" May 21 03:19:33.465736 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.465699 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/87a77bd0-28c8-408f-9bdd-17c8bb0ae511-tmp\") pod \"tuned-vfdck\" (UID: \"87a77bd0-28c8-408f-9bdd-17c8bb0ae511\") " pod="openshift-cluster-node-tuning-operator/tuned-vfdck" May 21 03:19:33.465736 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.465719 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/70d7280d-5779-4c48-b698-9ce8a698bdeb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-k7gbn\" (UID: \"70d7280d-5779-4c48-b698-9ce8a698bdeb\") " pod="openshift-multus/multus-additional-cni-plugins-k7gbn" May 21 03:19:33.465736 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.465742 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4a110770-ece5-4091-a30a-46b820e75cae-cnibin\") pod \"multus-pppx8\" (UID: \"4a110770-ece5-4091-a30a-46b820e75cae\") " pod="openshift-multus/multus-pppx8" May 21 03:19:33.466199 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.465766 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a03c959-a5a9-44f4-89f3-d604f293b8a0-metrics-certs\") pod \"network-metrics-daemon-7vr9p\" (UID: \"1a03c959-a5a9-44f4-89f3-d604f293b8a0\") " pod="openshift-multus/network-metrics-daemon-7vr9p" May 21 03:19:33.466199 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.465794 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b19e3ebd-ec1e-4bdd-b766-79a3c736fe56-registration-dir\") pod \"aws-ebs-csi-driver-node-t6gmv\" (UID: \"b19e3ebd-ec1e-4bdd-b766-79a3c736fe56\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6gmv" May 21 03:19:33.466199 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.465814 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4a110770-ece5-4091-a30a-46b820e75cae-system-cni-dir\") pod \"multus-pppx8\" (UID: \"4a110770-ece5-4091-a30a-46b820e75cae\") " pod="openshift-multus/multus-pppx8" May 21 03:19:33.466199 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.465830 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4a110770-ece5-4091-a30a-46b820e75cae-host-var-lib-kubelet\") pod \"multus-pppx8\" (UID: \"4a110770-ece5-4091-a30a-46b820e75cae\") " pod="openshift-multus/multus-pppx8" May 21 03:19:33.466199 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.465861 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/70d7280d-5779-4c48-b698-9ce8a698bdeb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-k7gbn\" (UID: \"70d7280d-5779-4c48-b698-9ce8a698bdeb\") " pod="openshift-multus/multus-additional-cni-plugins-k7gbn" May 21 03:19:33.466199 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.465879 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b19e3ebd-ec1e-4bdd-b766-79a3c736fe56-device-dir\") pod \"aws-ebs-csi-driver-node-t6gmv\" (UID: \"b19e3ebd-ec1e-4bdd-b766-79a3c736fe56\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6gmv" May 21 03:19:33.466199 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.465898 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4a110770-ece5-4091-a30a-46b820e75cae-cni-binary-copy\") pod \"multus-pppx8\" (UID: \"4a110770-ece5-4091-a30a-46b820e75cae\") " pod="openshift-multus/multus-pppx8" May 21 03:19:33.466199 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.465915 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/87a77bd0-28c8-408f-9bdd-17c8bb0ae511-etc-tuned\") pod \"tuned-vfdck\" (UID: \"87a77bd0-28c8-408f-9bdd-17c8bb0ae511\") " pod="openshift-cluster-node-tuning-operator/tuned-vfdck" May 21 03:19:33.466199 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.465941 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnrbr\" (UniqueName: \"kubernetes.io/projected/1abd0f75-c601-4162-b828-a203307febed-kube-api-access-gnrbr\") pod \"node-ca-5zqvw\" (UID: \"1abd0f75-c601-4162-b828-a203307febed\") " pod="openshift-image-registry/node-ca-5zqvw" May 21 03:19:33.466199 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.465960 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4a110770-ece5-4091-a30a-46b820e75cae-multus-cni-dir\") pod \"multus-pppx8\" (UID: \"4a110770-ece5-4091-a30a-46b820e75cae\") " pod="openshift-multus/multus-pppx8" May 21 03:19:33.466199 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.465977 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4a110770-ece5-4091-a30a-46b820e75cae-host-var-lib-cni-multus\") pod \"multus-pppx8\" (UID: \"4a110770-ece5-4091-a30a-46b820e75cae\") " pod="openshift-multus/multus-pppx8" May 21 03:19:33.466199 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.465992 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4a110770-ece5-4091-a30a-46b820e75cae-host-run-netns\") pod \"multus-pppx8\" (UID: \"4a110770-ece5-4091-a30a-46b820e75cae\") " pod="openshift-multus/multus-pppx8" May 21 03:19:33.466199 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.466006 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4a110770-ece5-4091-a30a-46b820e75cae-etc-kubernetes\") pod \"multus-pppx8\" (UID: \"4a110770-ece5-4091-a30a-46b820e75cae\") " pod="openshift-multus/multus-pppx8" May 21 03:19:33.466199 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.466019 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/87a77bd0-28c8-408f-9bdd-17c8bb0ae511-host\") pod \"tuned-vfdck\" (UID: \"87a77bd0-28c8-408f-9bdd-17c8bb0ae511\") " pod="openshift-cluster-node-tuning-operator/tuned-vfdck" May 21 03:19:33.466199 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.466033 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59fsx\" (UniqueName: \"kubernetes.io/projected/70d7280d-5779-4c48-b698-9ce8a698bdeb-kube-api-access-59fsx\") pod \"multus-additional-cni-plugins-k7gbn\" (UID: \"70d7280d-5779-4c48-b698-9ce8a698bdeb\") " pod="openshift-multus/multus-additional-cni-plugins-k7gbn" May 21 03:19:33.466199 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.466047 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4a110770-ece5-4091-a30a-46b820e75cae-host-run-multus-certs\") pod \"multus-pppx8\" (UID: \"4a110770-ece5-4091-a30a-46b820e75cae\") " pod="openshift-multus/multus-pppx8" May 21 03:19:33.466753 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.466062 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/70d7280d-5779-4c48-b698-9ce8a698bdeb-system-cni-dir\") pod \"multus-additional-cni-plugins-k7gbn\" (UID: \"70d7280d-5779-4c48-b698-9ce8a698bdeb\") " pod="openshift-multus/multus-additional-cni-plugins-k7gbn" May 21 03:19:33.466753 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.466075 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/70d7280d-5779-4c48-b698-9ce8a698bdeb-cnibin\") pod \"multus-additional-cni-plugins-k7gbn\" (UID: \"70d7280d-5779-4c48-b698-9ce8a698bdeb\") " pod="openshift-multus/multus-additional-cni-plugins-k7gbn" May 21 03:19:33.466753 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.466089 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b19e3ebd-ec1e-4bdd-b766-79a3c736fe56-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t6gmv\" (UID: \"b19e3ebd-ec1e-4bdd-b766-79a3c736fe56\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6gmv" May 21 03:19:33.466753 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.466103 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j29h7\" (UniqueName: \"kubernetes.io/projected/87a77bd0-28c8-408f-9bdd-17c8bb0ae511-kube-api-access-j29h7\") pod \"tuned-vfdck\" (UID: \"87a77bd0-28c8-408f-9bdd-17c8bb0ae511\") " pod="openshift-cluster-node-tuning-operator/tuned-vfdck" May 21 03:19:33.466753 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.466116 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b19e3ebd-ec1e-4bdd-b766-79a3c736fe56-etc-selinux\") pod \"aws-ebs-csi-driver-node-t6gmv\" (UID: \"b19e3ebd-ec1e-4bdd-b766-79a3c736fe56\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6gmv" May 21 03:19:33.466753 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.466129 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4a110770-ece5-4091-a30a-46b820e75cae-host-var-lib-cni-bin\") pod \"multus-pppx8\" (UID: \"4a110770-ece5-4091-a30a-46b820e75cae\") " pod="openshift-multus/multus-pppx8" May 21 03:19:33.466753 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.466142 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/87a77bd0-28c8-408f-9bdd-17c8bb0ae511-lib-modules\") pod \"tuned-vfdck\" (UID: \"87a77bd0-28c8-408f-9bdd-17c8bb0ae511\") " pod="openshift-cluster-node-tuning-operator/tuned-vfdck" May 21 03:19:33.467247 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.467230 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tqqk8" May 21 03:19:33.469463 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.469445 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gqltp" May 21 03:19:33.471745 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.471725 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vwjdc" May 21 03:19:33.472260 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.472233 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-20 03:14:32 +0000 UTC" deadline="2027-12-15 08:56:18.697763077 +0000 UTC" May 21 03:19:33.472327 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.472262 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13757h36m45.225504541s" May 21 03:19:33.474043 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.474026 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vt8z9" May 21 03:19:33.474126 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:33.474088 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vt8z9" podUID="4931c73f-47f4-428d-8602-5e1f4d3cd47a" May 21 03:19:33.482820 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.482802 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 21 03:19:33.482922 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.482831 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 21 03:19:33.482986 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.482926 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 21 03:19:33.483037 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.482991 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 21 03:19:33.483084 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.483064 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 21 03:19:33.483084 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.483078 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 21 03:19:33.483176 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.483078 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 21 03:19:33.483292 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.483278 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 21 03:19:33.483345 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.483326 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 21 03:19:33.483400 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.483342 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 21 03:19:33.483400 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.483363 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-tt2q2\"" May 21 03:19:33.483400 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.483346 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-tfzg8\"" May 21 03:19:33.483400 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.483388 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-97flt\"" May 21 03:19:33.483703 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.483690 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 21 03:19:33.486552 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.486537 2574 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 21 03:19:33.491127 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.491104 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 21 03:19:33.491231 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.491172 2574 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-161.ec2.internal" May 21 03:19:33.492798 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.492782 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-161.ec2.internal"] May 21 03:19:33.499386 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.499372 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 21 03:19:33.499509 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.499493 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-128-161.ec2.internal"] May 21 03:19:33.506681 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.506664 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-mqctl" May 21 03:19:33.513881 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.513864 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-mqctl" May 21 03:19:33.561111 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.561091 2574 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 21 03:19:33.566649 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.566624 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/70d7280d-5779-4c48-b698-9ce8a698bdeb-system-cni-dir\") pod \"multus-additional-cni-plugins-k7gbn\" (UID: \"70d7280d-5779-4c48-b698-9ce8a698bdeb\") " pod="openshift-multus/multus-additional-cni-plugins-k7gbn" May 21 03:19:33.566748 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.566658 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/70d7280d-5779-4c48-b698-9ce8a698bdeb-cnibin\") pod \"multus-additional-cni-plugins-k7gbn\" (UID: \"70d7280d-5779-4c48-b698-9ce8a698bdeb\") " pod="openshift-multus/multus-additional-cni-plugins-k7gbn" May 21 03:19:33.566748 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.566684 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b19e3ebd-ec1e-4bdd-b766-79a3c736fe56-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t6gmv\" (UID: \"b19e3ebd-ec1e-4bdd-b766-79a3c736fe56\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6gmv" May 21 03:19:33.566748 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.566711 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7300d401-1c04-433f-a767-b2ec61b3d4b4-host-kubelet\") pod \"ovnkube-node-tqqk8\" (UID: \"7300d401-1c04-433f-a767-b2ec61b3d4b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqqk8" May 21 03:19:33.566748 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.566727 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/70d7280d-5779-4c48-b698-9ce8a698bdeb-system-cni-dir\") pod \"multus-additional-cni-plugins-k7gbn\" (UID: \"70d7280d-5779-4c48-b698-9ce8a698bdeb\") " pod="openshift-multus/multus-additional-cni-plugins-k7gbn" May 21 03:19:33.566748 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.566736 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7300d401-1c04-433f-a767-b2ec61b3d4b4-log-socket\") pod \"ovnkube-node-tqqk8\" (UID: \"7300d401-1c04-433f-a767-b2ec61b3d4b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqqk8" May 21 03:19:33.567022 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.566769 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/70d7280d-5779-4c48-b698-9ce8a698bdeb-cnibin\") pod \"multus-additional-cni-plugins-k7gbn\" (UID: \"70d7280d-5779-4c48-b698-9ce8a698bdeb\") " pod="openshift-multus/multus-additional-cni-plugins-k7gbn" May 21 03:19:33.567022 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.566839 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4931c73f-47f4-428d-8602-5e1f4d3cd47a-kubelet-config\") pod \"global-pull-secret-syncer-vt8z9\" (UID: \"4931c73f-47f4-428d-8602-5e1f4d3cd47a\") " pod="kube-system/global-pull-secret-syncer-vt8z9" May 21 03:19:33.567022 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.566871 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b19e3ebd-ec1e-4bdd-b766-79a3c736fe56-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t6gmv\" (UID: \"b19e3ebd-ec1e-4bdd-b766-79a3c736fe56\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6gmv" May 21 03:19:33.567022 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.566902 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j29h7\" (UniqueName: \"kubernetes.io/projected/87a77bd0-28c8-408f-9bdd-17c8bb0ae511-kube-api-access-j29h7\") pod \"tuned-vfdck\" (UID: \"87a77bd0-28c8-408f-9bdd-17c8bb0ae511\") " pod="openshift-cluster-node-tuning-operator/tuned-vfdck" May 21 03:19:33.567022 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.566932 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b19e3ebd-ec1e-4bdd-b766-79a3c736fe56-etc-selinux\") pod \"aws-ebs-csi-driver-node-t6gmv\" (UID: \"b19e3ebd-ec1e-4bdd-b766-79a3c736fe56\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6gmv" May 21 03:19:33.567022 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.566958 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4a110770-ece5-4091-a30a-46b820e75cae-host-var-lib-cni-bin\") pod \"multus-pppx8\" (UID: \"4a110770-ece5-4091-a30a-46b820e75cae\") " pod="openshift-multus/multus-pppx8" May 21 03:19:33.567022 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.566987 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7300d401-1c04-433f-a767-b2ec61b3d4b4-node-log\") pod \"ovnkube-node-tqqk8\" (UID: \"7300d401-1c04-433f-a767-b2ec61b3d4b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqqk8" May 21 03:19:33.567022 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.567015 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7300d401-1c04-433f-a767-b2ec61b3d4b4-host-cni-bin\") pod \"ovnkube-node-tqqk8\" (UID: \"7300d401-1c04-433f-a767-b2ec61b3d4b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqqk8" May 21 03:19:33.567415 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.567045 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/87a77bd0-28c8-408f-9bdd-17c8bb0ae511-lib-modules\") pod \"tuned-vfdck\" (UID: \"87a77bd0-28c8-408f-9bdd-17c8bb0ae511\") " pod="openshift-cluster-node-tuning-operator/tuned-vfdck" May 21 03:19:33.567415 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.567072 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j55xx\" (UniqueName: \"kubernetes.io/projected/4a110770-ece5-4091-a30a-46b820e75cae-kube-api-access-j55xx\") pod \"multus-pppx8\" (UID: \"4a110770-ece5-4091-a30a-46b820e75cae\") " pod="openshift-multus/multus-pppx8" May 21 03:19:33.567415 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.567099 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2f51be24-5086-480e-be43-8a11b02ca599-iptables-alerter-script\") pod \"iptables-alerter-vwjdc\" (UID: \"2f51be24-5086-480e-be43-8a11b02ca599\") " pod="openshift-network-operator/iptables-alerter-vwjdc" May 21 03:19:33.567415 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.567125 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7300d401-1c04-433f-a767-b2ec61b3d4b4-host-run-netns\") pod \"ovnkube-node-tqqk8\" (UID: \"7300d401-1c04-433f-a767-b2ec61b3d4b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqqk8" May 21 03:19:33.567415 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.567149 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/87a77bd0-28c8-408f-9bdd-17c8bb0ae511-etc-modprobe-d\") pod \"tuned-vfdck\" (UID: \"87a77bd0-28c8-408f-9bdd-17c8bb0ae511\") " pod="openshift-cluster-node-tuning-operator/tuned-vfdck" May 21 03:19:33.567415 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.567171 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/70d7280d-5779-4c48-b698-9ce8a698bdeb-os-release\") pod \"multus-additional-cni-plugins-k7gbn\" (UID: \"70d7280d-5779-4c48-b698-9ce8a698bdeb\") " pod="openshift-multus/multus-additional-cni-plugins-k7gbn" May 21 03:19:33.567415 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.567191 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/70d7280d-5779-4c48-b698-9ce8a698bdeb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-k7gbn\" (UID: \"70d7280d-5779-4c48-b698-9ce8a698bdeb\") " pod="openshift-multus/multus-additional-cni-plugins-k7gbn" May 21 03:19:33.567415 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.567214 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4a110770-ece5-4091-a30a-46b820e75cae-multus-conf-dir\") pod \"multus-pppx8\" (UID: \"4a110770-ece5-4091-a30a-46b820e75cae\") " pod="openshift-multus/multus-pppx8" May 21 03:19:33.567415 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.567259 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4a110770-ece5-4091-a30a-46b820e75cae-multus-daemon-config\") pod \"multus-pppx8\" (UID: \"4a110770-ece5-4091-a30a-46b820e75cae\") " pod="openshift-multus/multus-pppx8" May 21 03:19:33.567415 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.567289 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4931c73f-47f4-428d-8602-5e1f4d3cd47a-original-pull-secret\") pod \"global-pull-secret-syncer-vt8z9\" (UID: \"4931c73f-47f4-428d-8602-5e1f4d3cd47a\") " pod="kube-system/global-pull-secret-syncer-vt8z9" May 21 03:19:33.567415 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.567283 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4a110770-ece5-4091-a30a-46b820e75cae-host-var-lib-cni-bin\") pod \"multus-pppx8\" (UID: \"4a110770-ece5-4091-a30a-46b820e75cae\") " pod="openshift-multus/multus-pppx8" May 21 03:19:33.567415 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.567319 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4lzb\" (UniqueName: \"kubernetes.io/projected/7300d401-1c04-433f-a767-b2ec61b3d4b4-kube-api-access-j4lzb\") pod \"ovnkube-node-tqqk8\" (UID: \"7300d401-1c04-433f-a767-b2ec61b3d4b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqqk8" May 21 03:19:33.567415 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.567345 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05b002ff-a785-4372-a115-4fd04746df17-tmp-dir\") pod \"node-resolver-gqltp\" (UID: \"05b002ff-a785-4372-a115-4fd04746df17\") " pod="openshift-dns/node-resolver-gqltp" May 21 03:19:33.567415 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.567356 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/70d7280d-5779-4c48-b698-9ce8a698bdeb-os-release\") pod \"multus-additional-cni-plugins-k7gbn\" (UID: \"70d7280d-5779-4c48-b698-9ce8a698bdeb\") " pod="openshift-multus/multus-additional-cni-plugins-k7gbn" May 21 03:19:33.567415 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.567373 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-82c9f\" (UniqueName: \"kubernetes.io/projected/1a03c959-a5a9-44f4-89f3-d604f293b8a0-kube-api-access-82c9f\") pod \"network-metrics-daemon-7vr9p\" (UID: \"1a03c959-a5a9-44f4-89f3-d604f293b8a0\") " pod="openshift-multus/network-metrics-daemon-7vr9p" May 21 03:19:33.567415 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.567401 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/87a77bd0-28c8-408f-9bdd-17c8bb0ae511-etc-systemd\") pod \"tuned-vfdck\" (UID: \"87a77bd0-28c8-408f-9bdd-17c8bb0ae511\") " pod="openshift-cluster-node-tuning-operator/tuned-vfdck" May 21 03:19:33.567415 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.567423 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/87a77bd0-28c8-408f-9bdd-17c8bb0ae511-sys\") pod \"tuned-vfdck\" (UID: \"87a77bd0-28c8-408f-9bdd-17c8bb0ae511\") " pod="openshift-cluster-node-tuning-operator/tuned-vfdck" May 21 03:19:33.568099 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.567427 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/87a77bd0-28c8-408f-9bdd-17c8bb0ae511-lib-modules\") pod \"tuned-vfdck\" (UID: \"87a77bd0-28c8-408f-9bdd-17c8bb0ae511\") " pod="openshift-cluster-node-tuning-operator/tuned-vfdck" May 21 03:19:33.568099 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.567448 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/87a77bd0-28c8-408f-9bdd-17c8bb0ae511-var-lib-kubelet\") pod \"tuned-vfdck\" (UID: \"87a77bd0-28c8-408f-9bdd-17c8bb0ae511\") " pod="openshift-cluster-node-tuning-operator/tuned-vfdck" May 21 03:19:33.568099 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.567468 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1abd0f75-c601-4162-b828-a203307febed-serviceca\") pod \"node-ca-5zqvw\" (UID: \"1abd0f75-c601-4162-b828-a203307febed\") " pod="openshift-image-registry/node-ca-5zqvw" May 21 03:19:33.568099 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.567497 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4a110770-ece5-4091-a30a-46b820e75cae-hostroot\") pod \"multus-pppx8\" (UID: \"4a110770-ece5-4091-a30a-46b820e75cae\") " pod="openshift-multus/multus-pppx8" May 21 03:19:33.568099 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.567513 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/87a77bd0-28c8-408f-9bdd-17c8bb0ae511-etc-sysctl-d\") pod \"tuned-vfdck\" (UID: \"87a77bd0-28c8-408f-9bdd-17c8bb0ae511\") " pod="openshift-cluster-node-tuning-operator/tuned-vfdck" May 21 03:19:33.568099 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.567527 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/74fe87f5-634c-48e6-85b9-357a3b4d02f9-agent-certs\") pod \"konnectivity-agent-8nncl\" (UID: \"74fe87f5-634c-48e6-85b9-357a3b4d02f9\") " pod="kube-system/konnectivity-agent-8nncl" May 21 03:19:33.568099 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.567550 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b19e3ebd-ec1e-4bdd-b766-79a3c736fe56-sys-fs\") pod \"aws-ebs-csi-driver-node-t6gmv\" (UID: \"b19e3ebd-ec1e-4bdd-b766-79a3c736fe56\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6gmv" May 21 03:19:33.568099 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.567579 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-69kbd\" (UniqueName: \"kubernetes.io/projected/b19e3ebd-ec1e-4bdd-b766-79a3c736fe56-kube-api-access-69kbd\") pod \"aws-ebs-csi-driver-node-t6gmv\" (UID: \"b19e3ebd-ec1e-4bdd-b766-79a3c736fe56\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6gmv" May 21 03:19:33.568099 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.567594 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4a110770-ece5-4091-a30a-46b820e75cae-multus-socket-dir-parent\") pod \"multus-pppx8\" (UID: \"4a110770-ece5-4091-a30a-46b820e75cae\") " pod="openshift-multus/multus-pppx8" May 21 03:19:33.568099 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.567629 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4a110770-ece5-4091-a30a-46b820e75cae-host-run-k8s-cni-cncf-io\") pod \"multus-pppx8\" (UID: \"4a110770-ece5-4091-a30a-46b820e75cae\") " pod="openshift-multus/multus-pppx8" May 21 03:19:33.568099 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.567647 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/05b002ff-a785-4372-a115-4fd04746df17-hosts-file\") pod \"node-resolver-gqltp\" (UID: \"05b002ff-a785-4372-a115-4fd04746df17\") " pod="openshift-dns/node-resolver-gqltp" May 21 03:19:33.568099 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.567655 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/87a77bd0-28c8-408f-9bdd-17c8bb0ae511-etc-modprobe-d\") pod \"tuned-vfdck\" (UID: \"87a77bd0-28c8-408f-9bdd-17c8bb0ae511\") " pod="openshift-cluster-node-tuning-operator/tuned-vfdck" May 21 03:19:33.568099 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.567662 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/87a77bd0-28c8-408f-9bdd-17c8bb0ae511-etc-sysconfig\") pod \"tuned-vfdck\" (UID: \"87a77bd0-28c8-408f-9bdd-17c8bb0ae511\") " pod="openshift-cluster-node-tuning-operator/tuned-vfdck" May 21 03:19:33.568099 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.567260 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b19e3ebd-ec1e-4bdd-b766-79a3c736fe56-etc-selinux\") pod \"aws-ebs-csi-driver-node-t6gmv\" (UID: \"b19e3ebd-ec1e-4bdd-b766-79a3c736fe56\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6gmv" May 21 03:19:33.568099 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.567669 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/87a77bd0-28c8-408f-9bdd-17c8bb0ae511-etc-systemd\") pod \"tuned-vfdck\" (UID: \"87a77bd0-28c8-408f-9bdd-17c8bb0ae511\") " pod="openshift-cluster-node-tuning-operator/tuned-vfdck" May 21 03:19:33.568099 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.567680 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f628q\" (UniqueName: \"kubernetes.io/projected/168bd0e1-6421-4c11-8ef2-8caf34170ae9-kube-api-access-f628q\") pod \"network-check-target-skpvq\" (UID: \"168bd0e1-6421-4c11-8ef2-8caf34170ae9\") " pod="openshift-network-diagnostics/network-check-target-skpvq" May 21 03:19:33.568099 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.567697 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/74fe87f5-634c-48e6-85b9-357a3b4d02f9-konnectivity-ca\") pod \"konnectivity-agent-8nncl\" (UID: \"74fe87f5-634c-48e6-85b9-357a3b4d02f9\") " pod="kube-system/konnectivity-agent-8nncl" May 21 03:19:33.568724 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.567717 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b19e3ebd-ec1e-4bdd-b766-79a3c736fe56-socket-dir\") pod \"aws-ebs-csi-driver-node-t6gmv\" (UID: \"b19e3ebd-ec1e-4bdd-b766-79a3c736fe56\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6gmv" May 21 03:19:33.568724 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.567733 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2f51be24-5086-480e-be43-8a11b02ca599-host-slash\") pod \"iptables-alerter-vwjdc\" (UID: \"2f51be24-5086-480e-be43-8a11b02ca599\") " pod="openshift-network-operator/iptables-alerter-vwjdc" May 21 03:19:33.568724 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.567747 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7300d401-1c04-433f-a767-b2ec61b3d4b4-run-openvswitch\") pod \"ovnkube-node-tqqk8\" (UID: \"7300d401-1c04-433f-a767-b2ec61b3d4b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqqk8" May 21 03:19:33.568724 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.567764 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7300d401-1c04-433f-a767-b2ec61b3d4b4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tqqk8\" (UID: \"7300d401-1c04-433f-a767-b2ec61b3d4b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqqk8" May 21 03:19:33.568724 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.568402 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/87a77bd0-28c8-408f-9bdd-17c8bb0ae511-etc-kubernetes\") pod \"tuned-vfdck\" (UID: \"87a77bd0-28c8-408f-9bdd-17c8bb0ae511\") " pod="openshift-cluster-node-tuning-operator/tuned-vfdck" May 21 03:19:33.568724 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.568454 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/87a77bd0-28c8-408f-9bdd-17c8bb0ae511-run\") pod \"tuned-vfdck\" (UID: \"87a77bd0-28c8-408f-9bdd-17c8bb0ae511\") " pod="openshift-cluster-node-tuning-operator/tuned-vfdck" May 21 03:19:33.568724 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.568470 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4a110770-ece5-4091-a30a-46b820e75cae-multus-conf-dir\") pod \"multus-pppx8\" (UID: \"4a110770-ece5-4091-a30a-46b820e75cae\") " pod="openshift-multus/multus-pppx8" May 21 03:19:33.568724 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.568494 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/70d7280d-5779-4c48-b698-9ce8a698bdeb-cni-binary-copy\") pod \"multus-additional-cni-plugins-k7gbn\" (UID: \"70d7280d-5779-4c48-b698-9ce8a698bdeb\") " pod="openshift-multus/multus-additional-cni-plugins-k7gbn" May 21 03:19:33.568724 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.568533 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7300d401-1c04-433f-a767-b2ec61b3d4b4-etc-openvswitch\") pod \"ovnkube-node-tqqk8\" (UID: \"7300d401-1c04-433f-a767-b2ec61b3d4b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqqk8" May 21 03:19:33.568724 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.568567 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7300d401-1c04-433f-a767-b2ec61b3d4b4-host-run-ovn-kubernetes\") pod \"ovnkube-node-tqqk8\" (UID: \"7300d401-1c04-433f-a767-b2ec61b3d4b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqqk8" May 21 03:19:33.568724 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.568599 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1abd0f75-c601-4162-b828-a203307febed-host\") pod \"node-ca-5zqvw\" (UID: \"1abd0f75-c601-4162-b828-a203307febed\") " pod="openshift-image-registry/node-ca-5zqvw" May 21 03:19:33.568724 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.568656 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/87a77bd0-28c8-408f-9bdd-17c8bb0ae511-etc-sysconfig\") pod \"tuned-vfdck\" (UID: \"87a77bd0-28c8-408f-9bdd-17c8bb0ae511\") " pod="openshift-cluster-node-tuning-operator/tuned-vfdck" May 21 03:19:33.568724 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.568659 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/87a77bd0-28c8-408f-9bdd-17c8bb0ae511-sys\") pod \"tuned-vfdck\" (UID: \"87a77bd0-28c8-408f-9bdd-17c8bb0ae511\") " pod="openshift-cluster-node-tuning-operator/tuned-vfdck" May 21 03:19:33.568724 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.568709 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/87a77bd0-28c8-408f-9bdd-17c8bb0ae511-var-lib-kubelet\") pod \"tuned-vfdck\" (UID: \"87a77bd0-28c8-408f-9bdd-17c8bb0ae511\") " pod="openshift-cluster-node-tuning-operator/tuned-vfdck" May 21 03:19:33.569402 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.569059 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/70d7280d-5779-4c48-b698-9ce8a698bdeb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-k7gbn\" (UID: \"70d7280d-5779-4c48-b698-9ce8a698bdeb\") " pod="openshift-multus/multus-additional-cni-plugins-k7gbn" May 21 03:19:33.569402 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.569195 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1abd0f75-c601-4162-b828-a203307febed-serviceca\") pod \"node-ca-5zqvw\" (UID: \"1abd0f75-c601-4162-b828-a203307febed\") " pod="openshift-image-registry/node-ca-5zqvw" May 21 03:19:33.569402 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.569271 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b19e3ebd-ec1e-4bdd-b766-79a3c736fe56-socket-dir\") pod \"aws-ebs-csi-driver-node-t6gmv\" (UID: \"b19e3ebd-ec1e-4bdd-b766-79a3c736fe56\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6gmv" May 21 03:19:33.569402 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.569275 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4a110770-ece5-4091-a30a-46b820e75cae-hostroot\") pod \"multus-pppx8\" (UID: \"4a110770-ece5-4091-a30a-46b820e75cae\") " pod="openshift-multus/multus-pppx8" May 21 03:19:33.569402 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.569383 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/87a77bd0-28c8-408f-9bdd-17c8bb0ae511-etc-sysctl-d\") pod \"tuned-vfdck\" (UID: \"87a77bd0-28c8-408f-9bdd-17c8bb0ae511\") " pod="openshift-cluster-node-tuning-operator/tuned-vfdck" May 21 03:19:33.569619 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.569407 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/74fe87f5-634c-48e6-85b9-357a3b4d02f9-konnectivity-ca\") pod \"konnectivity-agent-8nncl\" (UID: \"74fe87f5-634c-48e6-85b9-357a3b4d02f9\") " pod="kube-system/konnectivity-agent-8nncl" May 21 03:19:33.569619 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.569473 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/87a77bd0-28c8-408f-9bdd-17c8bb0ae511-etc-kubernetes\") pod \"tuned-vfdck\" (UID: \"87a77bd0-28c8-408f-9bdd-17c8bb0ae511\") " pod="openshift-cluster-node-tuning-operator/tuned-vfdck" May 21 03:19:33.569619 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.569493 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b19e3ebd-ec1e-4bdd-b766-79a3c736fe56-sys-fs\") pod \"aws-ebs-csi-driver-node-t6gmv\" (UID: \"b19e3ebd-ec1e-4bdd-b766-79a3c736fe56\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6gmv" May 21 03:19:33.569768 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.569738 2574 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 21 03:19:33.569822 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.569772 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4a110770-ece5-4091-a30a-46b820e75cae-multus-socket-dir-parent\") pod \"multus-pppx8\" (UID: \"4a110770-ece5-4091-a30a-46b820e75cae\") " pod="openshift-multus/multus-pppx8" May 21 03:19:33.569894 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.569830 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4a110770-ece5-4091-a30a-46b820e75cae-host-run-k8s-cni-cncf-io\") pod \"multus-pppx8\" (UID: \"4a110770-ece5-4091-a30a-46b820e75cae\") " pod="openshift-multus/multus-pppx8" May 21 03:19:33.571594 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.569988 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/87a77bd0-28c8-408f-9bdd-17c8bb0ae511-run\") pod \"tuned-vfdck\" (UID: \"87a77bd0-28c8-408f-9bdd-17c8bb0ae511\") " pod="openshift-cluster-node-tuning-operator/tuned-vfdck" May 21 03:19:33.571594 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.570262 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4a110770-ece5-4091-a30a-46b820e75cae-os-release\") pod \"multus-pppx8\" (UID: \"4a110770-ece5-4091-a30a-46b820e75cae\") " pod="openshift-multus/multus-pppx8" May 21 03:19:33.571594 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.570300 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgc2z\" (UniqueName: \"kubernetes.io/projected/2f51be24-5086-480e-be43-8a11b02ca599-kube-api-access-bgc2z\") pod \"iptables-alerter-vwjdc\" (UID: \"2f51be24-5086-480e-be43-8a11b02ca599\") " pod="openshift-network-operator/iptables-alerter-vwjdc" May 21 03:19:33.571594 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.570332 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7300d401-1c04-433f-a767-b2ec61b3d4b4-run-systemd\") pod \"ovnkube-node-tqqk8\" (UID: \"7300d401-1c04-433f-a767-b2ec61b3d4b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqqk8" May 21 03:19:33.571594 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.570354 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7300d401-1c04-433f-a767-b2ec61b3d4b4-var-lib-openvswitch\") pod \"ovnkube-node-tqqk8\" (UID: \"7300d401-1c04-433f-a767-b2ec61b3d4b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqqk8" May 21 03:19:33.571594 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.570380 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7300d401-1c04-433f-a767-b2ec61b3d4b4-ovnkube-config\") pod \"ovnkube-node-tqqk8\" (UID: \"7300d401-1c04-433f-a767-b2ec61b3d4b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqqk8" May 21 03:19:33.571594 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.570410 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/87a77bd0-28c8-408f-9bdd-17c8bb0ae511-etc-sysctl-conf\") pod \"tuned-vfdck\" (UID: \"87a77bd0-28c8-408f-9bdd-17c8bb0ae511\") " pod="openshift-cluster-node-tuning-operator/tuned-vfdck" May 21 03:19:33.571594 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.570439 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/87a77bd0-28c8-408f-9bdd-17c8bb0ae511-tmp\") pod \"tuned-vfdck\" (UID: \"87a77bd0-28c8-408f-9bdd-17c8bb0ae511\") " pod="openshift-cluster-node-tuning-operator/tuned-vfdck" May 21 03:19:33.571594 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.570468 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/70d7280d-5779-4c48-b698-9ce8a698bdeb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-k7gbn\" (UID: \"70d7280d-5779-4c48-b698-9ce8a698bdeb\") " pod="openshift-multus/multus-additional-cni-plugins-k7gbn" May 21 03:19:33.571594 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.570494 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4a110770-ece5-4091-a30a-46b820e75cae-cnibin\") pod \"multus-pppx8\" (UID: \"4a110770-ece5-4091-a30a-46b820e75cae\") " pod="openshift-multus/multus-pppx8" May 21 03:19:33.571594 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.570527 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7300d401-1c04-433f-a767-b2ec61b3d4b4-host-slash\") pod \"ovnkube-node-tqqk8\" (UID: \"7300d401-1c04-433f-a767-b2ec61b3d4b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqqk8" May 21 03:19:33.571594 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.570564 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a03c959-a5a9-44f4-89f3-d604f293b8a0-metrics-certs\") pod \"network-metrics-daemon-7vr9p\" (UID: \"1a03c959-a5a9-44f4-89f3-d604f293b8a0\") " pod="openshift-multus/network-metrics-daemon-7vr9p" May 21 03:19:33.571594 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.570715 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b19e3ebd-ec1e-4bdd-b766-79a3c736fe56-registration-dir\") pod \"aws-ebs-csi-driver-node-t6gmv\" (UID: \"b19e3ebd-ec1e-4bdd-b766-79a3c736fe56\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6gmv" May 21 03:19:33.571594 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.570803 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4a110770-ece5-4091-a30a-46b820e75cae-system-cni-dir\") pod \"multus-pppx8\" (UID: \"4a110770-ece5-4091-a30a-46b820e75cae\") " pod="openshift-multus/multus-pppx8" May 21 03:19:33.571594 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.570830 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4a110770-ece5-4091-a30a-46b820e75cae-host-var-lib-kubelet\") pod \"multus-pppx8\" (UID: \"4a110770-ece5-4091-a30a-46b820e75cae\") " pod="openshift-multus/multus-pppx8" May 21 03:19:33.571594 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.570877 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7300d401-1c04-433f-a767-b2ec61b3d4b4-systemd-units\") pod \"ovnkube-node-tqqk8\" (UID: \"7300d401-1c04-433f-a767-b2ec61b3d4b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqqk8" May 21 03:19:33.571594 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.570907 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7300d401-1c04-433f-a767-b2ec61b3d4b4-host-cni-netd\") pod \"ovnkube-node-tqqk8\" (UID: \"7300d401-1c04-433f-a767-b2ec61b3d4b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqqk8" May 21 03:19:33.572499 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.570937 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7300d401-1c04-433f-a767-b2ec61b3d4b4-env-overrides\") pod \"ovnkube-node-tqqk8\" (UID: \"7300d401-1c04-433f-a767-b2ec61b3d4b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqqk8" May 21 03:19:33.572499 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.570969 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/70d7280d-5779-4c48-b698-9ce8a698bdeb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-k7gbn\" (UID: \"70d7280d-5779-4c48-b698-9ce8a698bdeb\") " pod="openshift-multus/multus-additional-cni-plugins-k7gbn" May 21 03:19:33.572499 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.570996 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b19e3ebd-ec1e-4bdd-b766-79a3c736fe56-device-dir\") pod \"aws-ebs-csi-driver-node-t6gmv\" (UID: \"b19e3ebd-ec1e-4bdd-b766-79a3c736fe56\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6gmv" May 21 03:19:33.572499 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:33.571106 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 03:19:33.572499 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:33.571209 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a03c959-a5a9-44f4-89f3-d604f293b8a0-metrics-certs podName:1a03c959-a5a9-44f4-89f3-d604f293b8a0 nodeName:}" failed. No retries permitted until 2026-05-21 03:19:34.071169858 +0000 UTC m=+2.113938752 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1a03c959-a5a9-44f4-89f3-d604f293b8a0-metrics-certs") pod "network-metrics-daemon-7vr9p" (UID: "1a03c959-a5a9-44f4-89f3-d604f293b8a0") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 03:19:33.572499 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.571269 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/87a77bd0-28c8-408f-9bdd-17c8bb0ae511-etc-sysctl-conf\") pod \"tuned-vfdck\" (UID: \"87a77bd0-28c8-408f-9bdd-17c8bb0ae511\") " pod="openshift-cluster-node-tuning-operator/tuned-vfdck" May 21 03:19:33.572499 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.571942 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b19e3ebd-ec1e-4bdd-b766-79a3c736fe56-registration-dir\") pod \"aws-ebs-csi-driver-node-t6gmv\" (UID: \"b19e3ebd-ec1e-4bdd-b766-79a3c736fe56\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6gmv" May 21 03:19:33.572499 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.570907 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1abd0f75-c601-4162-b828-a203307febed-host\") pod \"node-ca-5zqvw\" (UID: \"1abd0f75-c601-4162-b828-a203307febed\") " pod="openshift-image-registry/node-ca-5zqvw" May 21 03:19:33.572499 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.572035 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4a110770-ece5-4091-a30a-46b820e75cae-os-release\") pod \"multus-pppx8\" (UID: \"4a110770-ece5-4091-a30a-46b820e75cae\") " pod="openshift-multus/multus-pppx8" May 21 03:19:33.572499 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.572071 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4a110770-ece5-4091-a30a-46b820e75cae-cni-binary-copy\") pod \"multus-pppx8\" (UID: \"4a110770-ece5-4091-a30a-46b820e75cae\") " pod="openshift-multus/multus-pppx8" May 21 03:19:33.572499 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.572107 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7300d401-1c04-433f-a767-b2ec61b3d4b4-ovn-node-metrics-cert\") pod \"ovnkube-node-tqqk8\" (UID: \"7300d401-1c04-433f-a767-b2ec61b3d4b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqqk8" May 21 03:19:33.572499 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.572123 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4a110770-ece5-4091-a30a-46b820e75cae-system-cni-dir\") pod \"multus-pppx8\" (UID: \"4a110770-ece5-4091-a30a-46b820e75cae\") " pod="openshift-multus/multus-pppx8" May 21 03:19:33.572499 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.572140 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwdfk\" (UniqueName: \"kubernetes.io/projected/05b002ff-a785-4372-a115-4fd04746df17-kube-api-access-hwdfk\") pod \"node-resolver-gqltp\" (UID: \"05b002ff-a785-4372-a115-4fd04746df17\") " pod="openshift-dns/node-resolver-gqltp" May 21 03:19:33.572499 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.572172 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/87a77bd0-28c8-408f-9bdd-17c8bb0ae511-etc-tuned\") pod \"tuned-vfdck\" (UID: \"87a77bd0-28c8-408f-9bdd-17c8bb0ae511\") " pod="openshift-cluster-node-tuning-operator/tuned-vfdck" May 21 03:19:33.572499 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.572178 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4a110770-ece5-4091-a30a-46b820e75cae-host-var-lib-kubelet\") pod \"multus-pppx8\" (UID: \"4a110770-ece5-4091-a30a-46b820e75cae\") " pod="openshift-multus/multus-pppx8" May 21 03:19:33.572499 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.572208 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gnrbr\" (UniqueName: \"kubernetes.io/projected/1abd0f75-c601-4162-b828-a203307febed-kube-api-access-gnrbr\") pod \"node-ca-5zqvw\" (UID: \"1abd0f75-c601-4162-b828-a203307febed\") " pod="openshift-image-registry/node-ca-5zqvw" May 21 03:19:33.572499 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.572246 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4a110770-ece5-4091-a30a-46b820e75cae-multus-cni-dir\") pod \"multus-pppx8\" (UID: \"4a110770-ece5-4091-a30a-46b820e75cae\") " pod="openshift-multus/multus-pppx8" May 21 03:19:33.573241 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.572326 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/70d7280d-5779-4c48-b698-9ce8a698bdeb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-k7gbn\" (UID: \"70d7280d-5779-4c48-b698-9ce8a698bdeb\") " pod="openshift-multus/multus-additional-cni-plugins-k7gbn" May 21 03:19:33.573241 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.572401 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4a110770-ece5-4091-a30a-46b820e75cae-host-var-lib-cni-multus\") pod \"multus-pppx8\" (UID: \"4a110770-ece5-4091-a30a-46b820e75cae\") " pod="openshift-multus/multus-pppx8" May 21 03:19:33.573241 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.572432 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4931c73f-47f4-428d-8602-5e1f4d3cd47a-dbus\") pod \"global-pull-secret-syncer-vt8z9\" (UID: \"4931c73f-47f4-428d-8602-5e1f4d3cd47a\") " pod="kube-system/global-pull-secret-syncer-vt8z9" May 21 03:19:33.573241 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.572465 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7300d401-1c04-433f-a767-b2ec61b3d4b4-ovnkube-script-lib\") pod \"ovnkube-node-tqqk8\" (UID: \"7300d401-1c04-433f-a767-b2ec61b3d4b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqqk8" May 21 03:19:33.573241 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.572497 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4a110770-ece5-4091-a30a-46b820e75cae-host-run-netns\") pod \"multus-pppx8\" (UID: \"4a110770-ece5-4091-a30a-46b820e75cae\") " pod="openshift-multus/multus-pppx8" May 21 03:19:33.573241 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.572526 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4a110770-ece5-4091-a30a-46b820e75cae-etc-kubernetes\") pod \"multus-pppx8\" (UID: \"4a110770-ece5-4091-a30a-46b820e75cae\") " pod="openshift-multus/multus-pppx8" May 21 03:19:33.573241 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.572555 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7300d401-1c04-433f-a767-b2ec61b3d4b4-run-ovn\") pod \"ovnkube-node-tqqk8\" (UID: \"7300d401-1c04-433f-a767-b2ec61b3d4b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqqk8" May 21 03:19:33.573241 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.572578 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/87a77bd0-28c8-408f-9bdd-17c8bb0ae511-host\") pod \"tuned-vfdck\" (UID: \"87a77bd0-28c8-408f-9bdd-17c8bb0ae511\") " pod="openshift-cluster-node-tuning-operator/tuned-vfdck" May 21 03:19:33.573241 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.572619 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-59fsx\" (UniqueName: \"kubernetes.io/projected/70d7280d-5779-4c48-b698-9ce8a698bdeb-kube-api-access-59fsx\") pod \"multus-additional-cni-plugins-k7gbn\" (UID: \"70d7280d-5779-4c48-b698-9ce8a698bdeb\") " pod="openshift-multus/multus-additional-cni-plugins-k7gbn" May 21 03:19:33.573241 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.572711 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4a110770-ece5-4091-a30a-46b820e75cae-host-run-multus-certs\") pod \"multus-pppx8\" (UID: \"4a110770-ece5-4091-a30a-46b820e75cae\") " pod="openshift-multus/multus-pppx8" May 21 03:19:33.573241 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.572801 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4a110770-ece5-4091-a30a-46b820e75cae-host-run-multus-certs\") pod \"multus-pppx8\" (UID: \"4a110770-ece5-4091-a30a-46b820e75cae\") " pod="openshift-multus/multus-pppx8" May 21 03:19:33.573241 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.572825 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/70d7280d-5779-4c48-b698-9ce8a698bdeb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-k7gbn\" (UID: \"70d7280d-5779-4c48-b698-9ce8a698bdeb\") " pod="openshift-multus/multus-additional-cni-plugins-k7gbn" May 21 03:19:33.573241 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.572936 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b19e3ebd-ec1e-4bdd-b766-79a3c736fe56-device-dir\") pod \"aws-ebs-csi-driver-node-t6gmv\" (UID: \"b19e3ebd-ec1e-4bdd-b766-79a3c736fe56\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6gmv" May 21 03:19:33.573241 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.573001 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4a110770-ece5-4091-a30a-46b820e75cae-multus-cni-dir\") pod \"multus-pppx8\" (UID: \"4a110770-ece5-4091-a30a-46b820e75cae\") " pod="openshift-multus/multus-pppx8" May 21 03:19:33.574336 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.573334 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4a110770-ece5-4091-a30a-46b820e75cae-host-var-lib-cni-multus\") pod \"multus-pppx8\" (UID: \"4a110770-ece5-4091-a30a-46b820e75cae\") " pod="openshift-multus/multus-pppx8" May 21 03:19:33.574336 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.573371 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4a110770-ece5-4091-a30a-46b820e75cae-host-run-netns\") pod \"multus-pppx8\" (UID: \"4a110770-ece5-4091-a30a-46b820e75cae\") " pod="openshift-multus/multus-pppx8" May 21 03:19:33.574336 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.574038 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/87a77bd0-28c8-408f-9bdd-17c8bb0ae511-host\") pod \"tuned-vfdck\" (UID: \"87a77bd0-28c8-408f-9bdd-17c8bb0ae511\") " pod="openshift-cluster-node-tuning-operator/tuned-vfdck" May 21 03:19:33.574336 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.573904 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/70d7280d-5779-4c48-b698-9ce8a698bdeb-cni-binary-copy\") pod \"multus-additional-cni-plugins-k7gbn\" (UID: \"70d7280d-5779-4c48-b698-9ce8a698bdeb\") " pod="openshift-multus/multus-additional-cni-plugins-k7gbn" May 21 03:19:33.574336 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.573606 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4a110770-ece5-4091-a30a-46b820e75cae-cnibin\") pod \"multus-pppx8\" (UID: \"4a110770-ece5-4091-a30a-46b820e75cae\") " pod="openshift-multus/multus-pppx8" May 21 03:19:33.574336 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.573989 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4a110770-ece5-4091-a30a-46b820e75cae-etc-kubernetes\") pod \"multus-pppx8\" (UID: \"4a110770-ece5-4091-a30a-46b820e75cae\") " pod="openshift-multus/multus-pppx8" May 21 03:19:33.574626 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.574591 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4a110770-ece5-4091-a30a-46b820e75cae-cni-binary-copy\") pod \"multus-pppx8\" (UID: \"4a110770-ece5-4091-a30a-46b820e75cae\") " pod="openshift-multus/multus-pppx8" May 21 03:19:33.575216 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:33.574809 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 03:19:33.575216 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:33.574885 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 03:19:33.575216 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:33.574901 2574 projected.go:194] Error preparing data for projected volume kube-api-access-f628q for pod openshift-network-diagnostics/network-check-target-skpvq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 03:19:33.575216 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:33.574973 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/168bd0e1-6421-4c11-8ef2-8caf34170ae9-kube-api-access-f628q podName:168bd0e1-6421-4c11-8ef2-8caf34170ae9 nodeName:}" failed. No retries permitted until 2026-05-21 03:19:34.07495473 +0000 UTC m=+2.117723646 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-f628q" (UniqueName: "kubernetes.io/projected/168bd0e1-6421-4c11-8ef2-8caf34170ae9-kube-api-access-f628q") pod "network-check-target-skpvq" (UID: "168bd0e1-6421-4c11-8ef2-8caf34170ae9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 03:19:33.575216 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.575144 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/74fe87f5-634c-48e6-85b9-357a3b4d02f9-agent-certs\") pod \"konnectivity-agent-8nncl\" (UID: \"74fe87f5-634c-48e6-85b9-357a3b4d02f9\") " pod="kube-system/konnectivity-agent-8nncl" May 21 03:19:33.575860 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.575814 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/87a77bd0-28c8-408f-9bdd-17c8bb0ae511-tmp\") pod \"tuned-vfdck\" (UID: \"87a77bd0-28c8-408f-9bdd-17c8bb0ae511\") " pod="openshift-cluster-node-tuning-operator/tuned-vfdck" May 21 03:19:33.576138 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.576117 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/87a77bd0-28c8-408f-9bdd-17c8bb0ae511-etc-tuned\") pod \"tuned-vfdck\" (UID: \"87a77bd0-28c8-408f-9bdd-17c8bb0ae511\") " pod="openshift-cluster-node-tuning-operator/tuned-vfdck" May 21 03:19:33.577965 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.577834 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j55xx\" (UniqueName: \"kubernetes.io/projected/4a110770-ece5-4091-a30a-46b820e75cae-kube-api-access-j55xx\") pod \"multus-pppx8\" (UID: \"4a110770-ece5-4091-a30a-46b820e75cae\") " pod="openshift-multus/multus-pppx8" May 21 03:19:33.578055 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.577973 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j29h7\" (UniqueName: \"kubernetes.io/projected/87a77bd0-28c8-408f-9bdd-17c8bb0ae511-kube-api-access-j29h7\") pod \"tuned-vfdck\" (UID: \"87a77bd0-28c8-408f-9bdd-17c8bb0ae511\") " pod="openshift-cluster-node-tuning-operator/tuned-vfdck" May 21 03:19:33.578838 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.578213 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-82c9f\" (UniqueName: \"kubernetes.io/projected/1a03c959-a5a9-44f4-89f3-d604f293b8a0-kube-api-access-82c9f\") pod \"network-metrics-daemon-7vr9p\" (UID: \"1a03c959-a5a9-44f4-89f3-d604f293b8a0\") " pod="openshift-multus/network-metrics-daemon-7vr9p" May 21 03:19:33.578838 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.578459 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4a110770-ece5-4091-a30a-46b820e75cae-multus-daemon-config\") pod \"multus-pppx8\" (UID: \"4a110770-ece5-4091-a30a-46b820e75cae\") " pod="openshift-multus/multus-pppx8" May 21 03:19:33.579745 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.579722 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-69kbd\" (UniqueName: \"kubernetes.io/projected/b19e3ebd-ec1e-4bdd-b766-79a3c736fe56-kube-api-access-69kbd\") pod \"aws-ebs-csi-driver-node-t6gmv\" (UID: \"b19e3ebd-ec1e-4bdd-b766-79a3c736fe56\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6gmv" May 21 03:19:33.581721 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.581699 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-59fsx\" (UniqueName: \"kubernetes.io/projected/70d7280d-5779-4c48-b698-9ce8a698bdeb-kube-api-access-59fsx\") pod \"multus-additional-cni-plugins-k7gbn\" (UID: \"70d7280d-5779-4c48-b698-9ce8a698bdeb\") " pod="openshift-multus/multus-additional-cni-plugins-k7gbn" May 21 03:19:33.582133 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.582115 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnrbr\" (UniqueName: \"kubernetes.io/projected/1abd0f75-c601-4162-b828-a203307febed-kube-api-access-gnrbr\") pod \"node-ca-5zqvw\" (UID: \"1abd0f75-c601-4162-b828-a203307febed\") " pod="openshift-image-registry/node-ca-5zqvw" May 21 03:19:33.673012 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.672983 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7300d401-1c04-433f-a767-b2ec61b3d4b4-node-log\") pod \"ovnkube-node-tqqk8\" (UID: \"7300d401-1c04-433f-a767-b2ec61b3d4b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqqk8" May 21 03:19:33.673012 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.673016 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7300d401-1c04-433f-a767-b2ec61b3d4b4-host-cni-bin\") pod \"ovnkube-node-tqqk8\" (UID: \"7300d401-1c04-433f-a767-b2ec61b3d4b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqqk8" May 21 03:19:33.673229 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.673037 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2f51be24-5086-480e-be43-8a11b02ca599-iptables-alerter-script\") pod \"iptables-alerter-vwjdc\" (UID: \"2f51be24-5086-480e-be43-8a11b02ca599\") " pod="openshift-network-operator/iptables-alerter-vwjdc" May 21 03:19:33.673229 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.673077 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7300d401-1c04-433f-a767-b2ec61b3d4b4-host-run-netns\") pod \"ovnkube-node-tqqk8\" (UID: \"7300d401-1c04-433f-a767-b2ec61b3d4b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqqk8" May 21 03:19:33.673229 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.673089 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7300d401-1c04-433f-a767-b2ec61b3d4b4-node-log\") pod \"ovnkube-node-tqqk8\" (UID: \"7300d401-1c04-433f-a767-b2ec61b3d4b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqqk8" May 21 03:19:33.673229 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.673100 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7300d401-1c04-433f-a767-b2ec61b3d4b4-host-cni-bin\") pod \"ovnkube-node-tqqk8\" (UID: \"7300d401-1c04-433f-a767-b2ec61b3d4b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqqk8" May 21 03:19:33.673229 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.673105 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4931c73f-47f4-428d-8602-5e1f4d3cd47a-original-pull-secret\") pod \"global-pull-secret-syncer-vt8z9\" (UID: \"4931c73f-47f4-428d-8602-5e1f4d3cd47a\") " pod="kube-system/global-pull-secret-syncer-vt8z9" May 21 03:19:33.673229 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.673142 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j4lzb\" (UniqueName: \"kubernetes.io/projected/7300d401-1c04-433f-a767-b2ec61b3d4b4-kube-api-access-j4lzb\") pod \"ovnkube-node-tqqk8\" (UID: \"7300d401-1c04-433f-a767-b2ec61b3d4b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqqk8" May 21 03:19:33.673229 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.673149 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7300d401-1c04-433f-a767-b2ec61b3d4b4-host-run-netns\") pod \"ovnkube-node-tqqk8\" (UID: \"7300d401-1c04-433f-a767-b2ec61b3d4b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqqk8" May 21 03:19:33.673229 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.673158 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05b002ff-a785-4372-a115-4fd04746df17-tmp-dir\") pod \"node-resolver-gqltp\" (UID: \"05b002ff-a785-4372-a115-4fd04746df17\") " pod="openshift-dns/node-resolver-gqltp" May 21 03:19:33.673229 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.673186 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/05b002ff-a785-4372-a115-4fd04746df17-hosts-file\") pod \"node-resolver-gqltp\" (UID: \"05b002ff-a785-4372-a115-4fd04746df17\") " pod="openshift-dns/node-resolver-gqltp" May 21 03:19:33.673229 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:33.673199 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 03:19:33.673229 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.673222 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2f51be24-5086-480e-be43-8a11b02ca599-host-slash\") pod \"iptables-alerter-vwjdc\" (UID: \"2f51be24-5086-480e-be43-8a11b02ca599\") " pod="openshift-network-operator/iptables-alerter-vwjdc" May 21 03:19:33.673659 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:33.673260 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4931c73f-47f4-428d-8602-5e1f4d3cd47a-original-pull-secret podName:4931c73f-47f4-428d-8602-5e1f4d3cd47a nodeName:}" failed. No retries permitted until 2026-05-21 03:19:34.173239659 +0000 UTC m=+2.216008565 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4931c73f-47f4-428d-8602-5e1f4d3cd47a-original-pull-secret") pod "global-pull-secret-syncer-vt8z9" (UID: "4931c73f-47f4-428d-8602-5e1f4d3cd47a") : object "kube-system"/"original-pull-secret" not registered May 21 03:19:33.673659 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.673263 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2f51be24-5086-480e-be43-8a11b02ca599-host-slash\") pod \"iptables-alerter-vwjdc\" (UID: \"2f51be24-5086-480e-be43-8a11b02ca599\") " pod="openshift-network-operator/iptables-alerter-vwjdc" May 21 03:19:33.673659 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.673314 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7300d401-1c04-433f-a767-b2ec61b3d4b4-run-openvswitch\") pod \"ovnkube-node-tqqk8\" (UID: \"7300d401-1c04-433f-a767-b2ec61b3d4b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqqk8" May 21 03:19:33.673659 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.673353 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/05b002ff-a785-4372-a115-4fd04746df17-hosts-file\") pod \"node-resolver-gqltp\" (UID: \"05b002ff-a785-4372-a115-4fd04746df17\") " pod="openshift-dns/node-resolver-gqltp" May 21 03:19:33.673659 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.673389 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7300d401-1c04-433f-a767-b2ec61b3d4b4-run-openvswitch\") pod \"ovnkube-node-tqqk8\" (UID: \"7300d401-1c04-433f-a767-b2ec61b3d4b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqqk8" May 21 03:19:33.673659 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.673397 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7300d401-1c04-433f-a767-b2ec61b3d4b4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tqqk8\" (UID: \"7300d401-1c04-433f-a767-b2ec61b3d4b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqqk8" May 21 03:19:33.673659 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.673428 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7300d401-1c04-433f-a767-b2ec61b3d4b4-etc-openvswitch\") pod \"ovnkube-node-tqqk8\" (UID: \"7300d401-1c04-433f-a767-b2ec61b3d4b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqqk8" May 21 03:19:33.673659 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.673430 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7300d401-1c04-433f-a767-b2ec61b3d4b4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tqqk8\" (UID: \"7300d401-1c04-433f-a767-b2ec61b3d4b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqqk8" May 21 03:19:33.673659 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.673455 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05b002ff-a785-4372-a115-4fd04746df17-tmp-dir\") pod \"node-resolver-gqltp\" (UID: \"05b002ff-a785-4372-a115-4fd04746df17\") " pod="openshift-dns/node-resolver-gqltp" May 21 03:19:33.673659 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.673474 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7300d401-1c04-433f-a767-b2ec61b3d4b4-host-run-ovn-kubernetes\") pod \"ovnkube-node-tqqk8\" (UID: \"7300d401-1c04-433f-a767-b2ec61b3d4b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqqk8" May 21 03:19:33.673659 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.673499 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7300d401-1c04-433f-a767-b2ec61b3d4b4-etc-openvswitch\") pod \"ovnkube-node-tqqk8\" (UID: \"7300d401-1c04-433f-a767-b2ec61b3d4b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqqk8" May 21 03:19:33.673659 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.673504 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bgc2z\" (UniqueName: \"kubernetes.io/projected/2f51be24-5086-480e-be43-8a11b02ca599-kube-api-access-bgc2z\") pod \"iptables-alerter-vwjdc\" (UID: \"2f51be24-5086-480e-be43-8a11b02ca599\") " pod="openshift-network-operator/iptables-alerter-vwjdc" May 21 03:19:33.673659 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.673529 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7300d401-1c04-433f-a767-b2ec61b3d4b4-host-run-ovn-kubernetes\") pod \"ovnkube-node-tqqk8\" (UID: \"7300d401-1c04-433f-a767-b2ec61b3d4b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqqk8" May 21 03:19:33.673659 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.673534 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7300d401-1c04-433f-a767-b2ec61b3d4b4-run-systemd\") pod \"ovnkube-node-tqqk8\" (UID: \"7300d401-1c04-433f-a767-b2ec61b3d4b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqqk8" May 21 03:19:33.673659 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.673562 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7300d401-1c04-433f-a767-b2ec61b3d4b4-run-systemd\") pod \"ovnkube-node-tqqk8\" (UID: \"7300d401-1c04-433f-a767-b2ec61b3d4b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqqk8" May 21 03:19:33.673659 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.673573 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2f51be24-5086-480e-be43-8a11b02ca599-iptables-alerter-script\") pod \"iptables-alerter-vwjdc\" (UID: \"2f51be24-5086-480e-be43-8a11b02ca599\") " pod="openshift-network-operator/iptables-alerter-vwjdc" May 21 03:19:33.674362 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.673581 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7300d401-1c04-433f-a767-b2ec61b3d4b4-var-lib-openvswitch\") pod \"ovnkube-node-tqqk8\" (UID: \"7300d401-1c04-433f-a767-b2ec61b3d4b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqqk8" May 21 03:19:33.674362 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.673625 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7300d401-1c04-433f-a767-b2ec61b3d4b4-ovnkube-config\") pod \"ovnkube-node-tqqk8\" (UID: \"7300d401-1c04-433f-a767-b2ec61b3d4b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqqk8" May 21 03:19:33.674362 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.673654 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7300d401-1c04-433f-a767-b2ec61b3d4b4-host-slash\") pod \"ovnkube-node-tqqk8\" (UID: \"7300d401-1c04-433f-a767-b2ec61b3d4b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqqk8" May 21 03:19:33.674362 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.673669 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7300d401-1c04-433f-a767-b2ec61b3d4b4-var-lib-openvswitch\") pod \"ovnkube-node-tqqk8\" (UID: \"7300d401-1c04-433f-a767-b2ec61b3d4b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqqk8" May 21 03:19:33.674362 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.673695 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7300d401-1c04-433f-a767-b2ec61b3d4b4-systemd-units\") pod \"ovnkube-node-tqqk8\" (UID: \"7300d401-1c04-433f-a767-b2ec61b3d4b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqqk8" May 21 03:19:33.674362 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.673716 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7300d401-1c04-433f-a767-b2ec61b3d4b4-host-slash\") pod \"ovnkube-node-tqqk8\" (UID: \"7300d401-1c04-433f-a767-b2ec61b3d4b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqqk8" May 21 03:19:33.674362 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.673719 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7300d401-1c04-433f-a767-b2ec61b3d4b4-host-cni-netd\") pod \"ovnkube-node-tqqk8\" (UID: \"7300d401-1c04-433f-a767-b2ec61b3d4b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqqk8" May 21 03:19:33.674362 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.673748 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7300d401-1c04-433f-a767-b2ec61b3d4b4-host-cni-netd\") pod \"ovnkube-node-tqqk8\" (UID: \"7300d401-1c04-433f-a767-b2ec61b3d4b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqqk8" May 21 03:19:33.674362 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.673749 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7300d401-1c04-433f-a767-b2ec61b3d4b4-env-overrides\") pod \"ovnkube-node-tqqk8\" (UID: \"7300d401-1c04-433f-a767-b2ec61b3d4b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqqk8" May 21 03:19:33.674362 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.673770 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7300d401-1c04-433f-a767-b2ec61b3d4b4-systemd-units\") pod \"ovnkube-node-tqqk8\" (UID: \"7300d401-1c04-433f-a767-b2ec61b3d4b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqqk8" May 21 03:19:33.674362 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.673791 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7300d401-1c04-433f-a767-b2ec61b3d4b4-ovn-node-metrics-cert\") pod \"ovnkube-node-tqqk8\" (UID: \"7300d401-1c04-433f-a767-b2ec61b3d4b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqqk8" May 21 03:19:33.674362 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.673817 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hwdfk\" (UniqueName: \"kubernetes.io/projected/05b002ff-a785-4372-a115-4fd04746df17-kube-api-access-hwdfk\") pod \"node-resolver-gqltp\" (UID: \"05b002ff-a785-4372-a115-4fd04746df17\") " pod="openshift-dns/node-resolver-gqltp" May 21 03:19:33.674362 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.673864 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4931c73f-47f4-428d-8602-5e1f4d3cd47a-dbus\") pod \"global-pull-secret-syncer-vt8z9\" (UID: \"4931c73f-47f4-428d-8602-5e1f4d3cd47a\") " pod="kube-system/global-pull-secret-syncer-vt8z9" May 21 03:19:33.674362 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.673890 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7300d401-1c04-433f-a767-b2ec61b3d4b4-ovnkube-script-lib\") pod \"ovnkube-node-tqqk8\" (UID: \"7300d401-1c04-433f-a767-b2ec61b3d4b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqqk8" May 21 03:19:33.674362 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.673917 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7300d401-1c04-433f-a767-b2ec61b3d4b4-run-ovn\") pod \"ovnkube-node-tqqk8\" (UID: \"7300d401-1c04-433f-a767-b2ec61b3d4b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqqk8" May 21 03:19:33.674362 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.673949 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7300d401-1c04-433f-a767-b2ec61b3d4b4-host-kubelet\") pod \"ovnkube-node-tqqk8\" (UID: \"7300d401-1c04-433f-a767-b2ec61b3d4b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqqk8" May 21 03:19:33.674362 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.674001 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7300d401-1c04-433f-a767-b2ec61b3d4b4-log-socket\") pod \"ovnkube-node-tqqk8\" (UID: \"7300d401-1c04-433f-a767-b2ec61b3d4b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqqk8" May 21 03:19:33.675177 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.674026 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4931c73f-47f4-428d-8602-5e1f4d3cd47a-kubelet-config\") pod \"global-pull-secret-syncer-vt8z9\" (UID: \"4931c73f-47f4-428d-8602-5e1f4d3cd47a\") " pod="kube-system/global-pull-secret-syncer-vt8z9" May 21 03:19:33.675177 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.674063 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7300d401-1c04-433f-a767-b2ec61b3d4b4-host-kubelet\") pod \"ovnkube-node-tqqk8\" (UID: \"7300d401-1c04-433f-a767-b2ec61b3d4b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqqk8" May 21 03:19:33.675177 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.674100 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4931c73f-47f4-428d-8602-5e1f4d3cd47a-kubelet-config\") pod \"global-pull-secret-syncer-vt8z9\" (UID: \"4931c73f-47f4-428d-8602-5e1f4d3cd47a\") " pod="kube-system/global-pull-secret-syncer-vt8z9" May 21 03:19:33.675177 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.674108 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7300d401-1c04-433f-a767-b2ec61b3d4b4-run-ovn\") pod \"ovnkube-node-tqqk8\" (UID: \"7300d401-1c04-433f-a767-b2ec61b3d4b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqqk8" May 21 03:19:33.675177 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.674133 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7300d401-1c04-433f-a767-b2ec61b3d4b4-ovnkube-config\") pod \"ovnkube-node-tqqk8\" (UID: \"7300d401-1c04-433f-a767-b2ec61b3d4b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqqk8" May 21 03:19:33.675177 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.674143 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7300d401-1c04-433f-a767-b2ec61b3d4b4-log-socket\") pod \"ovnkube-node-tqqk8\" (UID: \"7300d401-1c04-433f-a767-b2ec61b3d4b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqqk8" May 21 03:19:33.675177 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.674375 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7300d401-1c04-433f-a767-b2ec61b3d4b4-env-overrides\") pod \"ovnkube-node-tqqk8\" (UID: \"7300d401-1c04-433f-a767-b2ec61b3d4b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqqk8" May 21 03:19:33.675177 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.674715 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7300d401-1c04-433f-a767-b2ec61b3d4b4-ovnkube-script-lib\") pod \"ovnkube-node-tqqk8\" (UID: \"7300d401-1c04-433f-a767-b2ec61b3d4b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqqk8" May 21 03:19:33.675177 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.674816 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4931c73f-47f4-428d-8602-5e1f4d3cd47a-dbus\") pod \"global-pull-secret-syncer-vt8z9\" (UID: \"4931c73f-47f4-428d-8602-5e1f4d3cd47a\") " pod="kube-system/global-pull-secret-syncer-vt8z9" May 21 03:19:33.675177 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.674906 2574 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 21 03:19:33.676134 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.676117 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7300d401-1c04-433f-a767-b2ec61b3d4b4-ovn-node-metrics-cert\") pod \"ovnkube-node-tqqk8\" (UID: \"7300d401-1c04-433f-a767-b2ec61b3d4b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqqk8" May 21 03:19:33.681511 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.681492 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4lzb\" (UniqueName: \"kubernetes.io/projected/7300d401-1c04-433f-a767-b2ec61b3d4b4-kube-api-access-j4lzb\") pod \"ovnkube-node-tqqk8\" (UID: \"7300d401-1c04-433f-a767-b2ec61b3d4b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqqk8" May 21 03:19:33.681713 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.681691 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwdfk\" (UniqueName: \"kubernetes.io/projected/05b002ff-a785-4372-a115-4fd04746df17-kube-api-access-hwdfk\") pod \"node-resolver-gqltp\" (UID: \"05b002ff-a785-4372-a115-4fd04746df17\") " pod="openshift-dns/node-resolver-gqltp" May 21 03:19:33.682281 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.682267 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgc2z\" (UniqueName: \"kubernetes.io/projected/2f51be24-5086-480e-be43-8a11b02ca599-kube-api-access-bgc2z\") pod \"iptables-alerter-vwjdc\" (UID: \"2f51be24-5086-480e-be43-8a11b02ca599\") " pod="openshift-network-operator/iptables-alerter-vwjdc" May 21 03:19:33.689558 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:33.689488 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3204d4e276a6036a6def62b77dcf7af.slice/crio-28a9b5abe0803aaf46bafcd1a2045f8a854b6e83da7f9fe14730dced6c0c0a05 WatchSource:0}: Error finding container 28a9b5abe0803aaf46bafcd1a2045f8a854b6e83da7f9fe14730dced6c0c0a05: Status 404 returned error can't find the container with id 28a9b5abe0803aaf46bafcd1a2045f8a854b6e83da7f9fe14730dced6c0c0a05 May 21 03:19:33.689827 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:33.689808 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b79a830b6f70433eb778f4f12409255.slice/crio-23c5810b33a5f8c29f2262dba4cc6dccac8c6ba579c8d18fe03770f11963b46b WatchSource:0}: Error finding container 23c5810b33a5f8c29f2262dba4cc6dccac8c6ba579c8d18fe03770f11963b46b: Status 404 returned error can't find the container with id 23c5810b33a5f8c29f2262dba4cc6dccac8c6ba579c8d18fe03770f11963b46b May 21 03:19:33.694283 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.694268 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 03:19:33.774267 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.774220 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8nncl" May 21 03:19:33.779340 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.779310 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6gmv" May 21 03:19:33.780996 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:33.780971 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74fe87f5_634c_48e6_85b9_357a3b4d02f9.slice/crio-c64c6556b653f3ed0f80d6353b9b681b847558ffaa53fedfc478a0f1079c5660 WatchSource:0}: Error finding container c64c6556b653f3ed0f80d6353b9b681b847558ffaa53fedfc478a0f1079c5660: Status 404 returned error can't find the container with id c64c6556b653f3ed0f80d6353b9b681b847558ffaa53fedfc478a0f1079c5660 May 21 03:19:33.786069 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:33.786039 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb19e3ebd_ec1e_4bdd_b766_79a3c736fe56.slice/crio-b2621cec595d065c27f344de44f190b70485da6691059e06b8b8c4d47d594bb1 WatchSource:0}: Error finding container b2621cec595d065c27f344de44f190b70485da6691059e06b8b8c4d47d594bb1: Status 404 returned error can't find the container with id b2621cec595d065c27f344de44f190b70485da6691059e06b8b8c4d47d594bb1 May 21 03:19:33.806709 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.806666 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-k7gbn" May 21 03:19:33.812930 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:33.812904 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70d7280d_5779_4c48_b698_9ce8a698bdeb.slice/crio-f311421a695bfd12a710c6044a20520ce99cdf8538c620965388e9896b2a5dfe WatchSource:0}: Error finding container f311421a695bfd12a710c6044a20520ce99cdf8538c620965388e9896b2a5dfe: Status 404 returned error can't find the container with id f311421a695bfd12a710c6044a20520ce99cdf8538c620965388e9896b2a5dfe May 21 03:19:33.824037 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.824017 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pppx8" May 21 03:19:33.831305 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:33.831263 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a110770_ece5_4091_a30a_46b820e75cae.slice/crio-1a6a11b7d8a225e27b4a30d01ba0a88d3d18a6f54a2222af7884d4037ac6f165 WatchSource:0}: Error finding container 1a6a11b7d8a225e27b4a30d01ba0a88d3d18a6f54a2222af7884d4037ac6f165: Status 404 returned error can't find the container with id 1a6a11b7d8a225e27b4a30d01ba0a88d3d18a6f54a2222af7884d4037ac6f165 May 21 03:19:33.836245 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.836227 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vfdck" May 21 03:19:33.841550 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.841524 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5zqvw" May 21 03:19:33.841779 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:33.841761 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87a77bd0_28c8_408f_9bdd_17c8bb0ae511.slice/crio-8da12131f15d8d501451a1f0c53d443923b67597959cb7810d7879136ac6bfdb WatchSource:0}: Error finding container 8da12131f15d8d501451a1f0c53d443923b67597959cb7810d7879136ac6bfdb: Status 404 returned error can't find the container with id 8da12131f15d8d501451a1f0c53d443923b67597959cb7810d7879136ac6bfdb May 21 03:19:33.847730 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:33.847707 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1abd0f75_c601_4162_b828_a203307febed.slice/crio-d36cbd01a5a4308b1e925547dd9948441a99ce2ef14a2f75299e26680bf358a9 WatchSource:0}: Error finding container d36cbd01a5a4308b1e925547dd9948441a99ce2ef14a2f75299e26680bf358a9: Status 404 returned error can't find the container with id d36cbd01a5a4308b1e925547dd9948441a99ce2ef14a2f75299e26680bf358a9 May 21 03:19:33.868535 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.868514 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tqqk8" May 21 03:19:33.874365 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:33.874342 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7300d401_1c04_433f_a767_b2ec61b3d4b4.slice/crio-873c69f62d070b7a62a30ab77e6976c9fbad52e9ae04138d1d24da8de74018a4 WatchSource:0}: Error finding container 873c69f62d070b7a62a30ab77e6976c9fbad52e9ae04138d1d24da8de74018a4: Status 404 returned error can't find the container with id 873c69f62d070b7a62a30ab77e6976c9fbad52e9ae04138d1d24da8de74018a4 May 21 03:19:33.891176 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.891156 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gqltp" May 21 03:19:33.895720 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:33.895694 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vwjdc" May 21 03:19:33.897264 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:33.897240 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05b002ff_a785_4372_a115_4fd04746df17.slice/crio-ac4dd238638a42597b6d6b72a863ed3d8afbf602139d6686f8886cca86fef947 WatchSource:0}: Error finding container ac4dd238638a42597b6d6b72a863ed3d8afbf602139d6686f8886cca86fef947: Status 404 returned error can't find the container with id ac4dd238638a42597b6d6b72a863ed3d8afbf602139d6686f8886cca86fef947 May 21 03:19:33.902583 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:19:33.902561 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f51be24_5086_480e_be43_8a11b02ca599.slice/crio-ea68e711ff6ff9545a49777c25732c4bc0cf21c894881032c92c9cc546b1dad5 WatchSource:0}: Error finding container ea68e711ff6ff9545a49777c25732c4bc0cf21c894881032c92c9cc546b1dad5: Status 404 returned error can't find the container with id ea68e711ff6ff9545a49777c25732c4bc0cf21c894881032c92c9cc546b1dad5 May 21 03:19:34.075866 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:34.075765 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f628q\" (UniqueName: \"kubernetes.io/projected/168bd0e1-6421-4c11-8ef2-8caf34170ae9-kube-api-access-f628q\") pod \"network-check-target-skpvq\" (UID: \"168bd0e1-6421-4c11-8ef2-8caf34170ae9\") " pod="openshift-network-diagnostics/network-check-target-skpvq" May 21 03:19:34.075866 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:34.075809 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a03c959-a5a9-44f4-89f3-d604f293b8a0-metrics-certs\") pod \"network-metrics-daemon-7vr9p\" (UID: \"1a03c959-a5a9-44f4-89f3-d604f293b8a0\") " pod="openshift-multus/network-metrics-daemon-7vr9p" May 21 03:19:34.076055 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:34.075924 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 03:19:34.076055 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:34.075942 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 03:19:34.076055 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:34.075963 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 03:19:34.076055 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:34.075975 2574 projected.go:194] Error preparing data for projected volume kube-api-access-f628q for pod openshift-network-diagnostics/network-check-target-skpvq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 03:19:34.076055 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:34.075979 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a03c959-a5a9-44f4-89f3-d604f293b8a0-metrics-certs podName:1a03c959-a5a9-44f4-89f3-d604f293b8a0 nodeName:}" failed. No retries permitted until 2026-05-21 03:19:35.075965196 +0000 UTC m=+3.118734089 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1a03c959-a5a9-44f4-89f3-d604f293b8a0-metrics-certs") pod "network-metrics-daemon-7vr9p" (UID: "1a03c959-a5a9-44f4-89f3-d604f293b8a0") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 03:19:34.076055 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:34.076014 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/168bd0e1-6421-4c11-8ef2-8caf34170ae9-kube-api-access-f628q podName:168bd0e1-6421-4c11-8ef2-8caf34170ae9 nodeName:}" failed. No retries permitted until 2026-05-21 03:19:35.076002808 +0000 UTC m=+3.118771703 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-f628q" (UniqueName: "kubernetes.io/projected/168bd0e1-6421-4c11-8ef2-8caf34170ae9-kube-api-access-f628q") pod "network-check-target-skpvq" (UID: "168bd0e1-6421-4c11-8ef2-8caf34170ae9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 03:19:34.177009 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:34.176972 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4931c73f-47f4-428d-8602-5e1f4d3cd47a-original-pull-secret\") pod \"global-pull-secret-syncer-vt8z9\" (UID: \"4931c73f-47f4-428d-8602-5e1f4d3cd47a\") " pod="kube-system/global-pull-secret-syncer-vt8z9" May 21 03:19:34.177180 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:34.177134 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 03:19:34.177251 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:34.177214 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4931c73f-47f4-428d-8602-5e1f4d3cd47a-original-pull-secret podName:4931c73f-47f4-428d-8602-5e1f4d3cd47a nodeName:}" failed. No retries permitted until 2026-05-21 03:19:35.177192407 +0000 UTC m=+3.219961302 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4931c73f-47f4-428d-8602-5e1f4d3cd47a-original-pull-secret") pod "global-pull-secret-syncer-vt8z9" (UID: "4931c73f-47f4-428d-8602-5e1f4d3cd47a") : object "kube-system"/"original-pull-secret" not registered May 21 03:19:34.474718 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:34.474686 2574 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 21 03:19:34.515275 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:34.515230 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 03:14:33 +0000 UTC" deadline="2027-12-10 02:29:19.044025241 +0000 UTC" May 21 03:19:34.515275 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:34.515272 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13631h9m44.528756657s" May 21 03:19:34.592460 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:34.592412 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6gmv" event={"ID":"b19e3ebd-ec1e-4bdd-b766-79a3c736fe56","Type":"ContainerStarted","Data":"b2621cec595d065c27f344de44f190b70485da6691059e06b8b8c4d47d594bb1"} May 21 03:19:34.599656 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:34.599604 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-161.ec2.internal" event={"ID":"b3204d4e276a6036a6def62b77dcf7af","Type":"ContainerStarted","Data":"28a9b5abe0803aaf46bafcd1a2045f8a854b6e83da7f9fe14730dced6c0c0a05"} May 21 03:19:34.604013 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:34.603978 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vwjdc" event={"ID":"2f51be24-5086-480e-be43-8a11b02ca599","Type":"ContainerStarted","Data":"ea68e711ff6ff9545a49777c25732c4bc0cf21c894881032c92c9cc546b1dad5"} May 21 03:19:34.609781 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:34.609741 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gqltp" event={"ID":"05b002ff-a785-4372-a115-4fd04746df17","Type":"ContainerStarted","Data":"ac4dd238638a42597b6d6b72a863ed3d8afbf602139d6686f8886cca86fef947"} May 21 03:19:34.612619 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:34.612594 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tqqk8" event={"ID":"7300d401-1c04-433f-a767-b2ec61b3d4b4","Type":"ContainerStarted","Data":"873c69f62d070b7a62a30ab77e6976c9fbad52e9ae04138d1d24da8de74018a4"} May 21 03:19:34.617194 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:34.617139 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vfdck" event={"ID":"87a77bd0-28c8-408f-9bdd-17c8bb0ae511","Type":"ContainerStarted","Data":"8da12131f15d8d501451a1f0c53d443923b67597959cb7810d7879136ac6bfdb"} May 21 03:19:34.622141 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:34.622112 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k7gbn" event={"ID":"70d7280d-5779-4c48-b698-9ce8a698bdeb","Type":"ContainerStarted","Data":"f311421a695bfd12a710c6044a20520ce99cdf8538c620965388e9896b2a5dfe"} May 21 03:19:34.643158 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:34.643117 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8nncl" event={"ID":"74fe87f5-634c-48e6-85b9-357a3b4d02f9","Type":"ContainerStarted","Data":"c64c6556b653f3ed0f80d6353b9b681b847558ffaa53fedfc478a0f1079c5660"} May 21 03:19:34.660964 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:34.660923 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-161.ec2.internal" event={"ID":"8b79a830b6f70433eb778f4f12409255","Type":"ContainerStarted","Data":"23c5810b33a5f8c29f2262dba4cc6dccac8c6ba579c8d18fe03770f11963b46b"} May 21 03:19:34.678553 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:34.678516 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5zqvw" event={"ID":"1abd0f75-c601-4162-b828-a203307febed","Type":"ContainerStarted","Data":"d36cbd01a5a4308b1e925547dd9948441a99ce2ef14a2f75299e26680bf358a9"} May 21 03:19:34.683916 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:34.683882 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pppx8" event={"ID":"4a110770-ece5-4091-a30a-46b820e75cae","Type":"ContainerStarted","Data":"1a6a11b7d8a225e27b4a30d01ba0a88d3d18a6f54a2222af7884d4037ac6f165"} May 21 03:19:35.084270 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:35.084222 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f628q\" (UniqueName: \"kubernetes.io/projected/168bd0e1-6421-4c11-8ef2-8caf34170ae9-kube-api-access-f628q\") pod \"network-check-target-skpvq\" (UID: \"168bd0e1-6421-4c11-8ef2-8caf34170ae9\") " pod="openshift-network-diagnostics/network-check-target-skpvq" May 21 03:19:35.084443 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:35.084290 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a03c959-a5a9-44f4-89f3-d604f293b8a0-metrics-certs\") pod \"network-metrics-daemon-7vr9p\" (UID: \"1a03c959-a5a9-44f4-89f3-d604f293b8a0\") " pod="openshift-multus/network-metrics-daemon-7vr9p" May 21 03:19:35.084443 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:35.084426 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 03:19:35.084557 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:35.084489 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a03c959-a5a9-44f4-89f3-d604f293b8a0-metrics-certs podName:1a03c959-a5a9-44f4-89f3-d604f293b8a0 nodeName:}" failed. No retries permitted until 2026-05-21 03:19:37.084470791 +0000 UTC m=+5.127239688 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1a03c959-a5a9-44f4-89f3-d604f293b8a0-metrics-certs") pod "network-metrics-daemon-7vr9p" (UID: "1a03c959-a5a9-44f4-89f3-d604f293b8a0") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 03:19:35.085025 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:35.085003 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 03:19:35.085142 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:35.085031 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 03:19:35.085142 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:35.085045 2574 projected.go:194] Error preparing data for projected volume kube-api-access-f628q for pod openshift-network-diagnostics/network-check-target-skpvq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 03:19:35.085142 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:35.085095 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/168bd0e1-6421-4c11-8ef2-8caf34170ae9-kube-api-access-f628q podName:168bd0e1-6421-4c11-8ef2-8caf34170ae9 nodeName:}" failed. No retries permitted until 2026-05-21 03:19:37.085079435 +0000 UTC m=+5.127848342 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-f628q" (UniqueName: "kubernetes.io/projected/168bd0e1-6421-4c11-8ef2-8caf34170ae9-kube-api-access-f628q") pod "network-check-target-skpvq" (UID: "168bd0e1-6421-4c11-8ef2-8caf34170ae9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 03:19:35.184924 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:35.184883 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4931c73f-47f4-428d-8602-5e1f4d3cd47a-original-pull-secret\") pod \"global-pull-secret-syncer-vt8z9\" (UID: \"4931c73f-47f4-428d-8602-5e1f4d3cd47a\") " pod="kube-system/global-pull-secret-syncer-vt8z9" May 21 03:19:35.185111 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:35.185078 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 03:19:35.185174 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:35.185154 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4931c73f-47f4-428d-8602-5e1f4d3cd47a-original-pull-secret podName:4931c73f-47f4-428d-8602-5e1f4d3cd47a nodeName:}" failed. No retries permitted until 2026-05-21 03:19:37.185134649 +0000 UTC m=+5.227903544 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4931c73f-47f4-428d-8602-5e1f4d3cd47a-original-pull-secret") pod "global-pull-secret-syncer-vt8z9" (UID: "4931c73f-47f4-428d-8602-5e1f4d3cd47a") : object "kube-system"/"original-pull-secret" not registered May 21 03:19:35.515464 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:35.515415 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 03:14:33 +0000 UTC" deadline="2027-10-16 14:49:26.013324544 +0000 UTC" May 21 03:19:35.515464 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:35.515460 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12323h29m50.497867714s" May 21 03:19:35.584796 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:35.584760 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7vr9p" May 21 03:19:35.585009 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:35.584922 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7vr9p" podUID="1a03c959-a5a9-44f4-89f3-d604f293b8a0" May 21 03:19:35.585361 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:35.585338 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-skpvq" May 21 03:19:35.585455 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:35.585438 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-skpvq" podUID="168bd0e1-6421-4c11-8ef2-8caf34170ae9" May 21 03:19:35.585576 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:35.585559 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vt8z9" May 21 03:19:35.585668 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:35.585641 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vt8z9" podUID="4931c73f-47f4-428d-8602-5e1f4d3cd47a" May 21 03:19:37.101279 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:37.101243 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f628q\" (UniqueName: \"kubernetes.io/projected/168bd0e1-6421-4c11-8ef2-8caf34170ae9-kube-api-access-f628q\") pod \"network-check-target-skpvq\" (UID: \"168bd0e1-6421-4c11-8ef2-8caf34170ae9\") " pod="openshift-network-diagnostics/network-check-target-skpvq" May 21 03:19:37.101740 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:37.101300 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a03c959-a5a9-44f4-89f3-d604f293b8a0-metrics-certs\") pod \"network-metrics-daemon-7vr9p\" (UID: \"1a03c959-a5a9-44f4-89f3-d604f293b8a0\") " pod="openshift-multus/network-metrics-daemon-7vr9p" May 21 03:19:37.101740 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:37.101402 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 03:19:37.101740 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:37.101429 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 03:19:37.101740 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:37.101450 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a03c959-a5a9-44f4-89f3-d604f293b8a0-metrics-certs podName:1a03c959-a5a9-44f4-89f3-d604f293b8a0 nodeName:}" failed. No retries permitted until 2026-05-21 03:19:41.101437553 +0000 UTC m=+9.144206445 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1a03c959-a5a9-44f4-89f3-d604f293b8a0-metrics-certs") pod "network-metrics-daemon-7vr9p" (UID: "1a03c959-a5a9-44f4-89f3-d604f293b8a0") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 03:19:37.101740 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:37.101455 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 03:19:37.101740 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:37.101474 2574 projected.go:194] Error preparing data for projected volume kube-api-access-f628q for pod openshift-network-diagnostics/network-check-target-skpvq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 03:19:37.101740 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:37.101527 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/168bd0e1-6421-4c11-8ef2-8caf34170ae9-kube-api-access-f628q podName:168bd0e1-6421-4c11-8ef2-8caf34170ae9 nodeName:}" failed. No retries permitted until 2026-05-21 03:19:41.10151159 +0000 UTC m=+9.144280501 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-f628q" (UniqueName: "kubernetes.io/projected/168bd0e1-6421-4c11-8ef2-8caf34170ae9-kube-api-access-f628q") pod "network-check-target-skpvq" (UID: "168bd0e1-6421-4c11-8ef2-8caf34170ae9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 03:19:37.201962 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:37.201923 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4931c73f-47f4-428d-8602-5e1f4d3cd47a-original-pull-secret\") pod \"global-pull-secret-syncer-vt8z9\" (UID: \"4931c73f-47f4-428d-8602-5e1f4d3cd47a\") " pod="kube-system/global-pull-secret-syncer-vt8z9" May 21 03:19:37.202139 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:37.202089 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 03:19:37.202220 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:37.202153 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4931c73f-47f4-428d-8602-5e1f4d3cd47a-original-pull-secret podName:4931c73f-47f4-428d-8602-5e1f4d3cd47a nodeName:}" failed. No retries permitted until 2026-05-21 03:19:41.202135917 +0000 UTC m=+9.244904822 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4931c73f-47f4-428d-8602-5e1f4d3cd47a-original-pull-secret") pod "global-pull-secret-syncer-vt8z9" (UID: "4931c73f-47f4-428d-8602-5e1f4d3cd47a") : object "kube-system"/"original-pull-secret" not registered May 21 03:19:37.585215 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:37.585141 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-skpvq" May 21 03:19:37.585406 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:37.585273 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-skpvq" podUID="168bd0e1-6421-4c11-8ef2-8caf34170ae9" May 21 03:19:37.585710 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:37.585532 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7vr9p" May 21 03:19:37.585710 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:37.585149 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vt8z9" May 21 03:19:37.585710 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:37.585653 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7vr9p" podUID="1a03c959-a5a9-44f4-89f3-d604f293b8a0" May 21 03:19:37.585925 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:37.585730 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vt8z9" podUID="4931c73f-47f4-428d-8602-5e1f4d3cd47a" May 21 03:19:39.585222 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:39.585171 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vt8z9" May 21 03:19:39.585734 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:39.585287 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vt8z9" podUID="4931c73f-47f4-428d-8602-5e1f4d3cd47a" May 21 03:19:39.585734 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:39.585608 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7vr9p" May 21 03:19:39.585734 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:39.585681 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7vr9p" podUID="1a03c959-a5a9-44f4-89f3-d604f293b8a0" May 21 03:19:39.585734 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:39.585724 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-skpvq" May 21 03:19:39.585905 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:39.585768 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-skpvq" podUID="168bd0e1-6421-4c11-8ef2-8caf34170ae9" May 21 03:19:41.132906 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:41.132863 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a03c959-a5a9-44f4-89f3-d604f293b8a0-metrics-certs\") pod \"network-metrics-daemon-7vr9p\" (UID: \"1a03c959-a5a9-44f4-89f3-d604f293b8a0\") " pod="openshift-multus/network-metrics-daemon-7vr9p" May 21 03:19:41.133300 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:41.132958 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f628q\" (UniqueName: \"kubernetes.io/projected/168bd0e1-6421-4c11-8ef2-8caf34170ae9-kube-api-access-f628q\") pod \"network-check-target-skpvq\" (UID: \"168bd0e1-6421-4c11-8ef2-8caf34170ae9\") " pod="openshift-network-diagnostics/network-check-target-skpvq" May 21 03:19:41.133300 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:41.133090 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 03:19:41.133300 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:41.133108 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 03:19:41.133300 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:41.133121 2574 projected.go:194] Error preparing data for projected volume kube-api-access-f628q for pod openshift-network-diagnostics/network-check-target-skpvq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 03:19:41.133300 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:41.133175 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/168bd0e1-6421-4c11-8ef2-8caf34170ae9-kube-api-access-f628q podName:168bd0e1-6421-4c11-8ef2-8caf34170ae9 nodeName:}" failed. No retries permitted until 2026-05-21 03:19:49.133156758 +0000 UTC m=+17.175925656 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-f628q" (UniqueName: "kubernetes.io/projected/168bd0e1-6421-4c11-8ef2-8caf34170ae9-kube-api-access-f628q") pod "network-check-target-skpvq" (UID: "168bd0e1-6421-4c11-8ef2-8caf34170ae9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 03:19:41.133575 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:41.133560 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 03:19:41.133631 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:41.133613 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a03c959-a5a9-44f4-89f3-d604f293b8a0-metrics-certs podName:1a03c959-a5a9-44f4-89f3-d604f293b8a0 nodeName:}" failed. No retries permitted until 2026-05-21 03:19:49.133597692 +0000 UTC m=+17.176366585 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1a03c959-a5a9-44f4-89f3-d604f293b8a0-metrics-certs") pod "network-metrics-daemon-7vr9p" (UID: "1a03c959-a5a9-44f4-89f3-d604f293b8a0") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 03:19:41.233429 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:41.233383 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4931c73f-47f4-428d-8602-5e1f4d3cd47a-original-pull-secret\") pod \"global-pull-secret-syncer-vt8z9\" (UID: \"4931c73f-47f4-428d-8602-5e1f4d3cd47a\") " pod="kube-system/global-pull-secret-syncer-vt8z9" May 21 03:19:41.233605 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:41.233577 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 03:19:41.233660 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:41.233623 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4931c73f-47f4-428d-8602-5e1f4d3cd47a-original-pull-secret podName:4931c73f-47f4-428d-8602-5e1f4d3cd47a nodeName:}" failed. No retries permitted until 2026-05-21 03:19:49.233610805 +0000 UTC m=+17.276379710 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4931c73f-47f4-428d-8602-5e1f4d3cd47a-original-pull-secret") pod "global-pull-secret-syncer-vt8z9" (UID: "4931c73f-47f4-428d-8602-5e1f4d3cd47a") : object "kube-system"/"original-pull-secret" not registered May 21 03:19:41.585208 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:41.585131 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-skpvq" May 21 03:19:41.585346 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:41.585283 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-skpvq" podUID="168bd0e1-6421-4c11-8ef2-8caf34170ae9" May 21 03:19:41.585346 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:41.585131 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vt8z9" May 21 03:19:41.585414 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:41.585377 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vt8z9" podUID="4931c73f-47f4-428d-8602-5e1f4d3cd47a" May 21 03:19:41.585414 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:41.585131 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7vr9p" May 21 03:19:41.585474 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:41.585463 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7vr9p" podUID="1a03c959-a5a9-44f4-89f3-d604f293b8a0" May 21 03:19:43.585236 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:43.585199 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-skpvq" May 21 03:19:43.585693 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:43.585323 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vt8z9" May 21 03:19:43.585693 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:43.585434 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vt8z9" podUID="4931c73f-47f4-428d-8602-5e1f4d3cd47a" May 21 03:19:43.585693 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:43.585319 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-skpvq" podUID="168bd0e1-6421-4c11-8ef2-8caf34170ae9" May 21 03:19:43.585693 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:43.585488 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7vr9p" May 21 03:19:43.585693 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:43.585567 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7vr9p" podUID="1a03c959-a5a9-44f4-89f3-d604f293b8a0" May 21 03:19:45.584757 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:45.584521 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7vr9p" May 21 03:19:45.585191 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:45.584521 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-skpvq" May 21 03:19:45.585191 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:45.584799 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7vr9p" podUID="1a03c959-a5a9-44f4-89f3-d604f293b8a0" May 21 03:19:45.585191 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:45.584912 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-skpvq" podUID="168bd0e1-6421-4c11-8ef2-8caf34170ae9" May 21 03:19:45.585191 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:45.584521 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vt8z9" May 21 03:19:45.585191 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:45.585048 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vt8z9" podUID="4931c73f-47f4-428d-8602-5e1f4d3cd47a" May 21 03:19:47.585244 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:47.585208 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-skpvq" May 21 03:19:47.585667 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:47.585256 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vt8z9" May 21 03:19:47.585667 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:47.585311 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7vr9p" May 21 03:19:47.585667 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:47.585388 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-skpvq" podUID="168bd0e1-6421-4c11-8ef2-8caf34170ae9" May 21 03:19:47.585667 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:47.585469 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vt8z9" podUID="4931c73f-47f4-428d-8602-5e1f4d3cd47a" May 21 03:19:47.585667 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:47.585547 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7vr9p" podUID="1a03c959-a5a9-44f4-89f3-d604f293b8a0" May 21 03:19:49.193138 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:49.193109 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f628q\" (UniqueName: \"kubernetes.io/projected/168bd0e1-6421-4c11-8ef2-8caf34170ae9-kube-api-access-f628q\") pod \"network-check-target-skpvq\" (UID: \"168bd0e1-6421-4c11-8ef2-8caf34170ae9\") " pod="openshift-network-diagnostics/network-check-target-skpvq" May 21 03:19:49.193561 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:49.193159 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a03c959-a5a9-44f4-89f3-d604f293b8a0-metrics-certs\") pod \"network-metrics-daemon-7vr9p\" (UID: \"1a03c959-a5a9-44f4-89f3-d604f293b8a0\") " pod="openshift-multus/network-metrics-daemon-7vr9p" May 21 03:19:49.193561 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:49.193251 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 03:19:49.193561 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:49.193329 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a03c959-a5a9-44f4-89f3-d604f293b8a0-metrics-certs podName:1a03c959-a5a9-44f4-89f3-d604f293b8a0 nodeName:}" failed. No retries permitted until 2026-05-21 03:20:05.193308533 +0000 UTC m=+33.236077431 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1a03c959-a5a9-44f4-89f3-d604f293b8a0-metrics-certs") pod "network-metrics-daemon-7vr9p" (UID: "1a03c959-a5a9-44f4-89f3-d604f293b8a0") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 03:19:49.193761 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:49.193745 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 03:19:49.193801 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:49.193773 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 03:19:49.193801 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:49.193789 2574 projected.go:194] Error preparing data for projected volume kube-api-access-f628q for pod openshift-network-diagnostics/network-check-target-skpvq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 03:19:49.193895 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:49.193860 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/168bd0e1-6421-4c11-8ef2-8caf34170ae9-kube-api-access-f628q podName:168bd0e1-6421-4c11-8ef2-8caf34170ae9 nodeName:}" failed. No retries permitted until 2026-05-21 03:20:05.193828622 +0000 UTC m=+33.236597514 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-f628q" (UniqueName: "kubernetes.io/projected/168bd0e1-6421-4c11-8ef2-8caf34170ae9-kube-api-access-f628q") pod "network-check-target-skpvq" (UID: "168bd0e1-6421-4c11-8ef2-8caf34170ae9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 03:19:49.293899 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:49.293862 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4931c73f-47f4-428d-8602-5e1f4d3cd47a-original-pull-secret\") pod \"global-pull-secret-syncer-vt8z9\" (UID: \"4931c73f-47f4-428d-8602-5e1f4d3cd47a\") " pod="kube-system/global-pull-secret-syncer-vt8z9" May 21 03:19:49.294056 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:49.294015 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 03:19:49.294112 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:49.294090 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4931c73f-47f4-428d-8602-5e1f4d3cd47a-original-pull-secret podName:4931c73f-47f4-428d-8602-5e1f4d3cd47a nodeName:}" failed. No retries permitted until 2026-05-21 03:20:05.294069344 +0000 UTC m=+33.336838241 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4931c73f-47f4-428d-8602-5e1f4d3cd47a-original-pull-secret") pod "global-pull-secret-syncer-vt8z9" (UID: "4931c73f-47f4-428d-8602-5e1f4d3cd47a") : object "kube-system"/"original-pull-secret" not registered May 21 03:19:49.585057 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:49.584962 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-skpvq" May 21 03:19:49.585057 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:49.584995 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vt8z9" May 21 03:19:49.585276 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:49.585073 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-skpvq" podUID="168bd0e1-6421-4c11-8ef2-8caf34170ae9" May 21 03:19:49.585276 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:49.585111 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7vr9p" May 21 03:19:49.585276 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:49.585236 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vt8z9" podUID="4931c73f-47f4-428d-8602-5e1f4d3cd47a" May 21 03:19:49.585411 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:49.585328 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7vr9p" podUID="1a03c959-a5a9-44f4-89f3-d604f293b8a0" May 21 03:19:51.584865 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:51.584817 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vt8z9" May 21 03:19:51.585324 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:51.584817 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-skpvq" May 21 03:19:51.585324 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:51.584964 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vt8z9" podUID="4931c73f-47f4-428d-8602-5e1f4d3cd47a" May 21 03:19:51.585324 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:51.585047 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-skpvq" podUID="168bd0e1-6421-4c11-8ef2-8caf34170ae9" May 21 03:19:51.585324 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:51.584817 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7vr9p" May 21 03:19:51.585324 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:51.585154 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7vr9p" podUID="1a03c959-a5a9-44f4-89f3-d604f293b8a0" May 21 03:19:53.584805 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:53.584779 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7vr9p" May 21 03:19:53.585181 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:53.584806 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vt8z9" May 21 03:19:53.585181 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:53.584780 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-skpvq" May 21 03:19:53.585181 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:53.584938 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7vr9p" podUID="1a03c959-a5a9-44f4-89f3-d604f293b8a0" May 21 03:19:53.585181 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:53.585078 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vt8z9" podUID="4931c73f-47f4-428d-8602-5e1f4d3cd47a" May 21 03:19:53.585181 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:53.585163 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-skpvq" podUID="168bd0e1-6421-4c11-8ef2-8caf34170ae9" May 21 03:19:53.745735 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:53.745695 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vfdck" event={"ID":"87a77bd0-28c8-408f-9bdd-17c8bb0ae511","Type":"ContainerStarted","Data":"ac7444f1b64599def40e55787a1874c50dcab7c7555e74fd7fe1e6d9ec8ab1c8"} May 21 03:19:53.747582 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:53.747547 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pppx8" event={"ID":"4a110770-ece5-4091-a30a-46b820e75cae","Type":"ContainerStarted","Data":"03efe7518be7cbed5987f6cd9c838305201de0ec1dbfbcb5dab90b010b5c0d73"} May 21 03:19:53.764286 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:53.764254 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-161.ec2.internal" event={"ID":"b3204d4e276a6036a6def62b77dcf7af","Type":"ContainerStarted","Data":"8b1acc5231485658610747cf3031d855c977eb198480cd574dceacd31069ecf0"} May 21 03:19:53.764926 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:53.764808 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-pppx8" podStartSLOduration=2.146339127 podStartE2EDuration="21.76479571s" podCreationTimestamp="2026-05-21 03:19:32 +0000 UTC" firstStartedPulling="2026-05-21 03:19:33.832789574 +0000 UTC m=+1.875558466" lastFinishedPulling="2026-05-21 03:19:53.451246146 +0000 UTC m=+21.494015049" observedRunningTime="2026-05-21 03:19:53.763305156 +0000 UTC m=+21.806074071" watchObservedRunningTime="2026-05-21 03:19:53.76479571 +0000 UTC m=+21.807564624" May 21 03:19:53.790825 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:53.790727 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-vfdck" podStartSLOduration=2.182101072 podStartE2EDuration="21.790708835s" podCreationTimestamp="2026-05-21 03:19:32 +0000 UTC" firstStartedPulling="2026-05-21 03:19:33.843285843 +0000 UTC m=+1.886054739" lastFinishedPulling="2026-05-21 03:19:53.451893595 +0000 UTC m=+21.494662502" observedRunningTime="2026-05-21 03:19:53.778729514 +0000 UTC m=+21.821498429" watchObservedRunningTime="2026-05-21 03:19:53.790708835 +0000 UTC m=+21.833477750" May 21 03:19:53.792432 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:53.792200 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-161.ec2.internal" podStartSLOduration=20.792187086 podStartE2EDuration="20.792187086s" podCreationTimestamp="2026-05-21 03:19:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 03:19:53.790105879 +0000 UTC m=+21.832874794" watchObservedRunningTime="2026-05-21 03:19:53.792187086 +0000 UTC m=+21.834956002" May 21 03:19:54.768099 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:54.767800 2574 generic.go:358] "Generic (PLEG): container finished" podID="70d7280d-5779-4c48-b698-9ce8a698bdeb" containerID="7008e466aafb02389de889bfb7d5d682d5b4298237f23a7f6236e4b80a945bb5" exitCode=0 May 21 03:19:54.768099 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:54.767874 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k7gbn" event={"ID":"70d7280d-5779-4c48-b698-9ce8a698bdeb","Type":"ContainerDied","Data":"7008e466aafb02389de889bfb7d5d682d5b4298237f23a7f6236e4b80a945bb5"} May 21 03:19:54.769635 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:54.769575 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8nncl" event={"ID":"74fe87f5-634c-48e6-85b9-357a3b4d02f9","Type":"ContainerStarted","Data":"cbec7e1744354bbf36f71ace4443a52d6c81bfdf335f42bf465b0b03a3e5b43c"} May 21 03:19:54.771245 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:54.771106 2574 generic.go:358] "Generic (PLEG): container finished" podID="8b79a830b6f70433eb778f4f12409255" containerID="8bdec1cd562a667560a5fa9c7e7a656d9cdaabde795ca43a5b2cc93a3a07d40d" exitCode=0 May 21 03:19:54.771245 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:54.771200 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-161.ec2.internal" event={"ID":"8b79a830b6f70433eb778f4f12409255","Type":"ContainerDied","Data":"8bdec1cd562a667560a5fa9c7e7a656d9cdaabde795ca43a5b2cc93a3a07d40d"} May 21 03:19:54.772508 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:54.772483 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5zqvw" event={"ID":"1abd0f75-c601-4162-b828-a203307febed","Type":"ContainerStarted","Data":"b68baa4e5d6e29fd84ea24391e7a49b0154061abfe8a8ac59dddbdfef266b2fe"} May 21 03:19:54.773786 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:54.773767 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6gmv" event={"ID":"b19e3ebd-ec1e-4bdd-b766-79a3c736fe56","Type":"ContainerStarted","Data":"89d1d299c7d8615fb482ce58ea30a0b09fb6f08b85f847caa5864365c6cf23f5"} May 21 03:19:54.775051 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:54.775031 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gqltp" event={"ID":"05b002ff-a785-4372-a115-4fd04746df17","Type":"ContainerStarted","Data":"036f2244f952538a41be41edeb07d6c4287d1e5cbfa818252655ba6452c1b64d"} May 21 03:19:54.777833 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:54.777815 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tqqk8" event={"ID":"7300d401-1c04-433f-a767-b2ec61b3d4b4","Type":"ContainerStarted","Data":"254728472d31d230db6102774cd95b46c314a9c01cfa96d280240b3b2d3c075b"} May 21 03:19:54.777935 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:54.777839 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tqqk8" event={"ID":"7300d401-1c04-433f-a767-b2ec61b3d4b4","Type":"ContainerStarted","Data":"4a4676a989d56832e46733dc670a9ab59bf29ef79000baff09d5677f6a2f2526"} May 21 03:19:54.777935 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:54.777882 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tqqk8" event={"ID":"7300d401-1c04-433f-a767-b2ec61b3d4b4","Type":"ContainerStarted","Data":"47ce55c980b3f9ba363ec9b428a41cde13f20f152ed3d790a4a1572974381d50"} May 21 03:19:54.777935 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:54.777895 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tqqk8" event={"ID":"7300d401-1c04-433f-a767-b2ec61b3d4b4","Type":"ContainerStarted","Data":"9b5b8e3aafb7d34d1d73205e95451d2578e80b2fb661eb87dff4b65a0c94d77b"} May 21 03:19:54.777935 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:54.777908 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tqqk8" event={"ID":"7300d401-1c04-433f-a767-b2ec61b3d4b4","Type":"ContainerStarted","Data":"29762470c9095daa86cad58859906bdc23be9618babd0067267671fda75b3427"} May 21 03:19:54.777935 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:54.777922 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tqqk8" event={"ID":"7300d401-1c04-433f-a767-b2ec61b3d4b4","Type":"ContainerStarted","Data":"a6466413aedd7f64b2d7c4f1241dffff95acf222fd22db91fc88eb91a4f67bc8"} May 21 03:19:54.800393 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:54.800339 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-5zqvw" podStartSLOduration=3.235172029 podStartE2EDuration="22.800321182s" podCreationTimestamp="2026-05-21 03:19:32 +0000 UTC" firstStartedPulling="2026-05-21 03:19:33.851643113 +0000 UTC m=+1.894412006" lastFinishedPulling="2026-05-21 03:19:53.416792267 +0000 UTC m=+21.459561159" observedRunningTime="2026-05-21 03:19:54.799536537 +0000 UTC m=+22.842305451" watchObservedRunningTime="2026-05-21 03:19:54.800321182 +0000 UTC m=+22.843090096" May 21 03:19:54.811715 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:54.811671 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-gqltp" podStartSLOduration=2.254055071 podStartE2EDuration="21.8116581s" podCreationTimestamp="2026-05-21 03:19:33 +0000 UTC" firstStartedPulling="2026-05-21 03:19:33.898784701 +0000 UTC m=+1.941553596" lastFinishedPulling="2026-05-21 03:19:53.456387734 +0000 UTC m=+21.499156625" observedRunningTime="2026-05-21 03:19:54.81124232 +0000 UTC m=+22.854011233" watchObservedRunningTime="2026-05-21 03:19:54.8116581 +0000 UTC m=+22.854427014" May 21 03:19:54.840777 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:54.840718 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-8nncl" podStartSLOduration=3.206615522 podStartE2EDuration="22.840699515s" podCreationTimestamp="2026-05-21 03:19:32 +0000 UTC" firstStartedPulling="2026-05-21 03:19:33.782706926 +0000 UTC m=+1.825475817" lastFinishedPulling="2026-05-21 03:19:53.416790917 +0000 UTC m=+21.459559810" observedRunningTime="2026-05-21 03:19:54.840296493 +0000 UTC m=+22.883065408" watchObservedRunningTime="2026-05-21 03:19:54.840699515 +0000 UTC m=+22.883468430" May 21 03:19:55.572312 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:55.572276 2574 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 21 03:19:55.584516 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:55.584488 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-skpvq" May 21 03:19:55.584627 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:55.584562 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vt8z9" May 21 03:19:55.584627 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:55.584592 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-skpvq" podUID="168bd0e1-6421-4c11-8ef2-8caf34170ae9" May 21 03:19:55.584714 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:55.584670 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vt8z9" podUID="4931c73f-47f4-428d-8602-5e1f4d3cd47a" May 21 03:19:55.584714 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:55.584705 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7vr9p" May 21 03:19:55.584815 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:55.584784 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7vr9p" podUID="1a03c959-a5a9-44f4-89f3-d604f293b8a0" May 21 03:19:55.782481 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:55.781299 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vwjdc" event={"ID":"2f51be24-5086-480e-be43-8a11b02ca599","Type":"ContainerStarted","Data":"124305e7de08762c20d57b618ba7da7e0800eff706f9a704716b4d0844bddf1e"} May 21 03:19:55.784550 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:55.784520 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-161.ec2.internal" event={"ID":"8b79a830b6f70433eb778f4f12409255","Type":"ContainerStarted","Data":"ab34a75796ab63460f2bc995ae65774bb2a5f673f846ed2b221ac5a6054f12e7"} May 21 03:19:55.786604 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:55.786567 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6gmv" event={"ID":"b19e3ebd-ec1e-4bdd-b766-79a3c736fe56","Type":"ContainerStarted","Data":"2828eb1d2e133ec5b12a3b9389e1034c3c1f010ae39c6b00c26766a1a15a6db6"} May 21 03:19:55.795776 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:55.795651 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-vwjdc" podStartSLOduration=3.250242727 podStartE2EDuration="22.795634021s" podCreationTimestamp="2026-05-21 03:19:33 +0000 UTC" firstStartedPulling="2026-05-21 03:19:33.903890357 +0000 UTC m=+1.946659252" lastFinishedPulling="2026-05-21 03:19:53.449281654 +0000 UTC m=+21.492050546" observedRunningTime="2026-05-21 03:19:55.795071872 +0000 UTC m=+23.837840785" watchObservedRunningTime="2026-05-21 03:19:55.795634021 +0000 UTC m=+23.838402936" May 21 03:19:55.808385 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:55.808345 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-161.ec2.internal" podStartSLOduration=22.808331904 podStartE2EDuration="22.808331904s" podCreationTimestamp="2026-05-21 03:19:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 03:19:55.808087109 +0000 UTC m=+23.850856025" watchObservedRunningTime="2026-05-21 03:19:55.808331904 +0000 UTC m=+23.851100819" May 21 03:19:56.539187 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:56.539091 2574 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-21T03:19:55.5723033Z","UUID":"7f3515ae-e8e3-4220-94a5-14c683de6e9f","Handler":null,"Name":"","Endpoint":""} May 21 03:19:56.540927 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:56.540901 2574 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 21 03:19:56.541069 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:56.540935 2574 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 21 03:19:56.791688 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:56.791647 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tqqk8" event={"ID":"7300d401-1c04-433f-a767-b2ec61b3d4b4","Type":"ContainerStarted","Data":"18b658053b28d63c07bcc2c2fc79138443ac2469d9fa143a38063fffbf3387a0"} May 21 03:19:57.555202 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:57.555165 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-8nncl" May 21 03:19:57.555772 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:57.555752 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-8nncl" May 21 03:19:57.585372 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:57.585329 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vt8z9" May 21 03:19:57.585372 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:57.585350 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-skpvq" May 21 03:19:57.585627 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:57.585444 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7vr9p" May 21 03:19:57.585627 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:57.585465 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vt8z9" podUID="4931c73f-47f4-428d-8602-5e1f4d3cd47a" May 21 03:19:57.585627 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:57.585538 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7vr9p" podUID="1a03c959-a5a9-44f4-89f3-d604f293b8a0" May 21 03:19:57.585627 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:57.585597 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-skpvq" podUID="168bd0e1-6421-4c11-8ef2-8caf34170ae9" May 21 03:19:57.795591 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:57.795554 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6gmv" event={"ID":"b19e3ebd-ec1e-4bdd-b766-79a3c736fe56","Type":"ContainerStarted","Data":"0e22cb58647b762244e93d6590f2f4bff78a5d33ae5055fe76b6a44faebc5ede"} May 21 03:19:57.796067 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:57.795650 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-8nncl" May 21 03:19:57.796170 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:57.796154 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-8nncl" May 21 03:19:57.826827 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:57.826733 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6gmv" podStartSLOduration=2.755499254 podStartE2EDuration="25.826719293s" podCreationTimestamp="2026-05-21 03:19:32 +0000 UTC" firstStartedPulling="2026-05-21 03:19:33.787648513 +0000 UTC m=+1.830417405" lastFinishedPulling="2026-05-21 03:19:56.858868477 +0000 UTC m=+24.901637444" observedRunningTime="2026-05-21 03:19:57.811759584 +0000 UTC m=+25.854528498" watchObservedRunningTime="2026-05-21 03:19:57.826719293 +0000 UTC m=+25.869488206" May 21 03:19:59.585652 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:59.585495 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-skpvq" May 21 03:19:59.586253 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:59.585578 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7vr9p" May 21 03:19:59.586253 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:59.585724 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-skpvq" podUID="168bd0e1-6421-4c11-8ef2-8caf34170ae9" May 21 03:19:59.586253 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:59.585599 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vt8z9" May 21 03:19:59.586253 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:59.585822 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7vr9p" podUID="1a03c959-a5a9-44f4-89f3-d604f293b8a0" May 21 03:19:59.586253 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:19:59.585917 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vt8z9" podUID="4931c73f-47f4-428d-8602-5e1f4d3cd47a" May 21 03:19:59.801641 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:59.801609 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k7gbn" event={"ID":"70d7280d-5779-4c48-b698-9ce8a698bdeb","Type":"ContainerStarted","Data":"08c171790f5305614c616b1294922e10b0aaba61b1b48dd1b3aee1848d09cd23"} May 21 03:19:59.804659 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:59.804634 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tqqk8" event={"ID":"7300d401-1c04-433f-a767-b2ec61b3d4b4","Type":"ContainerStarted","Data":"ec687c28d7fb6fcc765e8635891855ae646ed93ec7f7c2d538e3c4391511997f"} May 21 03:19:59.804903 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:59.804879 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tqqk8" May 21 03:19:59.804980 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:59.804918 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tqqk8" May 21 03:19:59.821531 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:59.821502 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tqqk8" May 21 03:19:59.848231 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:19:59.848186 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-tqqk8" podStartSLOduration=8.071122569 podStartE2EDuration="27.848169535s" podCreationTimestamp="2026-05-21 03:19:32 +0000 UTC" firstStartedPulling="2026-05-21 03:19:33.875948008 +0000 UTC m=+1.918716902" lastFinishedPulling="2026-05-21 03:19:53.652994961 +0000 UTC m=+21.695763868" observedRunningTime="2026-05-21 03:19:59.847974393 +0000 UTC m=+27.890743333" watchObservedRunningTime="2026-05-21 03:19:59.848169535 +0000 UTC m=+27.890938430" May 21 03:20:00.808475 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:00.808438 2574 generic.go:358] "Generic (PLEG): container finished" podID="70d7280d-5779-4c48-b698-9ce8a698bdeb" containerID="08c171790f5305614c616b1294922e10b0aaba61b1b48dd1b3aee1848d09cd23" exitCode=0 May 21 03:20:00.809147 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:00.808528 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k7gbn" event={"ID":"70d7280d-5779-4c48-b698-9ce8a698bdeb","Type":"ContainerDied","Data":"08c171790f5305614c616b1294922e10b0aaba61b1b48dd1b3aee1848d09cd23"} May 21 03:20:00.809147 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:00.808958 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tqqk8" May 21 03:20:00.826236 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:00.826211 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tqqk8" May 21 03:20:01.406033 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:01.405766 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7vr9p"] May 21 03:20:01.406200 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:01.406137 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7vr9p" May 21 03:20:01.406283 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:01.406260 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7vr9p" podUID="1a03c959-a5a9-44f4-89f3-d604f293b8a0" May 21 03:20:01.409131 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:01.408981 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vt8z9"] May 21 03:20:01.409131 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:01.409101 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vt8z9" May 21 03:20:01.409328 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:01.409197 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vt8z9" podUID="4931c73f-47f4-428d-8602-5e1f4d3cd47a" May 21 03:20:01.409626 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:01.409604 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-skpvq"] May 21 03:20:01.409730 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:01.409695 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-skpvq" May 21 03:20:01.409782 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:01.409769 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-skpvq" podUID="168bd0e1-6421-4c11-8ef2-8caf34170ae9" May 21 03:20:01.812419 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:01.812385 2574 generic.go:358] "Generic (PLEG): container finished" podID="70d7280d-5779-4c48-b698-9ce8a698bdeb" containerID="a256545a9c19d14b9e1c8c664e361904ff000dd473ebb82594cf8a499b6be2a4" exitCode=0 May 21 03:20:01.812791 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:01.812478 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k7gbn" event={"ID":"70d7280d-5779-4c48-b698-9ce8a698bdeb","Type":"ContainerDied","Data":"a256545a9c19d14b9e1c8c664e361904ff000dd473ebb82594cf8a499b6be2a4"} May 21 03:20:02.585475 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:02.585456 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-skpvq" May 21 03:20:02.585557 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:02.585537 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-skpvq" podUID="168bd0e1-6421-4c11-8ef2-8caf34170ae9" May 21 03:20:02.816588 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:02.816556 2574 generic.go:358] "Generic (PLEG): container finished" podID="70d7280d-5779-4c48-b698-9ce8a698bdeb" containerID="b4efab7798f0835196b75fe231a85f4429344590d9ad5020f30e1dddd8bb795a" exitCode=0 May 21 03:20:02.816984 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:02.816646 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k7gbn" event={"ID":"70d7280d-5779-4c48-b698-9ce8a698bdeb","Type":"ContainerDied","Data":"b4efab7798f0835196b75fe231a85f4429344590d9ad5020f30e1dddd8bb795a"} May 21 03:20:03.585362 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:03.585328 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vt8z9" May 21 03:20:03.585531 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:03.585328 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7vr9p" May 21 03:20:03.585531 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:03.585460 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vt8z9" podUID="4931c73f-47f4-428d-8602-5e1f4d3cd47a" May 21 03:20:03.585650 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:03.585585 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7vr9p" podUID="1a03c959-a5a9-44f4-89f3-d604f293b8a0" May 21 03:20:04.585090 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:04.585050 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-skpvq" May 21 03:20:04.585575 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:04.585162 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-skpvq" podUID="168bd0e1-6421-4c11-8ef2-8caf34170ae9" May 21 03:20:05.212096 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:05.212061 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f628q\" (UniqueName: \"kubernetes.io/projected/168bd0e1-6421-4c11-8ef2-8caf34170ae9-kube-api-access-f628q\") pod \"network-check-target-skpvq\" (UID: \"168bd0e1-6421-4c11-8ef2-8caf34170ae9\") " pod="openshift-network-diagnostics/network-check-target-skpvq" May 21 03:20:05.212253 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:05.212116 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a03c959-a5a9-44f4-89f3-d604f293b8a0-metrics-certs\") pod \"network-metrics-daemon-7vr9p\" (UID: \"1a03c959-a5a9-44f4-89f3-d604f293b8a0\") " pod="openshift-multus/network-metrics-daemon-7vr9p" May 21 03:20:05.212253 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:05.212208 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 03:20:05.212335 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:05.212254 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 03:20:05.212335 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:05.212271 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a03c959-a5a9-44f4-89f3-d604f293b8a0-metrics-certs podName:1a03c959-a5a9-44f4-89f3-d604f293b8a0 nodeName:}" failed. No retries permitted until 2026-05-21 03:20:37.212255271 +0000 UTC m=+65.255024175 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1a03c959-a5a9-44f4-89f3-d604f293b8a0-metrics-certs") pod "network-metrics-daemon-7vr9p" (UID: "1a03c959-a5a9-44f4-89f3-d604f293b8a0") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 03:20:05.212335 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:05.212275 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 03:20:05.212335 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:05.212285 2574 projected.go:194] Error preparing data for projected volume kube-api-access-f628q for pod openshift-network-diagnostics/network-check-target-skpvq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 03:20:05.212335 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:05.212334 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/168bd0e1-6421-4c11-8ef2-8caf34170ae9-kube-api-access-f628q podName:168bd0e1-6421-4c11-8ef2-8caf34170ae9 nodeName:}" failed. No retries permitted until 2026-05-21 03:20:37.212317163 +0000 UTC m=+65.255086057 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-f628q" (UniqueName: "kubernetes.io/projected/168bd0e1-6421-4c11-8ef2-8caf34170ae9-kube-api-access-f628q") pod "network-check-target-skpvq" (UID: "168bd0e1-6421-4c11-8ef2-8caf34170ae9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 03:20:05.312628 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:05.312591 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4931c73f-47f4-428d-8602-5e1f4d3cd47a-original-pull-secret\") pod \"global-pull-secret-syncer-vt8z9\" (UID: \"4931c73f-47f4-428d-8602-5e1f4d3cd47a\") " pod="kube-system/global-pull-secret-syncer-vt8z9" May 21 03:20:05.312798 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:05.312733 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 03:20:05.312798 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:05.312798 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4931c73f-47f4-428d-8602-5e1f4d3cd47a-original-pull-secret podName:4931c73f-47f4-428d-8602-5e1f4d3cd47a nodeName:}" failed. No retries permitted until 2026-05-21 03:20:37.312782686 +0000 UTC m=+65.355551629 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4931c73f-47f4-428d-8602-5e1f4d3cd47a-original-pull-secret") pod "global-pull-secret-syncer-vt8z9" (UID: "4931c73f-47f4-428d-8602-5e1f4d3cd47a") : object "kube-system"/"original-pull-secret" not registered May 21 03:20:05.585289 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:05.585203 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7vr9p" May 21 03:20:05.585289 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:05.585248 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vt8z9" May 21 03:20:05.585696 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:05.585358 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7vr9p" podUID="1a03c959-a5a9-44f4-89f3-d604f293b8a0" May 21 03:20:05.585696 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:05.585489 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vt8z9" podUID="4931c73f-47f4-428d-8602-5e1f4d3cd47a" May 21 03:20:06.584918 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:06.584881 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-skpvq" May 21 03:20:06.585212 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:06.584992 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-skpvq" podUID="168bd0e1-6421-4c11-8ef2-8caf34170ae9" May 21 03:20:07.258994 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:07.258965 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-161.ec2.internal" event="NodeReady" May 21 03:20:07.259421 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:07.259121 2574 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 21 03:20:07.293069 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:07.293030 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7b74df67-kzgvj"] May 21 03:20:07.309136 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:07.309105 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-2cxks"] May 21 03:20:07.323031 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:07.322990 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7b74df67-kzgvj"] May 21 03:20:07.323031 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:07.323023 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2cxks"] May 21 03:20:07.323243 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:07.323058 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b74df67-kzgvj" May 21 03:20:07.323243 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:07.323129 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2cxks" May 21 03:20:07.326055 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:07.326030 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 21 03:20:07.326219 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:07.326087 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7gx7m\"" May 21 03:20:07.326296 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:07.326035 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 21 03:20:07.326405 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:07.326389 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 21 03:20:07.326526 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:07.326510 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 21 03:20:07.326628 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:07.326610 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-pm6r8\"" May 21 03:20:07.326697 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:07.326664 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 21 03:20:07.326754 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:07.326620 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 21 03:20:07.336655 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:07.336633 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 21 03:20:07.405130 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:07.405089 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-d4jjb"] May 21 03:20:07.417724 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:07.417695 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-d4jjb"] May 21 03:20:07.417925 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:07.417822 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-d4jjb" May 21 03:20:07.420345 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:07.420106 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-znmrr\"" May 21 03:20:07.420345 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:07.420114 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 21 03:20:07.420556 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:07.420408 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 21 03:20:07.426329 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:07.426177 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf-ca-trust-extracted\") pod \"image-registry-7b74df67-kzgvj\" (UID: \"1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf\") " pod="openshift-image-registry/image-registry-7b74df67-kzgvj" May 21 03:20:07.426329 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:07.426215 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ba1902e2-00e1-4eaa-9aea-5c617de7ebb3-cert\") pod \"ingress-canary-2cxks\" (UID: \"ba1902e2-00e1-4eaa-9aea-5c617de7ebb3\") " pod="openshift-ingress-canary/ingress-canary-2cxks" May 21 03:20:07.426329 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:07.426247 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcxsz\" (UniqueName: \"kubernetes.io/projected/1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf-kube-api-access-wcxsz\") pod \"image-registry-7b74df67-kzgvj\" (UID: \"1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf\") " pod="openshift-image-registry/image-registry-7b74df67-kzgvj" May 21 03:20:07.426329 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:07.426276 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf-installation-pull-secrets\") pod \"image-registry-7b74df67-kzgvj\" (UID: \"1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf\") " pod="openshift-image-registry/image-registry-7b74df67-kzgvj" May 21 03:20:07.426329 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:07.426304 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf-bound-sa-token\") pod \"image-registry-7b74df67-kzgvj\" (UID: \"1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf\") " pod="openshift-image-registry/image-registry-7b74df67-kzgvj" May 21 03:20:07.426329 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:07.426329 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf-trusted-ca\") pod \"image-registry-7b74df67-kzgvj\" (UID: \"1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf\") " pod="openshift-image-registry/image-registry-7b74df67-kzgvj" May 21 03:20:07.426642 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:07.426385 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf-registry-certificates\") pod \"image-registry-7b74df67-kzgvj\" (UID: \"1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf\") " pod="openshift-image-registry/image-registry-7b74df67-kzgvj" May 21 03:20:07.426642 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:07.426416 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf-image-registry-private-configuration\") pod \"image-registry-7b74df67-kzgvj\" (UID: \"1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf\") " pod="openshift-image-registry/image-registry-7b74df67-kzgvj" May 21 03:20:07.426642 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:07.426463 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf-registry-tls\") pod \"image-registry-7b74df67-kzgvj\" (UID: \"1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf\") " pod="openshift-image-registry/image-registry-7b74df67-kzgvj" May 21 03:20:07.426642 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:07.426485 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwj95\" (UniqueName: \"kubernetes.io/projected/ba1902e2-00e1-4eaa-9aea-5c617de7ebb3-kube-api-access-zwj95\") pod \"ingress-canary-2cxks\" (UID: \"ba1902e2-00e1-4eaa-9aea-5c617de7ebb3\") " pod="openshift-ingress-canary/ingress-canary-2cxks" May 21 03:20:07.527665 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:07.527625 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf-registry-certificates\") pod \"image-registry-7b74df67-kzgvj\" (UID: \"1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf\") " pod="openshift-image-registry/image-registry-7b74df67-kzgvj" May 21 03:20:07.527891 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:07.527680 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf-image-registry-private-configuration\") pod \"image-registry-7b74df67-kzgvj\" (UID: \"1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf\") " pod="openshift-image-registry/image-registry-7b74df67-kzgvj" May 21 03:20:07.527891 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:07.527726 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf-registry-tls\") pod \"image-registry-7b74df67-kzgvj\" (UID: \"1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf\") " pod="openshift-image-registry/image-registry-7b74df67-kzgvj" May 21 03:20:07.527891 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:07.527757 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zwj95\" (UniqueName: \"kubernetes.io/projected/ba1902e2-00e1-4eaa-9aea-5c617de7ebb3-kube-api-access-zwj95\") pod \"ingress-canary-2cxks\" (UID: \"ba1902e2-00e1-4eaa-9aea-5c617de7ebb3\") " pod="openshift-ingress-canary/ingress-canary-2cxks" May 21 03:20:07.527891 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:07.527791 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a60fd84a-346a-44c3-9a02-5c3db633aaa4-tmp-dir\") pod \"dns-default-d4jjb\" (UID: \"a60fd84a-346a-44c3-9a02-5c3db633aaa4\") " pod="openshift-dns/dns-default-d4jjb" May 21 03:20:07.527891 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:07.527820 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbnj2\" (UniqueName: \"kubernetes.io/projected/a60fd84a-346a-44c3-9a02-5c3db633aaa4-kube-api-access-pbnj2\") pod \"dns-default-d4jjb\" (UID: \"a60fd84a-346a-44c3-9a02-5c3db633aaa4\") " pod="openshift-dns/dns-default-d4jjb" May 21 03:20:07.528114 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:07.527891 2574 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 03:20:07.528114 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:07.527907 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf-ca-trust-extracted\") pod \"image-registry-7b74df67-kzgvj\" (UID: \"1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf\") " pod="openshift-image-registry/image-registry-7b74df67-kzgvj" May 21 03:20:07.528114 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:07.527918 2574 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b74df67-kzgvj: secret "image-registry-tls" not found May 21 03:20:07.528114 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:07.527939 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ba1902e2-00e1-4eaa-9aea-5c617de7ebb3-cert\") pod \"ingress-canary-2cxks\" (UID: \"ba1902e2-00e1-4eaa-9aea-5c617de7ebb3\") " pod="openshift-ingress-canary/ingress-canary-2cxks" May 21 03:20:07.528114 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:07.527980 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf-registry-tls podName:1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf nodeName:}" failed. No retries permitted until 2026-05-21 03:20:08.027958239 +0000 UTC m=+36.070727150 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf-registry-tls") pod "image-registry-7b74df67-kzgvj" (UID: "1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf") : secret "image-registry-tls" not found May 21 03:20:07.528114 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:07.528008 2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 03:20:07.528114 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:07.528066 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba1902e2-00e1-4eaa-9aea-5c617de7ebb3-cert podName:ba1902e2-00e1-4eaa-9aea-5c617de7ebb3 nodeName:}" failed. No retries permitted until 2026-05-21 03:20:08.028050789 +0000 UTC m=+36.070819688 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ba1902e2-00e1-4eaa-9aea-5c617de7ebb3-cert") pod "ingress-canary-2cxks" (UID: "ba1902e2-00e1-4eaa-9aea-5c617de7ebb3") : secret "canary-serving-cert" not found May 21 03:20:07.528114 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:07.528081 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wcxsz\" (UniqueName: \"kubernetes.io/projected/1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf-kube-api-access-wcxsz\") pod \"image-registry-7b74df67-kzgvj\" (UID: \"1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf\") " pod="openshift-image-registry/image-registry-7b74df67-kzgvj" May 21 03:20:07.528114 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:07.528104 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a60fd84a-346a-44c3-9a02-5c3db633aaa4-config-volume\") pod \"dns-default-d4jjb\" (UID: \"a60fd84a-346a-44c3-9a02-5c3db633aaa4\") " pod="openshift-dns/dns-default-d4jjb" May 21 03:20:07.528483 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:07.528126 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a60fd84a-346a-44c3-9a02-5c3db633aaa4-metrics-tls\") pod \"dns-default-d4jjb\" (UID: \"a60fd84a-346a-44c3-9a02-5c3db633aaa4\") " pod="openshift-dns/dns-default-d4jjb" May 21 03:20:07.528483 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:07.528155 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf-installation-pull-secrets\") pod \"image-registry-7b74df67-kzgvj\" (UID: \"1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf\") " pod="openshift-image-registry/image-registry-7b74df67-kzgvj" May 21 03:20:07.528483 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:07.528186 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf-bound-sa-token\") pod \"image-registry-7b74df67-kzgvj\" (UID: \"1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf\") " pod="openshift-image-registry/image-registry-7b74df67-kzgvj" May 21 03:20:07.528483 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:07.528238 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf-ca-trust-extracted\") pod \"image-registry-7b74df67-kzgvj\" (UID: \"1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf\") " pod="openshift-image-registry/image-registry-7b74df67-kzgvj" May 21 03:20:07.528483 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:07.528312 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf-registry-certificates\") pod \"image-registry-7b74df67-kzgvj\" (UID: \"1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf\") " pod="openshift-image-registry/image-registry-7b74df67-kzgvj" May 21 03:20:07.528483 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:07.528331 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf-trusted-ca\") pod \"image-registry-7b74df67-kzgvj\" (UID: \"1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf\") " pod="openshift-image-registry/image-registry-7b74df67-kzgvj" May 21 03:20:07.529083 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:07.529060 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf-trusted-ca\") pod \"image-registry-7b74df67-kzgvj\" (UID: \"1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf\") " pod="openshift-image-registry/image-registry-7b74df67-kzgvj" May 21 03:20:07.532624 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:07.532515 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf-image-registry-private-configuration\") pod \"image-registry-7b74df67-kzgvj\" (UID: \"1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf\") " pod="openshift-image-registry/image-registry-7b74df67-kzgvj" May 21 03:20:07.532724 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:07.532525 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf-installation-pull-secrets\") pod \"image-registry-7b74df67-kzgvj\" (UID: \"1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf\") " pod="openshift-image-registry/image-registry-7b74df67-kzgvj" May 21 03:20:07.540944 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:07.540917 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf-bound-sa-token\") pod \"image-registry-7b74df67-kzgvj\" (UID: \"1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf\") " pod="openshift-image-registry/image-registry-7b74df67-kzgvj" May 21 03:20:07.541067 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:07.540970 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcxsz\" (UniqueName: \"kubernetes.io/projected/1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf-kube-api-access-wcxsz\") pod \"image-registry-7b74df67-kzgvj\" (UID: \"1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf\") " pod="openshift-image-registry/image-registry-7b74df67-kzgvj" May 21 03:20:07.541067 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:07.541047 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwj95\" (UniqueName: \"kubernetes.io/projected/ba1902e2-00e1-4eaa-9aea-5c617de7ebb3-kube-api-access-zwj95\") pod \"ingress-canary-2cxks\" (UID: \"ba1902e2-00e1-4eaa-9aea-5c617de7ebb3\") " pod="openshift-ingress-canary/ingress-canary-2cxks" May 21 03:20:07.584569 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:07.584538 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vt8z9" May 21 03:20:07.584757 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:07.584551 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7vr9p" May 21 03:20:07.587297 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:07.587277 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 21 03:20:07.587419 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:07.587314 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rwbqv\"" May 21 03:20:07.587419 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:07.587276 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 21 03:20:07.629640 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:07.629606 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a60fd84a-346a-44c3-9a02-5c3db633aaa4-tmp-dir\") pod \"dns-default-d4jjb\" (UID: \"a60fd84a-346a-44c3-9a02-5c3db633aaa4\") " pod="openshift-dns/dns-default-d4jjb" May 21 03:20:07.629640 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:07.629643 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pbnj2\" (UniqueName: \"kubernetes.io/projected/a60fd84a-346a-44c3-9a02-5c3db633aaa4-kube-api-access-pbnj2\") pod \"dns-default-d4jjb\" (UID: \"a60fd84a-346a-44c3-9a02-5c3db633aaa4\") " pod="openshift-dns/dns-default-d4jjb" May 21 03:20:07.629894 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:07.629697 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a60fd84a-346a-44c3-9a02-5c3db633aaa4-config-volume\") pod \"dns-default-d4jjb\" (UID: \"a60fd84a-346a-44c3-9a02-5c3db633aaa4\") " pod="openshift-dns/dns-default-d4jjb" May 21 03:20:07.629894 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:07.629722 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a60fd84a-346a-44c3-9a02-5c3db633aaa4-metrics-tls\") pod \"dns-default-d4jjb\" (UID: \"a60fd84a-346a-44c3-9a02-5c3db633aaa4\") " pod="openshift-dns/dns-default-d4jjb" May 21 03:20:07.629983 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:07.629912 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 03:20:07.630018 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:07.629982 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a60fd84a-346a-44c3-9a02-5c3db633aaa4-metrics-tls podName:a60fd84a-346a-44c3-9a02-5c3db633aaa4 nodeName:}" failed. No retries permitted until 2026-05-21 03:20:08.129961354 +0000 UTC m=+36.172730246 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a60fd84a-346a-44c3-9a02-5c3db633aaa4-metrics-tls") pod "dns-default-d4jjb" (UID: "a60fd84a-346a-44c3-9a02-5c3db633aaa4") : secret "dns-default-metrics-tls" not found May 21 03:20:07.630069 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:07.630013 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a60fd84a-346a-44c3-9a02-5c3db633aaa4-tmp-dir\") pod \"dns-default-d4jjb\" (UID: \"a60fd84a-346a-44c3-9a02-5c3db633aaa4\") " pod="openshift-dns/dns-default-d4jjb" May 21 03:20:07.630292 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:07.630272 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a60fd84a-346a-44c3-9a02-5c3db633aaa4-config-volume\") pod \"dns-default-d4jjb\" (UID: \"a60fd84a-346a-44c3-9a02-5c3db633aaa4\") " pod="openshift-dns/dns-default-d4jjb" May 21 03:20:07.638450 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:07.638427 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbnj2\" (UniqueName: \"kubernetes.io/projected/a60fd84a-346a-44c3-9a02-5c3db633aaa4-kube-api-access-pbnj2\") pod \"dns-default-d4jjb\" (UID: \"a60fd84a-346a-44c3-9a02-5c3db633aaa4\") " pod="openshift-dns/dns-default-d4jjb" May 21 03:20:08.033802 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:08.033747 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ba1902e2-00e1-4eaa-9aea-5c617de7ebb3-cert\") pod \"ingress-canary-2cxks\" (UID: \"ba1902e2-00e1-4eaa-9aea-5c617de7ebb3\") " pod="openshift-ingress-canary/ingress-canary-2cxks" May 21 03:20:08.033998 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:08.033883 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf-registry-tls\") pod \"image-registry-7b74df67-kzgvj\" (UID: \"1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf\") " pod="openshift-image-registry/image-registry-7b74df67-kzgvj" May 21 03:20:08.033998 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:08.033916 2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 03:20:08.033998 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:08.033991 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba1902e2-00e1-4eaa-9aea-5c617de7ebb3-cert podName:ba1902e2-00e1-4eaa-9aea-5c617de7ebb3 nodeName:}" failed. No retries permitted until 2026-05-21 03:20:09.033973842 +0000 UTC m=+37.076742751 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ba1902e2-00e1-4eaa-9aea-5c617de7ebb3-cert") pod "ingress-canary-2cxks" (UID: "ba1902e2-00e1-4eaa-9aea-5c617de7ebb3") : secret "canary-serving-cert" not found May 21 03:20:08.034163 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:08.034003 2574 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 03:20:08.034163 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:08.034019 2574 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b74df67-kzgvj: secret "image-registry-tls" not found May 21 03:20:08.034163 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:08.034065 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf-registry-tls podName:1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf nodeName:}" failed. No retries permitted until 2026-05-21 03:20:09.034052253 +0000 UTC m=+37.076821165 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf-registry-tls") pod "image-registry-7b74df67-kzgvj" (UID: "1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf") : secret "image-registry-tls" not found May 21 03:20:08.135003 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:08.134964 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a60fd84a-346a-44c3-9a02-5c3db633aaa4-metrics-tls\") pod \"dns-default-d4jjb\" (UID: \"a60fd84a-346a-44c3-9a02-5c3db633aaa4\") " pod="openshift-dns/dns-default-d4jjb" May 21 03:20:08.135208 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:08.135091 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 03:20:08.135208 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:08.135147 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a60fd84a-346a-44c3-9a02-5c3db633aaa4-metrics-tls podName:a60fd84a-346a-44c3-9a02-5c3db633aaa4 nodeName:}" failed. No retries permitted until 2026-05-21 03:20:09.13513327 +0000 UTC m=+37.177902162 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a60fd84a-346a-44c3-9a02-5c3db633aaa4-metrics-tls") pod "dns-default-d4jjb" (UID: "a60fd84a-346a-44c3-9a02-5c3db633aaa4") : secret "dns-default-metrics-tls" not found May 21 03:20:08.584818 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:08.584777 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-skpvq" May 21 03:20:08.587272 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:08.587247 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 21 03:20:08.587446 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:08.587284 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2nkrm\"" May 21 03:20:08.587446 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:08.587289 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 21 03:20:09.043559 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:09.043511 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf-registry-tls\") pod \"image-registry-7b74df67-kzgvj\" (UID: \"1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf\") " pod="openshift-image-registry/image-registry-7b74df67-kzgvj" May 21 03:20:09.043738 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:09.043592 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ba1902e2-00e1-4eaa-9aea-5c617de7ebb3-cert\") pod \"ingress-canary-2cxks\" (UID: \"ba1902e2-00e1-4eaa-9aea-5c617de7ebb3\") " pod="openshift-ingress-canary/ingress-canary-2cxks" May 21 03:20:09.043738 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:09.043701 2574 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 03:20:09.043738 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:09.043728 2574 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b74df67-kzgvj: secret "image-registry-tls" not found May 21 03:20:09.043883 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:09.043736 2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 03:20:09.043883 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:09.043797 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf-registry-tls podName:1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf nodeName:}" failed. No retries permitted until 2026-05-21 03:20:11.0437795 +0000 UTC m=+39.086548391 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf-registry-tls") pod "image-registry-7b74df67-kzgvj" (UID: "1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf") : secret "image-registry-tls" not found May 21 03:20:09.043883 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:09.043812 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba1902e2-00e1-4eaa-9aea-5c617de7ebb3-cert podName:ba1902e2-00e1-4eaa-9aea-5c617de7ebb3 nodeName:}" failed. No retries permitted until 2026-05-21 03:20:11.043806226 +0000 UTC m=+39.086575117 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ba1902e2-00e1-4eaa-9aea-5c617de7ebb3-cert") pod "ingress-canary-2cxks" (UID: "ba1902e2-00e1-4eaa-9aea-5c617de7ebb3") : secret "canary-serving-cert" not found May 21 03:20:09.144686 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:09.144655 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a60fd84a-346a-44c3-9a02-5c3db633aaa4-metrics-tls\") pod \"dns-default-d4jjb\" (UID: \"a60fd84a-346a-44c3-9a02-5c3db633aaa4\") " pod="openshift-dns/dns-default-d4jjb" May 21 03:20:09.144823 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:09.144772 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 03:20:09.144882 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:09.144828 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a60fd84a-346a-44c3-9a02-5c3db633aaa4-metrics-tls podName:a60fd84a-346a-44c3-9a02-5c3db633aaa4 nodeName:}" failed. No retries permitted until 2026-05-21 03:20:11.144812387 +0000 UTC m=+39.187581295 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a60fd84a-346a-44c3-9a02-5c3db633aaa4-metrics-tls") pod "dns-default-d4jjb" (UID: "a60fd84a-346a-44c3-9a02-5c3db633aaa4") : secret "dns-default-metrics-tls" not found May 21 03:20:09.832320 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:09.832270 2574 generic.go:358] "Generic (PLEG): container finished" podID="70d7280d-5779-4c48-b698-9ce8a698bdeb" containerID="30c8c7a9fe524ad0ce6eb000f02d7fa727dabc47017d858abf9b7711c65911d3" exitCode=0 May 21 03:20:09.832963 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:09.832351 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k7gbn" event={"ID":"70d7280d-5779-4c48-b698-9ce8a698bdeb","Type":"ContainerDied","Data":"30c8c7a9fe524ad0ce6eb000f02d7fa727dabc47017d858abf9b7711c65911d3"} May 21 03:20:10.836859 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:10.836811 2574 generic.go:358] "Generic (PLEG): container finished" podID="70d7280d-5779-4c48-b698-9ce8a698bdeb" containerID="4907081bcd55623f1491ea620b1bc88f7070c2702361162c1bf0cee3bda5b0ab" exitCode=0 May 21 03:20:10.837209 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:10.836907 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k7gbn" event={"ID":"70d7280d-5779-4c48-b698-9ce8a698bdeb","Type":"ContainerDied","Data":"4907081bcd55623f1491ea620b1bc88f7070c2702361162c1bf0cee3bda5b0ab"} May 21 03:20:11.064089 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:11.064047 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf-registry-tls\") pod \"image-registry-7b74df67-kzgvj\" (UID: \"1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf\") " pod="openshift-image-registry/image-registry-7b74df67-kzgvj" May 21 03:20:11.064272 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:11.064104 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ba1902e2-00e1-4eaa-9aea-5c617de7ebb3-cert\") pod \"ingress-canary-2cxks\" (UID: \"ba1902e2-00e1-4eaa-9aea-5c617de7ebb3\") " pod="openshift-ingress-canary/ingress-canary-2cxks" May 21 03:20:11.064272 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:11.064192 2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 03:20:11.064272 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:11.064201 2574 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 03:20:11.064272 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:11.064220 2574 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b74df67-kzgvj: secret "image-registry-tls" not found May 21 03:20:11.064272 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:11.064247 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba1902e2-00e1-4eaa-9aea-5c617de7ebb3-cert podName:ba1902e2-00e1-4eaa-9aea-5c617de7ebb3 nodeName:}" failed. No retries permitted until 2026-05-21 03:20:15.064232904 +0000 UTC m=+43.107001795 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ba1902e2-00e1-4eaa-9aea-5c617de7ebb3-cert") pod "ingress-canary-2cxks" (UID: "ba1902e2-00e1-4eaa-9aea-5c617de7ebb3") : secret "canary-serving-cert" not found May 21 03:20:11.064272 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:11.064271 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf-registry-tls podName:1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf nodeName:}" failed. No retries permitted until 2026-05-21 03:20:15.064257634 +0000 UTC m=+43.107026525 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf-registry-tls") pod "image-registry-7b74df67-kzgvj" (UID: "1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf") : secret "image-registry-tls" not found May 21 03:20:11.164718 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:11.164681 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a60fd84a-346a-44c3-9a02-5c3db633aaa4-metrics-tls\") pod \"dns-default-d4jjb\" (UID: \"a60fd84a-346a-44c3-9a02-5c3db633aaa4\") " pod="openshift-dns/dns-default-d4jjb" May 21 03:20:11.164941 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:11.164874 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 03:20:11.164941 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:11.164940 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a60fd84a-346a-44c3-9a02-5c3db633aaa4-metrics-tls podName:a60fd84a-346a-44c3-9a02-5c3db633aaa4 nodeName:}" failed. No retries permitted until 2026-05-21 03:20:15.164925136 +0000 UTC m=+43.207694028 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a60fd84a-346a-44c3-9a02-5c3db633aaa4-metrics-tls") pod "dns-default-d4jjb" (UID: "a60fd84a-346a-44c3-9a02-5c3db633aaa4") : secret "dns-default-metrics-tls" not found May 21 03:20:11.841203 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:11.841157 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k7gbn" event={"ID":"70d7280d-5779-4c48-b698-9ce8a698bdeb","Type":"ContainerStarted","Data":"df72e0218fa2225cccfdcf5dfd0745672b4c2c5f10e87eb9bff939b079b2fc85"} May 21 03:20:11.862839 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:11.862788 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-k7gbn" podStartSLOduration=4.6998079950000005 podStartE2EDuration="39.862772085s" podCreationTimestamp="2026-05-21 03:19:32 +0000 UTC" firstStartedPulling="2026-05-21 03:19:33.814563534 +0000 UTC m=+1.857332427" lastFinishedPulling="2026-05-21 03:20:08.97752761 +0000 UTC m=+37.020296517" observedRunningTime="2026-05-21 03:20:11.861347889 +0000 UTC m=+39.904116804" watchObservedRunningTime="2026-05-21 03:20:11.862772085 +0000 UTC m=+39.905540999" May 21 03:20:15.092366 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:15.092316 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf-registry-tls\") pod \"image-registry-7b74df67-kzgvj\" (UID: \"1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf\") " pod="openshift-image-registry/image-registry-7b74df67-kzgvj" May 21 03:20:15.092762 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:15.092382 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ba1902e2-00e1-4eaa-9aea-5c617de7ebb3-cert\") pod \"ingress-canary-2cxks\" (UID: \"ba1902e2-00e1-4eaa-9aea-5c617de7ebb3\") " pod="openshift-ingress-canary/ingress-canary-2cxks" May 21 03:20:15.092762 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:15.092481 2574 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 03:20:15.092762 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:15.092499 2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 03:20:15.092762 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:15.092506 2574 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b74df67-kzgvj: secret "image-registry-tls" not found May 21 03:20:15.092762 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:15.092557 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf-registry-tls podName:1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf nodeName:}" failed. No retries permitted until 2026-05-21 03:20:23.092540202 +0000 UTC m=+51.135309094 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf-registry-tls") pod "image-registry-7b74df67-kzgvj" (UID: "1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf") : secret "image-registry-tls" not found May 21 03:20:15.092762 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:15.092570 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba1902e2-00e1-4eaa-9aea-5c617de7ebb3-cert podName:ba1902e2-00e1-4eaa-9aea-5c617de7ebb3 nodeName:}" failed. No retries permitted until 2026-05-21 03:20:23.09256399 +0000 UTC m=+51.135332882 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ba1902e2-00e1-4eaa-9aea-5c617de7ebb3-cert") pod "ingress-canary-2cxks" (UID: "ba1902e2-00e1-4eaa-9aea-5c617de7ebb3") : secret "canary-serving-cert" not found May 21 03:20:15.193515 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:15.193479 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a60fd84a-346a-44c3-9a02-5c3db633aaa4-metrics-tls\") pod \"dns-default-d4jjb\" (UID: \"a60fd84a-346a-44c3-9a02-5c3db633aaa4\") " pod="openshift-dns/dns-default-d4jjb" May 21 03:20:15.193670 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:15.193603 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 03:20:15.193670 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:15.193664 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a60fd84a-346a-44c3-9a02-5c3db633aaa4-metrics-tls podName:a60fd84a-346a-44c3-9a02-5c3db633aaa4 nodeName:}" failed. No retries permitted until 2026-05-21 03:20:23.193645505 +0000 UTC m=+51.236414397 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a60fd84a-346a-44c3-9a02-5c3db633aaa4-metrics-tls") pod "dns-default-d4jjb" (UID: "a60fd84a-346a-44c3-9a02-5c3db633aaa4") : secret "dns-default-metrics-tls" not found May 21 03:20:23.151808 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:23.151763 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ba1902e2-00e1-4eaa-9aea-5c617de7ebb3-cert\") pod \"ingress-canary-2cxks\" (UID: \"ba1902e2-00e1-4eaa-9aea-5c617de7ebb3\") " pod="openshift-ingress-canary/ingress-canary-2cxks" May 21 03:20:23.152269 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:23.151908 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf-registry-tls\") pod \"image-registry-7b74df67-kzgvj\" (UID: \"1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf\") " pod="openshift-image-registry/image-registry-7b74df67-kzgvj" May 21 03:20:23.152269 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:23.151940 2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 03:20:23.152269 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:23.152024 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba1902e2-00e1-4eaa-9aea-5c617de7ebb3-cert podName:ba1902e2-00e1-4eaa-9aea-5c617de7ebb3 nodeName:}" failed. No retries permitted until 2026-05-21 03:20:39.152005693 +0000 UTC m=+67.194774585 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ba1902e2-00e1-4eaa-9aea-5c617de7ebb3-cert") pod "ingress-canary-2cxks" (UID: "ba1902e2-00e1-4eaa-9aea-5c617de7ebb3") : secret "canary-serving-cert" not found May 21 03:20:23.152269 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:23.152039 2574 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 03:20:23.152269 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:23.152055 2574 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b74df67-kzgvj: secret "image-registry-tls" not found May 21 03:20:23.152269 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:23.152100 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf-registry-tls podName:1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf nodeName:}" failed. No retries permitted until 2026-05-21 03:20:39.15208602 +0000 UTC m=+67.194854911 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf-registry-tls") pod "image-registry-7b74df67-kzgvj" (UID: "1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf") : secret "image-registry-tls" not found May 21 03:20:23.252820 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:23.252789 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a60fd84a-346a-44c3-9a02-5c3db633aaa4-metrics-tls\") pod \"dns-default-d4jjb\" (UID: \"a60fd84a-346a-44c3-9a02-5c3db633aaa4\") " pod="openshift-dns/dns-default-d4jjb" May 21 03:20:23.252931 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:23.252910 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 03:20:23.252975 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:23.252969 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a60fd84a-346a-44c3-9a02-5c3db633aaa4-metrics-tls podName:a60fd84a-346a-44c3-9a02-5c3db633aaa4 nodeName:}" failed. No retries permitted until 2026-05-21 03:20:39.2529559 +0000 UTC m=+67.295724793 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a60fd84a-346a-44c3-9a02-5c3db633aaa4-metrics-tls") pod "dns-default-d4jjb" (UID: "a60fd84a-346a-44c3-9a02-5c3db633aaa4") : secret "dns-default-metrics-tls" not found May 21 03:20:27.680031 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:27.679995 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-8cdd89f6d-b94cw"] May 21 03:20:27.684205 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:27.684185 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8cdd89f6d-b94cw" May 21 03:20:27.686347 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:27.686325 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" May 21 03:20:27.686431 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:27.686326 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" May 21 03:20:27.687050 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:27.687033 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" May 21 03:20:27.687117 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:27.687068 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" May 21 03:20:27.692792 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:27.692774 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-8cdd89f6d-b94cw"] May 21 03:20:27.783629 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:27.783605 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/07458b4b-766c-4d97-842f-ce70ef6f8648-klusterlet-config\") pod \"klusterlet-addon-workmgr-8cdd89f6d-b94cw\" (UID: \"07458b4b-766c-4d97-842f-ce70ef6f8648\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8cdd89f6d-b94cw" May 21 03:20:27.783726 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:27.783640 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/07458b4b-766c-4d97-842f-ce70ef6f8648-tmp\") pod \"klusterlet-addon-workmgr-8cdd89f6d-b94cw\" (UID: \"07458b4b-766c-4d97-842f-ce70ef6f8648\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8cdd89f6d-b94cw" May 21 03:20:27.783726 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:27.783712 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpg72\" (UniqueName: \"kubernetes.io/projected/07458b4b-766c-4d97-842f-ce70ef6f8648-kube-api-access-gpg72\") pod \"klusterlet-addon-workmgr-8cdd89f6d-b94cw\" (UID: \"07458b4b-766c-4d97-842f-ce70ef6f8648\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8cdd89f6d-b94cw" May 21 03:20:27.884551 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:27.884522 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/07458b4b-766c-4d97-842f-ce70ef6f8648-klusterlet-config\") pod \"klusterlet-addon-workmgr-8cdd89f6d-b94cw\" (UID: \"07458b4b-766c-4d97-842f-ce70ef6f8648\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8cdd89f6d-b94cw" May 21 03:20:27.884662 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:27.884560 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/07458b4b-766c-4d97-842f-ce70ef6f8648-tmp\") pod \"klusterlet-addon-workmgr-8cdd89f6d-b94cw\" (UID: \"07458b4b-766c-4d97-842f-ce70ef6f8648\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8cdd89f6d-b94cw" May 21 03:20:27.884662 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:27.884623 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gpg72\" (UniqueName: \"kubernetes.io/projected/07458b4b-766c-4d97-842f-ce70ef6f8648-kube-api-access-gpg72\") pod \"klusterlet-addon-workmgr-8cdd89f6d-b94cw\" (UID: \"07458b4b-766c-4d97-842f-ce70ef6f8648\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8cdd89f6d-b94cw" May 21 03:20:27.885011 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:27.884993 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/07458b4b-766c-4d97-842f-ce70ef6f8648-tmp\") pod \"klusterlet-addon-workmgr-8cdd89f6d-b94cw\" (UID: \"07458b4b-766c-4d97-842f-ce70ef6f8648\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8cdd89f6d-b94cw" May 21 03:20:27.887475 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:27.887459 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/07458b4b-766c-4d97-842f-ce70ef6f8648-klusterlet-config\") pod \"klusterlet-addon-workmgr-8cdd89f6d-b94cw\" (UID: \"07458b4b-766c-4d97-842f-ce70ef6f8648\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8cdd89f6d-b94cw" May 21 03:20:27.891675 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:27.891653 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpg72\" (UniqueName: \"kubernetes.io/projected/07458b4b-766c-4d97-842f-ce70ef6f8648-kube-api-access-gpg72\") pod \"klusterlet-addon-workmgr-8cdd89f6d-b94cw\" (UID: \"07458b4b-766c-4d97-842f-ce70ef6f8648\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8cdd89f6d-b94cw" May 21 03:20:27.992878 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:27.992788 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8cdd89f6d-b94cw" May 21 03:20:28.121742 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:28.121691 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-8cdd89f6d-b94cw"] May 21 03:20:28.125427 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:20:28.125400 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07458b4b_766c_4d97_842f_ce70ef6f8648.slice/crio-2576ddedb701dc0a9ae37c9b332991253c322792009bb4349eaec4feebd05cd3 WatchSource:0}: Error finding container 2576ddedb701dc0a9ae37c9b332991253c322792009bb4349eaec4feebd05cd3: Status 404 returned error can't find the container with id 2576ddedb701dc0a9ae37c9b332991253c322792009bb4349eaec4feebd05cd3 May 21 03:20:28.872370 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:28.872330 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8cdd89f6d-b94cw" event={"ID":"07458b4b-766c-4d97-842f-ce70ef6f8648","Type":"ContainerStarted","Data":"2576ddedb701dc0a9ae37c9b332991253c322792009bb4349eaec4feebd05cd3"} May 21 03:20:32.837092 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:32.837058 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tqqk8" May 21 03:20:33.894866 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:33.894815 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8cdd89f6d-b94cw" event={"ID":"07458b4b-766c-4d97-842f-ce70ef6f8648","Type":"ContainerStarted","Data":"5e2852482cfe99dbc2c305ba87c07981ac1915c9bb6f64b941e3a5ee03bec094"} May 21 03:20:33.895322 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:33.895062 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8cdd89f6d-b94cw" May 21 03:20:33.897141 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:33.897123 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8cdd89f6d-b94cw" May 21 03:20:33.909093 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:33.909020 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8cdd89f6d-b94cw" podStartSLOduration=1.993920795 podStartE2EDuration="6.909009896s" podCreationTimestamp="2026-05-21 03:20:27 +0000 UTC" firstStartedPulling="2026-05-21 03:20:28.12718099 +0000 UTC m=+56.169949882" lastFinishedPulling="2026-05-21 03:20:33.042270091 +0000 UTC m=+61.085038983" observedRunningTime="2026-05-21 03:20:33.908234228 +0000 UTC m=+61.951003141" watchObservedRunningTime="2026-05-21 03:20:33.909009896 +0000 UTC m=+61.951778809" May 21 03:20:37.257229 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:37.257180 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f628q\" (UniqueName: \"kubernetes.io/projected/168bd0e1-6421-4c11-8ef2-8caf34170ae9-kube-api-access-f628q\") pod \"network-check-target-skpvq\" (UID: \"168bd0e1-6421-4c11-8ef2-8caf34170ae9\") " pod="openshift-network-diagnostics/network-check-target-skpvq" May 21 03:20:37.257229 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:37.257244 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a03c959-a5a9-44f4-89f3-d604f293b8a0-metrics-certs\") pod \"network-metrics-daemon-7vr9p\" (UID: \"1a03c959-a5a9-44f4-89f3-d604f293b8a0\") " pod="openshift-multus/network-metrics-daemon-7vr9p" May 21 03:20:37.259834 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:37.259817 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 21 03:20:37.259896 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:37.259882 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 21 03:20:37.268186 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:37.268164 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 21 03:20:37.268281 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:37.268233 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a03c959-a5a9-44f4-89f3-d604f293b8a0-metrics-certs podName:1a03c959-a5a9-44f4-89f3-d604f293b8a0 nodeName:}" failed. No retries permitted until 2026-05-21 03:21:41.268211606 +0000 UTC m=+129.310980511 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1a03c959-a5a9-44f4-89f3-d604f293b8a0-metrics-certs") pod "network-metrics-daemon-7vr9p" (UID: "1a03c959-a5a9-44f4-89f3-d604f293b8a0") : secret "metrics-daemon-secret" not found May 21 03:20:37.269923 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:37.269910 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 21 03:20:37.281080 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:37.281063 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f628q\" (UniqueName: \"kubernetes.io/projected/168bd0e1-6421-4c11-8ef2-8caf34170ae9-kube-api-access-f628q\") pod \"network-check-target-skpvq\" (UID: \"168bd0e1-6421-4c11-8ef2-8caf34170ae9\") " pod="openshift-network-diagnostics/network-check-target-skpvq" May 21 03:20:37.358309 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:37.358286 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4931c73f-47f4-428d-8602-5e1f4d3cd47a-original-pull-secret\") pod \"global-pull-secret-syncer-vt8z9\" (UID: \"4931c73f-47f4-428d-8602-5e1f4d3cd47a\") " pod="kube-system/global-pull-secret-syncer-vt8z9" May 21 03:20:37.360686 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:37.360667 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 21 03:20:37.370705 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:37.370677 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4931c73f-47f4-428d-8602-5e1f4d3cd47a-original-pull-secret\") pod \"global-pull-secret-syncer-vt8z9\" (UID: \"4931c73f-47f4-428d-8602-5e1f4d3cd47a\") " pod="kube-system/global-pull-secret-syncer-vt8z9" May 21 03:20:37.396941 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:37.396922 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2nkrm\"" May 21 03:20:37.405690 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:37.405662 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-skpvq" May 21 03:20:37.518944 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:37.518873 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-skpvq"] May 21 03:20:37.521658 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:20:37.521631 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod168bd0e1_6421_4c11_8ef2_8caf34170ae9.slice/crio-6dfec34a5f6218bfcf7be5a2e091581c8bd03c074b34e3e7142d126b9c23d438 WatchSource:0}: Error finding container 6dfec34a5f6218bfcf7be5a2e091581c8bd03c074b34e3e7142d126b9c23d438: Status 404 returned error can't find the container with id 6dfec34a5f6218bfcf7be5a2e091581c8bd03c074b34e3e7142d126b9c23d438 May 21 03:20:37.596011 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:37.595985 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vt8z9" May 21 03:20:37.711141 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:37.711048 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vt8z9"] May 21 03:20:37.713873 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:20:37.713829 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4931c73f_47f4_428d_8602_5e1f4d3cd47a.slice/crio-e88d5c33cceeb570fae5ec5ffee83bcecd732d49df9eff531262c831fb38995f WatchSource:0}: Error finding container e88d5c33cceeb570fae5ec5ffee83bcecd732d49df9eff531262c831fb38995f: Status 404 returned error can't find the container with id e88d5c33cceeb570fae5ec5ffee83bcecd732d49df9eff531262c831fb38995f May 21 03:20:37.902457 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:37.902419 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vt8z9" event={"ID":"4931c73f-47f4-428d-8602-5e1f4d3cd47a","Type":"ContainerStarted","Data":"e88d5c33cceeb570fae5ec5ffee83bcecd732d49df9eff531262c831fb38995f"} May 21 03:20:37.903487 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:37.903462 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-skpvq" event={"ID":"168bd0e1-6421-4c11-8ef2-8caf34170ae9","Type":"ContainerStarted","Data":"6dfec34a5f6218bfcf7be5a2e091581c8bd03c074b34e3e7142d126b9c23d438"} May 21 03:20:39.172237 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:39.172186 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ba1902e2-00e1-4eaa-9aea-5c617de7ebb3-cert\") pod \"ingress-canary-2cxks\" (UID: \"ba1902e2-00e1-4eaa-9aea-5c617de7ebb3\") " pod="openshift-ingress-canary/ingress-canary-2cxks" May 21 03:20:39.172612 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:39.172293 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf-registry-tls\") pod \"image-registry-7b74df67-kzgvj\" (UID: \"1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf\") " pod="openshift-image-registry/image-registry-7b74df67-kzgvj" May 21 03:20:39.172612 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:39.172351 2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 03:20:39.172612 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:39.172428 2574 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 03:20:39.172612 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:39.172442 2574 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b74df67-kzgvj: secret "image-registry-tls" not found May 21 03:20:39.172612 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:39.172447 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba1902e2-00e1-4eaa-9aea-5c617de7ebb3-cert podName:ba1902e2-00e1-4eaa-9aea-5c617de7ebb3 nodeName:}" failed. No retries permitted until 2026-05-21 03:21:11.172427868 +0000 UTC m=+99.215196762 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ba1902e2-00e1-4eaa-9aea-5c617de7ebb3-cert") pod "ingress-canary-2cxks" (UID: "ba1902e2-00e1-4eaa-9aea-5c617de7ebb3") : secret "canary-serving-cert" not found May 21 03:20:39.172612 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:39.172499 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf-registry-tls podName:1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf nodeName:}" failed. No retries permitted until 2026-05-21 03:21:11.172482725 +0000 UTC m=+99.215251631 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf-registry-tls") pod "image-registry-7b74df67-kzgvj" (UID: "1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf") : secret "image-registry-tls" not found May 21 03:20:39.273136 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:39.273100 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a60fd84a-346a-44c3-9a02-5c3db633aaa4-metrics-tls\") pod \"dns-default-d4jjb\" (UID: \"a60fd84a-346a-44c3-9a02-5c3db633aaa4\") " pod="openshift-dns/dns-default-d4jjb" May 21 03:20:39.273303 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:39.273255 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 03:20:39.273364 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:39.273328 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a60fd84a-346a-44c3-9a02-5c3db633aaa4-metrics-tls podName:a60fd84a-346a-44c3-9a02-5c3db633aaa4 nodeName:}" failed. No retries permitted until 2026-05-21 03:21:11.273307409 +0000 UTC m=+99.316076303 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a60fd84a-346a-44c3-9a02-5c3db633aaa4-metrics-tls") pod "dns-default-d4jjb" (UID: "a60fd84a-346a-44c3-9a02-5c3db633aaa4") : secret "dns-default-metrics-tls" not found May 21 03:20:42.914705 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:42.914669 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vt8z9" event={"ID":"4931c73f-47f4-428d-8602-5e1f4d3cd47a","Type":"ContainerStarted","Data":"d49fcdba78efbbc0f57871ddf76cb327a436f855b43b54dc65761d87d53a9a6f"} May 21 03:20:42.915959 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:42.915932 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-skpvq" event={"ID":"168bd0e1-6421-4c11-8ef2-8caf34170ae9","Type":"ContainerStarted","Data":"553966dc4af1f0eefd16a4ad68eda1279947cbe6c8685a9f6fc7d91df4703df4"} May 21 03:20:42.916078 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:42.916041 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-skpvq" May 21 03:20:42.928537 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:42.928490 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-vt8z9" podStartSLOduration=65.513155535 podStartE2EDuration="1m9.928479899s" podCreationTimestamp="2026-05-21 03:19:33 +0000 UTC" firstStartedPulling="2026-05-21 03:20:37.715480654 +0000 UTC m=+65.758249546" lastFinishedPulling="2026-05-21 03:20:42.130805014 +0000 UTC m=+70.173573910" observedRunningTime="2026-05-21 03:20:42.928142017 +0000 UTC m=+70.970910930" watchObservedRunningTime="2026-05-21 03:20:42.928479899 +0000 UTC m=+70.971248813" May 21 03:20:42.945186 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:42.945141 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-skpvq" podStartSLOduration=66.339546311 podStartE2EDuration="1m10.945131321s" podCreationTimestamp="2026-05-21 03:19:32 +0000 UTC" firstStartedPulling="2026-05-21 03:20:37.523584943 +0000 UTC m=+65.566353835" lastFinishedPulling="2026-05-21 03:20:42.129169953 +0000 UTC m=+70.171938845" observedRunningTime="2026-05-21 03:20:42.944447168 +0000 UTC m=+70.987216081" watchObservedRunningTime="2026-05-21 03:20:42.945131321 +0000 UTC m=+70.987900235" May 21 03:20:43.432630 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.432596 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-pmfdr"] May 21 03:20:43.435260 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.435240 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-756cb57bf8-jgcjn"] May 21 03:20:43.435402 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.435382 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-pmfdr" May 21 03:20:43.437511 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.437484 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" May 21 03:20:43.437790 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.437753 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-4dkt4\"" May 21 03:20:43.437790 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.437759 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 21 03:20:43.437790 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.437777 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 21 03:20:43.438121 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.438104 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-756cb57bf8-jgcjn" May 21 03:20:43.438905 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.438883 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" May 21 03:20:43.440170 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.440151 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" May 21 03:20:43.440263 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.440168 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 21 03:20:43.440263 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.440168 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-dz9wd\"" May 21 03:20:43.440451 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.440435 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 21 03:20:43.440494 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.440477 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" May 21 03:20:43.440588 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.440572 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" May 21 03:20:43.440683 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.440665 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" May 21 03:20:43.443626 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.443606 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-pmfdr"] May 21 03:20:43.446658 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.446635 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-756cb57bf8-jgcjn"] May 21 03:20:43.504370 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.504347 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0c56fe16-837c-4d09-8521-f6e5b652b7d9-stats-auth\") pod \"router-default-756cb57bf8-jgcjn\" (UID: \"0c56fe16-837c-4d09-8521-f6e5b652b7d9\") " pod="openshift-ingress/router-default-756cb57bf8-jgcjn" May 21 03:20:43.504487 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.504382 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/234c46ba-e4c6-49c1-b967-283befa2e01d-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-pmfdr\" (UID: \"234c46ba-e4c6-49c1-b967-283befa2e01d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-pmfdr" May 21 03:20:43.504487 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.504419 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/234c46ba-e4c6-49c1-b967-283befa2e01d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-pmfdr\" (UID: \"234c46ba-e4c6-49c1-b967-283befa2e01d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-pmfdr" May 21 03:20:43.504561 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.504484 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c56fe16-837c-4d09-8521-f6e5b652b7d9-metrics-certs\") pod \"router-default-756cb57bf8-jgcjn\" (UID: \"0c56fe16-837c-4d09-8521-f6e5b652b7d9\") " pod="openshift-ingress/router-default-756cb57bf8-jgcjn" May 21 03:20:43.504561 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.504506 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pgl8\" (UniqueName: \"kubernetes.io/projected/0c56fe16-837c-4d09-8521-f6e5b652b7d9-kube-api-access-6pgl8\") pod \"router-default-756cb57bf8-jgcjn\" (UID: \"0c56fe16-837c-4d09-8521-f6e5b652b7d9\") " pod="openshift-ingress/router-default-756cb57bf8-jgcjn" May 21 03:20:43.504561 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.504549 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0c56fe16-837c-4d09-8521-f6e5b652b7d9-default-certificate\") pod \"router-default-756cb57bf8-jgcjn\" (UID: \"0c56fe16-837c-4d09-8521-f6e5b652b7d9\") " pod="openshift-ingress/router-default-756cb57bf8-jgcjn" May 21 03:20:43.504650 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.504577 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c56fe16-837c-4d09-8521-f6e5b652b7d9-service-ca-bundle\") pod \"router-default-756cb57bf8-jgcjn\" (UID: \"0c56fe16-837c-4d09-8521-f6e5b652b7d9\") " pod="openshift-ingress/router-default-756cb57bf8-jgcjn" May 21 03:20:43.504650 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.504596 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxjdz\" (UniqueName: \"kubernetes.io/projected/234c46ba-e4c6-49c1-b967-283befa2e01d-kube-api-access-fxjdz\") pod \"cluster-monitoring-operator-6c75959455-pmfdr\" (UID: \"234c46ba-e4c6-49c1-b967-283befa2e01d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-pmfdr" May 21 03:20:43.532556 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.532536 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-h65g2"] May 21 03:20:43.535245 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.535232 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-h65g2" May 21 03:20:43.537292 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.537244 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" May 21 03:20:43.537292 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.537267 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-l49w5\"" May 21 03:20:43.537458 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.537392 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" May 21 03:20:43.539771 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.539735 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-j66sg"] May 21 03:20:43.542431 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.542412 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-7hp2b"] May 21 03:20:43.542581 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.542566 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-j66sg" May 21 03:20:43.545152 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.545132 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" May 21 03:20:43.545233 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.545172 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" May 21 03:20:43.545360 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.545345 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-8lrds"] May 21 03:20:43.545448 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.545411 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" May 21 03:20:43.545503 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.545474 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-rktdp\"" May 21 03:20:43.545503 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.545485 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-7hp2b" May 21 03:20:43.547813 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.547797 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" May 21 03:20:43.548070 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.548028 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 21 03:20:43.548070 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.548048 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-h65g2"] May 21 03:20:43.548214 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.548099 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 21 03:20:43.548214 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.548142 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-8lrds" May 21 03:20:43.548373 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.548351 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-65kbn\"" May 21 03:20:43.548512 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.548495 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" May 21 03:20:43.550951 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.550771 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" May 21 03:20:43.551196 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.551162 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-rblvh\"" May 21 03:20:43.551553 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.551533 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" May 21 03:20:43.551661 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.551644 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" May 21 03:20:43.552824 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.552311 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-j66sg"] May 21 03:20:43.553007 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.552989 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" May 21 03:20:43.553245 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.553226 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-7hp2b"] May 21 03:20:43.562157 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.562133 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-8lrds"] May 21 03:20:43.565162 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.565135 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" May 21 03:20:43.565681 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.565662 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" May 21 03:20:43.605146 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.605115 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ca5acf81-ffcf-4db2-b3df-90a198122d30-samples-operator-tls\") pod \"cluster-samples-operator-697587599-j66sg\" (UID: \"ca5acf81-ffcf-4db2-b3df-90a198122d30\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-j66sg" May 21 03:20:43.605254 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.605169 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dba914e7-105d-41a4-8789-b248a94c0bd6-serving-cert\") pod \"console-operator-76dff48d59-8lrds\" (UID: \"dba914e7-105d-41a4-8789-b248a94c0bd6\") " pod="openshift-console-operator/console-operator-76dff48d59-8lrds" May 21 03:20:43.605254 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.605212 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dba914e7-105d-41a4-8789-b248a94c0bd6-trusted-ca\") pod \"console-operator-76dff48d59-8lrds\" (UID: \"dba914e7-105d-41a4-8789-b248a94c0bd6\") " pod="openshift-console-operator/console-operator-76dff48d59-8lrds" May 21 03:20:43.605254 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.605236 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/234c46ba-e4c6-49c1-b967-283befa2e01d-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-pmfdr\" (UID: \"234c46ba-e4c6-49c1-b967-283befa2e01d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-pmfdr" May 21 03:20:43.605424 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.605389 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4302517e-e98b-4cd7-8b24-fbf4a8994346-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-7hp2b\" (UID: \"4302517e-e98b-4cd7-8b24-fbf4a8994346\") " pod="openshift-insights/insights-operator-78bdfb888c-7hp2b" May 21 03:20:43.605478 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.605426 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqr4l\" (UniqueName: \"kubernetes.io/projected/2a0b651f-774b-47d2-a666-68fd4e2e3b15-kube-api-access-kqr4l\") pod \"volume-data-source-validator-5cf8c89d64-h65g2\" (UID: \"2a0b651f-774b-47d2-a666-68fd4e2e3b15\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-h65g2" May 21 03:20:43.605531 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.605501 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dba914e7-105d-41a4-8789-b248a94c0bd6-config\") pod \"console-operator-76dff48d59-8lrds\" (UID: \"dba914e7-105d-41a4-8789-b248a94c0bd6\") " pod="openshift-console-operator/console-operator-76dff48d59-8lrds" May 21 03:20:43.605633 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.605562 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0c56fe16-837c-4d09-8521-f6e5b652b7d9-default-certificate\") pod \"router-default-756cb57bf8-jgcjn\" (UID: \"0c56fe16-837c-4d09-8521-f6e5b652b7d9\") " pod="openshift-ingress/router-default-756cb57bf8-jgcjn" May 21 03:20:43.605633 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.605600 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4302517e-e98b-4cd7-8b24-fbf4a8994346-serving-cert\") pod \"insights-operator-78bdfb888c-7hp2b\" (UID: \"4302517e-e98b-4cd7-8b24-fbf4a8994346\") " pod="openshift-insights/insights-operator-78bdfb888c-7hp2b" May 21 03:20:43.605758 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.605641 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c56fe16-837c-4d09-8521-f6e5b652b7d9-service-ca-bundle\") pod \"router-default-756cb57bf8-jgcjn\" (UID: \"0c56fe16-837c-4d09-8521-f6e5b652b7d9\") " pod="openshift-ingress/router-default-756cb57bf8-jgcjn" May 21 03:20:43.605758 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.605668 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pp924\" (UniqueName: \"kubernetes.io/projected/dba914e7-105d-41a4-8789-b248a94c0bd6-kube-api-access-pp924\") pod \"console-operator-76dff48d59-8lrds\" (UID: \"dba914e7-105d-41a4-8789-b248a94c0bd6\") " pod="openshift-console-operator/console-operator-76dff48d59-8lrds" May 21 03:20:43.605758 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.605690 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fxjdz\" (UniqueName: \"kubernetes.io/projected/234c46ba-e4c6-49c1-b967-283befa2e01d-kube-api-access-fxjdz\") pod \"cluster-monitoring-operator-6c75959455-pmfdr\" (UID: \"234c46ba-e4c6-49c1-b967-283befa2e01d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-pmfdr" May 21 03:20:43.605984 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.605792 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0c56fe16-837c-4d09-8521-f6e5b652b7d9-stats-auth\") pod \"router-default-756cb57bf8-jgcjn\" (UID: \"0c56fe16-837c-4d09-8521-f6e5b652b7d9\") " pod="openshift-ingress/router-default-756cb57bf8-jgcjn" May 21 03:20:43.605984 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:43.605804 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0c56fe16-837c-4d09-8521-f6e5b652b7d9-service-ca-bundle podName:0c56fe16-837c-4d09-8521-f6e5b652b7d9 nodeName:}" failed. No retries permitted until 2026-05-21 03:20:44.105786566 +0000 UTC m=+72.148555487 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0c56fe16-837c-4d09-8521-f6e5b652b7d9-service-ca-bundle") pod "router-default-756cb57bf8-jgcjn" (UID: "0c56fe16-837c-4d09-8521-f6e5b652b7d9") : configmap references non-existent config key: service-ca.crt May 21 03:20:43.605984 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.605839 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/4302517e-e98b-4cd7-8b24-fbf4a8994346-snapshots\") pod \"insights-operator-78bdfb888c-7hp2b\" (UID: \"4302517e-e98b-4cd7-8b24-fbf4a8994346\") " pod="openshift-insights/insights-operator-78bdfb888c-7hp2b" May 21 03:20:43.605984 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.605885 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4302517e-e98b-4cd7-8b24-fbf4a8994346-service-ca-bundle\") pod \"insights-operator-78bdfb888c-7hp2b\" (UID: \"4302517e-e98b-4cd7-8b24-fbf4a8994346\") " pod="openshift-insights/insights-operator-78bdfb888c-7hp2b" May 21 03:20:43.605984 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.605917 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4302517e-e98b-4cd7-8b24-fbf4a8994346-tmp\") pod \"insights-operator-78bdfb888c-7hp2b\" (UID: \"4302517e-e98b-4cd7-8b24-fbf4a8994346\") " pod="openshift-insights/insights-operator-78bdfb888c-7hp2b" May 21 03:20:43.605984 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.605955 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/234c46ba-e4c6-49c1-b967-283befa2e01d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-pmfdr\" (UID: \"234c46ba-e4c6-49c1-b967-283befa2e01d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-pmfdr" May 21 03:20:43.605984 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.605987 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdv8q\" (UniqueName: \"kubernetes.io/projected/ca5acf81-ffcf-4db2-b3df-90a198122d30-kube-api-access-hdv8q\") pod \"cluster-samples-operator-697587599-j66sg\" (UID: \"ca5acf81-ffcf-4db2-b3df-90a198122d30\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-j66sg" May 21 03:20:43.606309 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.606008 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6pgl8\" (UniqueName: \"kubernetes.io/projected/0c56fe16-837c-4d09-8521-f6e5b652b7d9-kube-api-access-6pgl8\") pod \"router-default-756cb57bf8-jgcjn\" (UID: \"0c56fe16-837c-4d09-8521-f6e5b652b7d9\") " pod="openshift-ingress/router-default-756cb57bf8-jgcjn" May 21 03:20:43.606309 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.606034 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c56fe16-837c-4d09-8521-f6e5b652b7d9-metrics-certs\") pod \"router-default-756cb57bf8-jgcjn\" (UID: \"0c56fe16-837c-4d09-8521-f6e5b652b7d9\") " pod="openshift-ingress/router-default-756cb57bf8-jgcjn" May 21 03:20:43.606309 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.606061 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2b9f\" (UniqueName: \"kubernetes.io/projected/4302517e-e98b-4cd7-8b24-fbf4a8994346-kube-api-access-d2b9f\") pod \"insights-operator-78bdfb888c-7hp2b\" (UID: \"4302517e-e98b-4cd7-8b24-fbf4a8994346\") " pod="openshift-insights/insights-operator-78bdfb888c-7hp2b" May 21 03:20:43.606309 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:43.606075 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 21 03:20:43.606309 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:43.606119 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/234c46ba-e4c6-49c1-b967-283befa2e01d-cluster-monitoring-operator-tls podName:234c46ba-e4c6-49c1-b967-283befa2e01d nodeName:}" failed. No retries permitted until 2026-05-21 03:20:44.106104967 +0000 UTC m=+72.148873873 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/234c46ba-e4c6-49c1-b967-283befa2e01d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-pmfdr" (UID: "234c46ba-e4c6-49c1-b967-283befa2e01d") : secret "cluster-monitoring-operator-tls" not found May 21 03:20:43.606309 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.606151 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/234c46ba-e4c6-49c1-b967-283befa2e01d-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-pmfdr\" (UID: \"234c46ba-e4c6-49c1-b967-283befa2e01d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-pmfdr" May 21 03:20:43.606309 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:43.606169 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 21 03:20:43.606309 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:43.606233 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c56fe16-837c-4d09-8521-f6e5b652b7d9-metrics-certs podName:0c56fe16-837c-4d09-8521-f6e5b652b7d9 nodeName:}" failed. No retries permitted until 2026-05-21 03:20:44.106215467 +0000 UTC m=+72.148984378 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0c56fe16-837c-4d09-8521-f6e5b652b7d9-metrics-certs") pod "router-default-756cb57bf8-jgcjn" (UID: "0c56fe16-837c-4d09-8521-f6e5b652b7d9") : secret "router-metrics-certs-default" not found May 21 03:20:43.608159 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.608136 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0c56fe16-837c-4d09-8521-f6e5b652b7d9-stats-auth\") pod \"router-default-756cb57bf8-jgcjn\" (UID: \"0c56fe16-837c-4d09-8521-f6e5b652b7d9\") " pod="openshift-ingress/router-default-756cb57bf8-jgcjn" May 21 03:20:43.608351 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.608335 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0c56fe16-837c-4d09-8521-f6e5b652b7d9-default-certificate\") pod \"router-default-756cb57bf8-jgcjn\" (UID: \"0c56fe16-837c-4d09-8521-f6e5b652b7d9\") " pod="openshift-ingress/router-default-756cb57bf8-jgcjn" May 21 03:20:43.614209 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.614191 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pgl8\" (UniqueName: \"kubernetes.io/projected/0c56fe16-837c-4d09-8521-f6e5b652b7d9-kube-api-access-6pgl8\") pod \"router-default-756cb57bf8-jgcjn\" (UID: \"0c56fe16-837c-4d09-8521-f6e5b652b7d9\") " pod="openshift-ingress/router-default-756cb57bf8-jgcjn" May 21 03:20:43.614308 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.614292 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxjdz\" (UniqueName: \"kubernetes.io/projected/234c46ba-e4c6-49c1-b967-283befa2e01d-kube-api-access-fxjdz\") pod \"cluster-monitoring-operator-6c75959455-pmfdr\" (UID: \"234c46ba-e4c6-49c1-b967-283befa2e01d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-pmfdr" May 21 03:20:43.634713 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.634694 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-4q5lp"] May 21 03:20:43.638631 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.638616 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-4q5lp" May 21 03:20:43.640796 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.640774 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" May 21 03:20:43.640903 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.640774 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-rcscb\"" May 21 03:20:43.640903 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.640775 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" May 21 03:20:43.640903 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.640777 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" May 21 03:20:43.640903 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.640778 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" May 21 03:20:43.646366 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.646343 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-4q5lp"] May 21 03:20:43.706685 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.706619 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/87cfc78f-987e-46d9-a3e2-7128548b613d-config\") pod \"kube-storage-version-migrator-operator-565644f49-4q5lp\" (UID: \"87cfc78f-987e-46d9-a3e2-7128548b613d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-4q5lp" May 21 03:20:43.706685 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.706661 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4302517e-e98b-4cd7-8b24-fbf4a8994346-serving-cert\") pod \"insights-operator-78bdfb888c-7hp2b\" (UID: \"4302517e-e98b-4cd7-8b24-fbf4a8994346\") " pod="openshift-insights/insights-operator-78bdfb888c-7hp2b" May 21 03:20:43.706819 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.706717 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pp924\" (UniqueName: \"kubernetes.io/projected/dba914e7-105d-41a4-8789-b248a94c0bd6-kube-api-access-pp924\") pod \"console-operator-76dff48d59-8lrds\" (UID: \"dba914e7-105d-41a4-8789-b248a94c0bd6\") " pod="openshift-console-operator/console-operator-76dff48d59-8lrds" May 21 03:20:43.706819 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.706776 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/87cfc78f-987e-46d9-a3e2-7128548b613d-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-4q5lp\" (UID: \"87cfc78f-987e-46d9-a3e2-7128548b613d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-4q5lp" May 21 03:20:43.706819 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.706800 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/4302517e-e98b-4cd7-8b24-fbf4a8994346-snapshots\") pod \"insights-operator-78bdfb888c-7hp2b\" (UID: \"4302517e-e98b-4cd7-8b24-fbf4a8994346\") " pod="openshift-insights/insights-operator-78bdfb888c-7hp2b" May 21 03:20:43.706819 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.706816 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4302517e-e98b-4cd7-8b24-fbf4a8994346-service-ca-bundle\") pod \"insights-operator-78bdfb888c-7hp2b\" (UID: \"4302517e-e98b-4cd7-8b24-fbf4a8994346\") " pod="openshift-insights/insights-operator-78bdfb888c-7hp2b" May 21 03:20:43.707027 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.706837 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6wwf\" (UniqueName: \"kubernetes.io/projected/87cfc78f-987e-46d9-a3e2-7128548b613d-kube-api-access-m6wwf\") pod \"kube-storage-version-migrator-operator-565644f49-4q5lp\" (UID: \"87cfc78f-987e-46d9-a3e2-7128548b613d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-4q5lp" May 21 03:20:43.707027 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.706887 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4302517e-e98b-4cd7-8b24-fbf4a8994346-tmp\") pod \"insights-operator-78bdfb888c-7hp2b\" (UID: \"4302517e-e98b-4cd7-8b24-fbf4a8994346\") " pod="openshift-insights/insights-operator-78bdfb888c-7hp2b" May 21 03:20:43.707027 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.706962 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hdv8q\" (UniqueName: \"kubernetes.io/projected/ca5acf81-ffcf-4db2-b3df-90a198122d30-kube-api-access-hdv8q\") pod \"cluster-samples-operator-697587599-j66sg\" (UID: \"ca5acf81-ffcf-4db2-b3df-90a198122d30\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-j66sg" May 21 03:20:43.707027 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.707010 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d2b9f\" (UniqueName: \"kubernetes.io/projected/4302517e-e98b-4cd7-8b24-fbf4a8994346-kube-api-access-d2b9f\") pod \"insights-operator-78bdfb888c-7hp2b\" (UID: \"4302517e-e98b-4cd7-8b24-fbf4a8994346\") " pod="openshift-insights/insights-operator-78bdfb888c-7hp2b" May 21 03:20:43.707224 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.707168 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ca5acf81-ffcf-4db2-b3df-90a198122d30-samples-operator-tls\") pod \"cluster-samples-operator-697587599-j66sg\" (UID: \"ca5acf81-ffcf-4db2-b3df-90a198122d30\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-j66sg" May 21 03:20:43.707224 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.707204 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dba914e7-105d-41a4-8789-b248a94c0bd6-serving-cert\") pod \"console-operator-76dff48d59-8lrds\" (UID: \"dba914e7-105d-41a4-8789-b248a94c0bd6\") " pod="openshift-console-operator/console-operator-76dff48d59-8lrds" May 21 03:20:43.707550 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.707245 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dba914e7-105d-41a4-8789-b248a94c0bd6-trusted-ca\") pod \"console-operator-76dff48d59-8lrds\" (UID: \"dba914e7-105d-41a4-8789-b248a94c0bd6\") " pod="openshift-console-operator/console-operator-76dff48d59-8lrds" May 21 03:20:43.707550 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.707285 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4302517e-e98b-4cd7-8b24-fbf4a8994346-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-7hp2b\" (UID: \"4302517e-e98b-4cd7-8b24-fbf4a8994346\") " pod="openshift-insights/insights-operator-78bdfb888c-7hp2b" May 21 03:20:43.707550 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:43.707303 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 21 03:20:43.707550 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.707318 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kqr4l\" (UniqueName: \"kubernetes.io/projected/2a0b651f-774b-47d2-a666-68fd4e2e3b15-kube-api-access-kqr4l\") pod \"volume-data-source-validator-5cf8c89d64-h65g2\" (UID: \"2a0b651f-774b-47d2-a666-68fd4e2e3b15\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-h65g2" May 21 03:20:43.707550 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.707350 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dba914e7-105d-41a4-8789-b248a94c0bd6-config\") pod \"console-operator-76dff48d59-8lrds\" (UID: \"dba914e7-105d-41a4-8789-b248a94c0bd6\") " pod="openshift-console-operator/console-operator-76dff48d59-8lrds" May 21 03:20:43.707550 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:43.707381 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca5acf81-ffcf-4db2-b3df-90a198122d30-samples-operator-tls podName:ca5acf81-ffcf-4db2-b3df-90a198122d30 nodeName:}" failed. No retries permitted until 2026-05-21 03:20:44.207346739 +0000 UTC m=+72.250115647 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ca5acf81-ffcf-4db2-b3df-90a198122d30-samples-operator-tls") pod "cluster-samples-operator-697587599-j66sg" (UID: "ca5acf81-ffcf-4db2-b3df-90a198122d30") : secret "samples-operator-tls" not found May 21 03:20:43.707550 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.707405 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4302517e-e98b-4cd7-8b24-fbf4a8994346-tmp\") pod \"insights-operator-78bdfb888c-7hp2b\" (UID: \"4302517e-e98b-4cd7-8b24-fbf4a8994346\") " pod="openshift-insights/insights-operator-78bdfb888c-7hp2b" May 21 03:20:43.707550 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.707453 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4302517e-e98b-4cd7-8b24-fbf4a8994346-service-ca-bundle\") pod \"insights-operator-78bdfb888c-7hp2b\" (UID: \"4302517e-e98b-4cd7-8b24-fbf4a8994346\") " pod="openshift-insights/insights-operator-78bdfb888c-7hp2b" May 21 03:20:43.707550 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.707455 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/4302517e-e98b-4cd7-8b24-fbf4a8994346-snapshots\") pod \"insights-operator-78bdfb888c-7hp2b\" (UID: \"4302517e-e98b-4cd7-8b24-fbf4a8994346\") " pod="openshift-insights/insights-operator-78bdfb888c-7hp2b" May 21 03:20:43.708034 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.707997 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dba914e7-105d-41a4-8789-b248a94c0bd6-config\") pod \"console-operator-76dff48d59-8lrds\" (UID: \"dba914e7-105d-41a4-8789-b248a94c0bd6\") " pod="openshift-console-operator/console-operator-76dff48d59-8lrds" May 21 03:20:43.708267 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.708244 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4302517e-e98b-4cd7-8b24-fbf4a8994346-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-7hp2b\" (UID: \"4302517e-e98b-4cd7-8b24-fbf4a8994346\") " pod="openshift-insights/insights-operator-78bdfb888c-7hp2b" May 21 03:20:43.708343 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.708328 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dba914e7-105d-41a4-8789-b248a94c0bd6-trusted-ca\") pod \"console-operator-76dff48d59-8lrds\" (UID: \"dba914e7-105d-41a4-8789-b248a94c0bd6\") " pod="openshift-console-operator/console-operator-76dff48d59-8lrds" May 21 03:20:43.709163 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.709146 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4302517e-e98b-4cd7-8b24-fbf4a8994346-serving-cert\") pod \"insights-operator-78bdfb888c-7hp2b\" (UID: \"4302517e-e98b-4cd7-8b24-fbf4a8994346\") " pod="openshift-insights/insights-operator-78bdfb888c-7hp2b" May 21 03:20:43.709504 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.709490 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dba914e7-105d-41a4-8789-b248a94c0bd6-serving-cert\") pod \"console-operator-76dff48d59-8lrds\" (UID: \"dba914e7-105d-41a4-8789-b248a94c0bd6\") " pod="openshift-console-operator/console-operator-76dff48d59-8lrds" May 21 03:20:43.714465 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.714443 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pp924\" (UniqueName: \"kubernetes.io/projected/dba914e7-105d-41a4-8789-b248a94c0bd6-kube-api-access-pp924\") pod \"console-operator-76dff48d59-8lrds\" (UID: \"dba914e7-105d-41a4-8789-b248a94c0bd6\") " pod="openshift-console-operator/console-operator-76dff48d59-8lrds" May 21 03:20:43.715531 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.715511 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqr4l\" (UniqueName: \"kubernetes.io/projected/2a0b651f-774b-47d2-a666-68fd4e2e3b15-kube-api-access-kqr4l\") pod \"volume-data-source-validator-5cf8c89d64-h65g2\" (UID: \"2a0b651f-774b-47d2-a666-68fd4e2e3b15\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-h65g2" May 21 03:20:43.715608 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.715549 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2b9f\" (UniqueName: \"kubernetes.io/projected/4302517e-e98b-4cd7-8b24-fbf4a8994346-kube-api-access-d2b9f\") pod \"insights-operator-78bdfb888c-7hp2b\" (UID: \"4302517e-e98b-4cd7-8b24-fbf4a8994346\") " pod="openshift-insights/insights-operator-78bdfb888c-7hp2b" May 21 03:20:43.715718 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.715703 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdv8q\" (UniqueName: \"kubernetes.io/projected/ca5acf81-ffcf-4db2-b3df-90a198122d30-kube-api-access-hdv8q\") pod \"cluster-samples-operator-697587599-j66sg\" (UID: \"ca5acf81-ffcf-4db2-b3df-90a198122d30\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-j66sg" May 21 03:20:43.807930 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.807906 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/87cfc78f-987e-46d9-a3e2-7128548b613d-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-4q5lp\" (UID: \"87cfc78f-987e-46d9-a3e2-7128548b613d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-4q5lp" May 21 03:20:43.808017 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.807941 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m6wwf\" (UniqueName: \"kubernetes.io/projected/87cfc78f-987e-46d9-a3e2-7128548b613d-kube-api-access-m6wwf\") pod \"kube-storage-version-migrator-operator-565644f49-4q5lp\" (UID: \"87cfc78f-987e-46d9-a3e2-7128548b613d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-4q5lp" May 21 03:20:43.808102 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.808085 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/87cfc78f-987e-46d9-a3e2-7128548b613d-config\") pod \"kube-storage-version-migrator-operator-565644f49-4q5lp\" (UID: \"87cfc78f-987e-46d9-a3e2-7128548b613d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-4q5lp" May 21 03:20:43.808507 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.808482 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/87cfc78f-987e-46d9-a3e2-7128548b613d-config\") pod \"kube-storage-version-migrator-operator-565644f49-4q5lp\" (UID: \"87cfc78f-987e-46d9-a3e2-7128548b613d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-4q5lp" May 21 03:20:43.809867 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.809832 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/87cfc78f-987e-46d9-a3e2-7128548b613d-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-4q5lp\" (UID: \"87cfc78f-987e-46d9-a3e2-7128548b613d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-4q5lp" May 21 03:20:43.814760 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.814738 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6wwf\" (UniqueName: \"kubernetes.io/projected/87cfc78f-987e-46d9-a3e2-7128548b613d-kube-api-access-m6wwf\") pod \"kube-storage-version-migrator-operator-565644f49-4q5lp\" (UID: \"87cfc78f-987e-46d9-a3e2-7128548b613d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-4q5lp" May 21 03:20:43.844683 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.844665 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-h65g2" May 21 03:20:43.866485 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.866464 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-7hp2b" May 21 03:20:43.871089 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.871070 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-8lrds" May 21 03:20:43.946974 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.946941 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-4q5lp" May 21 03:20:43.989640 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:43.989611 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-h65g2"] May 21 03:20:43.993759 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:20:43.993720 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a0b651f_774b_47d2_a666_68fd4e2e3b15.slice/crio-07021c25d8ecc944e64e73f493eb3cd373aff5342b045cb452d2045cd69a3e23 WatchSource:0}: Error finding container 07021c25d8ecc944e64e73f493eb3cd373aff5342b045cb452d2045cd69a3e23: Status 404 returned error can't find the container with id 07021c25d8ecc944e64e73f493eb3cd373aff5342b045cb452d2045cd69a3e23 May 21 03:20:44.018373 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:44.018027 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-7hp2b"] May 21 03:20:44.021779 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:20:44.021756 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4302517e_e98b_4cd7_8b24_fbf4a8994346.slice/crio-674869eb4238d5c570333d32ae43636836a61b9ced2e9cebb1a49a4e011219f3 WatchSource:0}: Error finding container 674869eb4238d5c570333d32ae43636836a61b9ced2e9cebb1a49a4e011219f3: Status 404 returned error can't find the container with id 674869eb4238d5c570333d32ae43636836a61b9ced2e9cebb1a49a4e011219f3 May 21 03:20:44.030119 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:44.030096 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-8lrds"] May 21 03:20:44.032557 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:20:44.032529 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddba914e7_105d_41a4_8789_b248a94c0bd6.slice/crio-92da84c2842822577a41b7087da3762fed71bfd00827b7515be9ee323608a818 WatchSource:0}: Error finding container 92da84c2842822577a41b7087da3762fed71bfd00827b7515be9ee323608a818: Status 404 returned error can't find the container with id 92da84c2842822577a41b7087da3762fed71bfd00827b7515be9ee323608a818 May 21 03:20:44.083580 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:44.083555 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-4q5lp"] May 21 03:20:44.086356 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:20:44.086331 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87cfc78f_987e_46d9_a3e2_7128548b613d.slice/crio-2aca61f241bc77dde4150d1d5ec86991d94d5954776b75c7a26442e489383dcc WatchSource:0}: Error finding container 2aca61f241bc77dde4150d1d5ec86991d94d5954776b75c7a26442e489383dcc: Status 404 returned error can't find the container with id 2aca61f241bc77dde4150d1d5ec86991d94d5954776b75c7a26442e489383dcc May 21 03:20:44.111588 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:44.111562 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/234c46ba-e4c6-49c1-b967-283befa2e01d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-pmfdr\" (UID: \"234c46ba-e4c6-49c1-b967-283befa2e01d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-pmfdr" May 21 03:20:44.111674 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:44.111605 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c56fe16-837c-4d09-8521-f6e5b652b7d9-metrics-certs\") pod \"router-default-756cb57bf8-jgcjn\" (UID: \"0c56fe16-837c-4d09-8521-f6e5b652b7d9\") " pod="openshift-ingress/router-default-756cb57bf8-jgcjn" May 21 03:20:44.111721 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:44.111685 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c56fe16-837c-4d09-8521-f6e5b652b7d9-service-ca-bundle\") pod \"router-default-756cb57bf8-jgcjn\" (UID: \"0c56fe16-837c-4d09-8521-f6e5b652b7d9\") " pod="openshift-ingress/router-default-756cb57bf8-jgcjn" May 21 03:20:44.111721 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:44.111692 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 21 03:20:44.111793 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:44.111743 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/234c46ba-e4c6-49c1-b967-283befa2e01d-cluster-monitoring-operator-tls podName:234c46ba-e4c6-49c1-b967-283befa2e01d nodeName:}" failed. No retries permitted until 2026-05-21 03:20:45.111728172 +0000 UTC m=+73.154497081 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/234c46ba-e4c6-49c1-b967-283befa2e01d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-pmfdr" (UID: "234c46ba-e4c6-49c1-b967-283befa2e01d") : secret "cluster-monitoring-operator-tls" not found May 21 03:20:44.111793 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:44.111760 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 21 03:20:44.111793 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:44.111775 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0c56fe16-837c-4d09-8521-f6e5b652b7d9-service-ca-bundle podName:0c56fe16-837c-4d09-8521-f6e5b652b7d9 nodeName:}" failed. No retries permitted until 2026-05-21 03:20:45.111762812 +0000 UTC m=+73.154531704 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0c56fe16-837c-4d09-8521-f6e5b652b7d9-service-ca-bundle") pod "router-default-756cb57bf8-jgcjn" (UID: "0c56fe16-837c-4d09-8521-f6e5b652b7d9") : configmap references non-existent config key: service-ca.crt May 21 03:20:44.111956 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:44.111797 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c56fe16-837c-4d09-8521-f6e5b652b7d9-metrics-certs podName:0c56fe16-837c-4d09-8521-f6e5b652b7d9 nodeName:}" failed. No retries permitted until 2026-05-21 03:20:45.111787554 +0000 UTC m=+73.154556450 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0c56fe16-837c-4d09-8521-f6e5b652b7d9-metrics-certs") pod "router-default-756cb57bf8-jgcjn" (UID: "0c56fe16-837c-4d09-8521-f6e5b652b7d9") : secret "router-metrics-certs-default" not found May 21 03:20:44.212739 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:44.212682 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ca5acf81-ffcf-4db2-b3df-90a198122d30-samples-operator-tls\") pod \"cluster-samples-operator-697587599-j66sg\" (UID: \"ca5acf81-ffcf-4db2-b3df-90a198122d30\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-j66sg" May 21 03:20:44.212828 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:44.212784 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 21 03:20:44.212828 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:44.212827 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca5acf81-ffcf-4db2-b3df-90a198122d30-samples-operator-tls podName:ca5acf81-ffcf-4db2-b3df-90a198122d30 nodeName:}" failed. No retries permitted until 2026-05-21 03:20:45.212815744 +0000 UTC m=+73.255584648 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ca5acf81-ffcf-4db2-b3df-90a198122d30-samples-operator-tls") pod "cluster-samples-operator-697587599-j66sg" (UID: "ca5acf81-ffcf-4db2-b3df-90a198122d30") : secret "samples-operator-tls" not found May 21 03:20:44.924813 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:44.924769 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-h65g2" event={"ID":"2a0b651f-774b-47d2-a666-68fd4e2e3b15","Type":"ContainerStarted","Data":"07021c25d8ecc944e64e73f493eb3cd373aff5342b045cb452d2045cd69a3e23"} May 21 03:20:44.926272 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:44.926216 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-8lrds" event={"ID":"dba914e7-105d-41a4-8789-b248a94c0bd6","Type":"ContainerStarted","Data":"92da84c2842822577a41b7087da3762fed71bfd00827b7515be9ee323608a818"} May 21 03:20:44.927520 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:44.927459 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-7hp2b" event={"ID":"4302517e-e98b-4cd7-8b24-fbf4a8994346","Type":"ContainerStarted","Data":"674869eb4238d5c570333d32ae43636836a61b9ced2e9cebb1a49a4e011219f3"} May 21 03:20:44.929314 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:44.929263 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-4q5lp" event={"ID":"87cfc78f-987e-46d9-a3e2-7128548b613d","Type":"ContainerStarted","Data":"2aca61f241bc77dde4150d1d5ec86991d94d5954776b75c7a26442e489383dcc"} May 21 03:20:45.120999 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:45.120053 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c56fe16-837c-4d09-8521-f6e5b652b7d9-service-ca-bundle\") pod \"router-default-756cb57bf8-jgcjn\" (UID: \"0c56fe16-837c-4d09-8521-f6e5b652b7d9\") " pod="openshift-ingress/router-default-756cb57bf8-jgcjn" May 21 03:20:45.120999 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:45.120127 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/234c46ba-e4c6-49c1-b967-283befa2e01d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-pmfdr\" (UID: \"234c46ba-e4c6-49c1-b967-283befa2e01d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-pmfdr" May 21 03:20:45.120999 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:45.120180 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c56fe16-837c-4d09-8521-f6e5b652b7d9-metrics-certs\") pod \"router-default-756cb57bf8-jgcjn\" (UID: \"0c56fe16-837c-4d09-8521-f6e5b652b7d9\") " pod="openshift-ingress/router-default-756cb57bf8-jgcjn" May 21 03:20:45.120999 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:45.120342 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 21 03:20:45.120999 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:45.120405 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c56fe16-837c-4d09-8521-f6e5b652b7d9-metrics-certs podName:0c56fe16-837c-4d09-8521-f6e5b652b7d9 nodeName:}" failed. No retries permitted until 2026-05-21 03:20:47.120384754 +0000 UTC m=+75.163153651 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0c56fe16-837c-4d09-8521-f6e5b652b7d9-metrics-certs") pod "router-default-756cb57bf8-jgcjn" (UID: "0c56fe16-837c-4d09-8521-f6e5b652b7d9") : secret "router-metrics-certs-default" not found May 21 03:20:45.120999 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:45.120832 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0c56fe16-837c-4d09-8521-f6e5b652b7d9-service-ca-bundle podName:0c56fe16-837c-4d09-8521-f6e5b652b7d9 nodeName:}" failed. No retries permitted until 2026-05-21 03:20:47.12081458 +0000 UTC m=+75.163583474 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0c56fe16-837c-4d09-8521-f6e5b652b7d9-service-ca-bundle") pod "router-default-756cb57bf8-jgcjn" (UID: "0c56fe16-837c-4d09-8521-f6e5b652b7d9") : configmap references non-existent config key: service-ca.crt May 21 03:20:45.120999 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:45.120923 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 21 03:20:45.120999 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:45.120964 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/234c46ba-e4c6-49c1-b967-283befa2e01d-cluster-monitoring-operator-tls podName:234c46ba-e4c6-49c1-b967-283befa2e01d nodeName:}" failed. No retries permitted until 2026-05-21 03:20:47.120952866 +0000 UTC m=+75.163721759 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/234c46ba-e4c6-49c1-b967-283befa2e01d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-pmfdr" (UID: "234c46ba-e4c6-49c1-b967-283befa2e01d") : secret "cluster-monitoring-operator-tls" not found May 21 03:20:45.221778 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:45.221517 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ca5acf81-ffcf-4db2-b3df-90a198122d30-samples-operator-tls\") pod \"cluster-samples-operator-697587599-j66sg\" (UID: \"ca5acf81-ffcf-4db2-b3df-90a198122d30\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-j66sg" May 21 03:20:45.221778 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:45.221692 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 21 03:20:45.222015 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:45.221784 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca5acf81-ffcf-4db2-b3df-90a198122d30-samples-operator-tls podName:ca5acf81-ffcf-4db2-b3df-90a198122d30 nodeName:}" failed. No retries permitted until 2026-05-21 03:20:47.221758086 +0000 UTC m=+75.264527003 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ca5acf81-ffcf-4db2-b3df-90a198122d30-samples-operator-tls") pod "cluster-samples-operator-697587599-j66sg" (UID: "ca5acf81-ffcf-4db2-b3df-90a198122d30") : secret "samples-operator-tls" not found May 21 03:20:46.511508 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:46.511465 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-brdg7"] May 21 03:20:46.515984 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:46.515959 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-brdg7" May 21 03:20:46.518470 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:46.518341 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" May 21 03:20:46.518470 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:46.518390 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" May 21 03:20:46.518470 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:46.518398 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" May 21 03:20:46.518470 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:46.518399 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" May 21 03:20:46.519122 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:46.519103 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-584tb\"" May 21 03:20:46.521749 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:46.521726 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-brdg7"] May 21 03:20:46.636834 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:46.636804 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/651b5561-46ec-4f61-88f5-1788bc682717-config\") pod \"service-ca-operator-57b5b68b8-brdg7\" (UID: \"651b5561-46ec-4f61-88f5-1788bc682717\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-brdg7" May 21 03:20:46.636995 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:46.636837 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4c846\" (UniqueName: \"kubernetes.io/projected/651b5561-46ec-4f61-88f5-1788bc682717-kube-api-access-4c846\") pod \"service-ca-operator-57b5b68b8-brdg7\" (UID: \"651b5561-46ec-4f61-88f5-1788bc682717\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-brdg7" May 21 03:20:46.636995 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:46.636942 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/651b5561-46ec-4f61-88f5-1788bc682717-serving-cert\") pod \"service-ca-operator-57b5b68b8-brdg7\" (UID: \"651b5561-46ec-4f61-88f5-1788bc682717\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-brdg7" May 21 03:20:46.738303 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:46.738268 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/651b5561-46ec-4f61-88f5-1788bc682717-config\") pod \"service-ca-operator-57b5b68b8-brdg7\" (UID: \"651b5561-46ec-4f61-88f5-1788bc682717\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-brdg7" May 21 03:20:46.738303 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:46.738302 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4c846\" (UniqueName: \"kubernetes.io/projected/651b5561-46ec-4f61-88f5-1788bc682717-kube-api-access-4c846\") pod \"service-ca-operator-57b5b68b8-brdg7\" (UID: \"651b5561-46ec-4f61-88f5-1788bc682717\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-brdg7" May 21 03:20:46.738534 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:46.738454 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/651b5561-46ec-4f61-88f5-1788bc682717-serving-cert\") pod \"service-ca-operator-57b5b68b8-brdg7\" (UID: \"651b5561-46ec-4f61-88f5-1788bc682717\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-brdg7" May 21 03:20:46.738944 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:46.738925 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/651b5561-46ec-4f61-88f5-1788bc682717-config\") pod \"service-ca-operator-57b5b68b8-brdg7\" (UID: \"651b5561-46ec-4f61-88f5-1788bc682717\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-brdg7" May 21 03:20:46.740941 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:46.740913 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/651b5561-46ec-4f61-88f5-1788bc682717-serving-cert\") pod \"service-ca-operator-57b5b68b8-brdg7\" (UID: \"651b5561-46ec-4f61-88f5-1788bc682717\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-brdg7" May 21 03:20:46.748351 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:46.748327 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4c846\" (UniqueName: \"kubernetes.io/projected/651b5561-46ec-4f61-88f5-1788bc682717-kube-api-access-4c846\") pod \"service-ca-operator-57b5b68b8-brdg7\" (UID: \"651b5561-46ec-4f61-88f5-1788bc682717\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-brdg7" May 21 03:20:46.827999 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:46.827926 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-brdg7" May 21 03:20:47.141515 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:47.141494 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c56fe16-837c-4d09-8521-f6e5b652b7d9-metrics-certs\") pod \"router-default-756cb57bf8-jgcjn\" (UID: \"0c56fe16-837c-4d09-8521-f6e5b652b7d9\") " pod="openshift-ingress/router-default-756cb57bf8-jgcjn" May 21 03:20:47.141592 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:47.141573 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c56fe16-837c-4d09-8521-f6e5b652b7d9-service-ca-bundle\") pod \"router-default-756cb57bf8-jgcjn\" (UID: \"0c56fe16-837c-4d09-8521-f6e5b652b7d9\") " pod="openshift-ingress/router-default-756cb57bf8-jgcjn" May 21 03:20:47.141675 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:47.141604 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/234c46ba-e4c6-49c1-b967-283befa2e01d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-pmfdr\" (UID: \"234c46ba-e4c6-49c1-b967-283befa2e01d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-pmfdr" May 21 03:20:47.141675 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:47.141649 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 21 03:20:47.141749 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:47.141684 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0c56fe16-837c-4d09-8521-f6e5b652b7d9-service-ca-bundle podName:0c56fe16-837c-4d09-8521-f6e5b652b7d9 nodeName:}" failed. No retries permitted until 2026-05-21 03:20:51.141663931 +0000 UTC m=+79.184432827 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0c56fe16-837c-4d09-8521-f6e5b652b7d9-service-ca-bundle") pod "router-default-756cb57bf8-jgcjn" (UID: "0c56fe16-837c-4d09-8521-f6e5b652b7d9") : configmap references non-existent config key: service-ca.crt May 21 03:20:47.141749 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:47.141691 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 21 03:20:47.141749 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:47.141704 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c56fe16-837c-4d09-8521-f6e5b652b7d9-metrics-certs podName:0c56fe16-837c-4d09-8521-f6e5b652b7d9 nodeName:}" failed. No retries permitted until 2026-05-21 03:20:51.141695874 +0000 UTC m=+79.184464772 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0c56fe16-837c-4d09-8521-f6e5b652b7d9-metrics-certs") pod "router-default-756cb57bf8-jgcjn" (UID: "0c56fe16-837c-4d09-8521-f6e5b652b7d9") : secret "router-metrics-certs-default" not found May 21 03:20:47.141749 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:47.141737 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/234c46ba-e4c6-49c1-b967-283befa2e01d-cluster-monitoring-operator-tls podName:234c46ba-e4c6-49c1-b967-283befa2e01d nodeName:}" failed. No retries permitted until 2026-05-21 03:20:51.141725306 +0000 UTC m=+79.184494198 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/234c46ba-e4c6-49c1-b967-283befa2e01d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-pmfdr" (UID: "234c46ba-e4c6-49c1-b967-283befa2e01d") : secret "cluster-monitoring-operator-tls" not found May 21 03:20:47.242394 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:47.242372 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ca5acf81-ffcf-4db2-b3df-90a198122d30-samples-operator-tls\") pod \"cluster-samples-operator-697587599-j66sg\" (UID: \"ca5acf81-ffcf-4db2-b3df-90a198122d30\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-j66sg" May 21 03:20:47.242582 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:47.242565 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 21 03:20:47.242663 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:47.242634 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca5acf81-ffcf-4db2-b3df-90a198122d30-samples-operator-tls podName:ca5acf81-ffcf-4db2-b3df-90a198122d30 nodeName:}" failed. No retries permitted until 2026-05-21 03:20:51.242614934 +0000 UTC m=+79.285383826 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ca5acf81-ffcf-4db2-b3df-90a198122d30-samples-operator-tls") pod "cluster-samples-operator-697587599-j66sg" (UID: "ca5acf81-ffcf-4db2-b3df-90a198122d30") : secret "samples-operator-tls" not found May 21 03:20:47.315391 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:47.310238 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-brdg7"] May 21 03:20:47.938752 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:47.938711 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-4q5lp" event={"ID":"87cfc78f-987e-46d9-a3e2-7128548b613d","Type":"ContainerStarted","Data":"a724573b23d51dae46dda269805138e955aa47d2a70b39610d404d928f078c59"} May 21 03:20:47.940411 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:47.940384 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-h65g2" event={"ID":"2a0b651f-774b-47d2-a666-68fd4e2e3b15","Type":"ContainerStarted","Data":"0f43794806bc1a997750215cfa80f502111edcfc291688dc71bd0a405e53e98a"} May 21 03:20:47.941929 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:47.941892 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-brdg7" event={"ID":"651b5561-46ec-4f61-88f5-1788bc682717","Type":"ContainerStarted","Data":"d5c467898097a0cb8c06187c0886860dd41557dd59f6dab3295158cf6cb0b886"} May 21 03:20:47.943570 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:47.943544 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-8lrds_dba914e7-105d-41a4-8789-b248a94c0bd6/console-operator/0.log" May 21 03:20:47.943671 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:47.943584 2574 generic.go:358] "Generic (PLEG): container finished" podID="dba914e7-105d-41a4-8789-b248a94c0bd6" containerID="3d4afd602c7c7285e7b730bdc5be42b3a1fdb914b74cb8620fe030126077e2b2" exitCode=255 May 21 03:20:47.943671 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:47.943655 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-8lrds" event={"ID":"dba914e7-105d-41a4-8789-b248a94c0bd6","Type":"ContainerDied","Data":"3d4afd602c7c7285e7b730bdc5be42b3a1fdb914b74cb8620fe030126077e2b2"} May 21 03:20:47.943896 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:47.943878 2574 scope.go:117] "RemoveContainer" containerID="3d4afd602c7c7285e7b730bdc5be42b3a1fdb914b74cb8620fe030126077e2b2" May 21 03:20:47.945645 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:47.945616 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-7hp2b" event={"ID":"4302517e-e98b-4cd7-8b24-fbf4a8994346","Type":"ContainerStarted","Data":"41562885515b21ecf6a2e623e8bba9332d95a41ae8226d74cecbbdc05bed4a5c"} May 21 03:20:47.955167 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:47.955118 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-4q5lp" podStartSLOduration=1.87677321 podStartE2EDuration="4.955104586s" podCreationTimestamp="2026-05-21 03:20:43 +0000 UTC" firstStartedPulling="2026-05-21 03:20:44.088184929 +0000 UTC m=+72.130953822" lastFinishedPulling="2026-05-21 03:20:47.166516307 +0000 UTC m=+75.209285198" observedRunningTime="2026-05-21 03:20:47.953965384 +0000 UTC m=+75.996734299" watchObservedRunningTime="2026-05-21 03:20:47.955104586 +0000 UTC m=+75.997873498" May 21 03:20:48.003989 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:48.003046 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-78bdfb888c-7hp2b" podStartSLOduration=1.865094355 podStartE2EDuration="5.003027827s" podCreationTimestamp="2026-05-21 03:20:43 +0000 UTC" firstStartedPulling="2026-05-21 03:20:44.02402267 +0000 UTC m=+72.066791561" lastFinishedPulling="2026-05-21 03:20:47.161956132 +0000 UTC m=+75.204725033" observedRunningTime="2026-05-21 03:20:48.002461909 +0000 UTC m=+76.045230822" watchObservedRunningTime="2026-05-21 03:20:48.003027827 +0000 UTC m=+76.045796742" May 21 03:20:48.003989 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:48.003514 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-h65g2" podStartSLOduration=1.838911615 podStartE2EDuration="5.003507266s" podCreationTimestamp="2026-05-21 03:20:43 +0000 UTC" firstStartedPulling="2026-05-21 03:20:43.99734503 +0000 UTC m=+72.040113922" lastFinishedPulling="2026-05-21 03:20:47.161940681 +0000 UTC m=+75.204709573" observedRunningTime="2026-05-21 03:20:47.985899116 +0000 UTC m=+76.028668031" watchObservedRunningTime="2026-05-21 03:20:48.003507266 +0000 UTC m=+76.046276180" May 21 03:20:48.950188 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:48.950157 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-8lrds_dba914e7-105d-41a4-8789-b248a94c0bd6/console-operator/1.log" May 21 03:20:48.950590 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:48.950573 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-8lrds_dba914e7-105d-41a4-8789-b248a94c0bd6/console-operator/0.log" May 21 03:20:48.950654 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:48.950613 2574 generic.go:358] "Generic (PLEG): container finished" podID="dba914e7-105d-41a4-8789-b248a94c0bd6" containerID="0cb49bb7162a931146528d2ef31010a57df1b211c3a8ea3660bef5914fa6d342" exitCode=255 May 21 03:20:48.950768 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:48.950722 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-8lrds" event={"ID":"dba914e7-105d-41a4-8789-b248a94c0bd6","Type":"ContainerDied","Data":"0cb49bb7162a931146528d2ef31010a57df1b211c3a8ea3660bef5914fa6d342"} May 21 03:20:48.950815 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:48.950793 2574 scope.go:117] "RemoveContainer" containerID="3d4afd602c7c7285e7b730bdc5be42b3a1fdb914b74cb8620fe030126077e2b2" May 21 03:20:48.951023 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:48.950999 2574 scope.go:117] "RemoveContainer" containerID="0cb49bb7162a931146528d2ef31010a57df1b211c3a8ea3660bef5914fa6d342" May 21 03:20:48.951456 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:48.951238 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-8lrds_openshift-console-operator(dba914e7-105d-41a4-8789-b248a94c0bd6)\"" pod="openshift-console-operator/console-operator-76dff48d59-8lrds" podUID="dba914e7-105d-41a4-8789-b248a94c0bd6" May 21 03:20:49.954989 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:49.954945 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-brdg7" event={"ID":"651b5561-46ec-4f61-88f5-1788bc682717","Type":"ContainerStarted","Data":"b5a5a323642116452d50e140fa414b873c9d1094d718360a014a4fd2e2649baa"} May 21 03:20:49.956319 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:49.956299 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-8lrds_dba914e7-105d-41a4-8789-b248a94c0bd6/console-operator/1.log" May 21 03:20:49.956618 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:49.956605 2574 scope.go:117] "RemoveContainer" containerID="0cb49bb7162a931146528d2ef31010a57df1b211c3a8ea3660bef5914fa6d342" May 21 03:20:49.956764 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:49.956748 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-8lrds_openshift-console-operator(dba914e7-105d-41a4-8789-b248a94c0bd6)\"" pod="openshift-console-operator/console-operator-76dff48d59-8lrds" podUID="dba914e7-105d-41a4-8789-b248a94c0bd6" May 21 03:20:49.970968 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:49.970931 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-brdg7" podStartSLOduration=1.856672794 podStartE2EDuration="3.970919375s" podCreationTimestamp="2026-05-21 03:20:46 +0000 UTC" firstStartedPulling="2026-05-21 03:20:47.315334518 +0000 UTC m=+75.358103412" lastFinishedPulling="2026-05-21 03:20:49.429581101 +0000 UTC m=+77.472349993" observedRunningTime="2026-05-21 03:20:49.970703269 +0000 UTC m=+78.013472185" watchObservedRunningTime="2026-05-21 03:20:49.970919375 +0000 UTC m=+78.013688288" May 21 03:20:51.178196 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:51.178162 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c56fe16-837c-4d09-8521-f6e5b652b7d9-service-ca-bundle\") pod \"router-default-756cb57bf8-jgcjn\" (UID: \"0c56fe16-837c-4d09-8521-f6e5b652b7d9\") " pod="openshift-ingress/router-default-756cb57bf8-jgcjn" May 21 03:20:51.178636 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:51.178230 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/234c46ba-e4c6-49c1-b967-283befa2e01d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-pmfdr\" (UID: \"234c46ba-e4c6-49c1-b967-283befa2e01d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-pmfdr" May 21 03:20:51.178636 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:51.178273 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c56fe16-837c-4d09-8521-f6e5b652b7d9-metrics-certs\") pod \"router-default-756cb57bf8-jgcjn\" (UID: \"0c56fe16-837c-4d09-8521-f6e5b652b7d9\") " pod="openshift-ingress/router-default-756cb57bf8-jgcjn" May 21 03:20:51.178636 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:51.178381 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 21 03:20:51.178636 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:51.178405 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0c56fe16-837c-4d09-8521-f6e5b652b7d9-service-ca-bundle podName:0c56fe16-837c-4d09-8521-f6e5b652b7d9 nodeName:}" failed. No retries permitted until 2026-05-21 03:20:59.17838411 +0000 UTC m=+87.221153002 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0c56fe16-837c-4d09-8521-f6e5b652b7d9-service-ca-bundle") pod "router-default-756cb57bf8-jgcjn" (UID: "0c56fe16-837c-4d09-8521-f6e5b652b7d9") : configmap references non-existent config key: service-ca.crt May 21 03:20:51.178636 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:51.178445 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 21 03:20:51.178636 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:51.178465 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/234c46ba-e4c6-49c1-b967-283befa2e01d-cluster-monitoring-operator-tls podName:234c46ba-e4c6-49c1-b967-283befa2e01d nodeName:}" failed. No retries permitted until 2026-05-21 03:20:59.178446917 +0000 UTC m=+87.221215826 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/234c46ba-e4c6-49c1-b967-283befa2e01d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-pmfdr" (UID: "234c46ba-e4c6-49c1-b967-283befa2e01d") : secret "cluster-monitoring-operator-tls" not found May 21 03:20:51.178636 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:51.178485 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c56fe16-837c-4d09-8521-f6e5b652b7d9-metrics-certs podName:0c56fe16-837c-4d09-8521-f6e5b652b7d9 nodeName:}" failed. No retries permitted until 2026-05-21 03:20:59.178473709 +0000 UTC m=+87.221242619 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0c56fe16-837c-4d09-8521-f6e5b652b7d9-metrics-certs") pod "router-default-756cb57bf8-jgcjn" (UID: "0c56fe16-837c-4d09-8521-f6e5b652b7d9") : secret "router-metrics-certs-default" not found May 21 03:20:51.278976 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:51.278944 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ca5acf81-ffcf-4db2-b3df-90a198122d30-samples-operator-tls\") pod \"cluster-samples-operator-697587599-j66sg\" (UID: \"ca5acf81-ffcf-4db2-b3df-90a198122d30\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-j66sg" May 21 03:20:51.279124 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:51.279078 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 21 03:20:51.279159 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:51.279136 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca5acf81-ffcf-4db2-b3df-90a198122d30-samples-operator-tls podName:ca5acf81-ffcf-4db2-b3df-90a198122d30 nodeName:}" failed. No retries permitted until 2026-05-21 03:20:59.27912226 +0000 UTC m=+87.321891153 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ca5acf81-ffcf-4db2-b3df-90a198122d30-samples-operator-tls") pod "cluster-samples-operator-697587599-j66sg" (UID: "ca5acf81-ffcf-4db2-b3df-90a198122d30") : secret "samples-operator-tls" not found May 21 03:20:51.487250 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:51.487182 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gqltp_05b002ff-a785-4372-a115-4fd04746df17/dns-node-resolver/0.log" May 21 03:20:52.689898 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:52.689870 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5zqvw_1abd0f75-c601-4162-b828-a203307febed/node-ca/0.log" May 21 03:20:53.871467 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:53.871431 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-8lrds" May 21 03:20:53.871467 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:53.871463 2574 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-8lrds" May 21 03:20:53.871996 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:53.871960 2574 scope.go:117] "RemoveContainer" containerID="0cb49bb7162a931146528d2ef31010a57df1b211c3a8ea3660bef5914fa6d342" May 21 03:20:53.872180 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:53.872157 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-8lrds_openshift-console-operator(dba914e7-105d-41a4-8789-b248a94c0bd6)\"" pod="openshift-console-operator/console-operator-76dff48d59-8lrds" podUID="dba914e7-105d-41a4-8789-b248a94c0bd6" May 21 03:20:54.295822 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:54.295741 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-4q5lp_87cfc78f-987e-46d9-a3e2-7128548b613d/kube-storage-version-migrator-operator/0.log" May 21 03:20:59.245314 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:59.245268 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c56fe16-837c-4d09-8521-f6e5b652b7d9-service-ca-bundle\") pod \"router-default-756cb57bf8-jgcjn\" (UID: \"0c56fe16-837c-4d09-8521-f6e5b652b7d9\") " pod="openshift-ingress/router-default-756cb57bf8-jgcjn" May 21 03:20:59.245698 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:59.245327 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/234c46ba-e4c6-49c1-b967-283befa2e01d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-pmfdr\" (UID: \"234c46ba-e4c6-49c1-b967-283befa2e01d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-pmfdr" May 21 03:20:59.245698 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:59.245358 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c56fe16-837c-4d09-8521-f6e5b652b7d9-metrics-certs\") pod \"router-default-756cb57bf8-jgcjn\" (UID: \"0c56fe16-837c-4d09-8521-f6e5b652b7d9\") " pod="openshift-ingress/router-default-756cb57bf8-jgcjn" May 21 03:20:59.245698 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:59.245435 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0c56fe16-837c-4d09-8521-f6e5b652b7d9-service-ca-bundle podName:0c56fe16-837c-4d09-8521-f6e5b652b7d9 nodeName:}" failed. No retries permitted until 2026-05-21 03:21:15.245418454 +0000 UTC m=+103.288187346 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0c56fe16-837c-4d09-8521-f6e5b652b7d9-service-ca-bundle") pod "router-default-756cb57bf8-jgcjn" (UID: "0c56fe16-837c-4d09-8521-f6e5b652b7d9") : configmap references non-existent config key: service-ca.crt May 21 03:20:59.245698 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:59.245473 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 21 03:20:59.245698 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:59.245474 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 21 03:20:59.245698 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:59.245521 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c56fe16-837c-4d09-8521-f6e5b652b7d9-metrics-certs podName:0c56fe16-837c-4d09-8521-f6e5b652b7d9 nodeName:}" failed. No retries permitted until 2026-05-21 03:21:15.245509613 +0000 UTC m=+103.288278505 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0c56fe16-837c-4d09-8521-f6e5b652b7d9-metrics-certs") pod "router-default-756cb57bf8-jgcjn" (UID: "0c56fe16-837c-4d09-8521-f6e5b652b7d9") : secret "router-metrics-certs-default" not found May 21 03:20:59.245698 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:20:59.245532 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/234c46ba-e4c6-49c1-b967-283befa2e01d-cluster-monitoring-operator-tls podName:234c46ba-e4c6-49c1-b967-283befa2e01d nodeName:}" failed. No retries permitted until 2026-05-21 03:21:15.245527003 +0000 UTC m=+103.288295894 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/234c46ba-e4c6-49c1-b967-283befa2e01d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-pmfdr" (UID: "234c46ba-e4c6-49c1-b967-283befa2e01d") : secret "cluster-monitoring-operator-tls" not found May 21 03:20:59.346653 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:59.346608 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ca5acf81-ffcf-4db2-b3df-90a198122d30-samples-operator-tls\") pod \"cluster-samples-operator-697587599-j66sg\" (UID: \"ca5acf81-ffcf-4db2-b3df-90a198122d30\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-j66sg" May 21 03:20:59.349181 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:59.349160 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ca5acf81-ffcf-4db2-b3df-90a198122d30-samples-operator-tls\") pod \"cluster-samples-operator-697587599-j66sg\" (UID: \"ca5acf81-ffcf-4db2-b3df-90a198122d30\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-j66sg" May 21 03:20:59.454586 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:59.454556 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-j66sg" May 21 03:20:59.573149 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:59.573121 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-j66sg"] May 21 03:20:59.981812 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:20:59.981772 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-j66sg" event={"ID":"ca5acf81-ffcf-4db2-b3df-90a198122d30","Type":"ContainerStarted","Data":"bb4a9f536b4e56e1e1265be2611af3604e9dd5a91b169cee6f3c68b8aaa58eac"} May 21 03:21:01.992423 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:01.992386 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-j66sg" event={"ID":"ca5acf81-ffcf-4db2-b3df-90a198122d30","Type":"ContainerStarted","Data":"bda30a3e3faf8616576e3f9210100711b99fbfd407aed86879092fa3b1076b3e"} May 21 03:21:01.992423 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:01.992422 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-j66sg" event={"ID":"ca5acf81-ffcf-4db2-b3df-90a198122d30","Type":"ContainerStarted","Data":"17af507a0b65b1c34dc41d183308e7f4300decf1b9379dd480112024b91488a2"} May 21 03:21:02.008574 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:02.008486 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-j66sg" podStartSLOduration=17.183940918 podStartE2EDuration="19.008472921s" podCreationTimestamp="2026-05-21 03:20:43 +0000 UTC" firstStartedPulling="2026-05-21 03:20:59.620955969 +0000 UTC m=+87.663724861" lastFinishedPulling="2026-05-21 03:21:01.445487957 +0000 UTC m=+89.488256864" observedRunningTime="2026-05-21 03:21:02.008037299 +0000 UTC m=+90.050806213" watchObservedRunningTime="2026-05-21 03:21:02.008472921 +0000 UTC m=+90.051241835" May 21 03:21:05.585226 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:05.585199 2574 scope.go:117] "RemoveContainer" containerID="0cb49bb7162a931146528d2ef31010a57df1b211c3a8ea3660bef5914fa6d342" May 21 03:21:06.002830 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:06.002799 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-8lrds_dba914e7-105d-41a4-8789-b248a94c0bd6/console-operator/2.log" May 21 03:21:06.003202 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:06.003185 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-8lrds_dba914e7-105d-41a4-8789-b248a94c0bd6/console-operator/1.log" May 21 03:21:06.003252 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:06.003220 2574 generic.go:358] "Generic (PLEG): container finished" podID="dba914e7-105d-41a4-8789-b248a94c0bd6" containerID="1119d49eb70e306b2b191bdeccb1fc1275f61480c98712165b94f8155756640d" exitCode=255 May 21 03:21:06.003291 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:06.003270 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-8lrds" event={"ID":"dba914e7-105d-41a4-8789-b248a94c0bd6","Type":"ContainerDied","Data":"1119d49eb70e306b2b191bdeccb1fc1275f61480c98712165b94f8155756640d"} May 21 03:21:06.003323 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:06.003303 2574 scope.go:117] "RemoveContainer" containerID="0cb49bb7162a931146528d2ef31010a57df1b211c3a8ea3660bef5914fa6d342" May 21 03:21:06.003646 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:06.003620 2574 scope.go:117] "RemoveContainer" containerID="1119d49eb70e306b2b191bdeccb1fc1275f61480c98712165b94f8155756640d" May 21 03:21:06.003804 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:21:06.003782 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-8lrds_openshift-console-operator(dba914e7-105d-41a4-8789-b248a94c0bd6)\"" pod="openshift-console-operator/console-operator-76dff48d59-8lrds" podUID="dba914e7-105d-41a4-8789-b248a94c0bd6" May 21 03:21:07.007303 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:07.007276 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-8lrds_dba914e7-105d-41a4-8789-b248a94c0bd6/console-operator/2.log" May 21 03:21:11.247930 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:11.247817 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf-registry-tls\") pod \"image-registry-7b74df67-kzgvj\" (UID: \"1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf\") " pod="openshift-image-registry/image-registry-7b74df67-kzgvj" May 21 03:21:11.247930 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:11.247898 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ba1902e2-00e1-4eaa-9aea-5c617de7ebb3-cert\") pod \"ingress-canary-2cxks\" (UID: \"ba1902e2-00e1-4eaa-9aea-5c617de7ebb3\") " pod="openshift-ingress-canary/ingress-canary-2cxks" May 21 03:21:11.250517 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:11.250484 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf-registry-tls\") pod \"image-registry-7b74df67-kzgvj\" (UID: \"1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf\") " pod="openshift-image-registry/image-registry-7b74df67-kzgvj" May 21 03:21:11.250654 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:11.250490 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ba1902e2-00e1-4eaa-9aea-5c617de7ebb3-cert\") pod \"ingress-canary-2cxks\" (UID: \"ba1902e2-00e1-4eaa-9aea-5c617de7ebb3\") " pod="openshift-ingress-canary/ingress-canary-2cxks" May 21 03:21:11.348864 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:11.348796 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a60fd84a-346a-44c3-9a02-5c3db633aaa4-metrics-tls\") pod \"dns-default-d4jjb\" (UID: \"a60fd84a-346a-44c3-9a02-5c3db633aaa4\") " pod="openshift-dns/dns-default-d4jjb" May 21 03:21:11.351203 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:11.351182 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a60fd84a-346a-44c3-9a02-5c3db633aaa4-metrics-tls\") pod \"dns-default-d4jjb\" (UID: \"a60fd84a-346a-44c3-9a02-5c3db633aaa4\") " pod="openshift-dns/dns-default-d4jjb" May 21 03:21:11.542448 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:11.542368 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7gx7m\"" May 21 03:21:11.547170 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:11.547151 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-pm6r8\"" May 21 03:21:11.550202 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:11.550187 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b74df67-kzgvj" May 21 03:21:11.555905 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:11.555884 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2cxks" May 21 03:21:11.632098 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:11.632071 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-znmrr\"" May 21 03:21:11.640315 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:11.640169 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-d4jjb" May 21 03:21:11.701190 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:11.701114 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7b74df67-kzgvj"] May 21 03:21:11.705432 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:21:11.705401 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ffb96f0_278e_4bf4_a96a_d5dd212c7cdf.slice/crio-08f9ea11ff5a9845c02864a646847a34083f9deaabd7ded9bc71ba34a3f0f0cd WatchSource:0}: Error finding container 08f9ea11ff5a9845c02864a646847a34083f9deaabd7ded9bc71ba34a3f0f0cd: Status 404 returned error can't find the container with id 08f9ea11ff5a9845c02864a646847a34083f9deaabd7ded9bc71ba34a3f0f0cd May 21 03:21:11.720729 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:11.720700 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2cxks"] May 21 03:21:11.723576 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:21:11.723543 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba1902e2_00e1_4eaa_9aea_5c617de7ebb3.slice/crio-99f438b131138c89a18a2c9f5350e3fbf85335b69ac1d4872a386b602775b8a5 WatchSource:0}: Error finding container 99f438b131138c89a18a2c9f5350e3fbf85335b69ac1d4872a386b602775b8a5: Status 404 returned error can't find the container with id 99f438b131138c89a18a2c9f5350e3fbf85335b69ac1d4872a386b602775b8a5 May 21 03:21:11.777777 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:11.777733 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-d4jjb"] May 21 03:21:11.781179 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:21:11.781150 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda60fd84a_346a_44c3_9a02_5c3db633aaa4.slice/crio-912eafc48a2d515ff8d16c0709a6986a724c0ab5d3b3430520ff89d9cd8e2030 WatchSource:0}: Error finding container 912eafc48a2d515ff8d16c0709a6986a724c0ab5d3b3430520ff89d9cd8e2030: Status 404 returned error can't find the container with id 912eafc48a2d515ff8d16c0709a6986a724c0ab5d3b3430520ff89d9cd8e2030 May 21 03:21:12.019822 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:12.019786 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7b74df67-kzgvj" event={"ID":"1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf","Type":"ContainerStarted","Data":"83a920e5a6e5f46f1caceff0bf0aeb24df8b5cb427ab6431c666038f774c1cee"} May 21 03:21:12.020049 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:12.019831 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7b74df67-kzgvj" event={"ID":"1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf","Type":"ContainerStarted","Data":"08f9ea11ff5a9845c02864a646847a34083f9deaabd7ded9bc71ba34a3f0f0cd"} May 21 03:21:12.020049 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:12.019873 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7b74df67-kzgvj" May 21 03:21:12.021031 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:12.021006 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2cxks" event={"ID":"ba1902e2-00e1-4eaa-9aea-5c617de7ebb3","Type":"ContainerStarted","Data":"99f438b131138c89a18a2c9f5350e3fbf85335b69ac1d4872a386b602775b8a5"} May 21 03:21:12.021975 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:12.021954 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-d4jjb" event={"ID":"a60fd84a-346a-44c3-9a02-5c3db633aaa4","Type":"ContainerStarted","Data":"912eafc48a2d515ff8d16c0709a6986a724c0ab5d3b3430520ff89d9cd8e2030"} May 21 03:21:12.040941 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:12.040889 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7b74df67-kzgvj" podStartSLOduration=77.040875502 podStartE2EDuration="1m17.040875502s" podCreationTimestamp="2026-05-21 03:19:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 03:21:12.039612139 +0000 UTC m=+100.082381064" watchObservedRunningTime="2026-05-21 03:21:12.040875502 +0000 UTC m=+100.083644412" May 21 03:21:13.872160 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:13.872113 2574 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-8lrds" May 21 03:21:13.872160 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:13.872152 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-8lrds" May 21 03:21:13.872575 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:13.872472 2574 scope.go:117] "RemoveContainer" containerID="1119d49eb70e306b2b191bdeccb1fc1275f61480c98712165b94f8155756640d" May 21 03:21:13.872670 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:21:13.872651 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-8lrds_openshift-console-operator(dba914e7-105d-41a4-8789-b248a94c0bd6)\"" pod="openshift-console-operator/console-operator-76dff48d59-8lrds" podUID="dba914e7-105d-41a4-8789-b248a94c0bd6" May 21 03:21:13.924442 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:13.924407 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-skpvq" May 21 03:21:14.029256 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:14.029219 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2cxks" event={"ID":"ba1902e2-00e1-4eaa-9aea-5c617de7ebb3","Type":"ContainerStarted","Data":"ef7b40af69b1f3432ee9ed5df8967c23981dae3510c8c3a3db68a8e55cc1ffd1"} May 21 03:21:14.030827 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:14.030805 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-d4jjb" event={"ID":"a60fd84a-346a-44c3-9a02-5c3db633aaa4","Type":"ContainerStarted","Data":"f8444258ae80c340a1fde4e51501b4b11ac790eea8f32cbe77603ce2f915076c"} May 21 03:21:14.030827 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:14.030829 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-d4jjb" event={"ID":"a60fd84a-346a-44c3-9a02-5c3db633aaa4","Type":"ContainerStarted","Data":"8a83127ab205ce6c4b241905cacb000c4d3fff50d3f7d3c5ad21090ba205922f"} May 21 03:21:14.031034 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:14.031020 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-d4jjb" May 21 03:21:14.047881 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:14.047815 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-2cxks" podStartSLOduration=65.179174048 podStartE2EDuration="1m7.04780127s" podCreationTimestamp="2026-05-21 03:20:07 +0000 UTC" firstStartedPulling="2026-05-21 03:21:11.725360747 +0000 UTC m=+99.768129642" lastFinishedPulling="2026-05-21 03:21:13.593987971 +0000 UTC m=+101.636756864" observedRunningTime="2026-05-21 03:21:14.04671961 +0000 UTC m=+102.089488543" watchObservedRunningTime="2026-05-21 03:21:14.04780127 +0000 UTC m=+102.090570178" May 21 03:21:14.070181 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:14.070134 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-d4jjb" podStartSLOduration=65.262360389 podStartE2EDuration="1m7.070120242s" podCreationTimestamp="2026-05-21 03:20:07 +0000 UTC" firstStartedPulling="2026-05-21 03:21:11.782911453 +0000 UTC m=+99.825680345" lastFinishedPulling="2026-05-21 03:21:13.590671306 +0000 UTC m=+101.633440198" observedRunningTime="2026-05-21 03:21:14.069769805 +0000 UTC m=+102.112538742" watchObservedRunningTime="2026-05-21 03:21:14.070120242 +0000 UTC m=+102.112889155" May 21 03:21:14.158067 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:14.157988 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-ztkkq"] May 21 03:21:14.161202 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:14.161173 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ztkkq" May 21 03:21:14.163493 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:14.163463 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-d2pfl\"" May 21 03:21:14.163599 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:14.163499 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 21 03:21:14.163753 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:14.163739 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 21 03:21:14.175201 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:14.175157 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ztkkq"] May 21 03:21:14.276746 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:14.276706 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a98701a7-2592-4cb3-a4fd-1899fb9f4df3-crio-socket\") pod \"insights-runtime-extractor-ztkkq\" (UID: \"a98701a7-2592-4cb3-a4fd-1899fb9f4df3\") " pod="openshift-insights/insights-runtime-extractor-ztkkq" May 21 03:21:14.276746 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:14.276745 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a98701a7-2592-4cb3-a4fd-1899fb9f4df3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ztkkq\" (UID: \"a98701a7-2592-4cb3-a4fd-1899fb9f4df3\") " pod="openshift-insights/insights-runtime-extractor-ztkkq" May 21 03:21:14.276963 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:14.276783 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a98701a7-2592-4cb3-a4fd-1899fb9f4df3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ztkkq\" (UID: \"a98701a7-2592-4cb3-a4fd-1899fb9f4df3\") " pod="openshift-insights/insights-runtime-extractor-ztkkq" May 21 03:21:14.276963 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:14.276854 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4jwr\" (UniqueName: \"kubernetes.io/projected/a98701a7-2592-4cb3-a4fd-1899fb9f4df3-kube-api-access-x4jwr\") pod \"insights-runtime-extractor-ztkkq\" (UID: \"a98701a7-2592-4cb3-a4fd-1899fb9f4df3\") " pod="openshift-insights/insights-runtime-extractor-ztkkq" May 21 03:21:14.277070 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:14.276951 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a98701a7-2592-4cb3-a4fd-1899fb9f4df3-data-volume\") pod \"insights-runtime-extractor-ztkkq\" (UID: \"a98701a7-2592-4cb3-a4fd-1899fb9f4df3\") " pod="openshift-insights/insights-runtime-extractor-ztkkq" May 21 03:21:14.378036 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:14.378000 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a98701a7-2592-4cb3-a4fd-1899fb9f4df3-data-volume\") pod \"insights-runtime-extractor-ztkkq\" (UID: \"a98701a7-2592-4cb3-a4fd-1899fb9f4df3\") " pod="openshift-insights/insights-runtime-extractor-ztkkq" May 21 03:21:14.378036 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:14.378043 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a98701a7-2592-4cb3-a4fd-1899fb9f4df3-crio-socket\") pod \"insights-runtime-extractor-ztkkq\" (UID: \"a98701a7-2592-4cb3-a4fd-1899fb9f4df3\") " pod="openshift-insights/insights-runtime-extractor-ztkkq" May 21 03:21:14.378242 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:14.378059 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a98701a7-2592-4cb3-a4fd-1899fb9f4df3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ztkkq\" (UID: \"a98701a7-2592-4cb3-a4fd-1899fb9f4df3\") " pod="openshift-insights/insights-runtime-extractor-ztkkq" May 21 03:21:14.378242 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:14.378124 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a98701a7-2592-4cb3-a4fd-1899fb9f4df3-crio-socket\") pod \"insights-runtime-extractor-ztkkq\" (UID: \"a98701a7-2592-4cb3-a4fd-1899fb9f4df3\") " pod="openshift-insights/insights-runtime-extractor-ztkkq" May 21 03:21:14.378242 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:14.378197 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a98701a7-2592-4cb3-a4fd-1899fb9f4df3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ztkkq\" (UID: \"a98701a7-2592-4cb3-a4fd-1899fb9f4df3\") " pod="openshift-insights/insights-runtime-extractor-ztkkq" May 21 03:21:14.378340 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:14.378302 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x4jwr\" (UniqueName: \"kubernetes.io/projected/a98701a7-2592-4cb3-a4fd-1899fb9f4df3-kube-api-access-x4jwr\") pod \"insights-runtime-extractor-ztkkq\" (UID: \"a98701a7-2592-4cb3-a4fd-1899fb9f4df3\") " pod="openshift-insights/insights-runtime-extractor-ztkkq" May 21 03:21:14.378372 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:14.378354 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a98701a7-2592-4cb3-a4fd-1899fb9f4df3-data-volume\") pod \"insights-runtime-extractor-ztkkq\" (UID: \"a98701a7-2592-4cb3-a4fd-1899fb9f4df3\") " pod="openshift-insights/insights-runtime-extractor-ztkkq" May 21 03:21:14.378742 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:14.378716 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a98701a7-2592-4cb3-a4fd-1899fb9f4df3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ztkkq\" (UID: \"a98701a7-2592-4cb3-a4fd-1899fb9f4df3\") " pod="openshift-insights/insights-runtime-extractor-ztkkq" May 21 03:21:14.380725 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:14.380705 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a98701a7-2592-4cb3-a4fd-1899fb9f4df3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ztkkq\" (UID: \"a98701a7-2592-4cb3-a4fd-1899fb9f4df3\") " pod="openshift-insights/insights-runtime-extractor-ztkkq" May 21 03:21:14.386789 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:14.386761 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4jwr\" (UniqueName: \"kubernetes.io/projected/a98701a7-2592-4cb3-a4fd-1899fb9f4df3-kube-api-access-x4jwr\") pod \"insights-runtime-extractor-ztkkq\" (UID: \"a98701a7-2592-4cb3-a4fd-1899fb9f4df3\") " pod="openshift-insights/insights-runtime-extractor-ztkkq" May 21 03:21:14.470236 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:14.470139 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ztkkq" May 21 03:21:14.597788 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:14.597753 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ztkkq"] May 21 03:21:14.601787 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:21:14.601756 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda98701a7_2592_4cb3_a4fd_1899fb9f4df3.slice/crio-07f505bb2e7f8b78d59b630af54e7d64244bb55d7b22fba0efdd622d5bb51b22 WatchSource:0}: Error finding container 07f505bb2e7f8b78d59b630af54e7d64244bb55d7b22fba0efdd622d5bb51b22: Status 404 returned error can't find the container with id 07f505bb2e7f8b78d59b630af54e7d64244bb55d7b22fba0efdd622d5bb51b22 May 21 03:21:15.035138 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:15.035099 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ztkkq" event={"ID":"a98701a7-2592-4cb3-a4fd-1899fb9f4df3","Type":"ContainerStarted","Data":"666d8609ea2a86b680e2e253d5faa92a58d9b5aa06af54987776114ea1510dec"} May 21 03:21:15.035505 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:15.035147 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ztkkq" event={"ID":"a98701a7-2592-4cb3-a4fd-1899fb9f4df3","Type":"ContainerStarted","Data":"07f505bb2e7f8b78d59b630af54e7d64244bb55d7b22fba0efdd622d5bb51b22"} May 21 03:21:15.287284 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:15.287198 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c56fe16-837c-4d09-8521-f6e5b652b7d9-service-ca-bundle\") pod \"router-default-756cb57bf8-jgcjn\" (UID: \"0c56fe16-837c-4d09-8521-f6e5b652b7d9\") " pod="openshift-ingress/router-default-756cb57bf8-jgcjn" May 21 03:21:15.287284 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:15.287248 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/234c46ba-e4c6-49c1-b967-283befa2e01d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-pmfdr\" (UID: \"234c46ba-e4c6-49c1-b967-283befa2e01d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-pmfdr" May 21 03:21:15.287467 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:15.287288 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c56fe16-837c-4d09-8521-f6e5b652b7d9-metrics-certs\") pod \"router-default-756cb57bf8-jgcjn\" (UID: \"0c56fe16-837c-4d09-8521-f6e5b652b7d9\") " pod="openshift-ingress/router-default-756cb57bf8-jgcjn" May 21 03:21:15.287928 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:15.287904 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c56fe16-837c-4d09-8521-f6e5b652b7d9-service-ca-bundle\") pod \"router-default-756cb57bf8-jgcjn\" (UID: \"0c56fe16-837c-4d09-8521-f6e5b652b7d9\") " pod="openshift-ingress/router-default-756cb57bf8-jgcjn" May 21 03:21:15.289921 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:15.289891 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c56fe16-837c-4d09-8521-f6e5b652b7d9-metrics-certs\") pod \"router-default-756cb57bf8-jgcjn\" (UID: \"0c56fe16-837c-4d09-8521-f6e5b652b7d9\") " pod="openshift-ingress/router-default-756cb57bf8-jgcjn" May 21 03:21:15.290051 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:15.290031 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/234c46ba-e4c6-49c1-b967-283befa2e01d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-pmfdr\" (UID: \"234c46ba-e4c6-49c1-b967-283befa2e01d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-pmfdr" May 21 03:21:15.546542 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:15.546472 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-pmfdr" May 21 03:21:15.550207 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:15.550186 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-756cb57bf8-jgcjn" May 21 03:21:15.702666 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:15.702482 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-pmfdr"] May 21 03:21:15.705141 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:21:15.705113 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod234c46ba_e4c6_49c1_b967_283befa2e01d.slice/crio-2f8e5c95bd3478831a476ceed718def133206c11975f02229599f0d5c8125fc2 WatchSource:0}: Error finding container 2f8e5c95bd3478831a476ceed718def133206c11975f02229599f0d5c8125fc2: Status 404 returned error can't find the container with id 2f8e5c95bd3478831a476ceed718def133206c11975f02229599f0d5c8125fc2 May 21 03:21:15.723270 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:15.723247 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-756cb57bf8-jgcjn"] May 21 03:21:15.726106 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:21:15.726077 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c56fe16_837c_4d09_8521_f6e5b652b7d9.slice/crio-526a2b05ec71ded5b25989d9d6dab80f732365c5d9d8c4aa57369ac9f38da949 WatchSource:0}: Error finding container 526a2b05ec71ded5b25989d9d6dab80f732365c5d9d8c4aa57369ac9f38da949: Status 404 returned error can't find the container with id 526a2b05ec71ded5b25989d9d6dab80f732365c5d9d8c4aa57369ac9f38da949 May 21 03:21:16.038913 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:16.038882 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ztkkq" event={"ID":"a98701a7-2592-4cb3-a4fd-1899fb9f4df3","Type":"ContainerStarted","Data":"ccb81f5a5c398cb29005e8c502ca5e2d8aa498af5b6e51982098b98e0a1945b4"} May 21 03:21:16.039972 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:16.039949 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-pmfdr" event={"ID":"234c46ba-e4c6-49c1-b967-283befa2e01d","Type":"ContainerStarted","Data":"2f8e5c95bd3478831a476ceed718def133206c11975f02229599f0d5c8125fc2"} May 21 03:21:16.041459 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:16.041435 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-756cb57bf8-jgcjn" event={"ID":"0c56fe16-837c-4d09-8521-f6e5b652b7d9","Type":"ContainerStarted","Data":"729fba78d61156332757ea7354c72af5e33086c8c6119d5c858ac39696fbfa2b"} May 21 03:21:16.041556 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:16.041467 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-756cb57bf8-jgcjn" event={"ID":"0c56fe16-837c-4d09-8521-f6e5b652b7d9","Type":"ContainerStarted","Data":"526a2b05ec71ded5b25989d9d6dab80f732365c5d9d8c4aa57369ac9f38da949"} May 21 03:21:16.060359 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:16.060300 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-756cb57bf8-jgcjn" podStartSLOduration=33.060283013 podStartE2EDuration="33.060283013s" podCreationTimestamp="2026-05-21 03:20:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 03:21:16.059778255 +0000 UTC m=+104.102547172" watchObservedRunningTime="2026-05-21 03:21:16.060283013 +0000 UTC m=+104.103051928" May 21 03:21:16.551044 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:16.551009 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-756cb57bf8-jgcjn" May 21 03:21:16.553552 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:16.553509 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-756cb57bf8-jgcjn" May 21 03:21:17.045376 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:17.045338 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-756cb57bf8-jgcjn" May 21 03:21:17.046959 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:17.046938 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-756cb57bf8-jgcjn" May 21 03:21:19.052332 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:19.052289 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ztkkq" event={"ID":"a98701a7-2592-4cb3-a4fd-1899fb9f4df3","Type":"ContainerStarted","Data":"c6dc621e9a17e536c7953cbefb02c3f65f361ecb65f4a080486f67d5fef52b5e"} May 21 03:21:19.053515 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:19.053485 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-pmfdr" event={"ID":"234c46ba-e4c6-49c1-b967-283befa2e01d","Type":"ContainerStarted","Data":"5eb84e8ab515bdf1841565b4243418d140c18f38837561dade1258fba8e759d7"} May 21 03:21:19.068744 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:19.068702 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-ztkkq" podStartSLOduration=1.432107219 podStartE2EDuration="5.068689573s" podCreationTimestamp="2026-05-21 03:21:14 +0000 UTC" firstStartedPulling="2026-05-21 03:21:14.671027539 +0000 UTC m=+102.713796434" lastFinishedPulling="2026-05-21 03:21:18.307609882 +0000 UTC m=+106.350378788" observedRunningTime="2026-05-21 03:21:19.067950487 +0000 UTC m=+107.110719402" watchObservedRunningTime="2026-05-21 03:21:19.068689573 +0000 UTC m=+107.111458524" May 21 03:21:19.082472 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:19.082436 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-pmfdr" podStartSLOduration=33.477484849 podStartE2EDuration="36.082426027s" podCreationTimestamp="2026-05-21 03:20:43 +0000 UTC" firstStartedPulling="2026-05-21 03:21:15.707086166 +0000 UTC m=+103.749855063" lastFinishedPulling="2026-05-21 03:21:18.312027331 +0000 UTC m=+106.354796241" observedRunningTime="2026-05-21 03:21:19.081144899 +0000 UTC m=+107.123913805" watchObservedRunningTime="2026-05-21 03:21:19.082426027 +0000 UTC m=+107.125194941" May 21 03:21:24.037816 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:24.037786 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-d4jjb" May 21 03:21:26.249421 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:26.249384 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-xpvpv"] May 21 03:21:26.251991 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:26.251971 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xpvpv" May 21 03:21:26.253989 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:26.253966 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-xgvrr\"" May 21 03:21:26.254194 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:26.254174 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 21 03:21:26.254314 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:26.254291 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 21 03:21:26.254391 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:26.254376 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 21 03:21:26.254446 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:26.254391 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 21 03:21:26.276731 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:26.276705 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d6ff9c15-b4d2-4e99-86db-9db97458fad5-node-exporter-wtmp\") pod \"node-exporter-xpvpv\" (UID: \"d6ff9c15-b4d2-4e99-86db-9db97458fad5\") " pod="openshift-monitoring/node-exporter-xpvpv" May 21 03:21:26.276828 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:26.276738 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d6ff9c15-b4d2-4e99-86db-9db97458fad5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xpvpv\" (UID: \"d6ff9c15-b4d2-4e99-86db-9db97458fad5\") " pod="openshift-monitoring/node-exporter-xpvpv" May 21 03:21:26.276828 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:26.276765 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d6ff9c15-b4d2-4e99-86db-9db97458fad5-root\") pod \"node-exporter-xpvpv\" (UID: \"d6ff9c15-b4d2-4e99-86db-9db97458fad5\") " pod="openshift-monitoring/node-exporter-xpvpv" May 21 03:21:26.276828 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:26.276812 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kb8cz\" (UniqueName: \"kubernetes.io/projected/d6ff9c15-b4d2-4e99-86db-9db97458fad5-kube-api-access-kb8cz\") pod \"node-exporter-xpvpv\" (UID: \"d6ff9c15-b4d2-4e99-86db-9db97458fad5\") " pod="openshift-monitoring/node-exporter-xpvpv" May 21 03:21:26.276946 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:26.276827 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d6ff9c15-b4d2-4e99-86db-9db97458fad5-sys\") pod \"node-exporter-xpvpv\" (UID: \"d6ff9c15-b4d2-4e99-86db-9db97458fad5\") " pod="openshift-monitoring/node-exporter-xpvpv" May 21 03:21:26.276946 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:26.276860 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d6ff9c15-b4d2-4e99-86db-9db97458fad5-node-exporter-textfile\") pod \"node-exporter-xpvpv\" (UID: \"d6ff9c15-b4d2-4e99-86db-9db97458fad5\") " pod="openshift-monitoring/node-exporter-xpvpv" May 21 03:21:26.276946 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:26.276877 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d6ff9c15-b4d2-4e99-86db-9db97458fad5-metrics-client-ca\") pod \"node-exporter-xpvpv\" (UID: \"d6ff9c15-b4d2-4e99-86db-9db97458fad5\") " pod="openshift-monitoring/node-exporter-xpvpv" May 21 03:21:26.276946 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:26.276928 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d6ff9c15-b4d2-4e99-86db-9db97458fad5-node-exporter-tls\") pod \"node-exporter-xpvpv\" (UID: \"d6ff9c15-b4d2-4e99-86db-9db97458fad5\") " pod="openshift-monitoring/node-exporter-xpvpv" May 21 03:21:26.277105 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:26.276971 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d6ff9c15-b4d2-4e99-86db-9db97458fad5-node-exporter-accelerators-collector-config\") pod \"node-exporter-xpvpv\" (UID: \"d6ff9c15-b4d2-4e99-86db-9db97458fad5\") " pod="openshift-monitoring/node-exporter-xpvpv" May 21 03:21:26.377299 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:26.377270 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d6ff9c15-b4d2-4e99-86db-9db97458fad5-node-exporter-wtmp\") pod \"node-exporter-xpvpv\" (UID: \"d6ff9c15-b4d2-4e99-86db-9db97458fad5\") " pod="openshift-monitoring/node-exporter-xpvpv" May 21 03:21:26.377299 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:26.377299 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d6ff9c15-b4d2-4e99-86db-9db97458fad5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xpvpv\" (UID: \"d6ff9c15-b4d2-4e99-86db-9db97458fad5\") " pod="openshift-monitoring/node-exporter-xpvpv" May 21 03:21:26.377508 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:26.377318 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d6ff9c15-b4d2-4e99-86db-9db97458fad5-root\") pod \"node-exporter-xpvpv\" (UID: \"d6ff9c15-b4d2-4e99-86db-9db97458fad5\") " pod="openshift-monitoring/node-exporter-xpvpv" May 21 03:21:26.377508 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:26.377350 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kb8cz\" (UniqueName: \"kubernetes.io/projected/d6ff9c15-b4d2-4e99-86db-9db97458fad5-kube-api-access-kb8cz\") pod \"node-exporter-xpvpv\" (UID: \"d6ff9c15-b4d2-4e99-86db-9db97458fad5\") " pod="openshift-monitoring/node-exporter-xpvpv" May 21 03:21:26.377508 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:26.377376 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d6ff9c15-b4d2-4e99-86db-9db97458fad5-sys\") pod \"node-exporter-xpvpv\" (UID: \"d6ff9c15-b4d2-4e99-86db-9db97458fad5\") " pod="openshift-monitoring/node-exporter-xpvpv" May 21 03:21:26.377508 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:26.377400 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d6ff9c15-b4d2-4e99-86db-9db97458fad5-node-exporter-textfile\") pod \"node-exporter-xpvpv\" (UID: \"d6ff9c15-b4d2-4e99-86db-9db97458fad5\") " pod="openshift-monitoring/node-exporter-xpvpv" May 21 03:21:26.377508 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:26.377417 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d6ff9c15-b4d2-4e99-86db-9db97458fad5-root\") pod \"node-exporter-xpvpv\" (UID: \"d6ff9c15-b4d2-4e99-86db-9db97458fad5\") " pod="openshift-monitoring/node-exporter-xpvpv" May 21 03:21:26.377508 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:26.377458 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d6ff9c15-b4d2-4e99-86db-9db97458fad5-node-exporter-wtmp\") pod \"node-exporter-xpvpv\" (UID: \"d6ff9c15-b4d2-4e99-86db-9db97458fad5\") " pod="openshift-monitoring/node-exporter-xpvpv" May 21 03:21:26.377508 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:26.377479 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d6ff9c15-b4d2-4e99-86db-9db97458fad5-sys\") pod \"node-exporter-xpvpv\" (UID: \"d6ff9c15-b4d2-4e99-86db-9db97458fad5\") " pod="openshift-monitoring/node-exporter-xpvpv" May 21 03:21:26.377754 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:26.377425 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d6ff9c15-b4d2-4e99-86db-9db97458fad5-metrics-client-ca\") pod \"node-exporter-xpvpv\" (UID: \"d6ff9c15-b4d2-4e99-86db-9db97458fad5\") " pod="openshift-monitoring/node-exporter-xpvpv" May 21 03:21:26.377754 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:26.377555 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d6ff9c15-b4d2-4e99-86db-9db97458fad5-node-exporter-tls\") pod \"node-exporter-xpvpv\" (UID: \"d6ff9c15-b4d2-4e99-86db-9db97458fad5\") " pod="openshift-monitoring/node-exporter-xpvpv" May 21 03:21:26.377754 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:26.377609 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d6ff9c15-b4d2-4e99-86db-9db97458fad5-node-exporter-accelerators-collector-config\") pod \"node-exporter-xpvpv\" (UID: \"d6ff9c15-b4d2-4e99-86db-9db97458fad5\") " pod="openshift-monitoring/node-exporter-xpvpv" May 21 03:21:26.377887 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:26.377871 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d6ff9c15-b4d2-4e99-86db-9db97458fad5-node-exporter-textfile\") pod \"node-exporter-xpvpv\" (UID: \"d6ff9c15-b4d2-4e99-86db-9db97458fad5\") " pod="openshift-monitoring/node-exporter-xpvpv" May 21 03:21:26.378118 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:26.378099 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d6ff9c15-b4d2-4e99-86db-9db97458fad5-metrics-client-ca\") pod \"node-exporter-xpvpv\" (UID: \"d6ff9c15-b4d2-4e99-86db-9db97458fad5\") " pod="openshift-monitoring/node-exporter-xpvpv" May 21 03:21:26.378362 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:26.378127 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d6ff9c15-b4d2-4e99-86db-9db97458fad5-node-exporter-accelerators-collector-config\") pod \"node-exporter-xpvpv\" (UID: \"d6ff9c15-b4d2-4e99-86db-9db97458fad5\") " pod="openshift-monitoring/node-exporter-xpvpv" May 21 03:21:26.379826 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:26.379806 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d6ff9c15-b4d2-4e99-86db-9db97458fad5-node-exporter-tls\") pod \"node-exporter-xpvpv\" (UID: \"d6ff9c15-b4d2-4e99-86db-9db97458fad5\") " pod="openshift-monitoring/node-exporter-xpvpv" May 21 03:21:26.379928 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:26.379832 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d6ff9c15-b4d2-4e99-86db-9db97458fad5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xpvpv\" (UID: \"d6ff9c15-b4d2-4e99-86db-9db97458fad5\") " pod="openshift-monitoring/node-exporter-xpvpv" May 21 03:21:26.385035 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:26.385015 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kb8cz\" (UniqueName: \"kubernetes.io/projected/d6ff9c15-b4d2-4e99-86db-9db97458fad5-kube-api-access-kb8cz\") pod \"node-exporter-xpvpv\" (UID: \"d6ff9c15-b4d2-4e99-86db-9db97458fad5\") " pod="openshift-monitoring/node-exporter-xpvpv" May 21 03:21:26.561467 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:26.561397 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xpvpv" May 21 03:21:26.570672 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:21:26.570643 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6ff9c15_b4d2_4e99_86db_9db97458fad5.slice/crio-45e466697238f42f758f7626b26e53a043340cee155e52c4acc138d4ba071ecb WatchSource:0}: Error finding container 45e466697238f42f758f7626b26e53a043340cee155e52c4acc138d4ba071ecb: Status 404 returned error can't find the container with id 45e466697238f42f758f7626b26e53a043340cee155e52c4acc138d4ba071ecb May 21 03:21:27.074572 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:27.074533 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xpvpv" event={"ID":"d6ff9c15-b4d2-4e99-86db-9db97458fad5","Type":"ContainerStarted","Data":"45e466697238f42f758f7626b26e53a043340cee155e52c4acc138d4ba071ecb"} May 21 03:21:28.081837 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:28.081805 2574 generic.go:358] "Generic (PLEG): container finished" podID="d6ff9c15-b4d2-4e99-86db-9db97458fad5" containerID="4dc964401442fe927c1877a8a3575b1f90b6e245baeb985bf96913f2d9adca76" exitCode=0 May 21 03:21:28.082241 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:28.081900 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xpvpv" event={"ID":"d6ff9c15-b4d2-4e99-86db-9db97458fad5","Type":"ContainerDied","Data":"4dc964401442fe927c1877a8a3575b1f90b6e245baeb985bf96913f2d9adca76"} May 21 03:21:28.585019 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:28.584989 2574 scope.go:117] "RemoveContainer" containerID="1119d49eb70e306b2b191bdeccb1fc1275f61480c98712165b94f8155756640d" May 21 03:21:29.086227 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:29.086202 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-8lrds_dba914e7-105d-41a4-8789-b248a94c0bd6/console-operator/2.log" May 21 03:21:29.086655 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:29.086299 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-8lrds" event={"ID":"dba914e7-105d-41a4-8789-b248a94c0bd6","Type":"ContainerStarted","Data":"ffe2cee3f486d7993976e92b394369a0c65ad3b356fdd870d693aeeb48faee6d"} May 21 03:21:29.086655 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:29.086591 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-8lrds" May 21 03:21:29.088283 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:29.088260 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xpvpv" event={"ID":"d6ff9c15-b4d2-4e99-86db-9db97458fad5","Type":"ContainerStarted","Data":"f2b263c8efb536357f9793e4b652e0d9714f8bee0accb2436c15d77e803de575"} May 21 03:21:29.088283 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:29.088285 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xpvpv" event={"ID":"d6ff9c15-b4d2-4e99-86db-9db97458fad5","Type":"ContainerStarted","Data":"c8bca626438e5ef7c49f59d9b3d3a1da594a232354fcbbf6cb89c572a31d97dc"} May 21 03:21:29.093314 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:29.093293 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-76dff48d59-8lrds" May 21 03:21:29.123980 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:29.123935 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-76dff48d59-8lrds" podStartSLOduration=42.994863106 podStartE2EDuration="46.123923887s" podCreationTimestamp="2026-05-21 03:20:43 +0000 UTC" firstStartedPulling="2026-05-21 03:20:44.034257656 +0000 UTC m=+72.077026548" lastFinishedPulling="2026-05-21 03:20:47.163318422 +0000 UTC m=+75.206087329" observedRunningTime="2026-05-21 03:21:29.122252182 +0000 UTC m=+117.165021098" watchObservedRunningTime="2026-05-21 03:21:29.123923887 +0000 UTC m=+117.166692801" May 21 03:21:29.179895 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:29.179800 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-xpvpv" podStartSLOduration=2.234148625 podStartE2EDuration="3.179784743s" podCreationTimestamp="2026-05-21 03:21:26 +0000 UTC" firstStartedPulling="2026-05-21 03:21:26.57246759 +0000 UTC m=+114.615236482" lastFinishedPulling="2026-05-21 03:21:27.518103708 +0000 UTC m=+115.560872600" observedRunningTime="2026-05-21 03:21:29.179144141 +0000 UTC m=+117.221913056" watchObservedRunningTime="2026-05-21 03:21:29.179784743 +0000 UTC m=+117.222553657" May 21 03:21:31.424558 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:31.424519 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6c6695f958-kvbpb"] May 21 03:21:31.430717 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:31.430680 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6c6695f958-kvbpb" May 21 03:21:31.433615 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:31.433574 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" May 21 03:21:31.433773 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:31.433712 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" May 21 03:21:31.433927 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:31.433860 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" May 21 03:21:31.433989 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:31.433975 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" May 21 03:21:31.434040 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:31.433974 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" May 21 03:21:31.434040 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:31.434004 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-2drp5\"" May 21 03:21:31.439648 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:31.439626 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" May 21 03:21:31.440895 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:31.440873 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6c6695f958-kvbpb"] May 21 03:21:31.514594 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:31.514569 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1b1764d1-9674-4708-964f-3775a0499c17-metrics-client-ca\") pod \"telemeter-client-6c6695f958-kvbpb\" (UID: \"1b1764d1-9674-4708-964f-3775a0499c17\") " pod="openshift-monitoring/telemeter-client-6c6695f958-kvbpb" May 21 03:21:31.514727 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:31.514600 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b1764d1-9674-4708-964f-3775a0499c17-serving-certs-ca-bundle\") pod \"telemeter-client-6c6695f958-kvbpb\" (UID: \"1b1764d1-9674-4708-964f-3775a0499c17\") " pod="openshift-monitoring/telemeter-client-6c6695f958-kvbpb" May 21 03:21:31.514727 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:31.514620 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b1764d1-9674-4708-964f-3775a0499c17-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6c6695f958-kvbpb\" (UID: \"1b1764d1-9674-4708-964f-3775a0499c17\") " pod="openshift-monitoring/telemeter-client-6c6695f958-kvbpb" May 21 03:21:31.514727 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:31.514643 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hrxf\" (UniqueName: \"kubernetes.io/projected/1b1764d1-9674-4708-964f-3775a0499c17-kube-api-access-9hrxf\") pod \"telemeter-client-6c6695f958-kvbpb\" (UID: \"1b1764d1-9674-4708-964f-3775a0499c17\") " pod="openshift-monitoring/telemeter-client-6c6695f958-kvbpb" May 21 03:21:31.514727 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:31.514662 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1b1764d1-9674-4708-964f-3775a0499c17-federate-client-tls\") pod \"telemeter-client-6c6695f958-kvbpb\" (UID: \"1b1764d1-9674-4708-964f-3775a0499c17\") " pod="openshift-monitoring/telemeter-client-6c6695f958-kvbpb" May 21 03:21:31.514903 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:31.514738 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1b1764d1-9674-4708-964f-3775a0499c17-telemeter-client-tls\") pod \"telemeter-client-6c6695f958-kvbpb\" (UID: \"1b1764d1-9674-4708-964f-3775a0499c17\") " pod="openshift-monitoring/telemeter-client-6c6695f958-kvbpb" May 21 03:21:31.514903 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:31.514791 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1b1764d1-9674-4708-964f-3775a0499c17-secret-telemeter-client\") pod \"telemeter-client-6c6695f958-kvbpb\" (UID: \"1b1764d1-9674-4708-964f-3775a0499c17\") " pod="openshift-monitoring/telemeter-client-6c6695f958-kvbpb" May 21 03:21:31.514903 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:31.514825 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1b1764d1-9674-4708-964f-3775a0499c17-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6c6695f958-kvbpb\" (UID: \"1b1764d1-9674-4708-964f-3775a0499c17\") " pod="openshift-monitoring/telemeter-client-6c6695f958-kvbpb" May 21 03:21:31.615703 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:31.615676 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9hrxf\" (UniqueName: \"kubernetes.io/projected/1b1764d1-9674-4708-964f-3775a0499c17-kube-api-access-9hrxf\") pod \"telemeter-client-6c6695f958-kvbpb\" (UID: \"1b1764d1-9674-4708-964f-3775a0499c17\") " pod="openshift-monitoring/telemeter-client-6c6695f958-kvbpb" May 21 03:21:31.615863 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:31.615707 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1b1764d1-9674-4708-964f-3775a0499c17-federate-client-tls\") pod \"telemeter-client-6c6695f958-kvbpb\" (UID: \"1b1764d1-9674-4708-964f-3775a0499c17\") " pod="openshift-monitoring/telemeter-client-6c6695f958-kvbpb" May 21 03:21:31.615863 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:31.615736 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1b1764d1-9674-4708-964f-3775a0499c17-telemeter-client-tls\") pod \"telemeter-client-6c6695f958-kvbpb\" (UID: \"1b1764d1-9674-4708-964f-3775a0499c17\") " pod="openshift-monitoring/telemeter-client-6c6695f958-kvbpb" May 21 03:21:31.615863 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:31.615765 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1b1764d1-9674-4708-964f-3775a0499c17-secret-telemeter-client\") pod \"telemeter-client-6c6695f958-kvbpb\" (UID: \"1b1764d1-9674-4708-964f-3775a0499c17\") " pod="openshift-monitoring/telemeter-client-6c6695f958-kvbpb" May 21 03:21:31.615863 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:31.615791 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1b1764d1-9674-4708-964f-3775a0499c17-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6c6695f958-kvbpb\" (UID: \"1b1764d1-9674-4708-964f-3775a0499c17\") " pod="openshift-monitoring/telemeter-client-6c6695f958-kvbpb" May 21 03:21:31.615863 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:31.615811 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1b1764d1-9674-4708-964f-3775a0499c17-metrics-client-ca\") pod \"telemeter-client-6c6695f958-kvbpb\" (UID: \"1b1764d1-9674-4708-964f-3775a0499c17\") " pod="openshift-monitoring/telemeter-client-6c6695f958-kvbpb" May 21 03:21:31.615863 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:31.615828 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b1764d1-9674-4708-964f-3775a0499c17-serving-certs-ca-bundle\") pod \"telemeter-client-6c6695f958-kvbpb\" (UID: \"1b1764d1-9674-4708-964f-3775a0499c17\") " pod="openshift-monitoring/telemeter-client-6c6695f958-kvbpb" May 21 03:21:31.616138 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:31.615883 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b1764d1-9674-4708-964f-3775a0499c17-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6c6695f958-kvbpb\" (UID: \"1b1764d1-9674-4708-964f-3775a0499c17\") " pod="openshift-monitoring/telemeter-client-6c6695f958-kvbpb" May 21 03:21:31.616997 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:31.616969 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b1764d1-9674-4708-964f-3775a0499c17-serving-certs-ca-bundle\") pod \"telemeter-client-6c6695f958-kvbpb\" (UID: \"1b1764d1-9674-4708-964f-3775a0499c17\") " pod="openshift-monitoring/telemeter-client-6c6695f958-kvbpb" May 21 03:21:31.617109 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:31.616979 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1b1764d1-9674-4708-964f-3775a0499c17-metrics-client-ca\") pod \"telemeter-client-6c6695f958-kvbpb\" (UID: \"1b1764d1-9674-4708-964f-3775a0499c17\") " pod="openshift-monitoring/telemeter-client-6c6695f958-kvbpb" May 21 03:21:31.617109 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:31.617008 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b1764d1-9674-4708-964f-3775a0499c17-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6c6695f958-kvbpb\" (UID: \"1b1764d1-9674-4708-964f-3775a0499c17\") " pod="openshift-monitoring/telemeter-client-6c6695f958-kvbpb" May 21 03:21:31.618468 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:31.618432 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1b1764d1-9674-4708-964f-3775a0499c17-secret-telemeter-client\") pod \"telemeter-client-6c6695f958-kvbpb\" (UID: \"1b1764d1-9674-4708-964f-3775a0499c17\") " pod="openshift-monitoring/telemeter-client-6c6695f958-kvbpb" May 21 03:21:31.618583 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:31.618525 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1b1764d1-9674-4708-964f-3775a0499c17-telemeter-client-tls\") pod \"telemeter-client-6c6695f958-kvbpb\" (UID: \"1b1764d1-9674-4708-964f-3775a0499c17\") " pod="openshift-monitoring/telemeter-client-6c6695f958-kvbpb" May 21 03:21:31.618640 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:31.618585 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1b1764d1-9674-4708-964f-3775a0499c17-federate-client-tls\") pod \"telemeter-client-6c6695f958-kvbpb\" (UID: \"1b1764d1-9674-4708-964f-3775a0499c17\") " pod="openshift-monitoring/telemeter-client-6c6695f958-kvbpb" May 21 03:21:31.618640 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:31.618627 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1b1764d1-9674-4708-964f-3775a0499c17-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6c6695f958-kvbpb\" (UID: \"1b1764d1-9674-4708-964f-3775a0499c17\") " pod="openshift-monitoring/telemeter-client-6c6695f958-kvbpb" May 21 03:21:31.623275 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:31.623254 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hrxf\" (UniqueName: \"kubernetes.io/projected/1b1764d1-9674-4708-964f-3775a0499c17-kube-api-access-9hrxf\") pod \"telemeter-client-6c6695f958-kvbpb\" (UID: \"1b1764d1-9674-4708-964f-3775a0499c17\") " pod="openshift-monitoring/telemeter-client-6c6695f958-kvbpb" May 21 03:21:31.740403 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:31.740335 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6c6695f958-kvbpb" May 21 03:21:31.873019 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:31.872963 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6c6695f958-kvbpb"] May 21 03:21:31.876827 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:21:31.876798 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b1764d1_9674_4708_964f_3775a0499c17.slice/crio-2d1d49d0703779eb42422b4fdc209177a667b42839ed9edde7baf32f34e2712f WatchSource:0}: Error finding container 2d1d49d0703779eb42422b4fdc209177a667b42839ed9edde7baf32f34e2712f: Status 404 returned error can't find the container with id 2d1d49d0703779eb42422b4fdc209177a667b42839ed9edde7baf32f34e2712f May 21 03:21:32.096907 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:32.096796 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6c6695f958-kvbpb" event={"ID":"1b1764d1-9674-4708-964f-3775a0499c17","Type":"ContainerStarted","Data":"2d1d49d0703779eb42422b4fdc209177a667b42839ed9edde7baf32f34e2712f"} May 21 03:21:33.029599 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:33.029567 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7b74df67-kzgvj" May 21 03:21:35.107804 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:35.107759 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6c6695f958-kvbpb" event={"ID":"1b1764d1-9674-4708-964f-3775a0499c17","Type":"ContainerStarted","Data":"30e27b0d05eef58d3e0374628292254112781041561bd6fe2b5aa109b846f7af"} May 21 03:21:36.116369 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:36.116328 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6c6695f958-kvbpb" event={"ID":"1b1764d1-9674-4708-964f-3775a0499c17","Type":"ContainerStarted","Data":"30aedb7899e03449ddbf8f5bb676999bc81bfc94833fb9b4853fa7dc1382da56"} May 21 03:21:36.116369 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:36.116366 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6c6695f958-kvbpb" event={"ID":"1b1764d1-9674-4708-964f-3775a0499c17","Type":"ContainerStarted","Data":"830455c2465392501130182d9e9f562ca0d95e926d0185606791fdf949846e1a"} May 21 03:21:36.135906 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:36.135863 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6c6695f958-kvbpb" podStartSLOduration=1.7173671609999999 podStartE2EDuration="5.135833966s" podCreationTimestamp="2026-05-21 03:21:31 +0000 UTC" firstStartedPulling="2026-05-21 03:21:31.878719288 +0000 UTC m=+119.921488180" lastFinishedPulling="2026-05-21 03:21:35.297186079 +0000 UTC m=+123.339954985" observedRunningTime="2026-05-21 03:21:36.134162942 +0000 UTC m=+124.176931857" watchObservedRunningTime="2026-05-21 03:21:36.135833966 +0000 UTC m=+124.178602879" May 21 03:21:36.813264 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:36.813230 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7b74df67-kzgvj"] May 21 03:21:41.295271 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:41.295229 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a03c959-a5a9-44f4-89f3-d604f293b8a0-metrics-certs\") pod \"network-metrics-daemon-7vr9p\" (UID: \"1a03c959-a5a9-44f4-89f3-d604f293b8a0\") " pod="openshift-multus/network-metrics-daemon-7vr9p" May 21 03:21:41.297751 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:41.297729 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a03c959-a5a9-44f4-89f3-d604f293b8a0-metrics-certs\") pod \"network-metrics-daemon-7vr9p\" (UID: \"1a03c959-a5a9-44f4-89f3-d604f293b8a0\") " pod="openshift-multus/network-metrics-daemon-7vr9p" May 21 03:21:41.504459 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:41.504426 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rwbqv\"" May 21 03:21:41.512241 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:41.512216 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7vr9p" May 21 03:21:41.633833 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:41.633805 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7vr9p"] May 21 03:21:41.636837 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:21:41.636809 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a03c959_a5a9_44f4_89f3_d604f293b8a0.slice/crio-428b65280d0f944dd29416b1251dceb7c017392dab87eac0bccda5f85514def5 WatchSource:0}: Error finding container 428b65280d0f944dd29416b1251dceb7c017392dab87eac0bccda5f85514def5: Status 404 returned error can't find the container with id 428b65280d0f944dd29416b1251dceb7c017392dab87eac0bccda5f85514def5 May 21 03:21:42.137269 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:42.137226 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7vr9p" event={"ID":"1a03c959-a5a9-44f4-89f3-d604f293b8a0","Type":"ContainerStarted","Data":"428b65280d0f944dd29416b1251dceb7c017392dab87eac0bccda5f85514def5"} May 21 03:21:43.142105 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:43.142066 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7vr9p" event={"ID":"1a03c959-a5a9-44f4-89f3-d604f293b8a0","Type":"ContainerStarted","Data":"096cac80c4042152c8f3424932e2c696212485ba49c200cfb8074d4237a2b76f"} May 21 03:21:43.142105 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:43.142104 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7vr9p" event={"ID":"1a03c959-a5a9-44f4-89f3-d604f293b8a0","Type":"ContainerStarted","Data":"9c9a8d2f7c2da07f2a8d7046eceeb2aa48e147b3dc1854b350da841cc78c070a"} May 21 03:21:43.157511 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:43.157426 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-7vr9p" podStartSLOduration=130.067488849 podStartE2EDuration="2m11.157409093s" podCreationTimestamp="2026-05-21 03:19:32 +0000 UTC" firstStartedPulling="2026-05-21 03:21:41.638668121 +0000 UTC m=+129.681437013" lastFinishedPulling="2026-05-21 03:21:42.728588365 +0000 UTC m=+130.771357257" observedRunningTime="2026-05-21 03:21:43.155574008 +0000 UTC m=+131.198342918" watchObservedRunningTime="2026-05-21 03:21:43.157409093 +0000 UTC m=+131.200178008" May 21 03:21:46.684770 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:46.684735 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-766ccdc446-pmsmv"] May 21 03:21:46.688426 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:46.688404 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-766ccdc446-pmsmv" May 21 03:21:46.691736 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:46.691710 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" May 21 03:21:46.691977 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:46.691710 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-2gmfm\"" May 21 03:21:46.691977 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:46.691710 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" May 21 03:21:46.692141 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:46.691726 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" May 21 03:21:46.692141 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:46.691753 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" May 21 03:21:46.692141 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:46.691757 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" May 21 03:21:46.692141 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:46.691769 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" May 21 03:21:46.692141 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:46.691773 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" May 21 03:21:46.695668 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:46.695644 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" May 21 03:21:46.700044 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:46.700023 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-766ccdc446-pmsmv"] May 21 03:21:46.734198 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:46.734167 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f26e4685-45e6-4f4d-8bca-afd861743e31-oauth-serving-cert\") pod \"console-766ccdc446-pmsmv\" (UID: \"f26e4685-45e6-4f4d-8bca-afd861743e31\") " pod="openshift-console/console-766ccdc446-pmsmv" May 21 03:21:46.734380 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:46.734223 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f26e4685-45e6-4f4d-8bca-afd861743e31-service-ca\") pod \"console-766ccdc446-pmsmv\" (UID: \"f26e4685-45e6-4f4d-8bca-afd861743e31\") " pod="openshift-console/console-766ccdc446-pmsmv" May 21 03:21:46.734380 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:46.734241 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f26e4685-45e6-4f4d-8bca-afd861743e31-trusted-ca-bundle\") pod \"console-766ccdc446-pmsmv\" (UID: \"f26e4685-45e6-4f4d-8bca-afd861743e31\") " pod="openshift-console/console-766ccdc446-pmsmv" May 21 03:21:46.734380 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:46.734298 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f26e4685-45e6-4f4d-8bca-afd861743e31-console-serving-cert\") pod \"console-766ccdc446-pmsmv\" (UID: \"f26e4685-45e6-4f4d-8bca-afd861743e31\") " pod="openshift-console/console-766ccdc446-pmsmv" May 21 03:21:46.734380 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:46.734338 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f26e4685-45e6-4f4d-8bca-afd861743e31-console-oauth-config\") pod \"console-766ccdc446-pmsmv\" (UID: \"f26e4685-45e6-4f4d-8bca-afd861743e31\") " pod="openshift-console/console-766ccdc446-pmsmv" May 21 03:21:46.734380 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:46.734376 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f26e4685-45e6-4f4d-8bca-afd861743e31-console-config\") pod \"console-766ccdc446-pmsmv\" (UID: \"f26e4685-45e6-4f4d-8bca-afd861743e31\") " pod="openshift-console/console-766ccdc446-pmsmv" May 21 03:21:46.734541 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:46.734427 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b25jz\" (UniqueName: \"kubernetes.io/projected/f26e4685-45e6-4f4d-8bca-afd861743e31-kube-api-access-b25jz\") pod \"console-766ccdc446-pmsmv\" (UID: \"f26e4685-45e6-4f4d-8bca-afd861743e31\") " pod="openshift-console/console-766ccdc446-pmsmv" May 21 03:21:46.835196 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:46.835164 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f26e4685-45e6-4f4d-8bca-afd861743e31-console-serving-cert\") pod \"console-766ccdc446-pmsmv\" (UID: \"f26e4685-45e6-4f4d-8bca-afd861743e31\") " pod="openshift-console/console-766ccdc446-pmsmv" May 21 03:21:46.835323 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:46.835203 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f26e4685-45e6-4f4d-8bca-afd861743e31-console-oauth-config\") pod \"console-766ccdc446-pmsmv\" (UID: \"f26e4685-45e6-4f4d-8bca-afd861743e31\") " pod="openshift-console/console-766ccdc446-pmsmv" May 21 03:21:46.835323 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:46.835233 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f26e4685-45e6-4f4d-8bca-afd861743e31-console-config\") pod \"console-766ccdc446-pmsmv\" (UID: \"f26e4685-45e6-4f4d-8bca-afd861743e31\") " pod="openshift-console/console-766ccdc446-pmsmv" May 21 03:21:46.835323 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:46.835257 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b25jz\" (UniqueName: \"kubernetes.io/projected/f26e4685-45e6-4f4d-8bca-afd861743e31-kube-api-access-b25jz\") pod \"console-766ccdc446-pmsmv\" (UID: \"f26e4685-45e6-4f4d-8bca-afd861743e31\") " pod="openshift-console/console-766ccdc446-pmsmv" May 21 03:21:46.835323 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:46.835278 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f26e4685-45e6-4f4d-8bca-afd861743e31-oauth-serving-cert\") pod \"console-766ccdc446-pmsmv\" (UID: \"f26e4685-45e6-4f4d-8bca-afd861743e31\") " pod="openshift-console/console-766ccdc446-pmsmv" May 21 03:21:46.835533 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:46.835383 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f26e4685-45e6-4f4d-8bca-afd861743e31-service-ca\") pod \"console-766ccdc446-pmsmv\" (UID: \"f26e4685-45e6-4f4d-8bca-afd861743e31\") " pod="openshift-console/console-766ccdc446-pmsmv" May 21 03:21:46.835533 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:46.835435 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f26e4685-45e6-4f4d-8bca-afd861743e31-trusted-ca-bundle\") pod \"console-766ccdc446-pmsmv\" (UID: \"f26e4685-45e6-4f4d-8bca-afd861743e31\") " pod="openshift-console/console-766ccdc446-pmsmv" May 21 03:21:46.836083 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:46.836051 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f26e4685-45e6-4f4d-8bca-afd861743e31-oauth-serving-cert\") pod \"console-766ccdc446-pmsmv\" (UID: \"f26e4685-45e6-4f4d-8bca-afd861743e31\") " pod="openshift-console/console-766ccdc446-pmsmv" May 21 03:21:46.836189 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:46.836078 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f26e4685-45e6-4f4d-8bca-afd861743e31-console-config\") pod \"console-766ccdc446-pmsmv\" (UID: \"f26e4685-45e6-4f4d-8bca-afd861743e31\") " pod="openshift-console/console-766ccdc446-pmsmv" May 21 03:21:46.836189 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:46.836127 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f26e4685-45e6-4f4d-8bca-afd861743e31-service-ca\") pod \"console-766ccdc446-pmsmv\" (UID: \"f26e4685-45e6-4f4d-8bca-afd861743e31\") " pod="openshift-console/console-766ccdc446-pmsmv" May 21 03:21:46.836264 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:46.836214 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f26e4685-45e6-4f4d-8bca-afd861743e31-trusted-ca-bundle\") pod \"console-766ccdc446-pmsmv\" (UID: \"f26e4685-45e6-4f4d-8bca-afd861743e31\") " pod="openshift-console/console-766ccdc446-pmsmv" May 21 03:21:46.837995 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:46.837970 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f26e4685-45e6-4f4d-8bca-afd861743e31-console-serving-cert\") pod \"console-766ccdc446-pmsmv\" (UID: \"f26e4685-45e6-4f4d-8bca-afd861743e31\") " pod="openshift-console/console-766ccdc446-pmsmv" May 21 03:21:46.838237 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:46.838220 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f26e4685-45e6-4f4d-8bca-afd861743e31-console-oauth-config\") pod \"console-766ccdc446-pmsmv\" (UID: \"f26e4685-45e6-4f4d-8bca-afd861743e31\") " pod="openshift-console/console-766ccdc446-pmsmv" May 21 03:21:46.842705 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:46.842680 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b25jz\" (UniqueName: \"kubernetes.io/projected/f26e4685-45e6-4f4d-8bca-afd861743e31-kube-api-access-b25jz\") pod \"console-766ccdc446-pmsmv\" (UID: \"f26e4685-45e6-4f4d-8bca-afd861743e31\") " pod="openshift-console/console-766ccdc446-pmsmv" May 21 03:21:46.998174 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:46.998086 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-766ccdc446-pmsmv" May 21 03:21:47.128790 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:47.128760 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-766ccdc446-pmsmv"] May 21 03:21:47.131641 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:21:47.131612 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf26e4685_45e6_4f4d_8bca_afd861743e31.slice/crio-81628a9f20ecdb910adf3237e3cff7272ad20e23aa0a7a1ab24a9a3ffe00fda9 WatchSource:0}: Error finding container 81628a9f20ecdb910adf3237e3cff7272ad20e23aa0a7a1ab24a9a3ffe00fda9: Status 404 returned error can't find the container with id 81628a9f20ecdb910adf3237e3cff7272ad20e23aa0a7a1ab24a9a3ffe00fda9 May 21 03:21:47.154762 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:47.154730 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-766ccdc446-pmsmv" event={"ID":"f26e4685-45e6-4f4d-8bca-afd861743e31","Type":"ContainerStarted","Data":"81628a9f20ecdb910adf3237e3cff7272ad20e23aa0a7a1ab24a9a3ffe00fda9"} May 21 03:21:50.166042 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:50.165996 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-766ccdc446-pmsmv" event={"ID":"f26e4685-45e6-4f4d-8bca-afd861743e31","Type":"ContainerStarted","Data":"c602aa97a901b79ba15c5048e97c79e3faeb276e585b5908ff7c798615f3fddf"} May 21 03:21:50.182604 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:50.182555 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-766ccdc446-pmsmv" podStartSLOduration=1.492870463 podStartE2EDuration="4.182541995s" podCreationTimestamp="2026-05-21 03:21:46 +0000 UTC" firstStartedPulling="2026-05-21 03:21:47.134102452 +0000 UTC m=+135.176871344" lastFinishedPulling="2026-05-21 03:21:49.823773985 +0000 UTC m=+137.866542876" observedRunningTime="2026-05-21 03:21:50.181742921 +0000 UTC m=+138.224511837" watchObservedRunningTime="2026-05-21 03:21:50.182541995 +0000 UTC m=+138.225310909" May 21 03:21:54.183894 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:54.183823 2574 generic.go:358] "Generic (PLEG): container finished" podID="4302517e-e98b-4cd7-8b24-fbf4a8994346" containerID="41562885515b21ecf6a2e623e8bba9332d95a41ae8226d74cecbbdc05bed4a5c" exitCode=0 May 21 03:21:54.184305 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:54.183912 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-7hp2b" event={"ID":"4302517e-e98b-4cd7-8b24-fbf4a8994346","Type":"ContainerDied","Data":"41562885515b21ecf6a2e623e8bba9332d95a41ae8226d74cecbbdc05bed4a5c"} May 21 03:21:54.184305 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:54.184297 2574 scope.go:117] "RemoveContainer" containerID="41562885515b21ecf6a2e623e8bba9332d95a41ae8226d74cecbbdc05bed4a5c" May 21 03:21:54.666180 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:54.666152 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-756cb57bf8-jgcjn_0c56fe16-837c-4d09-8521-f6e5b652b7d9/router/0.log" May 21 03:21:54.675788 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:54.675763 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2cxks_ba1902e2-00e1-4eaa-9aea-5c617de7ebb3/serve-healthcheck-canary/0.log" May 21 03:21:55.188165 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:55.188133 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-7hp2b" event={"ID":"4302517e-e98b-4cd7-8b24-fbf4a8994346","Type":"ContainerStarted","Data":"b6de2b3e1df536385749973e11346137ea00d134722459308542c35a1c699163"} May 21 03:21:56.192190 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:56.192158 2574 generic.go:358] "Generic (PLEG): container finished" podID="651b5561-46ec-4f61-88f5-1788bc682717" containerID="b5a5a323642116452d50e140fa414b873c9d1094d718360a014a4fd2e2649baa" exitCode=0 May 21 03:21:56.192576 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:56.192224 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-brdg7" event={"ID":"651b5561-46ec-4f61-88f5-1788bc682717","Type":"ContainerDied","Data":"b5a5a323642116452d50e140fa414b873c9d1094d718360a014a4fd2e2649baa"} May 21 03:21:56.192576 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:56.192529 2574 scope.go:117] "RemoveContainer" containerID="b5a5a323642116452d50e140fa414b873c9d1094d718360a014a4fd2e2649baa" May 21 03:21:56.998934 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:56.998895 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-766ccdc446-pmsmv" May 21 03:21:56.998934 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:56.998938 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-766ccdc446-pmsmv" May 21 03:21:57.003935 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:57.003913 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-766ccdc446-pmsmv" May 21 03:21:57.196472 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:57.196430 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-brdg7" event={"ID":"651b5561-46ec-4f61-88f5-1788bc682717","Type":"ContainerStarted","Data":"37aa6ee1aa3bded03d184503337c622dcfef990845dec690198733fc112a72da"} May 21 03:21:57.200319 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:57.200295 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-766ccdc446-pmsmv" May 21 03:21:58.200518 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:58.200481 2574 generic.go:358] "Generic (PLEG): container finished" podID="87cfc78f-987e-46d9-a3e2-7128548b613d" containerID="a724573b23d51dae46dda269805138e955aa47d2a70b39610d404d928f078c59" exitCode=0 May 21 03:21:58.200897 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:58.200559 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-4q5lp" event={"ID":"87cfc78f-987e-46d9-a3e2-7128548b613d","Type":"ContainerDied","Data":"a724573b23d51dae46dda269805138e955aa47d2a70b39610d404d928f078c59"} May 21 03:21:58.201029 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:58.201014 2574 scope.go:117] "RemoveContainer" containerID="a724573b23d51dae46dda269805138e955aa47d2a70b39610d404d928f078c59" May 21 03:21:59.205151 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:21:59.205114 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-4q5lp" event={"ID":"87cfc78f-987e-46d9-a3e2-7128548b613d","Type":"ContainerStarted","Data":"370ca31f21c7e6150c4c798db80a57bbd598802e16a622c61452f3f59999a7de"} May 21 03:22:01.837698 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:22:01.837632 2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7b74df67-kzgvj" podUID="1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf" containerName="registry" containerID="cri-o://83a920e5a6e5f46f1caceff0bf0aeb24df8b5cb427ab6431c666038f774c1cee" gracePeriod=30 May 21 03:22:02.088766 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:22:02.088706 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b74df67-kzgvj" May 21 03:22:02.170722 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:22:02.170671 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf-registry-certificates\") pod \"1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf\" (UID: \"1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf\") " May 21 03:22:02.170722 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:22:02.170732 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf-image-registry-private-configuration\") pod \"1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf\" (UID: \"1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf\") " May 21 03:22:02.170981 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:22:02.170770 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wcxsz\" (UniqueName: \"kubernetes.io/projected/1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf-kube-api-access-wcxsz\") pod \"1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf\" (UID: \"1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf\") " May 21 03:22:02.170981 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:22:02.170792 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf-installation-pull-secrets\") pod \"1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf\" (UID: \"1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf\") " May 21 03:22:02.170981 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:22:02.170871 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf-bound-sa-token\") pod \"1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf\" (UID: \"1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf\") " May 21 03:22:02.170981 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:22:02.170894 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf-registry-tls\") pod \"1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf\" (UID: \"1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf\") " May 21 03:22:02.170981 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:22:02.170929 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf-trusted-ca\") pod \"1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf\" (UID: \"1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf\") " May 21 03:22:02.170981 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:22:02.170959 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf-ca-trust-extracted\") pod \"1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf\" (UID: \"1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf\") " May 21 03:22:02.171250 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:22:02.171164 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf" (UID: "1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 03:22:02.171922 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:22:02.171660 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf" (UID: "1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 03:22:02.173631 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:22:02.173523 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf" (UID: "1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 03:22:02.173763 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:22:02.173711 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf" (UID: "1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 03:22:02.173763 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:22:02.173731 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf" (UID: "1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 03:22:02.173900 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:22:02.173764 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf-kube-api-access-wcxsz" (OuterVolumeSpecName: "kube-api-access-wcxsz") pod "1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf" (UID: "1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf"). InnerVolumeSpecName "kube-api-access-wcxsz". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 03:22:02.173900 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:22:02.173865 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf" (UID: "1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 03:22:02.180422 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:22:02.180393 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf" (UID: "1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 03:22:02.214495 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:22:02.214459 2574 generic.go:358] "Generic (PLEG): container finished" podID="1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf" containerID="83a920e5a6e5f46f1caceff0bf0aeb24df8b5cb427ab6431c666038f774c1cee" exitCode=0 May 21 03:22:02.214656 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:22:02.214516 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b74df67-kzgvj" May 21 03:22:02.214656 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:22:02.214522 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7b74df67-kzgvj" event={"ID":"1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf","Type":"ContainerDied","Data":"83a920e5a6e5f46f1caceff0bf0aeb24df8b5cb427ab6431c666038f774c1cee"} May 21 03:22:02.214656 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:22:02.214548 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7b74df67-kzgvj" event={"ID":"1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf","Type":"ContainerDied","Data":"08f9ea11ff5a9845c02864a646847a34083f9deaabd7ded9bc71ba34a3f0f0cd"} May 21 03:22:02.214656 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:22:02.214563 2574 scope.go:117] "RemoveContainer" containerID="83a920e5a6e5f46f1caceff0bf0aeb24df8b5cb427ab6431c666038f774c1cee" May 21 03:22:02.223117 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:22:02.223087 2574 scope.go:117] "RemoveContainer" containerID="83a920e5a6e5f46f1caceff0bf0aeb24df8b5cb427ab6431c666038f774c1cee" May 21 03:22:02.223389 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:22:02.223368 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83a920e5a6e5f46f1caceff0bf0aeb24df8b5cb427ab6431c666038f774c1cee\": container with ID starting with 83a920e5a6e5f46f1caceff0bf0aeb24df8b5cb427ab6431c666038f774c1cee not found: ID does not exist" containerID="83a920e5a6e5f46f1caceff0bf0aeb24df8b5cb427ab6431c666038f774c1cee" May 21 03:22:02.223458 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:22:02.223398 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83a920e5a6e5f46f1caceff0bf0aeb24df8b5cb427ab6431c666038f774c1cee"} err="failed to get container status \"83a920e5a6e5f46f1caceff0bf0aeb24df8b5cb427ab6431c666038f774c1cee\": rpc error: code = NotFound desc = could not find container \"83a920e5a6e5f46f1caceff0bf0aeb24df8b5cb427ab6431c666038f774c1cee\": container with ID starting with 83a920e5a6e5f46f1caceff0bf0aeb24df8b5cb427ab6431c666038f774c1cee not found: ID does not exist" May 21 03:22:02.235006 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:22:02.234942 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7b74df67-kzgvj"] May 21 03:22:02.237461 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:22:02.237439 2574 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7b74df67-kzgvj"] May 21 03:22:02.272126 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:22:02.272099 2574 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf-bound-sa-token\") on node \"ip-10-0-128-161.ec2.internal\" DevicePath \"\"" May 21 03:22:02.272126 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:22:02.272127 2574 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf-registry-tls\") on node \"ip-10-0-128-161.ec2.internal\" DevicePath \"\"" May 21 03:22:02.272310 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:22:02.272137 2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf-trusted-ca\") on node \"ip-10-0-128-161.ec2.internal\" DevicePath \"\"" May 21 03:22:02.272310 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:22:02.272146 2574 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf-ca-trust-extracted\") on node \"ip-10-0-128-161.ec2.internal\" DevicePath \"\"" May 21 03:22:02.272310 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:22:02.272155 2574 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf-registry-certificates\") on node \"ip-10-0-128-161.ec2.internal\" DevicePath \"\"" May 21 03:22:02.272310 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:22:02.272167 2574 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf-image-registry-private-configuration\") on node \"ip-10-0-128-161.ec2.internal\" DevicePath \"\"" May 21 03:22:02.272310 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:22:02.272178 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wcxsz\" (UniqueName: \"kubernetes.io/projected/1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf-kube-api-access-wcxsz\") on node \"ip-10-0-128-161.ec2.internal\" DevicePath \"\"" May 21 03:22:02.272310 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:22:02.272186 2574 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf-installation-pull-secrets\") on node \"ip-10-0-128-161.ec2.internal\" DevicePath \"\"" May 21 03:22:02.589643 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:22:02.589606 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf" path="/var/lib/kubelet/pods/1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf/volumes" May 21 03:23:16.930469 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:23:16.930430 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-766ccdc446-pmsmv"] May 21 03:23:41.956089 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:23:41.955975 2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-766ccdc446-pmsmv" podUID="f26e4685-45e6-4f4d-8bca-afd861743e31" containerName="console" containerID="cri-o://c602aa97a901b79ba15c5048e97c79e3faeb276e585b5908ff7c798615f3fddf" gracePeriod=15 May 21 03:23:42.211613 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:23:42.211545 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-766ccdc446-pmsmv_f26e4685-45e6-4f4d-8bca-afd861743e31/console/0.log" May 21 03:23:42.211613 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:23:42.211608 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-766ccdc446-pmsmv" May 21 03:23:42.272743 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:23:42.272698 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f26e4685-45e6-4f4d-8bca-afd861743e31-service-ca\") pod \"f26e4685-45e6-4f4d-8bca-afd861743e31\" (UID: \"f26e4685-45e6-4f4d-8bca-afd861743e31\") " May 21 03:23:42.272743 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:23:42.272743 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f26e4685-45e6-4f4d-8bca-afd861743e31-oauth-serving-cert\") pod \"f26e4685-45e6-4f4d-8bca-afd861743e31\" (UID: \"f26e4685-45e6-4f4d-8bca-afd861743e31\") " May 21 03:23:42.273011 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:23:42.272761 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f26e4685-45e6-4f4d-8bca-afd861743e31-console-serving-cert\") pod \"f26e4685-45e6-4f4d-8bca-afd861743e31\" (UID: \"f26e4685-45e6-4f4d-8bca-afd861743e31\") " May 21 03:23:42.273011 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:23:42.272792 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f26e4685-45e6-4f4d-8bca-afd861743e31-console-config\") pod \"f26e4685-45e6-4f4d-8bca-afd861743e31\" (UID: \"f26e4685-45e6-4f4d-8bca-afd861743e31\") " May 21 03:23:42.273011 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:23:42.272950 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f26e4685-45e6-4f4d-8bca-afd861743e31-console-oauth-config\") pod \"f26e4685-45e6-4f4d-8bca-afd861743e31\" (UID: \"f26e4685-45e6-4f4d-8bca-afd861743e31\") " May 21 03:23:42.273160 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:23:42.273039 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b25jz\" (UniqueName: \"kubernetes.io/projected/f26e4685-45e6-4f4d-8bca-afd861743e31-kube-api-access-b25jz\") pod \"f26e4685-45e6-4f4d-8bca-afd861743e31\" (UID: \"f26e4685-45e6-4f4d-8bca-afd861743e31\") " May 21 03:23:42.273160 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:23:42.273081 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f26e4685-45e6-4f4d-8bca-afd861743e31-trusted-ca-bundle\") pod \"f26e4685-45e6-4f4d-8bca-afd861743e31\" (UID: \"f26e4685-45e6-4f4d-8bca-afd861743e31\") " May 21 03:23:42.273275 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:23:42.273158 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f26e4685-45e6-4f4d-8bca-afd861743e31-service-ca" (OuterVolumeSpecName: "service-ca") pod "f26e4685-45e6-4f4d-8bca-afd861743e31" (UID: "f26e4685-45e6-4f4d-8bca-afd861743e31"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 03:23:42.273275 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:23:42.273215 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f26e4685-45e6-4f4d-8bca-afd861743e31-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f26e4685-45e6-4f4d-8bca-afd861743e31" (UID: "f26e4685-45e6-4f4d-8bca-afd861743e31"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 03:23:42.273275 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:23:42.273225 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f26e4685-45e6-4f4d-8bca-afd861743e31-console-config" (OuterVolumeSpecName: "console-config") pod "f26e4685-45e6-4f4d-8bca-afd861743e31" (UID: "f26e4685-45e6-4f4d-8bca-afd861743e31"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 03:23:42.273419 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:23:42.273395 2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f26e4685-45e6-4f4d-8bca-afd861743e31-service-ca\") on node \"ip-10-0-128-161.ec2.internal\" DevicePath \"\"" May 21 03:23:42.273419 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:23:42.273415 2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f26e4685-45e6-4f4d-8bca-afd861743e31-oauth-serving-cert\") on node \"ip-10-0-128-161.ec2.internal\" DevicePath \"\"" May 21 03:23:42.273549 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:23:42.273428 2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f26e4685-45e6-4f4d-8bca-afd861743e31-console-config\") on node \"ip-10-0-128-161.ec2.internal\" DevicePath \"\"" May 21 03:23:42.273549 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:23:42.273507 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f26e4685-45e6-4f4d-8bca-afd861743e31-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f26e4685-45e6-4f4d-8bca-afd861743e31" (UID: "f26e4685-45e6-4f4d-8bca-afd861743e31"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 03:23:42.275321 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:23:42.275296 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f26e4685-45e6-4f4d-8bca-afd861743e31-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f26e4685-45e6-4f4d-8bca-afd861743e31" (UID: "f26e4685-45e6-4f4d-8bca-afd861743e31"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 03:23:42.275407 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:23:42.275369 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f26e4685-45e6-4f4d-8bca-afd861743e31-kube-api-access-b25jz" (OuterVolumeSpecName: "kube-api-access-b25jz") pod "f26e4685-45e6-4f4d-8bca-afd861743e31" (UID: "f26e4685-45e6-4f4d-8bca-afd861743e31"). InnerVolumeSpecName "kube-api-access-b25jz". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 03:23:42.275407 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:23:42.275397 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f26e4685-45e6-4f4d-8bca-afd861743e31-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f26e4685-45e6-4f4d-8bca-afd861743e31" (UID: "f26e4685-45e6-4f4d-8bca-afd861743e31"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 03:23:42.374111 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:23:42.374073 2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f26e4685-45e6-4f4d-8bca-afd861743e31-console-serving-cert\") on node \"ip-10-0-128-161.ec2.internal\" DevicePath \"\"" May 21 03:23:42.374111 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:23:42.374105 2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f26e4685-45e6-4f4d-8bca-afd861743e31-console-oauth-config\") on node \"ip-10-0-128-161.ec2.internal\" DevicePath \"\"" May 21 03:23:42.374111 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:23:42.374115 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b25jz\" (UniqueName: \"kubernetes.io/projected/f26e4685-45e6-4f4d-8bca-afd861743e31-kube-api-access-b25jz\") on node \"ip-10-0-128-161.ec2.internal\" DevicePath \"\"" May 21 03:23:42.374111 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:23:42.374123 2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f26e4685-45e6-4f4d-8bca-afd861743e31-trusted-ca-bundle\") on node \"ip-10-0-128-161.ec2.internal\" DevicePath \"\"" May 21 03:23:42.501538 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:23:42.501452 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-766ccdc446-pmsmv_f26e4685-45e6-4f4d-8bca-afd861743e31/console/0.log" May 21 03:23:42.501538 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:23:42.501494 2574 generic.go:358] "Generic (PLEG): container finished" podID="f26e4685-45e6-4f4d-8bca-afd861743e31" containerID="c602aa97a901b79ba15c5048e97c79e3faeb276e585b5908ff7c798615f3fddf" exitCode=2 May 21 03:23:42.501763 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:23:42.501554 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-766ccdc446-pmsmv" event={"ID":"f26e4685-45e6-4f4d-8bca-afd861743e31","Type":"ContainerDied","Data":"c602aa97a901b79ba15c5048e97c79e3faeb276e585b5908ff7c798615f3fddf"} May 21 03:23:42.501763 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:23:42.501576 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-766ccdc446-pmsmv" May 21 03:23:42.501763 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:23:42.501586 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-766ccdc446-pmsmv" event={"ID":"f26e4685-45e6-4f4d-8bca-afd861743e31","Type":"ContainerDied","Data":"81628a9f20ecdb910adf3237e3cff7272ad20e23aa0a7a1ab24a9a3ffe00fda9"} May 21 03:23:42.501763 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:23:42.501605 2574 scope.go:117] "RemoveContainer" containerID="c602aa97a901b79ba15c5048e97c79e3faeb276e585b5908ff7c798615f3fddf" May 21 03:23:42.510595 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:23:42.510572 2574 scope.go:117] "RemoveContainer" containerID="c602aa97a901b79ba15c5048e97c79e3faeb276e585b5908ff7c798615f3fddf" May 21 03:23:42.511023 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:23:42.511002 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c602aa97a901b79ba15c5048e97c79e3faeb276e585b5908ff7c798615f3fddf\": container with ID starting with c602aa97a901b79ba15c5048e97c79e3faeb276e585b5908ff7c798615f3fddf not found: ID does not exist" containerID="c602aa97a901b79ba15c5048e97c79e3faeb276e585b5908ff7c798615f3fddf" May 21 03:23:42.511080 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:23:42.511034 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c602aa97a901b79ba15c5048e97c79e3faeb276e585b5908ff7c798615f3fddf"} err="failed to get container status \"c602aa97a901b79ba15c5048e97c79e3faeb276e585b5908ff7c798615f3fddf\": rpc error: code = NotFound desc = could not find container \"c602aa97a901b79ba15c5048e97c79e3faeb276e585b5908ff7c798615f3fddf\": container with ID starting with c602aa97a901b79ba15c5048e97c79e3faeb276e585b5908ff7c798615f3fddf not found: ID does not exist" May 21 03:23:42.522274 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:23:42.522246 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-766ccdc446-pmsmv"] May 21 03:23:42.528459 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:23:42.528428 2574 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-766ccdc446-pmsmv"] May 21 03:23:42.588973 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:23:42.588937 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f26e4685-45e6-4f4d-8bca-afd861743e31" path="/var/lib/kubelet/pods/f26e4685-45e6-4f4d-8bca-afd861743e31/volumes" May 21 03:23:47.688704 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:23:47.688670 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-w4sz7"] May 21 03:23:47.689110 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:23:47.688984 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f26e4685-45e6-4f4d-8bca-afd861743e31" containerName="console" May 21 03:23:47.689110 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:23:47.688996 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="f26e4685-45e6-4f4d-8bca-afd861743e31" containerName="console" May 21 03:23:47.689110 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:23:47.689007 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf" containerName="registry" May 21 03:23:47.689110 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:23:47.689013 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf" containerName="registry" May 21 03:23:47.689110 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:23:47.689064 2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="f26e4685-45e6-4f4d-8bca-afd861743e31" containerName="console" May 21 03:23:47.689110 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:23:47.689074 2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="1ffb96f0-278e-4bf4-a96a-d5dd212c7cdf" containerName="registry" May 21 03:23:47.693107 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:23:47.693090 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-w4sz7" May 21 03:23:47.695257 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:23:47.695234 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" May 21 03:23:47.696202 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:23:47.696177 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" May 21 03:23:47.696342 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:23:47.696210 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-47hmb\"" May 21 03:23:47.697810 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:23:47.697784 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-w4sz7"] May 21 03:23:47.718815 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:23:47.718783 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/87440979-b6d3-4803-a899-0827572b35b6-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-w4sz7\" (UID: \"87440979-b6d3-4803-a899-0827572b35b6\") " pod="cert-manager/cert-manager-cainjector-68b757865b-w4sz7" May 21 03:23:47.718973 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:23:47.718885 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkgks\" (UniqueName: \"kubernetes.io/projected/87440979-b6d3-4803-a899-0827572b35b6-kube-api-access-tkgks\") pod \"cert-manager-cainjector-68b757865b-w4sz7\" (UID: \"87440979-b6d3-4803-a899-0827572b35b6\") " pod="cert-manager/cert-manager-cainjector-68b757865b-w4sz7" May 21 03:23:47.819968 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:23:47.819927 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/87440979-b6d3-4803-a899-0827572b35b6-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-w4sz7\" (UID: \"87440979-b6d3-4803-a899-0827572b35b6\") " pod="cert-manager/cert-manager-cainjector-68b757865b-w4sz7" May 21 03:23:47.820161 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:23:47.820015 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tkgks\" (UniqueName: \"kubernetes.io/projected/87440979-b6d3-4803-a899-0827572b35b6-kube-api-access-tkgks\") pod \"cert-manager-cainjector-68b757865b-w4sz7\" (UID: \"87440979-b6d3-4803-a899-0827572b35b6\") " pod="cert-manager/cert-manager-cainjector-68b757865b-w4sz7" May 21 03:23:47.827800 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:23:47.827769 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/87440979-b6d3-4803-a899-0827572b35b6-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-w4sz7\" (UID: \"87440979-b6d3-4803-a899-0827572b35b6\") " pod="cert-manager/cert-manager-cainjector-68b757865b-w4sz7" May 21 03:23:47.827937 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:23:47.827781 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkgks\" (UniqueName: \"kubernetes.io/projected/87440979-b6d3-4803-a899-0827572b35b6-kube-api-access-tkgks\") pod \"cert-manager-cainjector-68b757865b-w4sz7\" (UID: \"87440979-b6d3-4803-a899-0827572b35b6\") " pod="cert-manager/cert-manager-cainjector-68b757865b-w4sz7" May 21 03:23:48.012603 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:23:48.012513 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-w4sz7" May 21 03:23:48.142364 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:23:48.142338 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-w4sz7"] May 21 03:23:48.144952 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:23:48.144923 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod87440979_b6d3_4803_a899_0827572b35b6.slice/crio-e58f5e95a855eba42bf1505907824761749e69c813bbf0cf79b6085b0e054a05 WatchSource:0}: Error finding container e58f5e95a855eba42bf1505907824761749e69c813bbf0cf79b6085b0e054a05: Status 404 returned error can't find the container with id e58f5e95a855eba42bf1505907824761749e69c813bbf0cf79b6085b0e054a05 May 21 03:23:48.518876 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:23:48.518823 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-w4sz7" event={"ID":"87440979-b6d3-4803-a899-0827572b35b6","Type":"ContainerStarted","Data":"e58f5e95a855eba42bf1505907824761749e69c813bbf0cf79b6085b0e054a05"} May 21 03:23:51.690490 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:23:51.690450 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-87q5z"] May 21 03:23:51.693983 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:23:51.693961 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-87q5z" May 21 03:23:51.696030 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:23:51.695998 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-9gf9s\"" May 21 03:23:51.701321 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:23:51.701288 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-87q5z"] May 21 03:23:51.754199 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:23:51.754161 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2dd2d51c-1999-4fc5-bba0-d9f7dba862aa-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-87q5z\" (UID: \"2dd2d51c-1999-4fc5-bba0-d9f7dba862aa\") " pod="cert-manager/cert-manager-webhook-587ccfb98-87q5z" May 21 03:23:51.754379 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:23:51.754218 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtw57\" (UniqueName: \"kubernetes.io/projected/2dd2d51c-1999-4fc5-bba0-d9f7dba862aa-kube-api-access-qtw57\") pod \"cert-manager-webhook-587ccfb98-87q5z\" (UID: \"2dd2d51c-1999-4fc5-bba0-d9f7dba862aa\") " pod="cert-manager/cert-manager-webhook-587ccfb98-87q5z" May 21 03:23:51.855625 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:23:51.855585 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qtw57\" (UniqueName: \"kubernetes.io/projected/2dd2d51c-1999-4fc5-bba0-d9f7dba862aa-kube-api-access-qtw57\") pod \"cert-manager-webhook-587ccfb98-87q5z\" (UID: \"2dd2d51c-1999-4fc5-bba0-d9f7dba862aa\") " pod="cert-manager/cert-manager-webhook-587ccfb98-87q5z" May 21 03:23:51.855835 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:23:51.855674 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2dd2d51c-1999-4fc5-bba0-d9f7dba862aa-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-87q5z\" (UID: \"2dd2d51c-1999-4fc5-bba0-d9f7dba862aa\") " pod="cert-manager/cert-manager-webhook-587ccfb98-87q5z" May 21 03:23:51.863130 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:23:51.863107 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2dd2d51c-1999-4fc5-bba0-d9f7dba862aa-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-87q5z\" (UID: \"2dd2d51c-1999-4fc5-bba0-d9f7dba862aa\") " pod="cert-manager/cert-manager-webhook-587ccfb98-87q5z" May 21 03:23:51.863253 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:23:51.863169 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtw57\" (UniqueName: \"kubernetes.io/projected/2dd2d51c-1999-4fc5-bba0-d9f7dba862aa-kube-api-access-qtw57\") pod \"cert-manager-webhook-587ccfb98-87q5z\" (UID: \"2dd2d51c-1999-4fc5-bba0-d9f7dba862aa\") " pod="cert-manager/cert-manager-webhook-587ccfb98-87q5z" May 21 03:23:52.006188 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:23:52.006097 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-87q5z" May 21 03:23:52.138185 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:23:52.138150 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-87q5z"] May 21 03:23:52.140999 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:23:52.140967 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2dd2d51c_1999_4fc5_bba0_d9f7dba862aa.slice/crio-24d8159aadd3e8cc7ef81671664dc0e7b17f343ff13cd01905611d1659953a4b WatchSource:0}: Error finding container 24d8159aadd3e8cc7ef81671664dc0e7b17f343ff13cd01905611d1659953a4b: Status 404 returned error can't find the container with id 24d8159aadd3e8cc7ef81671664dc0e7b17f343ff13cd01905611d1659953a4b May 21 03:23:52.533520 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:23:52.533481 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-87q5z" event={"ID":"2dd2d51c-1999-4fc5-bba0-d9f7dba862aa","Type":"ContainerStarted","Data":"da8443129b89cc0b187cca43d805af8b82fcbb6c1500b6d7caafd24547f650de"} May 21 03:23:52.533690 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:23:52.533529 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-87q5z" event={"ID":"2dd2d51c-1999-4fc5-bba0-d9f7dba862aa","Type":"ContainerStarted","Data":"24d8159aadd3e8cc7ef81671664dc0e7b17f343ff13cd01905611d1659953a4b"} May 21 03:23:52.533690 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:23:52.533565 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-587ccfb98-87q5z" May 21 03:23:52.534921 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:23:52.534899 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-w4sz7" event={"ID":"87440979-b6d3-4803-a899-0827572b35b6","Type":"ContainerStarted","Data":"f94e667428b62b603fa64e59b665be770e2397e226ba9b750c2ad3397fb90e07"} May 21 03:23:52.548356 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:23:52.548312 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-587ccfb98-87q5z" podStartSLOduration=1.548298341 podStartE2EDuration="1.548298341s" podCreationTimestamp="2026-05-21 03:23:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 03:23:52.54724792 +0000 UTC m=+260.590016837" watchObservedRunningTime="2026-05-21 03:23:52.548298341 +0000 UTC m=+260.591067255" May 21 03:23:52.561459 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:23:52.561411 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-w4sz7" podStartSLOduration=2.051492823 podStartE2EDuration="5.561396579s" podCreationTimestamp="2026-05-21 03:23:47 +0000 UTC" firstStartedPulling="2026-05-21 03:23:48.146599801 +0000 UTC m=+256.189368693" lastFinishedPulling="2026-05-21 03:23:51.656503557 +0000 UTC m=+259.699272449" observedRunningTime="2026-05-21 03:23:52.560147997 +0000 UTC m=+260.602916911" watchObservedRunningTime="2026-05-21 03:23:52.561396579 +0000 UTC m=+260.604165494" May 21 03:23:58.539593 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:23:58.539545 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-587ccfb98-87q5z" May 21 03:24:18.853768 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:18.853732 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5fcf489fb9-qkwkn"] May 21 03:24:18.859006 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:18.858982 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5fcf489fb9-qkwkn" May 21 03:24:18.861353 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:18.861330 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-5rz5x\"" May 21 03:24:18.861353 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:18.861342 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 21 03:24:18.861532 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:18.861430 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 21 03:24:18.861532 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:18.861449 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 21 03:24:18.861532 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:18.861516 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 21 03:24:18.867442 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:18.867420 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5fcf489fb9-qkwkn"] May 21 03:24:18.980559 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:18.980518 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/585f7729-b506-494c-8484-4e6b7e4c2b7b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5fcf489fb9-qkwkn\" (UID: \"585f7729-b506-494c-8484-4e6b7e4c2b7b\") " pod="opendatahub/opendatahub-operator-controller-manager-5fcf489fb9-qkwkn" May 21 03:24:18.980727 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:18.980562 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/585f7729-b506-494c-8484-4e6b7e4c2b7b-webhook-cert\") pod \"opendatahub-operator-controller-manager-5fcf489fb9-qkwkn\" (UID: \"585f7729-b506-494c-8484-4e6b7e4c2b7b\") " pod="opendatahub/opendatahub-operator-controller-manager-5fcf489fb9-qkwkn" May 21 03:24:18.980727 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:18.980623 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjfjt\" (UniqueName: \"kubernetes.io/projected/585f7729-b506-494c-8484-4e6b7e4c2b7b-kube-api-access-wjfjt\") pod \"opendatahub-operator-controller-manager-5fcf489fb9-qkwkn\" (UID: \"585f7729-b506-494c-8484-4e6b7e4c2b7b\") " pod="opendatahub/opendatahub-operator-controller-manager-5fcf489fb9-qkwkn" May 21 03:24:19.081584 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:19.081537 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/585f7729-b506-494c-8484-4e6b7e4c2b7b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5fcf489fb9-qkwkn\" (UID: \"585f7729-b506-494c-8484-4e6b7e4c2b7b\") " pod="opendatahub/opendatahub-operator-controller-manager-5fcf489fb9-qkwkn" May 21 03:24:19.081792 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:19.081590 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/585f7729-b506-494c-8484-4e6b7e4c2b7b-webhook-cert\") pod \"opendatahub-operator-controller-manager-5fcf489fb9-qkwkn\" (UID: \"585f7729-b506-494c-8484-4e6b7e4c2b7b\") " pod="opendatahub/opendatahub-operator-controller-manager-5fcf489fb9-qkwkn" May 21 03:24:19.081792 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:19.081629 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wjfjt\" (UniqueName: \"kubernetes.io/projected/585f7729-b506-494c-8484-4e6b7e4c2b7b-kube-api-access-wjfjt\") pod \"opendatahub-operator-controller-manager-5fcf489fb9-qkwkn\" (UID: \"585f7729-b506-494c-8484-4e6b7e4c2b7b\") " pod="opendatahub/opendatahub-operator-controller-manager-5fcf489fb9-qkwkn" May 21 03:24:19.084264 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:19.084236 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/585f7729-b506-494c-8484-4e6b7e4c2b7b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5fcf489fb9-qkwkn\" (UID: \"585f7729-b506-494c-8484-4e6b7e4c2b7b\") " pod="opendatahub/opendatahub-operator-controller-manager-5fcf489fb9-qkwkn" May 21 03:24:19.084376 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:19.084272 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/585f7729-b506-494c-8484-4e6b7e4c2b7b-webhook-cert\") pod \"opendatahub-operator-controller-manager-5fcf489fb9-qkwkn\" (UID: \"585f7729-b506-494c-8484-4e6b7e4c2b7b\") " pod="opendatahub/opendatahub-operator-controller-manager-5fcf489fb9-qkwkn" May 21 03:24:19.089420 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:19.089390 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjfjt\" (UniqueName: \"kubernetes.io/projected/585f7729-b506-494c-8484-4e6b7e4c2b7b-kube-api-access-wjfjt\") pod \"opendatahub-operator-controller-manager-5fcf489fb9-qkwkn\" (UID: \"585f7729-b506-494c-8484-4e6b7e4c2b7b\") " pod="opendatahub/opendatahub-operator-controller-manager-5fcf489fb9-qkwkn" May 21 03:24:19.170544 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:19.170499 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5fcf489fb9-qkwkn" May 21 03:24:19.305346 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:19.305311 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5fcf489fb9-qkwkn"] May 21 03:24:19.308711 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:24:19.308687 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod585f7729_b506_494c_8484_4e6b7e4c2b7b.slice/crio-a1b4ab6d1d710fb70031ff620b8f726dc3b815d6bb8178cc94fb9b845dea9324 WatchSource:0}: Error finding container a1b4ab6d1d710fb70031ff620b8f726dc3b815d6bb8178cc94fb9b845dea9324: Status 404 returned error can't find the container with id a1b4ab6d1d710fb70031ff620b8f726dc3b815d6bb8178cc94fb9b845dea9324 May 21 03:24:19.611939 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:19.611828 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5fcf489fb9-qkwkn" event={"ID":"585f7729-b506-494c-8484-4e6b7e4c2b7b","Type":"ContainerStarted","Data":"a1b4ab6d1d710fb70031ff620b8f726dc3b815d6bb8178cc94fb9b845dea9324"} May 21 03:24:22.622398 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:22.622368 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5fcf489fb9-qkwkn" event={"ID":"585f7729-b506-494c-8484-4e6b7e4c2b7b","Type":"ContainerStarted","Data":"818255bed7b9c1242ebc16e4de3df9bae92d1d833d3b3c63b0499f13f1a554af"} May 21 03:24:22.622776 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:22.622467 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5fcf489fb9-qkwkn" May 21 03:24:22.640377 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:22.640325 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5fcf489fb9-qkwkn" podStartSLOduration=2.167802283 podStartE2EDuration="4.640309007s" podCreationTimestamp="2026-05-21 03:24:18 +0000 UTC" firstStartedPulling="2026-05-21 03:24:19.310974416 +0000 UTC m=+287.353743311" lastFinishedPulling="2026-05-21 03:24:21.783481132 +0000 UTC m=+289.826250035" observedRunningTime="2026-05-21 03:24:22.638897108 +0000 UTC m=+290.681666019" watchObservedRunningTime="2026-05-21 03:24:22.640309007 +0000 UTC m=+290.683077925" May 21 03:24:32.470468 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:32.470441 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-8lrds_dba914e7-105d-41a4-8789-b248a94c0bd6/console-operator/2.log" May 21 03:24:32.472263 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:32.472241 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-8lrds_dba914e7-105d-41a4-8789-b248a94c0bd6/console-operator/2.log" May 21 03:24:32.479769 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:32.479754 2574 kubelet.go:1628] "Image garbage collection succeeded" May 21 03:24:33.628747 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:33.628707 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5fcf489fb9-qkwkn" May 21 03:24:42.190466 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:42.190424 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5749999c66-b7kmq"] May 21 03:24:42.193824 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:42.193789 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5749999c66-b7kmq" May 21 03:24:42.196243 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:42.196218 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" May 21 03:24:42.197052 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:42.197021 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-bnxsw\"" May 21 03:24:42.197173 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:42.197077 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" May 21 03:24:42.200096 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:42.200075 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5749999c66-b7kmq"] May 21 03:24:42.265216 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:42.265183 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsw6m\" (UniqueName: \"kubernetes.io/projected/236040c0-bedd-4a35-ad97-b420dd53ade0-kube-api-access-gsw6m\") pod \"kube-auth-proxy-5749999c66-b7kmq\" (UID: \"236040c0-bedd-4a35-ad97-b420dd53ade0\") " pod="openshift-ingress/kube-auth-proxy-5749999c66-b7kmq" May 21 03:24:42.265375 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:42.265240 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/236040c0-bedd-4a35-ad97-b420dd53ade0-tmp\") pod \"kube-auth-proxy-5749999c66-b7kmq\" (UID: \"236040c0-bedd-4a35-ad97-b420dd53ade0\") " pod="openshift-ingress/kube-auth-proxy-5749999c66-b7kmq" May 21 03:24:42.265375 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:42.265269 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/236040c0-bedd-4a35-ad97-b420dd53ade0-tls-certs\") pod \"kube-auth-proxy-5749999c66-b7kmq\" (UID: \"236040c0-bedd-4a35-ad97-b420dd53ade0\") " pod="openshift-ingress/kube-auth-proxy-5749999c66-b7kmq" May 21 03:24:42.365961 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:42.365926 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/236040c0-bedd-4a35-ad97-b420dd53ade0-tmp\") pod \"kube-auth-proxy-5749999c66-b7kmq\" (UID: \"236040c0-bedd-4a35-ad97-b420dd53ade0\") " pod="openshift-ingress/kube-auth-proxy-5749999c66-b7kmq" May 21 03:24:42.366114 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:42.365968 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/236040c0-bedd-4a35-ad97-b420dd53ade0-tls-certs\") pod \"kube-auth-proxy-5749999c66-b7kmq\" (UID: \"236040c0-bedd-4a35-ad97-b420dd53ade0\") " pod="openshift-ingress/kube-auth-proxy-5749999c66-b7kmq" May 21 03:24:42.366114 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:42.365999 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gsw6m\" (UniqueName: \"kubernetes.io/projected/236040c0-bedd-4a35-ad97-b420dd53ade0-kube-api-access-gsw6m\") pod \"kube-auth-proxy-5749999c66-b7kmq\" (UID: \"236040c0-bedd-4a35-ad97-b420dd53ade0\") " pod="openshift-ingress/kube-auth-proxy-5749999c66-b7kmq" May 21 03:24:42.368414 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:42.368387 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/236040c0-bedd-4a35-ad97-b420dd53ade0-tmp\") pod \"kube-auth-proxy-5749999c66-b7kmq\" (UID: \"236040c0-bedd-4a35-ad97-b420dd53ade0\") " pod="openshift-ingress/kube-auth-proxy-5749999c66-b7kmq" May 21 03:24:42.368661 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:42.368636 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/236040c0-bedd-4a35-ad97-b420dd53ade0-tls-certs\") pod \"kube-auth-proxy-5749999c66-b7kmq\" (UID: \"236040c0-bedd-4a35-ad97-b420dd53ade0\") " pod="openshift-ingress/kube-auth-proxy-5749999c66-b7kmq" May 21 03:24:42.373193 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:42.373172 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsw6m\" (UniqueName: \"kubernetes.io/projected/236040c0-bedd-4a35-ad97-b420dd53ade0-kube-api-access-gsw6m\") pod \"kube-auth-proxy-5749999c66-b7kmq\" (UID: \"236040c0-bedd-4a35-ad97-b420dd53ade0\") " pod="openshift-ingress/kube-auth-proxy-5749999c66-b7kmq" May 21 03:24:42.504346 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:42.504270 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5749999c66-b7kmq" May 21 03:24:42.630963 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:42.630814 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5749999c66-b7kmq"] May 21 03:24:42.634222 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:24:42.634192 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod236040c0_bedd_4a35_ad97_b420dd53ade0.slice/crio-2828a9372aeb6e8b8bf102a771b1f7d4f17ee49c657e654bf702696ef2e59f28 WatchSource:0}: Error finding container 2828a9372aeb6e8b8bf102a771b1f7d4f17ee49c657e654bf702696ef2e59f28: Status 404 returned error can't find the container with id 2828a9372aeb6e8b8bf102a771b1f7d4f17ee49c657e654bf702696ef2e59f28 May 21 03:24:42.635982 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:42.635963 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 03:24:42.682490 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:42.682458 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5749999c66-b7kmq" event={"ID":"236040c0-bedd-4a35-ad97-b420dd53ade0","Type":"ContainerStarted","Data":"2828a9372aeb6e8b8bf102a771b1f7d4f17ee49c657e654bf702696ef2e59f28"} May 21 03:24:44.697369 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:44.697330 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-2tg2w"] May 21 03:24:44.700592 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:44.700570 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-2tg2w" May 21 03:24:44.702579 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:44.702559 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" May 21 03:24:44.702659 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:44.702567 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-2fdh2\"" May 21 03:24:44.706668 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:44.706648 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-2tg2w"] May 21 03:24:44.782678 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:44.782643 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knkhj\" (UniqueName: \"kubernetes.io/projected/267041ad-559e-4d00-a0f6-9590dc2d5e2f-kube-api-access-knkhj\") pod \"odh-model-controller-858dbf95b8-2tg2w\" (UID: \"267041ad-559e-4d00-a0f6-9590dc2d5e2f\") " pod="opendatahub/odh-model-controller-858dbf95b8-2tg2w" May 21 03:24:44.782869 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:44.782694 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/267041ad-559e-4d00-a0f6-9590dc2d5e2f-cert\") pod \"odh-model-controller-858dbf95b8-2tg2w\" (UID: \"267041ad-559e-4d00-a0f6-9590dc2d5e2f\") " pod="opendatahub/odh-model-controller-858dbf95b8-2tg2w" May 21 03:24:44.883951 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:44.883912 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-knkhj\" (UniqueName: \"kubernetes.io/projected/267041ad-559e-4d00-a0f6-9590dc2d5e2f-kube-api-access-knkhj\") pod \"odh-model-controller-858dbf95b8-2tg2w\" (UID: \"267041ad-559e-4d00-a0f6-9590dc2d5e2f\") " pod="opendatahub/odh-model-controller-858dbf95b8-2tg2w" May 21 03:24:44.884102 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:44.883970 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/267041ad-559e-4d00-a0f6-9590dc2d5e2f-cert\") pod \"odh-model-controller-858dbf95b8-2tg2w\" (UID: \"267041ad-559e-4d00-a0f6-9590dc2d5e2f\") " pod="opendatahub/odh-model-controller-858dbf95b8-2tg2w" May 21 03:24:44.884102 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:24:44.884070 2574 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found May 21 03:24:44.884181 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:24:44.884124 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/267041ad-559e-4d00-a0f6-9590dc2d5e2f-cert podName:267041ad-559e-4d00-a0f6-9590dc2d5e2f nodeName:}" failed. No retries permitted until 2026-05-21 03:24:45.384107734 +0000 UTC m=+313.426876626 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/267041ad-559e-4d00-a0f6-9590dc2d5e2f-cert") pod "odh-model-controller-858dbf95b8-2tg2w" (UID: "267041ad-559e-4d00-a0f6-9590dc2d5e2f") : secret "odh-model-controller-webhook-cert" not found May 21 03:24:44.892225 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:44.892201 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-knkhj\" (UniqueName: \"kubernetes.io/projected/267041ad-559e-4d00-a0f6-9590dc2d5e2f-kube-api-access-knkhj\") pod \"odh-model-controller-858dbf95b8-2tg2w\" (UID: \"267041ad-559e-4d00-a0f6-9590dc2d5e2f\") " pod="opendatahub/odh-model-controller-858dbf95b8-2tg2w" May 21 03:24:45.388687 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:45.388655 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/267041ad-559e-4d00-a0f6-9590dc2d5e2f-cert\") pod \"odh-model-controller-858dbf95b8-2tg2w\" (UID: \"267041ad-559e-4d00-a0f6-9590dc2d5e2f\") " pod="opendatahub/odh-model-controller-858dbf95b8-2tg2w" May 21 03:24:45.391651 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:45.391623 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/267041ad-559e-4d00-a0f6-9590dc2d5e2f-cert\") pod \"odh-model-controller-858dbf95b8-2tg2w\" (UID: \"267041ad-559e-4d00-a0f6-9590dc2d5e2f\") " pod="opendatahub/odh-model-controller-858dbf95b8-2tg2w" May 21 03:24:45.611351 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:45.611317 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-2tg2w" May 21 03:24:45.694409 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:45.694379 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5749999c66-b7kmq" event={"ID":"236040c0-bedd-4a35-ad97-b420dd53ade0","Type":"ContainerStarted","Data":"01d4e8efe2b2a9dc7b385d312cc5b5ff9f3dc22b943f4fbfaabe46c52938360b"} May 21 03:24:45.710923 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:45.710874 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5749999c66-b7kmq" podStartSLOduration=0.742055371 podStartE2EDuration="3.710858677s" podCreationTimestamp="2026-05-21 03:24:42 +0000 UTC" firstStartedPulling="2026-05-21 03:24:42.636095058 +0000 UTC m=+310.678863953" lastFinishedPulling="2026-05-21 03:24:45.604898364 +0000 UTC m=+313.647667259" observedRunningTime="2026-05-21 03:24:45.708871221 +0000 UTC m=+313.751640149" watchObservedRunningTime="2026-05-21 03:24:45.710858677 +0000 UTC m=+313.753627586" May 21 03:24:45.750327 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:45.750124 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-2tg2w"] May 21 03:24:45.753171 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:24:45.753060 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod267041ad_559e_4d00_a0f6_9590dc2d5e2f.slice/crio-9b7cc7e25e4f73091e65cb87a078f84bb702a8bd6577ef2dbcc218ed598986d9 WatchSource:0}: Error finding container 9b7cc7e25e4f73091e65cb87a078f84bb702a8bd6577ef2dbcc218ed598986d9: Status 404 returned error can't find the container with id 9b7cc7e25e4f73091e65cb87a078f84bb702a8bd6577ef2dbcc218ed598986d9 May 21 03:24:46.699740 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:46.699692 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-2tg2w" event={"ID":"267041ad-559e-4d00-a0f6-9590dc2d5e2f","Type":"ContainerStarted","Data":"9b7cc7e25e4f73091e65cb87a078f84bb702a8bd6577ef2dbcc218ed598986d9"} May 21 03:24:48.707864 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:48.707765 2574 generic.go:358] "Generic (PLEG): container finished" podID="267041ad-559e-4d00-a0f6-9590dc2d5e2f" containerID="b2f246a844d1ec84c4a301b1e16a1cd8a600056b4676cfa5d016c770bb671641" exitCode=1 May 21 03:24:48.708268 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:48.707873 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-2tg2w" event={"ID":"267041ad-559e-4d00-a0f6-9590dc2d5e2f","Type":"ContainerDied","Data":"b2f246a844d1ec84c4a301b1e16a1cd8a600056b4676cfa5d016c770bb671641"} May 21 03:24:48.708268 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:48.708118 2574 scope.go:117] "RemoveContainer" containerID="b2f246a844d1ec84c4a301b1e16a1cd8a600056b4676cfa5d016c770bb671641" May 21 03:24:49.712932 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:49.712893 2574 generic.go:358] "Generic (PLEG): container finished" podID="267041ad-559e-4d00-a0f6-9590dc2d5e2f" containerID="b22d98093e229099287067123648287ff1e49c5906903e140459190eda06a751" exitCode=1 May 21 03:24:49.713478 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:49.712970 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-2tg2w" event={"ID":"267041ad-559e-4d00-a0f6-9590dc2d5e2f","Type":"ContainerDied","Data":"b22d98093e229099287067123648287ff1e49c5906903e140459190eda06a751"} May 21 03:24:49.713478 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:49.713011 2574 scope.go:117] "RemoveContainer" containerID="b2f246a844d1ec84c4a301b1e16a1cd8a600056b4676cfa5d016c770bb671641" May 21 03:24:49.713478 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:49.713205 2574 scope.go:117] "RemoveContainer" containerID="b22d98093e229099287067123648287ff1e49c5906903e140459190eda06a751" May 21 03:24:49.713478 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:24:49.713427 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-2tg2w_opendatahub(267041ad-559e-4d00-a0f6-9590dc2d5e2f)\"" pod="opendatahub/odh-model-controller-858dbf95b8-2tg2w" podUID="267041ad-559e-4d00-a0f6-9590dc2d5e2f" May 21 03:24:50.433773 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:50.433735 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-dmwdm"] May 21 03:24:50.438274 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:50.438249 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-dmwdm" May 21 03:24:50.440249 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:50.440218 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" May 21 03:24:50.440427 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:50.440406 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-gk924\"" May 21 03:24:50.447727 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:50.447697 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-dmwdm"] May 21 03:24:50.531746 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:50.531711 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8e44a64a-5a59-4643-8f85-1773d9a9d2b8-cert\") pod \"kserve-controller-manager-856948b99f-dmwdm\" (UID: \"8e44a64a-5a59-4643-8f85-1773d9a9d2b8\") " pod="opendatahub/kserve-controller-manager-856948b99f-dmwdm" May 21 03:24:50.531949 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:50.531760 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zjrs\" (UniqueName: \"kubernetes.io/projected/8e44a64a-5a59-4643-8f85-1773d9a9d2b8-kube-api-access-6zjrs\") pod \"kserve-controller-manager-856948b99f-dmwdm\" (UID: \"8e44a64a-5a59-4643-8f85-1773d9a9d2b8\") " pod="opendatahub/kserve-controller-manager-856948b99f-dmwdm" May 21 03:24:50.632412 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:50.632377 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8e44a64a-5a59-4643-8f85-1773d9a9d2b8-cert\") pod \"kserve-controller-manager-856948b99f-dmwdm\" (UID: \"8e44a64a-5a59-4643-8f85-1773d9a9d2b8\") " pod="opendatahub/kserve-controller-manager-856948b99f-dmwdm" May 21 03:24:50.632412 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:50.632416 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6zjrs\" (UniqueName: \"kubernetes.io/projected/8e44a64a-5a59-4643-8f85-1773d9a9d2b8-kube-api-access-6zjrs\") pod \"kserve-controller-manager-856948b99f-dmwdm\" (UID: \"8e44a64a-5a59-4643-8f85-1773d9a9d2b8\") " pod="opendatahub/kserve-controller-manager-856948b99f-dmwdm" May 21 03:24:50.632622 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:24:50.632544 2574 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found May 21 03:24:50.632622 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:24:50.632611 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e44a64a-5a59-4643-8f85-1773d9a9d2b8-cert podName:8e44a64a-5a59-4643-8f85-1773d9a9d2b8 nodeName:}" failed. No retries permitted until 2026-05-21 03:24:51.132595217 +0000 UTC m=+319.175364108 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8e44a64a-5a59-4643-8f85-1773d9a9d2b8-cert") pod "kserve-controller-manager-856948b99f-dmwdm" (UID: "8e44a64a-5a59-4643-8f85-1773d9a9d2b8") : secret "kserve-webhook-server-cert" not found May 21 03:24:50.645931 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:50.645882 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zjrs\" (UniqueName: \"kubernetes.io/projected/8e44a64a-5a59-4643-8f85-1773d9a9d2b8-kube-api-access-6zjrs\") pod \"kserve-controller-manager-856948b99f-dmwdm\" (UID: \"8e44a64a-5a59-4643-8f85-1773d9a9d2b8\") " pod="opendatahub/kserve-controller-manager-856948b99f-dmwdm" May 21 03:24:50.717999 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:50.717914 2574 scope.go:117] "RemoveContainer" containerID="b22d98093e229099287067123648287ff1e49c5906903e140459190eda06a751" May 21 03:24:50.718404 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:24:50.718113 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-2tg2w_opendatahub(267041ad-559e-4d00-a0f6-9590dc2d5e2f)\"" pod="opendatahub/odh-model-controller-858dbf95b8-2tg2w" podUID="267041ad-559e-4d00-a0f6-9590dc2d5e2f" May 21 03:24:51.136123 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:51.136095 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8e44a64a-5a59-4643-8f85-1773d9a9d2b8-cert\") pod \"kserve-controller-manager-856948b99f-dmwdm\" (UID: \"8e44a64a-5a59-4643-8f85-1773d9a9d2b8\") " pod="opendatahub/kserve-controller-manager-856948b99f-dmwdm" May 21 03:24:51.138605 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:51.138583 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8e44a64a-5a59-4643-8f85-1773d9a9d2b8-cert\") pod \"kserve-controller-manager-856948b99f-dmwdm\" (UID: \"8e44a64a-5a59-4643-8f85-1773d9a9d2b8\") " pod="opendatahub/kserve-controller-manager-856948b99f-dmwdm" May 21 03:24:51.350710 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:51.350679 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-dmwdm" May 21 03:24:51.496807 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:51.496775 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-dmwdm"] May 21 03:24:51.500909 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:24:51.500881 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e44a64a_5a59_4643_8f85_1773d9a9d2b8.slice/crio-f9c4e58867a101a4eeeadbc145a0dd11c17593dce793f6bfe08601d4fa89c831 WatchSource:0}: Error finding container f9c4e58867a101a4eeeadbc145a0dd11c17593dce793f6bfe08601d4fa89c831: Status 404 returned error can't find the container with id f9c4e58867a101a4eeeadbc145a0dd11c17593dce793f6bfe08601d4fa89c831 May 21 03:24:51.722670 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:51.722589 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-dmwdm" event={"ID":"8e44a64a-5a59-4643-8f85-1773d9a9d2b8","Type":"ContainerStarted","Data":"f9c4e58867a101a4eeeadbc145a0dd11c17593dce793f6bfe08601d4fa89c831"} May 21 03:24:55.612238 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:55.612216 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-2tg2w" May 21 03:24:55.612673 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:55.612657 2574 scope.go:117] "RemoveContainer" containerID="b22d98093e229099287067123648287ff1e49c5906903e140459190eda06a751" May 21 03:24:55.612873 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:24:55.612834 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-2tg2w_opendatahub(267041ad-559e-4d00-a0f6-9590dc2d5e2f)\"" pod="opendatahub/odh-model-controller-858dbf95b8-2tg2w" podUID="267041ad-559e-4d00-a0f6-9590dc2d5e2f" May 21 03:24:55.737687 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:55.737639 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-dmwdm" event={"ID":"8e44a64a-5a59-4643-8f85-1773d9a9d2b8","Type":"ContainerStarted","Data":"0c081158a57f2d42ddb0d9c8e524d75785499de87b7799ad28695f82ef82e441"} May 21 03:24:55.737892 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:55.737760 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-856948b99f-dmwdm" May 21 03:24:55.756376 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:55.756330 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-856948b99f-dmwdm" podStartSLOduration=1.706520481 podStartE2EDuration="5.756318224s" podCreationTimestamp="2026-05-21 03:24:50 +0000 UTC" firstStartedPulling="2026-05-21 03:24:51.50264561 +0000 UTC m=+319.545414501" lastFinishedPulling="2026-05-21 03:24:55.552443351 +0000 UTC m=+323.595212244" observedRunningTime="2026-05-21 03:24:55.75492197 +0000 UTC m=+323.797690883" watchObservedRunningTime="2026-05-21 03:24:55.756318224 +0000 UTC m=+323.799087146" May 21 03:24:56.224943 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:56.224907 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-sj8df"] May 21 03:24:56.227143 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:56.227128 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-sj8df" May 21 03:24:56.229463 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:56.229435 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" May 21 03:24:56.229922 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:56.229903 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" May 21 03:24:56.229977 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:56.229955 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-9lw7n\"" May 21 03:24:56.239818 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:56.239794 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-sj8df"] May 21 03:24:56.279689 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:56.279651 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/f16ba603-6956-49e4-9507-aacc50e8f314-operator-config\") pod \"servicemesh-operator3-55f49c5f94-sj8df\" (UID: \"f16ba603-6956-49e4-9507-aacc50e8f314\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-sj8df" May 21 03:24:56.279836 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:56.279775 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kp89p\" (UniqueName: \"kubernetes.io/projected/f16ba603-6956-49e4-9507-aacc50e8f314-kube-api-access-kp89p\") pod \"servicemesh-operator3-55f49c5f94-sj8df\" (UID: \"f16ba603-6956-49e4-9507-aacc50e8f314\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-sj8df" May 21 03:24:56.380889 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:56.380825 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kp89p\" (UniqueName: \"kubernetes.io/projected/f16ba603-6956-49e4-9507-aacc50e8f314-kube-api-access-kp89p\") pod \"servicemesh-operator3-55f49c5f94-sj8df\" (UID: \"f16ba603-6956-49e4-9507-aacc50e8f314\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-sj8df" May 21 03:24:56.381050 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:56.380939 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/f16ba603-6956-49e4-9507-aacc50e8f314-operator-config\") pod \"servicemesh-operator3-55f49c5f94-sj8df\" (UID: \"f16ba603-6956-49e4-9507-aacc50e8f314\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-sj8df" May 21 03:24:56.383518 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:56.383499 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/f16ba603-6956-49e4-9507-aacc50e8f314-operator-config\") pod \"servicemesh-operator3-55f49c5f94-sj8df\" (UID: \"f16ba603-6956-49e4-9507-aacc50e8f314\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-sj8df" May 21 03:24:56.390977 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:56.390952 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kp89p\" (UniqueName: \"kubernetes.io/projected/f16ba603-6956-49e4-9507-aacc50e8f314-kube-api-access-kp89p\") pod \"servicemesh-operator3-55f49c5f94-sj8df\" (UID: \"f16ba603-6956-49e4-9507-aacc50e8f314\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-sj8df" May 21 03:24:56.536707 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:56.536634 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-sj8df" May 21 03:24:56.669993 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:56.669681 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-sj8df"] May 21 03:24:56.672805 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:24:56.672768 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf16ba603_6956_49e4_9507_aacc50e8f314.slice/crio-7f8cac94cac1ffb87511cd02220063d020b97c770490e2f6f2156646737271b6 WatchSource:0}: Error finding container 7f8cac94cac1ffb87511cd02220063d020b97c770490e2f6f2156646737271b6: Status 404 returned error can't find the container with id 7f8cac94cac1ffb87511cd02220063d020b97c770490e2f6f2156646737271b6 May 21 03:24:56.741929 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:24:56.741899 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-sj8df" event={"ID":"f16ba603-6956-49e4-9507-aacc50e8f314","Type":"ContainerStarted","Data":"7f8cac94cac1ffb87511cd02220063d020b97c770490e2f6f2156646737271b6"} May 21 03:25:00.757861 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:25:00.757811 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-sj8df" event={"ID":"f16ba603-6956-49e4-9507-aacc50e8f314","Type":"ContainerStarted","Data":"fd9e26bf3f02fc8aededa4a9eb0f69227e645cf31d99af8294df07343b5b9ff3"} May 21 03:25:00.758376 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:25:00.757907 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-sj8df" May 21 03:25:00.777073 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:25:00.777031 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-sj8df" podStartSLOduration=1.635892343 podStartE2EDuration="4.777017868s" podCreationTimestamp="2026-05-21 03:24:56 +0000 UTC" firstStartedPulling="2026-05-21 03:24:56.675223829 +0000 UTC m=+324.717992723" lastFinishedPulling="2026-05-21 03:24:59.816349354 +0000 UTC m=+327.859118248" observedRunningTime="2026-05-21 03:25:00.774792807 +0000 UTC m=+328.817561721" watchObservedRunningTime="2026-05-21 03:25:00.777017868 +0000 UTC m=+328.819786782" May 21 03:25:05.611769 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:25:05.611730 2574 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/odh-model-controller-858dbf95b8-2tg2w" May 21 03:25:05.612157 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:25:05.612143 2574 scope.go:117] "RemoveContainer" containerID="b22d98093e229099287067123648287ff1e49c5906903e140459190eda06a751" May 21 03:25:06.777746 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:25:06.777712 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-2tg2w" event={"ID":"267041ad-559e-4d00-a0f6-9590dc2d5e2f","Type":"ContainerStarted","Data":"54b86900a27f2c1be4f2a414821b38bfa009f8d0c838d25c2164b5c40e5f93c3"} May 21 03:25:06.778152 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:25:06.777918 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-2tg2w" May 21 03:25:06.794628 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:25:06.794582 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/odh-model-controller-858dbf95b8-2tg2w" podStartSLOduration=2.689685766 podStartE2EDuration="22.794568794s" podCreationTimestamp="2026-05-21 03:24:44 +0000 UTC" firstStartedPulling="2026-05-21 03:24:45.754128806 +0000 UTC m=+313.796897701" lastFinishedPulling="2026-05-21 03:25:05.859011834 +0000 UTC m=+333.901780729" observedRunningTime="2026-05-21 03:25:06.793938142 +0000 UTC m=+334.836707057" watchObservedRunningTime="2026-05-21 03:25:06.794568794 +0000 UTC m=+334.837337708" May 21 03:25:11.603664 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:25:11.603628 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-d2cqg"] May 21 03:25:11.606289 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:25:11.606273 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d2cqg" May 21 03:25:11.608820 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:25:11.608795 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" May 21 03:25:11.608820 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:25:11.608810 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" May 21 03:25:11.609029 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:25:11.608820 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" May 21 03:25:11.609029 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:25:11.608892 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" May 21 03:25:11.609029 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:25:11.608925 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-tllxs\"" May 21 03:25:11.616170 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:25:11.616145 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-d2cqg"] May 21 03:25:11.719934 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:25:11.719896 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vx6s\" (UniqueName: \"kubernetes.io/projected/0ae56f66-117f-4709-9c96-9d8ab3a3ad7e-kube-api-access-5vx6s\") pod \"istiod-openshift-gateway-798958bb55-d2cqg\" (UID: \"0ae56f66-117f-4709-9c96-9d8ab3a3ad7e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d2cqg" May 21 03:25:11.720121 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:25:11.719948 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0ae56f66-117f-4709-9c96-9d8ab3a3ad7e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-d2cqg\" (UID: \"0ae56f66-117f-4709-9c96-9d8ab3a3ad7e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d2cqg" May 21 03:25:11.720121 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:25:11.719980 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ae56f66-117f-4709-9c96-9d8ab3a3ad7e-local-certs\") pod \"istiod-openshift-gateway-798958bb55-d2cqg\" (UID: \"0ae56f66-117f-4709-9c96-9d8ab3a3ad7e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d2cqg" May 21 03:25:11.720121 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:25:11.720005 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0ae56f66-117f-4709-9c96-9d8ab3a3ad7e-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-d2cqg\" (UID: \"0ae56f66-117f-4709-9c96-9d8ab3a3ad7e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d2cqg" May 21 03:25:11.720121 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:25:11.720021 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0ae56f66-117f-4709-9c96-9d8ab3a3ad7e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-d2cqg\" (UID: \"0ae56f66-117f-4709-9c96-9d8ab3a3ad7e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d2cqg" May 21 03:25:11.720121 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:25:11.720048 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ae56f66-117f-4709-9c96-9d8ab3a3ad7e-istio-token\") pod \"istiod-openshift-gateway-798958bb55-d2cqg\" (UID: \"0ae56f66-117f-4709-9c96-9d8ab3a3ad7e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d2cqg" May 21 03:25:11.720121 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:25:11.720107 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0ae56f66-117f-4709-9c96-9d8ab3a3ad7e-cacerts\") pod \"istiod-openshift-gateway-798958bb55-d2cqg\" (UID: \"0ae56f66-117f-4709-9c96-9d8ab3a3ad7e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d2cqg" May 21 03:25:11.763816 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:25:11.763790 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-sj8df" May 21 03:25:11.820877 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:25:11.820830 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0ae56f66-117f-4709-9c96-9d8ab3a3ad7e-cacerts\") pod \"istiod-openshift-gateway-798958bb55-d2cqg\" (UID: \"0ae56f66-117f-4709-9c96-9d8ab3a3ad7e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d2cqg" May 21 03:25:11.821062 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:25:11.820913 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5vx6s\" (UniqueName: \"kubernetes.io/projected/0ae56f66-117f-4709-9c96-9d8ab3a3ad7e-kube-api-access-5vx6s\") pod \"istiod-openshift-gateway-798958bb55-d2cqg\" (UID: \"0ae56f66-117f-4709-9c96-9d8ab3a3ad7e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d2cqg" May 21 03:25:11.821062 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:25:11.820951 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0ae56f66-117f-4709-9c96-9d8ab3a3ad7e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-d2cqg\" (UID: \"0ae56f66-117f-4709-9c96-9d8ab3a3ad7e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d2cqg" May 21 03:25:11.821062 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:25:11.820977 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ae56f66-117f-4709-9c96-9d8ab3a3ad7e-local-certs\") pod \"istiod-openshift-gateway-798958bb55-d2cqg\" (UID: \"0ae56f66-117f-4709-9c96-9d8ab3a3ad7e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d2cqg" May 21 03:25:11.821062 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:25:11.821004 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0ae56f66-117f-4709-9c96-9d8ab3a3ad7e-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-d2cqg\" (UID: \"0ae56f66-117f-4709-9c96-9d8ab3a3ad7e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d2cqg" May 21 03:25:11.821062 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:25:11.821026 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0ae56f66-117f-4709-9c96-9d8ab3a3ad7e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-d2cqg\" (UID: \"0ae56f66-117f-4709-9c96-9d8ab3a3ad7e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d2cqg" May 21 03:25:11.821062 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:25:11.821054 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ae56f66-117f-4709-9c96-9d8ab3a3ad7e-istio-token\") pod \"istiod-openshift-gateway-798958bb55-d2cqg\" (UID: \"0ae56f66-117f-4709-9c96-9d8ab3a3ad7e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d2cqg" May 21 03:25:11.821908 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:25:11.821661 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0ae56f66-117f-4709-9c96-9d8ab3a3ad7e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-d2cqg\" (UID: \"0ae56f66-117f-4709-9c96-9d8ab3a3ad7e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d2cqg" May 21 03:25:11.823584 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:25:11.823548 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0ae56f66-117f-4709-9c96-9d8ab3a3ad7e-cacerts\") pod \"istiod-openshift-gateway-798958bb55-d2cqg\" (UID: \"0ae56f66-117f-4709-9c96-9d8ab3a3ad7e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d2cqg" May 21 03:25:11.823584 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:25:11.823568 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ae56f66-117f-4709-9c96-9d8ab3a3ad7e-local-certs\") pod \"istiod-openshift-gateway-798958bb55-d2cqg\" (UID: \"0ae56f66-117f-4709-9c96-9d8ab3a3ad7e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d2cqg" May 21 03:25:11.824559 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:25:11.824536 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0ae56f66-117f-4709-9c96-9d8ab3a3ad7e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-d2cqg\" (UID: \"0ae56f66-117f-4709-9c96-9d8ab3a3ad7e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d2cqg" May 21 03:25:11.824637 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:25:11.824589 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0ae56f66-117f-4709-9c96-9d8ab3a3ad7e-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-d2cqg\" (UID: \"0ae56f66-117f-4709-9c96-9d8ab3a3ad7e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d2cqg" May 21 03:25:11.829255 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:25:11.829230 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vx6s\" (UniqueName: \"kubernetes.io/projected/0ae56f66-117f-4709-9c96-9d8ab3a3ad7e-kube-api-access-5vx6s\") pod \"istiod-openshift-gateway-798958bb55-d2cqg\" (UID: \"0ae56f66-117f-4709-9c96-9d8ab3a3ad7e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d2cqg" May 21 03:25:11.830162 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:25:11.830140 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ae56f66-117f-4709-9c96-9d8ab3a3ad7e-istio-token\") pod \"istiod-openshift-gateway-798958bb55-d2cqg\" (UID: \"0ae56f66-117f-4709-9c96-9d8ab3a3ad7e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d2cqg" May 21 03:25:11.916173 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:25:11.916141 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d2cqg" May 21 03:25:12.083513 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:25:12.083466 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-d2cqg"] May 21 03:25:12.089464 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:25:12.089434 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ae56f66_117f_4709_9c96_9d8ab3a3ad7e.slice/crio-35c2d22f9a15831fd7d7cf1753eba72e69806eeae3e4e442853fad8c65df66fb WatchSource:0}: Error finding container 35c2d22f9a15831fd7d7cf1753eba72e69806eeae3e4e442853fad8c65df66fb: Status 404 returned error can't find the container with id 35c2d22f9a15831fd7d7cf1753eba72e69806eeae3e4e442853fad8c65df66fb May 21 03:25:12.801398 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:25:12.801363 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d2cqg" event={"ID":"0ae56f66-117f-4709-9c96-9d8ab3a3ad7e","Type":"ContainerStarted","Data":"35c2d22f9a15831fd7d7cf1753eba72e69806eeae3e4e442853fad8c65df66fb"} May 21 03:25:15.100603 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:25:15.098317 2574 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} May 21 03:25:15.100603 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:25:15.098406 2574 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} May 21 03:25:15.813353 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:25:15.813315 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d2cqg" event={"ID":"0ae56f66-117f-4709-9c96-9d8ab3a3ad7e","Type":"ContainerStarted","Data":"af37971f13dea5958319eaa126c50fdd9632a9c86d9d224825592e76f4979480"} May 21 03:25:15.813529 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:25:15.813424 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d2cqg" May 21 03:25:15.837770 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:25:15.837718 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d2cqg" podStartSLOduration=1.831224974 podStartE2EDuration="4.837697648s" podCreationTimestamp="2026-05-21 03:25:11 +0000 UTC" firstStartedPulling="2026-05-21 03:25:12.091573833 +0000 UTC m=+340.134342728" lastFinishedPulling="2026-05-21 03:25:15.098046493 +0000 UTC m=+343.140815402" observedRunningTime="2026-05-21 03:25:15.835691466 +0000 UTC m=+343.878460381" watchObservedRunningTime="2026-05-21 03:25:15.837697648 +0000 UTC m=+343.880466565" May 21 03:25:16.819481 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:25:16.819453 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d2cqg" May 21 03:25:17.783626 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:25:17.783594 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-858dbf95b8-2tg2w" May 21 03:25:26.747614 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:25:26.747580 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-856948b99f-dmwdm" May 21 03:26:11.496786 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:11.496747 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-db8mn"] May 21 03:26:11.500105 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:11.500079 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-db8mn" May 21 03:26:11.502963 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:11.502942 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-blwbt\"" May 21 03:26:11.503100 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:11.502949 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 21 03:26:11.503661 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:11.503642 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 21 03:26:11.503756 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:11.503645 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" May 21 03:26:11.510220 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:11.510197 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-db8mn"] May 21 03:26:11.638790 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:11.638749 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5dtp\" (UniqueName: \"kubernetes.io/projected/836070e4-690c-4d4e-a61c-7fe9813d832b-kube-api-access-d5dtp\") pod \"dns-operator-controller-manager-648d5c98bc-db8mn\" (UID: \"836070e4-690c-4d4e-a61c-7fe9813d832b\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-db8mn" May 21 03:26:11.739893 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:11.739822 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d5dtp\" (UniqueName: \"kubernetes.io/projected/836070e4-690c-4d4e-a61c-7fe9813d832b-kube-api-access-d5dtp\") pod \"dns-operator-controller-manager-648d5c98bc-db8mn\" (UID: \"836070e4-690c-4d4e-a61c-7fe9813d832b\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-db8mn" May 21 03:26:11.748343 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:11.748265 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5dtp\" (UniqueName: \"kubernetes.io/projected/836070e4-690c-4d4e-a61c-7fe9813d832b-kube-api-access-d5dtp\") pod \"dns-operator-controller-manager-648d5c98bc-db8mn\" (UID: \"836070e4-690c-4d4e-a61c-7fe9813d832b\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-db8mn" May 21 03:26:11.811401 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:11.811358 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-db8mn" May 21 03:26:11.952302 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:11.952276 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-db8mn"] May 21 03:26:11.954901 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:26:11.954871 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod836070e4_690c_4d4e_a61c_7fe9813d832b.slice/crio-1ec4341ab6e83cdef4e7eead05670bf29667a9d4c3c589a66bc9941777f147ac WatchSource:0}: Error finding container 1ec4341ab6e83cdef4e7eead05670bf29667a9d4c3c589a66bc9941777f147ac: Status 404 returned error can't find the container with id 1ec4341ab6e83cdef4e7eead05670bf29667a9d4c3c589a66bc9941777f147ac May 21 03:26:12.004264 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:12.004175 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-db8mn" event={"ID":"836070e4-690c-4d4e-a61c-7fe9813d832b","Type":"ContainerStarted","Data":"1ec4341ab6e83cdef4e7eead05670bf29667a9d4c3c589a66bc9941777f147ac"} May 21 03:26:14.224698 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:14.224655 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jk6px"] May 21 03:26:14.228000 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:14.227981 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jk6px" May 21 03:26:14.230278 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:14.230245 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-lpt6f\"" May 21 03:26:14.238703 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:14.238661 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jk6px"] May 21 03:26:14.363150 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:14.363044 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hzlx\" (UniqueName: \"kubernetes.io/projected/c0289abd-9e6b-4ca3-be7d-805be44c3027-kube-api-access-9hzlx\") pod \"limitador-operator-controller-manager-85c4996f8c-jk6px\" (UID: \"c0289abd-9e6b-4ca3-be7d-805be44c3027\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jk6px" May 21 03:26:14.463542 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:14.463493 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9hzlx\" (UniqueName: \"kubernetes.io/projected/c0289abd-9e6b-4ca3-be7d-805be44c3027-kube-api-access-9hzlx\") pod \"limitador-operator-controller-manager-85c4996f8c-jk6px\" (UID: \"c0289abd-9e6b-4ca3-be7d-805be44c3027\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jk6px" May 21 03:26:14.475839 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:14.475809 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hzlx\" (UniqueName: \"kubernetes.io/projected/c0289abd-9e6b-4ca3-be7d-805be44c3027-kube-api-access-9hzlx\") pod \"limitador-operator-controller-manager-85c4996f8c-jk6px\" (UID: \"c0289abd-9e6b-4ca3-be7d-805be44c3027\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jk6px" May 21 03:26:14.539128 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:14.539086 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jk6px" May 21 03:26:14.673913 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:14.673877 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jk6px"] May 21 03:26:14.677355 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:26:14.677328 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0289abd_9e6b_4ca3_be7d_805be44c3027.slice/crio-4fc065f705b888d65397c0707d94f5b69b41641132091b60b5b6a3848754616c WatchSource:0}: Error finding container 4fc065f705b888d65397c0707d94f5b69b41641132091b60b5b6a3848754616c: Status 404 returned error can't find the container with id 4fc065f705b888d65397c0707d94f5b69b41641132091b60b5b6a3848754616c May 21 03:26:15.019363 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:15.019259 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-db8mn" event={"ID":"836070e4-690c-4d4e-a61c-7fe9813d832b","Type":"ContainerStarted","Data":"27b90eaf03980eb20da92f8254d9256b58cad9ca68bc1671aa6b596127ddae2a"} May 21 03:26:15.019520 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:15.019371 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-db8mn" May 21 03:26:15.020547 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:15.020524 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jk6px" event={"ID":"c0289abd-9e6b-4ca3-be7d-805be44c3027","Type":"ContainerStarted","Data":"4fc065f705b888d65397c0707d94f5b69b41641132091b60b5b6a3848754616c"} May 21 03:26:15.041731 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:15.041674 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-db8mn" podStartSLOduration=1.9299975759999999 podStartE2EDuration="4.041657461s" podCreationTimestamp="2026-05-21 03:26:11 +0000 UTC" firstStartedPulling="2026-05-21 03:26:11.95676585 +0000 UTC m=+399.999534742" lastFinishedPulling="2026-05-21 03:26:14.068425731 +0000 UTC m=+402.111194627" observedRunningTime="2026-05-21 03:26:15.039702437 +0000 UTC m=+403.082471353" watchObservedRunningTime="2026-05-21 03:26:15.041657461 +0000 UTC m=+403.084426376" May 21 03:26:17.028579 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:17.028548 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jk6px" event={"ID":"c0289abd-9e6b-4ca3-be7d-805be44c3027","Type":"ContainerStarted","Data":"9cc6374f940365606b2ce1b82797aaa5cbb90165d8a57382c2f288145f21a5d9"} May 21 03:26:17.029000 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:17.028664 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jk6px" May 21 03:26:17.044828 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:17.044764 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jk6px" podStartSLOduration=0.80233591 podStartE2EDuration="3.044746893s" podCreationTimestamp="2026-05-21 03:26:14 +0000 UTC" firstStartedPulling="2026-05-21 03:26:14.679837254 +0000 UTC m=+402.722606148" lastFinishedPulling="2026-05-21 03:26:16.922248225 +0000 UTC m=+404.965017131" observedRunningTime="2026-05-21 03:26:17.043033807 +0000 UTC m=+405.085802721" watchObservedRunningTime="2026-05-21 03:26:17.044746893 +0000 UTC m=+405.087515807" May 21 03:26:17.638657 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:17.638624 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-4h8xn"] May 21 03:26:17.641999 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:17.641983 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-4h8xn" May 21 03:26:17.644468 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:17.644435 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-5p8db\"" May 21 03:26:17.651625 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:17.651598 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-4h8xn"] May 21 03:26:17.794554 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:17.794508 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49h6p\" (UniqueName: \"kubernetes.io/projected/d065f850-b862-4c0c-acb4-e0f13c80a5c5-kube-api-access-49h6p\") pod \"authorino-operator-657f44b778-4h8xn\" (UID: \"d065f850-b862-4c0c-acb4-e0f13c80a5c5\") " pod="kuadrant-system/authorino-operator-657f44b778-4h8xn" May 21 03:26:17.896166 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:17.896073 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-49h6p\" (UniqueName: \"kubernetes.io/projected/d065f850-b862-4c0c-acb4-e0f13c80a5c5-kube-api-access-49h6p\") pod \"authorino-operator-657f44b778-4h8xn\" (UID: \"d065f850-b862-4c0c-acb4-e0f13c80a5c5\") " pod="kuadrant-system/authorino-operator-657f44b778-4h8xn" May 21 03:26:17.915524 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:17.915490 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49h6p\" (UniqueName: \"kubernetes.io/projected/d065f850-b862-4c0c-acb4-e0f13c80a5c5-kube-api-access-49h6p\") pod \"authorino-operator-657f44b778-4h8xn\" (UID: \"d065f850-b862-4c0c-acb4-e0f13c80a5c5\") " pod="kuadrant-system/authorino-operator-657f44b778-4h8xn" May 21 03:26:17.953546 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:17.953506 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-4h8xn" May 21 03:26:18.088277 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:18.088247 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-4h8xn"] May 21 03:26:18.091129 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:26:18.091087 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd065f850_b862_4c0c_acb4_e0f13c80a5c5.slice/crio-97e2be8436f20ea5cd9ac1653f0b5dc6b4b917afc19fdacb37b71fb8c30f1e09 WatchSource:0}: Error finding container 97e2be8436f20ea5cd9ac1653f0b5dc6b4b917afc19fdacb37b71fb8c30f1e09: Status 404 returned error can't find the container with id 97e2be8436f20ea5cd9ac1653f0b5dc6b4b917afc19fdacb37b71fb8c30f1e09 May 21 03:26:19.037610 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:19.037567 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-4h8xn" event={"ID":"d065f850-b862-4c0c-acb4-e0f13c80a5c5","Type":"ContainerStarted","Data":"97e2be8436f20ea5cd9ac1653f0b5dc6b4b917afc19fdacb37b71fb8c30f1e09"} May 21 03:26:20.042916 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:20.042873 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-4h8xn" event={"ID":"d065f850-b862-4c0c-acb4-e0f13c80a5c5","Type":"ContainerStarted","Data":"10e6d141e4d2ef6e57a505a7ec8aca350e1823f39caf89ce5471048060b3a150"} May 21 03:26:20.043280 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:20.042965 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-657f44b778-4h8xn" May 21 03:26:20.061010 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:20.060953 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-657f44b778-4h8xn" podStartSLOduration=1.19149985 podStartE2EDuration="3.060939011s" podCreationTimestamp="2026-05-21 03:26:17 +0000 UTC" firstStartedPulling="2026-05-21 03:26:18.09369858 +0000 UTC m=+406.136467475" lastFinishedPulling="2026-05-21 03:26:19.96313774 +0000 UTC m=+408.005906636" observedRunningTime="2026-05-21 03:26:20.060018136 +0000 UTC m=+408.102787050" watchObservedRunningTime="2026-05-21 03:26:20.060939011 +0000 UTC m=+408.103707926" May 21 03:26:26.026989 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:26.026961 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-db8mn" May 21 03:26:28.034648 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:28.034613 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jk6px" May 21 03:26:29.376588 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:29.376553 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jk6px"] May 21 03:26:29.376988 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:29.376763 2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jk6px" podUID="c0289abd-9e6b-4ca3-be7d-805be44c3027" containerName="manager" containerID="cri-o://9cc6374f940365606b2ce1b82797aaa5cbb90165d8a57382c2f288145f21a5d9" gracePeriod=2 May 21 03:26:29.385444 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:29.385405 2574 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jk6px"] May 21 03:26:29.410072 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:29.410045 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-s6kdh"] May 21 03:26:29.410502 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:29.410453 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0289abd-9e6b-4ca3-be7d-805be44c3027" containerName="manager" May 21 03:26:29.410502 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:29.410470 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0289abd-9e6b-4ca3-be7d-805be44c3027" containerName="manager" May 21 03:26:29.410502 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:29.410536 2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="c0289abd-9e6b-4ca3-be7d-805be44c3027" containerName="manager" May 21 03:26:29.413425 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:29.413408 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-s6kdh" May 21 03:26:29.424311 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:29.424288 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-s6kdh"] May 21 03:26:29.437450 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:29.437414 2574 status_manager.go:895] "Failed to get status for pod" podUID="c0289abd-9e6b-4ca3-be7d-805be44c3027" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jk6px" err="pods \"limitador-operator-controller-manager-85c4996f8c-jk6px\" is forbidden: User \"system:node:ip-10-0-128-161.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-161.ec2.internal' and this object" May 21 03:26:29.487039 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:29.487004 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6htg9\" (UniqueName: \"kubernetes.io/projected/01b970d3-0e48-49a3-ba6e-21cb129fe204-kube-api-access-6htg9\") pod \"limitador-operator-controller-manager-85c4996f8c-s6kdh\" (UID: \"01b970d3-0e48-49a3-ba6e-21cb129fe204\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-s6kdh" May 21 03:26:29.587800 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:29.587758 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6htg9\" (UniqueName: \"kubernetes.io/projected/01b970d3-0e48-49a3-ba6e-21cb129fe204-kube-api-access-6htg9\") pod \"limitador-operator-controller-manager-85c4996f8c-s6kdh\" (UID: \"01b970d3-0e48-49a3-ba6e-21cb129fe204\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-s6kdh" May 21 03:26:29.595829 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:29.595808 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6htg9\" (UniqueName: \"kubernetes.io/projected/01b970d3-0e48-49a3-ba6e-21cb129fe204-kube-api-access-6htg9\") pod \"limitador-operator-controller-manager-85c4996f8c-s6kdh\" (UID: \"01b970d3-0e48-49a3-ba6e-21cb129fe204\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-s6kdh" May 21 03:26:29.612680 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:29.612662 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jk6px" May 21 03:26:29.614564 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:29.614540 2574 status_manager.go:895] "Failed to get status for pod" podUID="c0289abd-9e6b-4ca3-be7d-805be44c3027" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jk6px" err="pods \"limitador-operator-controller-manager-85c4996f8c-jk6px\" is forbidden: User \"system:node:ip-10-0-128-161.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-161.ec2.internal' and this object" May 21 03:26:29.746816 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:29.746754 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-s6kdh" May 21 03:26:29.789903 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:29.789869 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9hzlx\" (UniqueName: \"kubernetes.io/projected/c0289abd-9e6b-4ca3-be7d-805be44c3027-kube-api-access-9hzlx\") pod \"c0289abd-9e6b-4ca3-be7d-805be44c3027\" (UID: \"c0289abd-9e6b-4ca3-be7d-805be44c3027\") " May 21 03:26:29.792362 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:29.792331 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0289abd-9e6b-4ca3-be7d-805be44c3027-kube-api-access-9hzlx" (OuterVolumeSpecName: "kube-api-access-9hzlx") pod "c0289abd-9e6b-4ca3-be7d-805be44c3027" (UID: "c0289abd-9e6b-4ca3-be7d-805be44c3027"). InnerVolumeSpecName "kube-api-access-9hzlx". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 03:26:29.877955 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:29.877925 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-s6kdh"] May 21 03:26:29.880489 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:26:29.880448 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01b970d3_0e48_49a3_ba6e_21cb129fe204.slice/crio-546f5d7900496f2de19b0828bd9be70f4f617454faed927eb7a92b2fd3538af2 WatchSource:0}: Error finding container 546f5d7900496f2de19b0828bd9be70f4f617454faed927eb7a92b2fd3538af2: Status 404 returned error can't find the container with id 546f5d7900496f2de19b0828bd9be70f4f617454faed927eb7a92b2fd3538af2 May 21 03:26:29.891335 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:29.891319 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9hzlx\" (UniqueName: \"kubernetes.io/projected/c0289abd-9e6b-4ca3-be7d-805be44c3027-kube-api-access-9hzlx\") on node \"ip-10-0-128-161.ec2.internal\" DevicePath \"\"" May 21 03:26:30.077420 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:30.077318 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-s6kdh" event={"ID":"01b970d3-0e48-49a3-ba6e-21cb129fe204","Type":"ContainerStarted","Data":"c25c9377644e9e3ab426cb54eca779ef73d8404cfe6f1b3ed7fafef90673371e"} May 21 03:26:30.077420 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:30.077367 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-s6kdh" event={"ID":"01b970d3-0e48-49a3-ba6e-21cb129fe204","Type":"ContainerStarted","Data":"546f5d7900496f2de19b0828bd9be70f4f617454faed927eb7a92b2fd3538af2"} May 21 03:26:30.077420 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:30.077389 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-s6kdh" May 21 03:26:30.078479 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:30.078456 2574 generic.go:358] "Generic (PLEG): container finished" podID="c0289abd-9e6b-4ca3-be7d-805be44c3027" containerID="9cc6374f940365606b2ce1b82797aaa5cbb90165d8a57382c2f288145f21a5d9" exitCode=0 May 21 03:26:30.078589 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:30.078501 2574 scope.go:117] "RemoveContainer" containerID="9cc6374f940365606b2ce1b82797aaa5cbb90165d8a57382c2f288145f21a5d9" May 21 03:26:30.078589 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:30.078503 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jk6px" May 21 03:26:30.079390 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:30.079361 2574 status_manager.go:895] "Failed to get status for pod" podUID="c0289abd-9e6b-4ca3-be7d-805be44c3027" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jk6px" err="pods \"limitador-operator-controller-manager-85c4996f8c-jk6px\" is forbidden: User \"system:node:ip-10-0-128-161.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-161.ec2.internal' and this object" May 21 03:26:30.086999 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:30.086980 2574 scope.go:117] "RemoveContainer" containerID="9cc6374f940365606b2ce1b82797aaa5cbb90165d8a57382c2f288145f21a5d9" May 21 03:26:30.087257 ip-10-0-128-161 kubenswrapper[2574]: E0521 03:26:30.087237 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9cc6374f940365606b2ce1b82797aaa5cbb90165d8a57382c2f288145f21a5d9\": container with ID starting with 9cc6374f940365606b2ce1b82797aaa5cbb90165d8a57382c2f288145f21a5d9 not found: ID does not exist" containerID="9cc6374f940365606b2ce1b82797aaa5cbb90165d8a57382c2f288145f21a5d9" May 21 03:26:30.087302 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:30.087265 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9cc6374f940365606b2ce1b82797aaa5cbb90165d8a57382c2f288145f21a5d9"} err="failed to get container status \"9cc6374f940365606b2ce1b82797aaa5cbb90165d8a57382c2f288145f21a5d9\": rpc error: code = NotFound desc = could not find container \"9cc6374f940365606b2ce1b82797aaa5cbb90165d8a57382c2f288145f21a5d9\": container with ID starting with 9cc6374f940365606b2ce1b82797aaa5cbb90165d8a57382c2f288145f21a5d9 not found: ID does not exist" May 21 03:26:30.099718 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:30.099670 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-s6kdh" podStartSLOduration=1.099655966 podStartE2EDuration="1.099655966s" podCreationTimestamp="2026-05-21 03:26:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 03:26:30.098105434 +0000 UTC m=+418.140874445" watchObservedRunningTime="2026-05-21 03:26:30.099655966 +0000 UTC m=+418.142424880" May 21 03:26:30.099801 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:30.099772 2574 status_manager.go:895] "Failed to get status for pod" podUID="c0289abd-9e6b-4ca3-be7d-805be44c3027" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jk6px" err="pods \"limitador-operator-controller-manager-85c4996f8c-jk6px\" is forbidden: User \"system:node:ip-10-0-128-161.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-161.ec2.internal' and this object" May 21 03:26:30.589489 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:30.589451 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0289abd-9e6b-4ca3-be7d-805be44c3027" path="/var/lib/kubelet/pods/c0289abd-9e6b-4ca3-be7d-805be44c3027/volumes" May 21 03:26:31.048701 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:31.048668 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-657f44b778-4h8xn" May 21 03:26:41.086511 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:41.086433 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-s6kdh" May 21 03:26:43.173066 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:43.173033 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-5b9c8f7c7f-x6lt5"] May 21 03:26:43.177411 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:43.177382 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b9c8f7c7f-x6lt5" May 21 03:26:43.179940 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:43.179916 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" May 21 03:26:43.180044 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:43.180021 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" May 21 03:26:43.180732 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:43.180715 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" May 21 03:26:43.180806 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:43.180773 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-2gmfm\"" May 21 03:26:43.180806 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:43.180789 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" May 21 03:26:43.180939 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:43.180922 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" May 21 03:26:43.180995 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:43.180952 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" May 21 03:26:43.181090 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:43.181058 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" May 21 03:26:43.184443 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:43.184421 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" May 21 03:26:43.187686 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:43.187665 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b9c8f7c7f-x6lt5"] May 21 03:26:43.199652 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:43.199629 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf0dab46-e06e-4455-bc3d-2670d9a18504-console-serving-cert\") pod \"console-5b9c8f7c7f-x6lt5\" (UID: \"cf0dab46-e06e-4455-bc3d-2670d9a18504\") " pod="openshift-console/console-5b9c8f7c7f-x6lt5" May 21 03:26:43.199746 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:43.199663 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf0dab46-e06e-4455-bc3d-2670d9a18504-console-config\") pod \"console-5b9c8f7c7f-x6lt5\" (UID: \"cf0dab46-e06e-4455-bc3d-2670d9a18504\") " pod="openshift-console/console-5b9c8f7c7f-x6lt5" May 21 03:26:43.199746 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:43.199708 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf0dab46-e06e-4455-bc3d-2670d9a18504-console-oauth-config\") pod \"console-5b9c8f7c7f-x6lt5\" (UID: \"cf0dab46-e06e-4455-bc3d-2670d9a18504\") " pod="openshift-console/console-5b9c8f7c7f-x6lt5" May 21 03:26:43.199916 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:43.199830 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf0dab46-e06e-4455-bc3d-2670d9a18504-service-ca\") pod \"console-5b9c8f7c7f-x6lt5\" (UID: \"cf0dab46-e06e-4455-bc3d-2670d9a18504\") " pod="openshift-console/console-5b9c8f7c7f-x6lt5" May 21 03:26:43.199916 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:43.199906 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf0dab46-e06e-4455-bc3d-2670d9a18504-oauth-serving-cert\") pod \"console-5b9c8f7c7f-x6lt5\" (UID: \"cf0dab46-e06e-4455-bc3d-2670d9a18504\") " pod="openshift-console/console-5b9c8f7c7f-x6lt5" May 21 03:26:43.200019 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:43.200008 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf0dab46-e06e-4455-bc3d-2670d9a18504-trusted-ca-bundle\") pod \"console-5b9c8f7c7f-x6lt5\" (UID: \"cf0dab46-e06e-4455-bc3d-2670d9a18504\") " pod="openshift-console/console-5b9c8f7c7f-x6lt5" May 21 03:26:43.200107 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:43.200035 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rv9rm\" (UniqueName: \"kubernetes.io/projected/cf0dab46-e06e-4455-bc3d-2670d9a18504-kube-api-access-rv9rm\") pod \"console-5b9c8f7c7f-x6lt5\" (UID: \"cf0dab46-e06e-4455-bc3d-2670d9a18504\") " pod="openshift-console/console-5b9c8f7c7f-x6lt5" May 21 03:26:43.300497 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:43.300466 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf0dab46-e06e-4455-bc3d-2670d9a18504-oauth-serving-cert\") pod \"console-5b9c8f7c7f-x6lt5\" (UID: \"cf0dab46-e06e-4455-bc3d-2670d9a18504\") " pod="openshift-console/console-5b9c8f7c7f-x6lt5" May 21 03:26:43.300649 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:43.300531 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf0dab46-e06e-4455-bc3d-2670d9a18504-trusted-ca-bundle\") pod \"console-5b9c8f7c7f-x6lt5\" (UID: \"cf0dab46-e06e-4455-bc3d-2670d9a18504\") " pod="openshift-console/console-5b9c8f7c7f-x6lt5" May 21 03:26:43.300649 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:43.300560 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rv9rm\" (UniqueName: \"kubernetes.io/projected/cf0dab46-e06e-4455-bc3d-2670d9a18504-kube-api-access-rv9rm\") pod \"console-5b9c8f7c7f-x6lt5\" (UID: \"cf0dab46-e06e-4455-bc3d-2670d9a18504\") " pod="openshift-console/console-5b9c8f7c7f-x6lt5" May 21 03:26:43.300649 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:43.300598 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf0dab46-e06e-4455-bc3d-2670d9a18504-console-serving-cert\") pod \"console-5b9c8f7c7f-x6lt5\" (UID: \"cf0dab46-e06e-4455-bc3d-2670d9a18504\") " pod="openshift-console/console-5b9c8f7c7f-x6lt5" May 21 03:26:43.300649 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:43.300621 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf0dab46-e06e-4455-bc3d-2670d9a18504-console-config\") pod \"console-5b9c8f7c7f-x6lt5\" (UID: \"cf0dab46-e06e-4455-bc3d-2670d9a18504\") " pod="openshift-console/console-5b9c8f7c7f-x6lt5" May 21 03:26:43.300873 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:43.300652 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf0dab46-e06e-4455-bc3d-2670d9a18504-console-oauth-config\") pod \"console-5b9c8f7c7f-x6lt5\" (UID: \"cf0dab46-e06e-4455-bc3d-2670d9a18504\") " pod="openshift-console/console-5b9c8f7c7f-x6lt5" May 21 03:26:43.300873 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:43.300693 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf0dab46-e06e-4455-bc3d-2670d9a18504-service-ca\") pod \"console-5b9c8f7c7f-x6lt5\" (UID: \"cf0dab46-e06e-4455-bc3d-2670d9a18504\") " pod="openshift-console/console-5b9c8f7c7f-x6lt5" May 21 03:26:43.301334 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:43.301309 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf0dab46-e06e-4455-bc3d-2670d9a18504-service-ca\") pod \"console-5b9c8f7c7f-x6lt5\" (UID: \"cf0dab46-e06e-4455-bc3d-2670d9a18504\") " pod="openshift-console/console-5b9c8f7c7f-x6lt5" May 21 03:26:43.301437 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:43.301309 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf0dab46-e06e-4455-bc3d-2670d9a18504-oauth-serving-cert\") pod \"console-5b9c8f7c7f-x6lt5\" (UID: \"cf0dab46-e06e-4455-bc3d-2670d9a18504\") " pod="openshift-console/console-5b9c8f7c7f-x6lt5" May 21 03:26:43.301437 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:43.301387 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf0dab46-e06e-4455-bc3d-2670d9a18504-console-config\") pod \"console-5b9c8f7c7f-x6lt5\" (UID: \"cf0dab46-e06e-4455-bc3d-2670d9a18504\") " pod="openshift-console/console-5b9c8f7c7f-x6lt5" May 21 03:26:43.301516 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:43.301498 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf0dab46-e06e-4455-bc3d-2670d9a18504-trusted-ca-bundle\") pod \"console-5b9c8f7c7f-x6lt5\" (UID: \"cf0dab46-e06e-4455-bc3d-2670d9a18504\") " pod="openshift-console/console-5b9c8f7c7f-x6lt5" May 21 03:26:43.303174 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:43.303156 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf0dab46-e06e-4455-bc3d-2670d9a18504-console-oauth-config\") pod \"console-5b9c8f7c7f-x6lt5\" (UID: \"cf0dab46-e06e-4455-bc3d-2670d9a18504\") " pod="openshift-console/console-5b9c8f7c7f-x6lt5" May 21 03:26:43.303265 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:43.303158 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf0dab46-e06e-4455-bc3d-2670d9a18504-console-serving-cert\") pod \"console-5b9c8f7c7f-x6lt5\" (UID: \"cf0dab46-e06e-4455-bc3d-2670d9a18504\") " pod="openshift-console/console-5b9c8f7c7f-x6lt5" May 21 03:26:43.307893 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:43.307871 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rv9rm\" (UniqueName: \"kubernetes.io/projected/cf0dab46-e06e-4455-bc3d-2670d9a18504-kube-api-access-rv9rm\") pod \"console-5b9c8f7c7f-x6lt5\" (UID: \"cf0dab46-e06e-4455-bc3d-2670d9a18504\") " pod="openshift-console/console-5b9c8f7c7f-x6lt5" May 21 03:26:43.489670 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:43.489566 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b9c8f7c7f-x6lt5" May 21 03:26:43.636233 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:43.636208 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b9c8f7c7f-x6lt5"] May 21 03:26:43.638133 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:26:43.638104 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf0dab46_e06e_4455_bc3d_2670d9a18504.slice/crio-f459c379ac92e9b4869d023a3db7385310d8dc8fc14662f7acf14734064b5adb WatchSource:0}: Error finding container f459c379ac92e9b4869d023a3db7385310d8dc8fc14662f7acf14734064b5adb: Status 404 returned error can't find the container with id f459c379ac92e9b4869d023a3db7385310d8dc8fc14662f7acf14734064b5adb May 21 03:26:44.137438 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:44.137399 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b9c8f7c7f-x6lt5" event={"ID":"cf0dab46-e06e-4455-bc3d-2670d9a18504","Type":"ContainerStarted","Data":"cfdae7c7aa4e48c26366a915e2dfba955572761559fd655a3c68af3686f7e5cf"} May 21 03:26:44.137438 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:44.137445 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b9c8f7c7f-x6lt5" event={"ID":"cf0dab46-e06e-4455-bc3d-2670d9a18504","Type":"ContainerStarted","Data":"f459c379ac92e9b4869d023a3db7385310d8dc8fc14662f7acf14734064b5adb"} May 21 03:26:44.155015 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:44.154940 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-5b9c8f7c7f-x6lt5" podStartSLOduration=1.154925803 podStartE2EDuration="1.154925803s" podCreationTimestamp="2026-05-21 03:26:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 03:26:44.153503696 +0000 UTC m=+432.196272609" watchObservedRunningTime="2026-05-21 03:26:44.154925803 +0000 UTC m=+432.197694718" May 21 03:26:53.489978 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:53.489931 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5b9c8f7c7f-x6lt5" May 21 03:26:53.489978 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:53.489977 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5b9c8f7c7f-x6lt5" May 21 03:26:53.494727 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:53.494705 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5b9c8f7c7f-x6lt5" May 21 03:26:54.174831 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:26:54.174798 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5b9c8f7c7f-x6lt5" May 21 03:27:26.771274 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:27:26.771237 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:27:26.775293 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:27:26.775272 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-6k5xk" May 21 03:27:26.777344 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:27:26.777320 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" May 21 03:27:26.777577 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:27:26.777565 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-2trq2\"" May 21 03:27:26.780519 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:27:26.780494 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:27:26.806189 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:27:26.806153 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:27:26.873362 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:27:26.873321 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kcff\" (UniqueName: \"kubernetes.io/projected/49ea3deb-7547-4f6a-bfeb-7abfa2c8583a-kube-api-access-2kcff\") pod \"limitador-limitador-78c99df468-6k5xk\" (UID: \"49ea3deb-7547-4f6a-bfeb-7abfa2c8583a\") " pod="kuadrant-system/limitador-limitador-78c99df468-6k5xk" May 21 03:27:26.873537 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:27:26.873384 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/49ea3deb-7547-4f6a-bfeb-7abfa2c8583a-config-file\") pod \"limitador-limitador-78c99df468-6k5xk\" (UID: \"49ea3deb-7547-4f6a-bfeb-7abfa2c8583a\") " pod="kuadrant-system/limitador-limitador-78c99df468-6k5xk" May 21 03:27:26.974431 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:27:26.974385 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2kcff\" (UniqueName: \"kubernetes.io/projected/49ea3deb-7547-4f6a-bfeb-7abfa2c8583a-kube-api-access-2kcff\") pod \"limitador-limitador-78c99df468-6k5xk\" (UID: \"49ea3deb-7547-4f6a-bfeb-7abfa2c8583a\") " pod="kuadrant-system/limitador-limitador-78c99df468-6k5xk" May 21 03:27:26.974637 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:27:26.974472 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/49ea3deb-7547-4f6a-bfeb-7abfa2c8583a-config-file\") pod \"limitador-limitador-78c99df468-6k5xk\" (UID: \"49ea3deb-7547-4f6a-bfeb-7abfa2c8583a\") " pod="kuadrant-system/limitador-limitador-78c99df468-6k5xk" May 21 03:27:26.975151 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:27:26.975128 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/49ea3deb-7547-4f6a-bfeb-7abfa2c8583a-config-file\") pod \"limitador-limitador-78c99df468-6k5xk\" (UID: \"49ea3deb-7547-4f6a-bfeb-7abfa2c8583a\") " pod="kuadrant-system/limitador-limitador-78c99df468-6k5xk" May 21 03:27:26.982190 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:27:26.982166 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kcff\" (UniqueName: \"kubernetes.io/projected/49ea3deb-7547-4f6a-bfeb-7abfa2c8583a-kube-api-access-2kcff\") pod \"limitador-limitador-78c99df468-6k5xk\" (UID: \"49ea3deb-7547-4f6a-bfeb-7abfa2c8583a\") " pod="kuadrant-system/limitador-limitador-78c99df468-6k5xk" May 21 03:27:27.087616 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:27:27.087522 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-6k5xk" May 21 03:27:27.226033 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:27:27.226005 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:27:27.228334 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:27:27.228301 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49ea3deb_7547_4f6a_bfeb_7abfa2c8583a.slice/crio-a2b866e5444726667b0bc3d8475704128f394794111d387f0a7213c1a5a22c10 WatchSource:0}: Error finding container a2b866e5444726667b0bc3d8475704128f394794111d387f0a7213c1a5a22c10: Status 404 returned error can't find the container with id a2b866e5444726667b0bc3d8475704128f394794111d387f0a7213c1a5a22c10 May 21 03:27:27.286398 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:27:27.286360 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-6k5xk" event={"ID":"49ea3deb-7547-4f6a-bfeb-7abfa2c8583a","Type":"ContainerStarted","Data":"a2b866e5444726667b0bc3d8475704128f394794111d387f0a7213c1a5a22c10"} May 21 03:27:30.306516 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:27:30.306480 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-6k5xk" event={"ID":"49ea3deb-7547-4f6a-bfeb-7abfa2c8583a","Type":"ContainerStarted","Data":"c86e46b9c92cb3cd954e03b48ccf3d03e857a38b7812b2063e7529599a8577b9"} May 21 03:27:30.306976 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:27:30.306538 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-78c99df468-6k5xk" May 21 03:27:30.323075 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:27:30.323022 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-78c99df468-6k5xk" podStartSLOduration=1.8948471709999999 podStartE2EDuration="4.323009329s" podCreationTimestamp="2026-05-21 03:27:26 +0000 UTC" firstStartedPulling="2026-05-21 03:27:27.23011268 +0000 UTC m=+475.272881572" lastFinishedPulling="2026-05-21 03:27:29.658274838 +0000 UTC m=+477.701043730" observedRunningTime="2026-05-21 03:27:30.320486819 +0000 UTC m=+478.363255736" watchObservedRunningTime="2026-05-21 03:27:30.323009329 +0000 UTC m=+478.365778242" May 21 03:27:41.311369 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:27:41.311333 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-78c99df468-6k5xk" May 21 03:28:51.909708 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:28:51.909669 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:29:09.381328 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:29:09.381288 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:29:32.494593 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:29:32.494553 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-8lrds_dba914e7-105d-41a4-8789-b248a94c0bd6/console-operator/2.log" May 21 03:29:32.495129 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:29:32.494704 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-8lrds_dba914e7-105d-41a4-8789-b248a94c0bd6/console-operator/2.log" May 21 03:29:32.875018 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:29:32.874978 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:29:40.278783 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:29:40.278701 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:29:43.278143 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:29:43.278102 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:29:55.685292 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:29:55.685252 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:30:00.130288 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:30:00.130247 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29655570-fpxlj"] May 21 03:30:00.133903 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:30:00.133880 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29655570-fpxlj" May 21 03:30:00.136022 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:30:00.136001 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-w6zwm\"" May 21 03:30:00.140165 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:30:00.140139 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29655570-fpxlj"] May 21 03:30:00.225655 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:30:00.225619 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jtr2\" (UniqueName: \"kubernetes.io/projected/f4d50b33-405a-433e-b328-92f92e9ac692-kube-api-access-7jtr2\") pod \"maas-api-key-cleanup-29655570-fpxlj\" (UID: \"f4d50b33-405a-433e-b328-92f92e9ac692\") " pod="opendatahub/maas-api-key-cleanup-29655570-fpxlj" May 21 03:30:00.326727 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:30:00.326687 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7jtr2\" (UniqueName: \"kubernetes.io/projected/f4d50b33-405a-433e-b328-92f92e9ac692-kube-api-access-7jtr2\") pod \"maas-api-key-cleanup-29655570-fpxlj\" (UID: \"f4d50b33-405a-433e-b328-92f92e9ac692\") " pod="opendatahub/maas-api-key-cleanup-29655570-fpxlj" May 21 03:30:00.334977 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:30:00.334948 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jtr2\" (UniqueName: \"kubernetes.io/projected/f4d50b33-405a-433e-b328-92f92e9ac692-kube-api-access-7jtr2\") pod \"maas-api-key-cleanup-29655570-fpxlj\" (UID: \"f4d50b33-405a-433e-b328-92f92e9ac692\") " pod="opendatahub/maas-api-key-cleanup-29655570-fpxlj" May 21 03:30:00.446189 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:30:00.446112 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29655570-fpxlj" May 21 03:30:00.595513 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:30:00.595486 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29655570-fpxlj"] May 21 03:30:00.595644 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:30:00.595632 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 03:30:00.825315 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:30:00.825231 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29655570-fpxlj" event={"ID":"f4d50b33-405a-433e-b328-92f92e9ac692","Type":"ContainerStarted","Data":"da9b03fe348ebdc55969604920d693b125ab74348c9363a9e5724695a742f59f"} May 21 03:30:04.846872 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:30:04.846768 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29655570-fpxlj" event={"ID":"f4d50b33-405a-433e-b328-92f92e9ac692","Type":"ContainerStarted","Data":"6b470c748836a98c5b76ace85e933f933808f5b82ad627085ec3db5ab7764138"} May 21 03:30:04.861506 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:30:04.861454 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29655570-fpxlj" podStartSLOduration=1.258768645 podStartE2EDuration="4.861436874s" podCreationTimestamp="2026-05-21 03:30:00 +0000 UTC" firstStartedPulling="2026-05-21 03:30:00.595751578 +0000 UTC m=+628.638520469" lastFinishedPulling="2026-05-21 03:30:04.198419794 +0000 UTC m=+632.241188698" observedRunningTime="2026-05-21 03:30:04.860144079 +0000 UTC m=+632.902913001" watchObservedRunningTime="2026-05-21 03:30:04.861436874 +0000 UTC m=+632.904205790" May 21 03:30:05.851405 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:30:05.851373 2574 generic.go:358] "Generic (PLEG): container finished" podID="f4d50b33-405a-433e-b328-92f92e9ac692" containerID="6b470c748836a98c5b76ace85e933f933808f5b82ad627085ec3db5ab7764138" exitCode=0 May 21 03:30:05.851782 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:30:05.851462 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29655570-fpxlj" event={"ID":"f4d50b33-405a-433e-b328-92f92e9ac692","Type":"ContainerDied","Data":"6b470c748836a98c5b76ace85e933f933808f5b82ad627085ec3db5ab7764138"} May 21 03:30:06.991751 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:30:06.991727 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29655570-fpxlj" May 21 03:30:07.082618 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:30:07.082582 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7jtr2\" (UniqueName: \"kubernetes.io/projected/f4d50b33-405a-433e-b328-92f92e9ac692-kube-api-access-7jtr2\") pod \"f4d50b33-405a-433e-b328-92f92e9ac692\" (UID: \"f4d50b33-405a-433e-b328-92f92e9ac692\") " May 21 03:30:07.084932 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:30:07.084907 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4d50b33-405a-433e-b328-92f92e9ac692-kube-api-access-7jtr2" (OuterVolumeSpecName: "kube-api-access-7jtr2") pod "f4d50b33-405a-433e-b328-92f92e9ac692" (UID: "f4d50b33-405a-433e-b328-92f92e9ac692"). InnerVolumeSpecName "kube-api-access-7jtr2". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 03:30:07.183273 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:30:07.183239 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7jtr2\" (UniqueName: \"kubernetes.io/projected/f4d50b33-405a-433e-b328-92f92e9ac692-kube-api-access-7jtr2\") on node \"ip-10-0-128-161.ec2.internal\" DevicePath \"\"" May 21 03:30:07.860382 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:30:07.860340 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29655570-fpxlj" event={"ID":"f4d50b33-405a-433e-b328-92f92e9ac692","Type":"ContainerDied","Data":"da9b03fe348ebdc55969604920d693b125ab74348c9363a9e5724695a742f59f"} May 21 03:30:07.860382 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:30:07.860380 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29655570-fpxlj" May 21 03:30:07.860589 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:30:07.860383 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="da9b03fe348ebdc55969604920d693b125ab74348c9363a9e5724695a742f59f" May 21 03:30:17.085169 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:30:17.085127 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:30:54.574789 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:30:54.574750 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:31:00.579626 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:31:00.579596 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:31:07.079457 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:31:07.079421 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:31:16.788579 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:31:16.788542 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:31:26.179503 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:31:26.179459 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:31:35.474413 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:31:35.474375 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:31:44.375563 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:31:44.375512 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:31:55.488814 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:31:55.488783 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:33:07.184255 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:33:07.184171 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:33:23.775288 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:33:23.775251 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:34:01.270440 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:34:01.270401 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:34:17.477684 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:34:17.477602 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:34:32.276108 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:34:32.276070 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:34:32.526883 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:34:32.526770 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-8lrds_dba914e7-105d-41a4-8789-b248a94c0bd6/console-operator/2.log" May 21 03:34:32.528028 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:34:32.528001 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-8lrds_dba914e7-105d-41a4-8789-b248a94c0bd6/console-operator/2.log" May 21 03:34:48.677292 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:34:48.677259 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:35:46.481513 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:35:46.481432 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:35:54.882969 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:35:54.882934 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:36:11.478176 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:36:11.478134 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:36:20.281222 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:36:20.281184 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:36:37.379896 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:36:37.379859 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:36:46.080534 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:36:46.080497 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:37:18.180204 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:37:18.180115 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:37:27.384108 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:37:27.384070 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:37:35.375163 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:37:35.375130 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:37:44.177915 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:37:44.177878 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:37:52.872250 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:37:52.872219 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:38:09.373517 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:38:09.373474 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:38:22.476827 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:38:22.476792 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:39:08.877252 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:39:08.877158 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:39:13.680023 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:39:13.679989 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:39:21.879727 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:39:21.879691 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:39:30.185729 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:39:30.185688 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:39:32.554241 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:39:32.554213 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-8lrds_dba914e7-105d-41a4-8789-b248a94c0bd6/console-operator/2.log" May 21 03:39:32.556626 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:39:32.556597 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-8lrds_dba914e7-105d-41a4-8789-b248a94c0bd6/console-operator/2.log" May 21 03:39:40.682910 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:39:40.682877 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:39:48.484308 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:39:48.484263 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:39:57.781964 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:39:57.781930 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:40:06.078494 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:40:06.078455 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:40:15.582196 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:40:15.582110 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:40:23.785945 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:40:23.785906 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:40:32.054837 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:40:32.054798 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:40:40.773387 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:40:40.773347 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:40:50.179732 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:40:50.179695 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:40:58.376156 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:40:58.376117 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:41:06.385536 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:41:06.385501 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:41:15.682533 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:41:15.682498 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:41:23.980224 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:41:23.980188 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:41:32.481336 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:41:32.481295 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:43:49.680662 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:43:49.680625 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:43:55.180325 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:43:55.180287 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:44:20.983025 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:44:20.982989 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:44:28.074937 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:44:28.074898 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:44:32.578601 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:44:32.578568 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-8lrds_dba914e7-105d-41a4-8789-b248a94c0bd6/console-operator/2.log" May 21 03:44:32.581461 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:44:32.581439 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-8lrds_dba914e7-105d-41a4-8789-b248a94c0bd6/console-operator/2.log" May 21 03:44:37.374251 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:44:37.374209 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:44:48.177559 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:44:48.177519 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:44:56.182052 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:44:56.182013 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:45:00.129384 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:45:00.129338 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29655585-dvgnb"] May 21 03:45:00.131715 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:45:00.129892 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4d50b33-405a-433e-b328-92f92e9ac692" containerName="cleanup" May 21 03:45:00.131715 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:45:00.129911 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4d50b33-405a-433e-b328-92f92e9ac692" containerName="cleanup" May 21 03:45:00.131715 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:45:00.130001 2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="f4d50b33-405a-433e-b328-92f92e9ac692" containerName="cleanup" May 21 03:45:00.132700 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:45:00.132685 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29655585-dvgnb" May 21 03:45:00.134642 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:45:00.134616 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-w6zwm\"" May 21 03:45:00.137937 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:45:00.137905 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29655585-dvgnb"] May 21 03:45:00.175543 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:45:00.175516 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2z65l\" (UniqueName: \"kubernetes.io/projected/1cc040e1-acad-4935-913b-12e0d0101ad9-kube-api-access-2z65l\") pod \"maas-api-key-cleanup-29655585-dvgnb\" (UID: \"1cc040e1-acad-4935-913b-12e0d0101ad9\") " pod="opendatahub/maas-api-key-cleanup-29655585-dvgnb" May 21 03:45:00.276787 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:45:00.276750 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2z65l\" (UniqueName: \"kubernetes.io/projected/1cc040e1-acad-4935-913b-12e0d0101ad9-kube-api-access-2z65l\") pod \"maas-api-key-cleanup-29655585-dvgnb\" (UID: \"1cc040e1-acad-4935-913b-12e0d0101ad9\") " pod="opendatahub/maas-api-key-cleanup-29655585-dvgnb" May 21 03:45:00.284279 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:45:00.284257 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2z65l\" (UniqueName: \"kubernetes.io/projected/1cc040e1-acad-4935-913b-12e0d0101ad9-kube-api-access-2z65l\") pod \"maas-api-key-cleanup-29655585-dvgnb\" (UID: \"1cc040e1-acad-4935-913b-12e0d0101ad9\") " pod="opendatahub/maas-api-key-cleanup-29655585-dvgnb" May 21 03:45:00.444349 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:45:00.444278 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29655585-dvgnb" May 21 03:45:00.568447 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:45:00.568411 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29655585-dvgnb"] May 21 03:45:00.570993 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:45:00.570964 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cc040e1_acad_4935_913b_12e0d0101ad9.slice/crio-beaaa04b474ee52e562433663004d203eb45ab0f706be8a0549f08bdfc1b2679 WatchSource:0}: Error finding container beaaa04b474ee52e562433663004d203eb45ab0f706be8a0549f08bdfc1b2679: Status 404 returned error can't find the container with id beaaa04b474ee52e562433663004d203eb45ab0f706be8a0549f08bdfc1b2679 May 21 03:45:00.573144 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:45:00.573125 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 03:45:00.903280 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:45:00.903243 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29655585-dvgnb" event={"ID":"1cc040e1-acad-4935-913b-12e0d0101ad9","Type":"ContainerStarted","Data":"069f867f0c48014067ae3a7ab3b1fb726ac9f6d828e0a554728e50f82cc26010"} May 21 03:45:00.903438 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:45:00.903286 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29655585-dvgnb" event={"ID":"1cc040e1-acad-4935-913b-12e0d0101ad9","Type":"ContainerStarted","Data":"beaaa04b474ee52e562433663004d203eb45ab0f706be8a0549f08bdfc1b2679"} May 21 03:45:00.917153 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:45:00.917110 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29655585-dvgnb" podStartSLOduration=0.917097128 podStartE2EDuration="917.097128ms" podCreationTimestamp="2026-05-21 03:45:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 03:45:00.915835477 +0000 UTC m=+1528.958604408" watchObservedRunningTime="2026-05-21 03:45:00.917097128 +0000 UTC m=+1528.959866041" May 21 03:45:01.907713 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:45:01.907680 2574 generic.go:358] "Generic (PLEG): container finished" podID="1cc040e1-acad-4935-913b-12e0d0101ad9" containerID="069f867f0c48014067ae3a7ab3b1fb726ac9f6d828e0a554728e50f82cc26010" exitCode=0 May 21 03:45:01.908131 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:45:01.907770 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29655585-dvgnb" event={"ID":"1cc040e1-acad-4935-913b-12e0d0101ad9","Type":"ContainerDied","Data":"069f867f0c48014067ae3a7ab3b1fb726ac9f6d828e0a554728e50f82cc26010"} May 21 03:45:03.042781 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:45:03.042749 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29655585-dvgnb" May 21 03:45:03.099931 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:45:03.099903 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2z65l\" (UniqueName: \"kubernetes.io/projected/1cc040e1-acad-4935-913b-12e0d0101ad9-kube-api-access-2z65l\") pod \"1cc040e1-acad-4935-913b-12e0d0101ad9\" (UID: \"1cc040e1-acad-4935-913b-12e0d0101ad9\") " May 21 03:45:03.102038 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:45:03.102007 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1cc040e1-acad-4935-913b-12e0d0101ad9-kube-api-access-2z65l" (OuterVolumeSpecName: "kube-api-access-2z65l") pod "1cc040e1-acad-4935-913b-12e0d0101ad9" (UID: "1cc040e1-acad-4935-913b-12e0d0101ad9"). InnerVolumeSpecName "kube-api-access-2z65l". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 03:45:03.200949 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:45:03.200883 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2z65l\" (UniqueName: \"kubernetes.io/projected/1cc040e1-acad-4935-913b-12e0d0101ad9-kube-api-access-2z65l\") on node \"ip-10-0-128-161.ec2.internal\" DevicePath \"\"" May 21 03:45:03.921451 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:45:03.921416 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29655585-dvgnb" event={"ID":"1cc040e1-acad-4935-913b-12e0d0101ad9","Type":"ContainerDied","Data":"beaaa04b474ee52e562433663004d203eb45ab0f706be8a0549f08bdfc1b2679"} May 21 03:45:03.921451 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:45:03.921453 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="beaaa04b474ee52e562433663004d203eb45ab0f706be8a0549f08bdfc1b2679" May 21 03:45:03.921664 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:45:03.921467 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29655585-dvgnb" May 21 03:45:07.379153 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:45:07.379115 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:45:15.571786 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:45:15.571749 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:45:26.594153 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:45:26.594115 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:45:34.879767 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:45:34.879731 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:45:45.677175 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:45:45.677137 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:45:55.377861 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:45:55.377802 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:46:29.677921 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:46:29.677878 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:47:12.978026 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:47:12.977985 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:47:21.275646 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:47:21.275606 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:47:29.679165 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:47:29.679126 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:47:38.183574 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:47:38.183486 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:47:48.573275 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:47:48.573233 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:47:59.672420 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:47:59.672384 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:48:08.589358 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:48:08.589328 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:48:16.975871 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:48:16.975807 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:48:25.083879 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:48:25.083820 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:48:33.386550 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:48:33.386511 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:48:42.182946 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:48:42.182905 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:48:52.670976 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:48:52.670943 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:49:09.989457 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:49:09.989382 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:49:18.673663 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:49:18.673624 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:49:26.773400 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:49:26.773359 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:49:32.601370 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:49:32.601336 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-8lrds_dba914e7-105d-41a4-8789-b248a94c0bd6/console-operator/2.log" May 21 03:49:32.605953 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:49:32.605928 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-8lrds_dba914e7-105d-41a4-8789-b248a94c0bd6/console-operator/2.log" May 21 03:49:34.680135 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:49:34.680098 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:49:52.380126 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:49:52.380086 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:50:00.479630 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:50:00.479589 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:50:09.875399 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:50:09.875361 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:50:18.279190 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:50:18.279151 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:50:27.178652 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:50:27.178613 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:50:35.772563 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:50:35.772526 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:50:44.281080 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:50:44.280993 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:50:57.876072 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:50:57.876030 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:51:07.281283 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:51:07.281245 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:51:18.373835 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:51:18.373794 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:51:27.381677 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:51:27.381642 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:51:33.878706 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:51:33.878669 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:51:42.976009 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:51:42.975972 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:51:51.479315 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:51:51.479282 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:52:07.177666 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:52:07.177630 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:52:16.170509 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:52:16.170430 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:52:24.877113 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:52:24.877073 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:52:33.275799 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:52:33.275762 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:52:56.479291 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:52:56.479250 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:53:09.082422 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:09.082382 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-6k5xk"] May 21 03:53:15.565346 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:15.565309 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-dmwdm_8e44a64a-5a59-4643-8f85-1773d9a9d2b8/manager/0.log" May 21 03:53:15.788711 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:15.788680 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29655570-fpxlj_f4d50b33-405a-433e-b328-92f92e9ac692/cleanup/0.log" May 21 03:53:15.896484 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:15.896453 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29655585-dvgnb_1cc040e1-acad-4935-913b-12e0d0101ad9/cleanup/0.log" May 21 03:53:16.133821 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:16.133792 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-2tg2w_267041ad-559e-4d00-a0f6-9590dc2d5e2f/manager/2.log" May 21 03:53:16.248218 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:16.248140 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5fcf489fb9-qkwkn_585f7729-b506-494c-8484-4e6b7e4c2b7b/manager/0.log" May 21 03:53:17.907575 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:17.907539 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-4h8xn_d065f850-b862-4c0c-acb4-e0f13c80a5c5/manager/0.log" May 21 03:53:18.017462 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:18.017431 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-db8mn_836070e4-690c-4d4e-a61c-7fe9813d832b/manager/0.log" May 21 03:53:18.501450 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:18.501420 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-6k5xk_49ea3deb-7547-4f6a-bfeb-7abfa2c8583a/limitador/0.log" May 21 03:53:18.615396 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:18.615367 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-s6kdh_01b970d3-0e48-49a3-ba6e-21cb129fe204/manager/0.log" May 21 03:53:19.083030 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:19.083001 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-d2cqg_0ae56f66-117f-4709-9c96-9d8ab3a3ad7e/discovery/0.log" May 21 03:53:19.189004 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:19.188971 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5749999c66-b7kmq_236040c0-bedd-4a35-ad97-b420dd53ade0/kube-auth-proxy/0.log" May 21 03:53:19.647774 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:19.647739 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-756cb57bf8-jgcjn_0c56fe16-837c-4d09-8521-f6e5b652b7d9/router/0.log" May 21 03:53:27.616923 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:27.616898 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-vt8z9_4931c73f-47f4-428d-8602-5e1f4d3cd47a/global-pull-secret-syncer/0.log" May 21 03:53:27.697838 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:27.697805 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-8nncl_74fe87f5-634c-48e6-85b9-357a3b4d02f9/konnectivity-agent/0.log" May 21 03:53:27.759654 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:27.759619 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-161.ec2.internal_b3204d4e276a6036a6def62b77dcf7af/haproxy/0.log" May 21 03:53:32.510115 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:32.510083 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-4h8xn_d065f850-b862-4c0c-acb4-e0f13c80a5c5/manager/0.log" May 21 03:53:32.541375 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:32.541353 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-db8mn_836070e4-690c-4d4e-a61c-7fe9813d832b/manager/0.log" May 21 03:53:32.715028 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:32.714996 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-6k5xk_49ea3deb-7547-4f6a-bfeb-7abfa2c8583a/limitador/0.log" May 21 03:53:32.804396 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:32.804314 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-s6kdh_01b970d3-0e48-49a3-ba6e-21cb129fe204/manager/0.log" May 21 03:53:34.448999 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:34.448968 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-pmfdr_234c46ba-e4c6-49c1-b967-283befa2e01d/cluster-monitoring-operator/0.log" May 21 03:53:34.749699 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:34.749612 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xpvpv_d6ff9c15-b4d2-4e99-86db-9db97458fad5/node-exporter/0.log" May 21 03:53:34.767743 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:34.767713 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xpvpv_d6ff9c15-b4d2-4e99-86db-9db97458fad5/kube-rbac-proxy/0.log" May 21 03:53:34.787273 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:34.787252 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xpvpv_d6ff9c15-b4d2-4e99-86db-9db97458fad5/init-textfile/0.log" May 21 03:53:35.132261 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:35.132231 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6c6695f958-kvbpb_1b1764d1-9674-4708-964f-3775a0499c17/telemeter-client/0.log" May 21 03:53:35.151113 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:35.151090 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6c6695f958-kvbpb_1b1764d1-9674-4708-964f-3775a0499c17/reload/0.log" May 21 03:53:35.169701 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:35.169675 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6c6695f958-kvbpb_1b1764d1-9674-4708-964f-3775a0499c17/kube-rbac-proxy/0.log" May 21 03:53:36.025483 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:36.025447 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-p57vb/perf-node-gather-daemonset-sfh6z"] May 21 03:53:36.026082 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:36.026053 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cc040e1-acad-4935-913b-12e0d0101ad9" containerName="cleanup" May 21 03:53:36.026082 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:36.026081 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cc040e1-acad-4935-913b-12e0d0101ad9" containerName="cleanup" May 21 03:53:36.026256 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:36.026168 2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="1cc040e1-acad-4935-913b-12e0d0101ad9" containerName="cleanup" May 21 03:53:36.029153 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:36.029138 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p57vb/perf-node-gather-daemonset-sfh6z" May 21 03:53:36.031002 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:36.030984 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-p57vb\"/\"default-dockercfg-zvfx6\"" May 21 03:53:36.031201 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:36.031185 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-p57vb\"/\"openshift-service-ca.crt\"" May 21 03:53:36.031919 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:36.031901 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-p57vb\"/\"kube-root-ca.crt\"" May 21 03:53:36.037317 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:36.037299 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p57vb/perf-node-gather-daemonset-sfh6z"] May 21 03:53:36.195435 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:36.195401 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/19367787-c3e3-4e46-83be-103379b7a0c0-podres\") pod \"perf-node-gather-daemonset-sfh6z\" (UID: \"19367787-c3e3-4e46-83be-103379b7a0c0\") " pod="openshift-must-gather-p57vb/perf-node-gather-daemonset-sfh6z" May 21 03:53:36.195607 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:36.195463 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/19367787-c3e3-4e46-83be-103379b7a0c0-sys\") pod \"perf-node-gather-daemonset-sfh6z\" (UID: \"19367787-c3e3-4e46-83be-103379b7a0c0\") " pod="openshift-must-gather-p57vb/perf-node-gather-daemonset-sfh6z" May 21 03:53:36.195607 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:36.195529 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/19367787-c3e3-4e46-83be-103379b7a0c0-lib-modules\") pod \"perf-node-gather-daemonset-sfh6z\" (UID: \"19367787-c3e3-4e46-83be-103379b7a0c0\") " pod="openshift-must-gather-p57vb/perf-node-gather-daemonset-sfh6z" May 21 03:53:36.195607 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:36.195589 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/19367787-c3e3-4e46-83be-103379b7a0c0-proc\") pod \"perf-node-gather-daemonset-sfh6z\" (UID: \"19367787-c3e3-4e46-83be-103379b7a0c0\") " pod="openshift-must-gather-p57vb/perf-node-gather-daemonset-sfh6z" May 21 03:53:36.195607 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:36.195607 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7w89\" (UniqueName: \"kubernetes.io/projected/19367787-c3e3-4e46-83be-103379b7a0c0-kube-api-access-s7w89\") pod \"perf-node-gather-daemonset-sfh6z\" (UID: \"19367787-c3e3-4e46-83be-103379b7a0c0\") " pod="openshift-must-gather-p57vb/perf-node-gather-daemonset-sfh6z" May 21 03:53:36.296675 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:36.296595 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/19367787-c3e3-4e46-83be-103379b7a0c0-proc\") pod \"perf-node-gather-daemonset-sfh6z\" (UID: \"19367787-c3e3-4e46-83be-103379b7a0c0\") " pod="openshift-must-gather-p57vb/perf-node-gather-daemonset-sfh6z" May 21 03:53:36.296675 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:36.296627 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s7w89\" (UniqueName: \"kubernetes.io/projected/19367787-c3e3-4e46-83be-103379b7a0c0-kube-api-access-s7w89\") pod \"perf-node-gather-daemonset-sfh6z\" (UID: \"19367787-c3e3-4e46-83be-103379b7a0c0\") " pod="openshift-must-gather-p57vb/perf-node-gather-daemonset-sfh6z" May 21 03:53:36.296675 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:36.296655 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/19367787-c3e3-4e46-83be-103379b7a0c0-podres\") pod \"perf-node-gather-daemonset-sfh6z\" (UID: \"19367787-c3e3-4e46-83be-103379b7a0c0\") " pod="openshift-must-gather-p57vb/perf-node-gather-daemonset-sfh6z" May 21 03:53:36.296972 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:36.296705 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/19367787-c3e3-4e46-83be-103379b7a0c0-sys\") pod \"perf-node-gather-daemonset-sfh6z\" (UID: \"19367787-c3e3-4e46-83be-103379b7a0c0\") " pod="openshift-must-gather-p57vb/perf-node-gather-daemonset-sfh6z" May 21 03:53:36.296972 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:36.296712 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/19367787-c3e3-4e46-83be-103379b7a0c0-proc\") pod \"perf-node-gather-daemonset-sfh6z\" (UID: \"19367787-c3e3-4e46-83be-103379b7a0c0\") " pod="openshift-must-gather-p57vb/perf-node-gather-daemonset-sfh6z" May 21 03:53:36.296972 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:36.296725 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/19367787-c3e3-4e46-83be-103379b7a0c0-lib-modules\") pod \"perf-node-gather-daemonset-sfh6z\" (UID: \"19367787-c3e3-4e46-83be-103379b7a0c0\") " pod="openshift-must-gather-p57vb/perf-node-gather-daemonset-sfh6z" May 21 03:53:36.296972 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:36.296797 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/19367787-c3e3-4e46-83be-103379b7a0c0-sys\") pod \"perf-node-gather-daemonset-sfh6z\" (UID: \"19367787-c3e3-4e46-83be-103379b7a0c0\") " pod="openshift-must-gather-p57vb/perf-node-gather-daemonset-sfh6z" May 21 03:53:36.296972 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:36.296825 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/19367787-c3e3-4e46-83be-103379b7a0c0-lib-modules\") pod \"perf-node-gather-daemonset-sfh6z\" (UID: \"19367787-c3e3-4e46-83be-103379b7a0c0\") " pod="openshift-must-gather-p57vb/perf-node-gather-daemonset-sfh6z" May 21 03:53:36.296972 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:36.296829 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/19367787-c3e3-4e46-83be-103379b7a0c0-podres\") pod \"perf-node-gather-daemonset-sfh6z\" (UID: \"19367787-c3e3-4e46-83be-103379b7a0c0\") " pod="openshift-must-gather-p57vb/perf-node-gather-daemonset-sfh6z" May 21 03:53:36.303805 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:36.303783 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7w89\" (UniqueName: \"kubernetes.io/projected/19367787-c3e3-4e46-83be-103379b7a0c0-kube-api-access-s7w89\") pod \"perf-node-gather-daemonset-sfh6z\" (UID: \"19367787-c3e3-4e46-83be-103379b7a0c0\") " pod="openshift-must-gather-p57vb/perf-node-gather-daemonset-sfh6z" May 21 03:53:36.339887 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:36.339833 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p57vb/perf-node-gather-daemonset-sfh6z" May 21 03:53:36.465175 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:36.465149 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p57vb/perf-node-gather-daemonset-sfh6z"] May 21 03:53:36.466992 ip-10-0-128-161 kubenswrapper[2574]: W0521 03:53:36.466964 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod19367787_c3e3_4e46_83be_103379b7a0c0.slice/crio-5ac8db60b05799c463754cac91cd5d28ce6760bbb57f508f8341594355f8a128 WatchSource:0}: Error finding container 5ac8db60b05799c463754cac91cd5d28ce6760bbb57f508f8341594355f8a128: Status 404 returned error can't find the container with id 5ac8db60b05799c463754cac91cd5d28ce6760bbb57f508f8341594355f8a128 May 21 03:53:36.468588 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:36.468572 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 03:53:36.706118 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:36.706085 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p57vb/perf-node-gather-daemonset-sfh6z" event={"ID":"19367787-c3e3-4e46-83be-103379b7a0c0","Type":"ContainerStarted","Data":"afb42f2a53439d3da13f3e394c0204a6d8fbd26bdcb5c6674a98e9402df84d38"} May 21 03:53:36.706317 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:36.706127 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p57vb/perf-node-gather-daemonset-sfh6z" event={"ID":"19367787-c3e3-4e46-83be-103379b7a0c0","Type":"ContainerStarted","Data":"5ac8db60b05799c463754cac91cd5d28ce6760bbb57f508f8341594355f8a128"} May 21 03:53:36.706317 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:36.706209 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-p57vb/perf-node-gather-daemonset-sfh6z" May 21 03:53:36.721257 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:36.721211 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-p57vb/perf-node-gather-daemonset-sfh6z" podStartSLOduration=0.72119843 podStartE2EDuration="721.19843ms" podCreationTimestamp="2026-05-21 03:53:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 03:53:36.719404876 +0000 UTC m=+2044.762173800" watchObservedRunningTime="2026-05-21 03:53:36.72119843 +0000 UTC m=+2044.763967346" May 21 03:53:36.890196 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:36.890153 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-8lrds_dba914e7-105d-41a4-8789-b248a94c0bd6/console-operator/2.log" May 21 03:53:36.897361 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:36.897338 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-8lrds_dba914e7-105d-41a4-8789-b248a94c0bd6/console-operator/3.log" May 21 03:53:37.342479 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:37.342451 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5b9c8f7c7f-x6lt5_cf0dab46-e06e-4455-bc3d-2670d9a18504/console/0.log" May 21 03:53:37.836147 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:37.836078 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5cf8c89d64-h65g2_2a0b651f-774b-47d2-a666-68fd4e2e3b15/volume-data-source-validator/0.log" May 21 03:53:38.635286 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:38.635260 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-d4jjb_a60fd84a-346a-44c3-9a02-5c3db633aaa4/dns/0.log" May 21 03:53:38.653384 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:38.653359 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-d4jjb_a60fd84a-346a-44c3-9a02-5c3db633aaa4/kube-rbac-proxy/0.log" May 21 03:53:38.711653 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:38.711620 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gqltp_05b002ff-a785-4372-a115-4fd04746df17/dns-node-resolver/0.log" May 21 03:53:39.241638 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:39.241608 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5zqvw_1abd0f75-c601-4162-b828-a203307febed/node-ca/0.log" May 21 03:53:40.215777 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:40.215723 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-d2cqg_0ae56f66-117f-4709-9c96-9d8ab3a3ad7e/discovery/0.log" May 21 03:53:40.233704 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:40.233682 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5749999c66-b7kmq_236040c0-bedd-4a35-ad97-b420dd53ade0/kube-auth-proxy/0.log" May 21 03:53:40.460108 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:40.460048 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-756cb57bf8-jgcjn_0c56fe16-837c-4d09-8521-f6e5b652b7d9/router/0.log" May 21 03:53:40.984648 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:40.984622 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2cxks_ba1902e2-00e1-4eaa-9aea-5c617de7ebb3/serve-healthcheck-canary/0.log" May 21 03:53:41.455624 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:41.455592 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-7hp2b_4302517e-e98b-4cd7-8b24-fbf4a8994346/insights-operator/0.log" May 21 03:53:41.456162 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:41.456064 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-7hp2b_4302517e-e98b-4cd7-8b24-fbf4a8994346/insights-operator/1.log" May 21 03:53:41.598406 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:41.598379 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ztkkq_a98701a7-2592-4cb3-a4fd-1899fb9f4df3/kube-rbac-proxy/0.log" May 21 03:53:41.616881 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:41.616832 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ztkkq_a98701a7-2592-4cb3-a4fd-1899fb9f4df3/exporter/0.log" May 21 03:53:41.636204 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:41.636184 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ztkkq_a98701a7-2592-4cb3-a4fd-1899fb9f4df3/extractor/0.log" May 21 03:53:42.719997 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:42.719968 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-p57vb/perf-node-gather-daemonset-sfh6z" May 21 03:53:43.656067 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:43.656010 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-dmwdm_8e44a64a-5a59-4643-8f85-1773d9a9d2b8/manager/0.log" May 21 03:53:43.717280 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:43.717254 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29655570-fpxlj_f4d50b33-405a-433e-b328-92f92e9ac692/cleanup/0.log" May 21 03:53:43.737817 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:43.737795 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29655585-dvgnb_1cc040e1-acad-4935-913b-12e0d0101ad9/cleanup/0.log" May 21 03:53:43.881977 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:43.881949 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-2tg2w_267041ad-559e-4d00-a0f6-9590dc2d5e2f/manager/1.log" May 21 03:53:43.902856 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:43.902813 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-2tg2w_267041ad-559e-4d00-a0f6-9590dc2d5e2f/manager/2.log" May 21 03:53:43.964207 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:43.964118 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5fcf489fb9-qkwkn_585f7729-b506-494c-8484-4e6b7e4c2b7b/manager/0.log" May 21 03:53:50.089945 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:50.089905 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-4q5lp_87cfc78f-987e-46d9-a3e2-7128548b613d/kube-storage-version-migrator-operator/1.log" May 21 03:53:50.091594 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:50.091556 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-4q5lp_87cfc78f-987e-46d9-a3e2-7128548b613d/kube-storage-version-migrator-operator/0.log" May 21 03:53:51.098972 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:51.098945 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k7gbn_70d7280d-5779-4c48-b698-9ce8a698bdeb/kube-multus-additional-cni-plugins/0.log" May 21 03:53:51.118649 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:51.118625 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k7gbn_70d7280d-5779-4c48-b698-9ce8a698bdeb/egress-router-binary-copy/0.log" May 21 03:53:51.138249 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:51.138213 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k7gbn_70d7280d-5779-4c48-b698-9ce8a698bdeb/cni-plugins/0.log" May 21 03:53:51.156393 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:51.156368 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k7gbn_70d7280d-5779-4c48-b698-9ce8a698bdeb/bond-cni-plugin/0.log" May 21 03:53:51.188099 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:51.188080 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k7gbn_70d7280d-5779-4c48-b698-9ce8a698bdeb/routeoverride-cni/0.log" May 21 03:53:51.205986 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:51.205966 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k7gbn_70d7280d-5779-4c48-b698-9ce8a698bdeb/whereabouts-cni-bincopy/0.log" May 21 03:53:51.226062 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:51.226041 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k7gbn_70d7280d-5779-4c48-b698-9ce8a698bdeb/whereabouts-cni/0.log" May 21 03:53:51.585402 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:51.585379 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-pppx8_4a110770-ece5-4091-a30a-46b820e75cae/kube-multus/0.log" May 21 03:53:51.646381 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:51.646354 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-7vr9p_1a03c959-a5a9-44f4-89f3-d604f293b8a0/network-metrics-daemon/0.log" May 21 03:53:51.662222 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:51.662195 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-7vr9p_1a03c959-a5a9-44f4-89f3-d604f293b8a0/kube-rbac-proxy/0.log" May 21 03:53:53.109316 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:53.109238 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tqqk8_7300d401-1c04-433f-a767-b2ec61b3d4b4/ovn-controller/0.log" May 21 03:53:53.141260 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:53.141237 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tqqk8_7300d401-1c04-433f-a767-b2ec61b3d4b4/ovn-acl-logging/0.log" May 21 03:53:53.159044 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:53.159024 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tqqk8_7300d401-1c04-433f-a767-b2ec61b3d4b4/kube-rbac-proxy-node/0.log" May 21 03:53:53.177615 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:53.177585 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tqqk8_7300d401-1c04-433f-a767-b2ec61b3d4b4/kube-rbac-proxy-ovn-metrics/0.log" May 21 03:53:53.194022 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:53.194005 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tqqk8_7300d401-1c04-433f-a767-b2ec61b3d4b4/northd/0.log" May 21 03:53:53.211218 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:53.211202 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tqqk8_7300d401-1c04-433f-a767-b2ec61b3d4b4/nbdb/0.log" May 21 03:53:53.228784 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:53.228760 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tqqk8_7300d401-1c04-433f-a767-b2ec61b3d4b4/sbdb/0.log" May 21 03:53:53.401835 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:53.401797 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tqqk8_7300d401-1c04-433f-a767-b2ec61b3d4b4/ovnkube-controller/0.log" May 21 03:53:54.515736 ip-10-0-128-161 kubenswrapper[2574]: I0521 03:53:54.515705 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-skpvq_168bd0e1-6421-4c11-8ef2-8caf34170ae9/network-check-target-container/0.log"