May 27 14:05:14.767195 ip-10-0-136-198 systemd[1]: Starting Kubernetes Kubelet... May 27 14:05:15.280808 ip-10-0-136-198 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 27 14:05:15.280808 ip-10-0-136-198 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 27 14:05:15.280808 ip-10-0-136-198 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 27 14:05:15.280808 ip-10-0-136-198 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 27 14:05:15.280808 ip-10-0-136-198 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 27 14:05:15.284839 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.284738 2563 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 27 14:05:15.287734 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.287717 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 27 14:05:15.287734 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.287734 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 27 14:05:15.287806 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.287738 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 27 14:05:15.287806 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.287741 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 27 14:05:15.287806 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.287745 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 27 14:05:15.287806 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.287748 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 27 14:05:15.287806 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.287751 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 27 14:05:15.287806 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.287754 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 27 14:05:15.287806 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.287757 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 27 14:05:15.287806 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.287759 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 27 14:05:15.287806 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.287762 2563 feature_gate.go:328] unrecognized feature gate: DualReplica May 27 14:05:15.287806 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.287765 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 27 14:05:15.287806 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.287768 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 27 14:05:15.287806 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.287779 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 27 14:05:15.287806 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.287788 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 27 14:05:15.287806 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.287791 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 27 14:05:15.287806 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.287793 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 27 14:05:15.287806 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.287796 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 27 14:05:15.287806 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.287799 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability May 27 14:05:15.287806 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.287802 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 27 14:05:15.287806 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.287804 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 27 14:05:15.288268 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.287809 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 27 14:05:15.288268 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.287813 2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 27 14:05:15.288268 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.287816 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores May 27 14:05:15.288268 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.287819 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 27 14:05:15.288268 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.287822 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 27 14:05:15.288268 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.287825 2563 feature_gate.go:328] unrecognized feature gate: Example May 27 14:05:15.288268 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.287828 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 27 14:05:15.288268 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.287831 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 27 14:05:15.288268 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.287833 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 27 14:05:15.288268 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.287836 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 27 14:05:15.288268 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.287838 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 27 14:05:15.288268 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.287841 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 27 14:05:15.288268 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.287843 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 27 14:05:15.288268 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.287846 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 27 14:05:15.288268 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.287848 2563 feature_gate.go:328] unrecognized feature gate: Example2 May 27 14:05:15.288268 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.287851 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 27 14:05:15.288268 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.287853 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 27 14:05:15.288268 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.287856 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 27 14:05:15.288268 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.287858 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 27 14:05:15.288268 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.287861 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 27 14:05:15.288751 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.287864 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 27 14:05:15.288751 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.287866 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 27 14:05:15.288751 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.287869 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 27 14:05:15.288751 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.287871 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 27 14:05:15.288751 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.287874 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 27 14:05:15.288751 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.287876 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 27 14:05:15.288751 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.287879 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 27 14:05:15.288751 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.287882 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 27 14:05:15.288751 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.287884 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 27 14:05:15.288751 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.287886 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 27 14:05:15.288751 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.287889 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 27 14:05:15.288751 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.287905 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 27 14:05:15.288751 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.287907 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 27 14:05:15.288751 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.287911 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 27 14:05:15.288751 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.287914 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 27 14:05:15.288751 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.287917 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 27 14:05:15.288751 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.287920 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 27 14:05:15.288751 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.287922 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 27 14:05:15.288751 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.287925 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 27 14:05:15.288751 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.287927 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 27 14:05:15.289253 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.287930 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 27 14:05:15.289253 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.287934 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 27 14:05:15.289253 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.287936 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 27 14:05:15.289253 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.287939 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages May 27 14:05:15.289253 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.287942 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 27 14:05:15.289253 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.287945 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 27 14:05:15.289253 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.287950 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 27 14:05:15.289253 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.287954 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 27 14:05:15.289253 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.287957 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 27 14:05:15.289253 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.287960 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 27 14:05:15.289253 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.287962 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 27 14:05:15.289253 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.287965 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 27 14:05:15.289253 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.287968 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 27 14:05:15.289253 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.287970 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 27 14:05:15.289253 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.287974 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 27 14:05:15.289253 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.287983 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 27 14:05:15.289253 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.287986 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 27 14:05:15.289253 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.287989 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 27 14:05:15.289253 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.287992 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 27 14:05:15.289253 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.287994 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 27 14:05:15.289773 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.287997 2563 feature_gate.go:328] unrecognized feature gate: NewOLM May 27 14:05:15.289773 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.287999 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 27 14:05:15.289773 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288002 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 27 14:05:15.289773 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288005 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 27 14:05:15.289773 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288008 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 27 14:05:15.289773 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288390 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 27 14:05:15.289773 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288397 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 27 14:05:15.289773 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288400 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 27 14:05:15.289773 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288403 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 27 14:05:15.289773 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288406 2563 feature_gate.go:328] unrecognized feature gate: DualReplica May 27 14:05:15.289773 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288409 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 27 14:05:15.289773 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288411 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 27 14:05:15.289773 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288414 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 27 14:05:15.289773 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288417 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 27 14:05:15.289773 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288419 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 27 14:05:15.289773 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288422 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 27 14:05:15.289773 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288424 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 27 14:05:15.289773 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288428 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 27 14:05:15.289773 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288430 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 27 14:05:15.289773 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288433 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 27 14:05:15.290269 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288435 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 27 14:05:15.290269 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288438 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 27 14:05:15.290269 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288440 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 27 14:05:15.290269 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288443 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 27 14:05:15.290269 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288445 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 27 14:05:15.290269 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288448 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 27 14:05:15.290269 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288450 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 27 14:05:15.290269 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288454 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 27 14:05:15.290269 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288458 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 27 14:05:15.290269 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288461 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 27 14:05:15.290269 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288464 2563 feature_gate.go:328] unrecognized feature gate: Example May 27 14:05:15.290269 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288467 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 27 14:05:15.290269 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288470 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 27 14:05:15.290269 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288473 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 27 14:05:15.290269 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288475 2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 27 14:05:15.290269 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288479 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 27 14:05:15.290269 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288482 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 27 14:05:15.290269 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288485 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 27 14:05:15.290269 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288488 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 27 14:05:15.290741 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288491 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 27 14:05:15.290741 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288493 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 27 14:05:15.290741 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288496 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 27 14:05:15.290741 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288498 2563 feature_gate.go:328] unrecognized feature gate: Example2 May 27 14:05:15.290741 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288501 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores May 27 14:05:15.290741 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288504 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 27 14:05:15.290741 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288507 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 27 14:05:15.290741 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288509 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability May 27 14:05:15.290741 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288512 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 27 14:05:15.290741 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288514 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 27 14:05:15.290741 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288517 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 27 14:05:15.290741 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288520 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 27 14:05:15.290741 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288523 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 27 14:05:15.290741 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288525 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 27 14:05:15.290741 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288528 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 27 14:05:15.290741 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288530 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 27 14:05:15.290741 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288533 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 27 14:05:15.290741 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288535 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 27 14:05:15.290741 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288538 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 27 14:05:15.290741 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288540 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 27 14:05:15.291247 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288543 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 27 14:05:15.291247 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288545 2563 feature_gate.go:328] unrecognized feature gate: NewOLM May 27 14:05:15.291247 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288550 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 27 14:05:15.291247 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288554 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 27 14:05:15.291247 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288557 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 27 14:05:15.291247 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288559 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 27 14:05:15.291247 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288562 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 27 14:05:15.291247 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288564 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 27 14:05:15.291247 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288567 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 27 14:05:15.291247 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288570 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 27 14:05:15.291247 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288572 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 27 14:05:15.291247 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288575 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 27 14:05:15.291247 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288578 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 27 14:05:15.291247 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288580 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 27 14:05:15.291247 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288583 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 27 14:05:15.291247 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288585 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 27 14:05:15.291247 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288588 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 27 14:05:15.291247 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288591 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 27 14:05:15.291247 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288593 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 27 14:05:15.291705 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288595 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 27 14:05:15.291705 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288598 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 27 14:05:15.291705 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288601 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 27 14:05:15.291705 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288603 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 27 14:05:15.291705 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288605 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 27 14:05:15.291705 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288608 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages May 27 14:05:15.291705 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288611 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 27 14:05:15.291705 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288613 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 27 14:05:15.291705 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288616 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 27 14:05:15.291705 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288618 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 27 14:05:15.291705 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288621 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 27 14:05:15.291705 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288623 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 27 14:05:15.291705 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.288627 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 27 14:05:15.291705 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289510 2563 flags.go:64] FLAG: --address="0.0.0.0" May 27 14:05:15.291705 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289520 2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 27 14:05:15.291705 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289527 2563 flags.go:64] FLAG: --anonymous-auth="true" May 27 14:05:15.291705 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289532 2563 flags.go:64] FLAG: --application-metrics-count-limit="100" May 27 14:05:15.291705 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289536 2563 flags.go:64] FLAG: --authentication-token-webhook="false" May 27 14:05:15.291705 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289540 2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 27 14:05:15.291705 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289544 2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 27 14:05:15.291705 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289549 2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 27 14:05:15.292244 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289552 2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 27 14:05:15.292244 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289555 2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 27 14:05:15.292244 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289559 2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 27 14:05:15.292244 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289562 2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 27 14:05:15.292244 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289565 2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 27 14:05:15.292244 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289568 2563 flags.go:64] FLAG: --cgroup-root="" May 27 14:05:15.292244 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289571 2563 flags.go:64] FLAG: --cgroups-per-qos="true" May 27 14:05:15.292244 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289575 2563 flags.go:64] FLAG: --client-ca-file="" May 27 14:05:15.292244 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289579 2563 flags.go:64] FLAG: --cloud-config="" May 27 14:05:15.292244 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289582 2563 flags.go:64] FLAG: --cloud-provider="external" May 27 14:05:15.292244 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289585 2563 flags.go:64] FLAG: --cluster-dns="[]" May 27 14:05:15.292244 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289612 2563 flags.go:64] FLAG: --cluster-domain="" May 27 14:05:15.292244 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289616 2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 27 14:05:15.292244 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289619 2563 flags.go:64] FLAG: --config-dir="" May 27 14:05:15.292244 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289622 2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 27 14:05:15.292244 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289626 2563 flags.go:64] FLAG: --container-log-max-files="5" May 27 14:05:15.292244 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289630 2563 flags.go:64] FLAG: --container-log-max-size="10Mi" May 27 14:05:15.292244 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289634 2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 27 14:05:15.292244 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289638 2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 27 14:05:15.292244 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289641 2563 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 27 14:05:15.292244 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289644 2563 flags.go:64] FLAG: --contention-profiling="false" May 27 14:05:15.292244 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289647 2563 flags.go:64] FLAG: --cpu-cfs-quota="true" May 27 14:05:15.292244 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289650 2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 27 14:05:15.292244 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289653 2563 flags.go:64] FLAG: --cpu-manager-policy="none" May 27 14:05:15.292244 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289656 2563 flags.go:64] FLAG: --cpu-manager-policy-options="" May 27 14:05:15.292841 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289661 2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 27 14:05:15.292841 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289664 2563 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 27 14:05:15.292841 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289667 2563 flags.go:64] FLAG: --enable-debugging-handlers="true" May 27 14:05:15.292841 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289671 2563 flags.go:64] FLAG: --enable-load-reader="false" May 27 14:05:15.292841 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289674 2563 flags.go:64] FLAG: --enable-server="true" May 27 14:05:15.292841 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289677 2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 27 14:05:15.292841 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289681 2563 flags.go:64] FLAG: --event-burst="100" May 27 14:05:15.292841 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289684 2563 flags.go:64] FLAG: --event-qps="50" May 27 14:05:15.292841 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289687 2563 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 27 14:05:15.292841 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289690 2563 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 27 14:05:15.292841 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289694 2563 flags.go:64] FLAG: --eviction-hard="" May 27 14:05:15.292841 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289697 2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 27 14:05:15.292841 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289700 2563 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 27 14:05:15.292841 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289703 2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 27 14:05:15.292841 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289706 2563 flags.go:64] FLAG: --eviction-soft="" May 27 14:05:15.292841 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289709 2563 flags.go:64] FLAG: --eviction-soft-grace-period="" May 27 14:05:15.292841 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289712 2563 flags.go:64] FLAG: --exit-on-lock-contention="false" May 27 14:05:15.292841 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289715 2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 27 14:05:15.292841 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289718 2563 flags.go:64] FLAG: --experimental-mounter-path="" May 27 14:05:15.292841 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289721 2563 flags.go:64] FLAG: --fail-cgroupv1="false" May 27 14:05:15.292841 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289724 2563 flags.go:64] FLAG: --fail-swap-on="true" May 27 14:05:15.292841 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289727 2563 flags.go:64] FLAG: --feature-gates="" May 27 14:05:15.292841 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289730 2563 flags.go:64] FLAG: --file-check-frequency="20s" May 27 14:05:15.292841 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289733 2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 27 14:05:15.292841 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289737 2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 27 14:05:15.293445 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289740 2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 27 14:05:15.293445 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289743 2563 flags.go:64] FLAG: --healthz-port="10248" May 27 14:05:15.293445 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289746 2563 flags.go:64] FLAG: --help="false" May 27 14:05:15.293445 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289750 2563 flags.go:64] FLAG: --hostname-override="ip-10-0-136-198.ec2.internal" May 27 14:05:15.293445 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289753 2563 flags.go:64] FLAG: --housekeeping-interval="10s" May 27 14:05:15.293445 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289756 2563 flags.go:64] FLAG: --http-check-frequency="20s" May 27 14:05:15.293445 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289759 2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 27 14:05:15.293445 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289763 2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 27 14:05:15.293445 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289767 2563 flags.go:64] FLAG: --image-gc-high-threshold="85" May 27 14:05:15.293445 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289770 2563 flags.go:64] FLAG: --image-gc-low-threshold="80" May 27 14:05:15.293445 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289773 2563 flags.go:64] FLAG: --image-service-endpoint="" May 27 14:05:15.293445 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289776 2563 flags.go:64] FLAG: --kernel-memcg-notification="false" May 27 14:05:15.293445 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289779 2563 flags.go:64] FLAG: --kube-api-burst="100" May 27 14:05:15.293445 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289783 2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 27 14:05:15.293445 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289786 2563 flags.go:64] FLAG: --kube-api-qps="50" May 27 14:05:15.293445 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289789 2563 flags.go:64] FLAG: --kube-reserved="" May 27 14:05:15.293445 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289793 2563 flags.go:64] FLAG: --kube-reserved-cgroup="" May 27 14:05:15.293445 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289795 2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 27 14:05:15.293445 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289799 2563 flags.go:64] FLAG: --kubelet-cgroups="" May 27 14:05:15.293445 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289802 2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 27 14:05:15.293445 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289805 2563 flags.go:64] FLAG: --lock-file="" May 27 14:05:15.293445 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289807 2563 flags.go:64] FLAG: --log-cadvisor-usage="false" May 27 14:05:15.293445 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289810 2563 flags.go:64] FLAG: --log-flush-frequency="5s" May 27 14:05:15.293445 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289813 2563 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 27 14:05:15.294025 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289821 2563 flags.go:64] FLAG: --log-json-split-stream="false" May 27 14:05:15.294025 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289824 2563 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 27 14:05:15.294025 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289827 2563 flags.go:64] FLAG: --log-text-split-stream="false" May 27 14:05:15.294025 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289830 2563 flags.go:64] FLAG: --logging-format="text" May 27 14:05:15.294025 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289833 2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 27 14:05:15.294025 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289837 2563 flags.go:64] FLAG: --make-iptables-util-chains="true" May 27 14:05:15.294025 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289840 2563 flags.go:64] FLAG: --manifest-url="" May 27 14:05:15.294025 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289843 2563 flags.go:64] FLAG: --manifest-url-header="" May 27 14:05:15.294025 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289847 2563 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 27 14:05:15.294025 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289851 2563 flags.go:64] FLAG: --max-open-files="1000000" May 27 14:05:15.294025 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289856 2563 flags.go:64] FLAG: --max-pods="110" May 27 14:05:15.294025 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289864 2563 flags.go:64] FLAG: --maximum-dead-containers="-1" May 27 14:05:15.294025 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289868 2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 27 14:05:15.294025 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289871 2563 flags.go:64] FLAG: --memory-manager-policy="None" May 27 14:05:15.294025 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289874 2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 27 14:05:15.294025 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289877 2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 27 14:05:15.294025 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289881 2563 flags.go:64] FLAG: --node-ip="0.0.0.0" May 27 14:05:15.294025 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289884 2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 27 14:05:15.294025 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289890 2563 flags.go:64] FLAG: --node-status-max-images="50" May 27 14:05:15.294025 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289908 2563 flags.go:64] FLAG: --node-status-update-frequency="10s" May 27 14:05:15.294025 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289913 2563 flags.go:64] FLAG: --oom-score-adj="-999" May 27 14:05:15.294025 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289918 2563 flags.go:64] FLAG: --pod-cidr="" May 27 14:05:15.294025 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289922 2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 27 14:05:15.294624 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289928 2563 flags.go:64] FLAG: --pod-manifest-path="" May 27 14:05:15.294624 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289932 2563 flags.go:64] FLAG: --pod-max-pids="-1" May 27 14:05:15.294624 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289935 2563 flags.go:64] FLAG: --pods-per-core="0" May 27 14:05:15.294624 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289938 2563 flags.go:64] FLAG: --port="10250" May 27 14:05:15.294624 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289941 2563 flags.go:64] FLAG: --protect-kernel-defaults="false" May 27 14:05:15.294624 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289944 2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0baf435fd330e561d" May 27 14:05:15.294624 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289947 2563 flags.go:64] FLAG: --qos-reserved="" May 27 14:05:15.294624 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289951 2563 flags.go:64] FLAG: --read-only-port="10255" May 27 14:05:15.294624 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289953 2563 flags.go:64] FLAG: --register-node="true" May 27 14:05:15.294624 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289956 2563 flags.go:64] FLAG: --register-schedulable="true" May 27 14:05:15.294624 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289959 2563 flags.go:64] FLAG: --register-with-taints="" May 27 14:05:15.294624 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289963 2563 flags.go:64] FLAG: --registry-burst="10" May 27 14:05:15.294624 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289966 2563 flags.go:64] FLAG: --registry-qps="5" May 27 14:05:15.294624 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289969 2563 flags.go:64] FLAG: --reserved-cpus="" May 27 14:05:15.294624 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289973 2563 flags.go:64] FLAG: --reserved-memory="" May 27 14:05:15.294624 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289977 2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 27 14:05:15.294624 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289980 2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 27 14:05:15.294624 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289983 2563 flags.go:64] FLAG: --rotate-certificates="false" May 27 14:05:15.294624 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289986 2563 flags.go:64] FLAG: --rotate-server-certificates="false" May 27 14:05:15.294624 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289989 2563 flags.go:64] FLAG: --runonce="false" May 27 14:05:15.294624 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289992 2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 27 14:05:15.294624 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.289997 2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 27 14:05:15.294624 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.290000 2563 flags.go:64] FLAG: --seccomp-default="false" May 27 14:05:15.294624 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.290003 2563 flags.go:64] FLAG: --serialize-image-pulls="true" May 27 14:05:15.294624 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.290006 2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 27 14:05:15.294624 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.290010 2563 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 27 14:05:15.295351 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.290013 2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 27 14:05:15.295351 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.290016 2563 flags.go:64] FLAG: --storage-driver-password="root" May 27 14:05:15.295351 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.290019 2563 flags.go:64] FLAG: --storage-driver-secure="false" May 27 14:05:15.295351 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.290023 2563 flags.go:64] FLAG: --storage-driver-table="stats" May 27 14:05:15.295351 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.290026 2563 flags.go:64] FLAG: --storage-driver-user="root" May 27 14:05:15.295351 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.290029 2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 27 14:05:15.295351 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.290032 2563 flags.go:64] FLAG: --sync-frequency="1m0s" May 27 14:05:15.295351 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.290035 2563 flags.go:64] FLAG: --system-cgroups="" May 27 14:05:15.295351 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.290038 2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 27 14:05:15.295351 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.290044 2563 flags.go:64] FLAG: --system-reserved-cgroup="" May 27 14:05:15.295351 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.290047 2563 flags.go:64] FLAG: --tls-cert-file="" May 27 14:05:15.295351 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.290050 2563 flags.go:64] FLAG: --tls-cipher-suites="[]" May 27 14:05:15.295351 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.290054 2563 flags.go:64] FLAG: --tls-min-version="" May 27 14:05:15.295351 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.290057 2563 flags.go:64] FLAG: --tls-private-key-file="" May 27 14:05:15.295351 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.290060 2563 flags.go:64] FLAG: --topology-manager-policy="none" May 27 14:05:15.295351 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.290063 2563 flags.go:64] FLAG: --topology-manager-policy-options="" May 27 14:05:15.295351 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.290066 2563 flags.go:64] FLAG: --topology-manager-scope="container" May 27 14:05:15.295351 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.290069 2563 flags.go:64] FLAG: --v="2" May 27 14:05:15.295351 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.290073 2563 flags.go:64] FLAG: --version="false" May 27 14:05:15.295351 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.290078 2563 flags.go:64] FLAG: --vmodule="" May 27 14:05:15.295351 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.290082 2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 27 14:05:15.295351 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.290085 2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 27 14:05:15.295351 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290208 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 27 14:05:15.295351 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290212 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 27 14:05:15.295951 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290215 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 27 14:05:15.295951 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290218 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 27 14:05:15.295951 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290229 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 27 14:05:15.295951 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290233 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 27 14:05:15.295951 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290237 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 27 14:05:15.295951 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290240 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 27 14:05:15.295951 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290242 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 27 14:05:15.295951 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290245 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 27 14:05:15.295951 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290248 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 27 14:05:15.295951 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290251 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 27 14:05:15.295951 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290253 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 27 14:05:15.295951 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290256 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 27 14:05:15.295951 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290259 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 27 14:05:15.295951 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290263 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 27 14:05:15.295951 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290266 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 27 14:05:15.295951 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290270 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 27 14:05:15.295951 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290273 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 27 14:05:15.295951 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290276 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 27 14:05:15.295951 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290279 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 27 14:05:15.296438 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290282 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 27 14:05:15.296438 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290285 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 27 14:05:15.296438 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290287 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 27 14:05:15.296438 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290290 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 27 14:05:15.296438 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290292 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 27 14:05:15.296438 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290295 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 27 14:05:15.296438 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290297 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 27 14:05:15.296438 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290300 2563 feature_gate.go:328] unrecognized feature gate: Example2 May 27 14:05:15.296438 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290302 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 27 14:05:15.296438 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290305 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 27 14:05:15.296438 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290308 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 27 14:05:15.296438 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290310 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 27 14:05:15.296438 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290313 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 27 14:05:15.296438 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290316 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 27 14:05:15.296438 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290319 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 27 14:05:15.296438 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290321 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 27 14:05:15.296438 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290331 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 27 14:05:15.296438 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290334 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 27 14:05:15.296438 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290337 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 27 14:05:15.296438 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290339 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 27 14:05:15.296955 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290342 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 27 14:05:15.296955 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290345 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 27 14:05:15.296955 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290347 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores May 27 14:05:15.296955 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290350 2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 27 14:05:15.296955 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290352 2563 feature_gate.go:328] unrecognized feature gate: NewOLM May 27 14:05:15.296955 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290355 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 27 14:05:15.296955 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290358 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages May 27 14:05:15.296955 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290360 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 27 14:05:15.296955 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290363 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 27 14:05:15.296955 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290365 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 27 14:05:15.296955 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290368 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability May 27 14:05:15.296955 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290370 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 27 14:05:15.296955 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290373 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 27 14:05:15.296955 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290375 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 27 14:05:15.296955 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290378 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 27 14:05:15.296955 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290381 2563 feature_gate.go:328] unrecognized feature gate: Example May 27 14:05:15.296955 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290383 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 27 14:05:15.296955 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290385 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 27 14:05:15.296955 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290388 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 27 14:05:15.296955 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290391 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 27 14:05:15.297446 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290393 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 27 14:05:15.297446 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290395 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 27 14:05:15.297446 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290398 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 27 14:05:15.297446 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290400 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 27 14:05:15.297446 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290403 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 27 14:05:15.297446 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290406 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 27 14:05:15.297446 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290408 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 27 14:05:15.297446 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290411 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 27 14:05:15.297446 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290414 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 27 14:05:15.297446 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290422 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 27 14:05:15.297446 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290426 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 27 14:05:15.297446 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290429 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 27 14:05:15.297446 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290431 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 27 14:05:15.297446 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290434 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 27 14:05:15.297446 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290437 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 27 14:05:15.297446 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290439 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 27 14:05:15.297446 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290442 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 27 14:05:15.297446 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290444 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 27 14:05:15.297446 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290447 2563 feature_gate.go:328] unrecognized feature gate: DualReplica May 27 14:05:15.297929 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290451 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 27 14:05:15.297929 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290454 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 27 14:05:15.297929 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290457 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 27 14:05:15.297929 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290460 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 27 14:05:15.297929 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290462 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 27 14:05:15.297929 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.290465 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 27 14:05:15.297929 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.290471 2563 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 27 14:05:15.300100 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.300079 2563 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 27 14:05:15.300189 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.300101 2563 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 27 14:05:15.300189 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300153 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 27 14:05:15.300189 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300158 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 27 14:05:15.300189 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300162 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 27 14:05:15.300189 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300165 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 27 14:05:15.300189 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300167 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 27 14:05:15.300189 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300171 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 27 14:05:15.300189 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300174 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 27 14:05:15.300189 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300176 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 27 14:05:15.300189 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300179 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 27 14:05:15.300189 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300182 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 27 14:05:15.300189 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300184 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 27 14:05:15.300189 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300187 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 27 14:05:15.300189 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300190 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 27 14:05:15.300189 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300193 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 27 14:05:15.300189 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300196 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 27 14:05:15.300189 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300199 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 27 14:05:15.300613 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300202 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 27 14:05:15.300613 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300205 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 27 14:05:15.300613 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300214 2563 feature_gate.go:328] unrecognized feature gate: Example2 May 27 14:05:15.300613 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300217 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 27 14:05:15.300613 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300219 2563 feature_gate.go:328] unrecognized feature gate: NewOLM May 27 14:05:15.300613 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300222 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 27 14:05:15.300613 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300225 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages May 27 14:05:15.300613 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300228 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 27 14:05:15.300613 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300230 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 27 14:05:15.300613 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300233 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 27 14:05:15.300613 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300235 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 27 14:05:15.300613 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300238 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 27 14:05:15.300613 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300240 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 27 14:05:15.300613 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300243 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 27 14:05:15.300613 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300245 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 27 14:05:15.300613 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300254 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 27 14:05:15.300613 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300257 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 27 14:05:15.300613 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300259 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 27 14:05:15.300613 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300262 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 27 14:05:15.300613 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300265 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 27 14:05:15.301123 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300267 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 27 14:05:15.301123 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300270 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 27 14:05:15.301123 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300272 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 27 14:05:15.301123 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300275 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 27 14:05:15.301123 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300277 2563 feature_gate.go:328] unrecognized feature gate: DualReplica May 27 14:05:15.301123 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300280 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 27 14:05:15.301123 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300282 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 27 14:05:15.301123 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300285 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 27 14:05:15.301123 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300288 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 27 14:05:15.301123 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300290 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 27 14:05:15.301123 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300293 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 27 14:05:15.301123 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300295 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 27 14:05:15.301123 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300299 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 27 14:05:15.301123 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300305 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 27 14:05:15.301123 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300308 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 27 14:05:15.301123 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300311 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 27 14:05:15.301123 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300314 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 27 14:05:15.301123 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300317 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 27 14:05:15.301123 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300320 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 27 14:05:15.301592 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300323 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 27 14:05:15.301592 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300326 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 27 14:05:15.301592 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300328 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 27 14:05:15.301592 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300331 2563 feature_gate.go:328] unrecognized feature gate: Example May 27 14:05:15.301592 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300333 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 27 14:05:15.301592 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300336 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 27 14:05:15.301592 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300339 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 27 14:05:15.301592 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300342 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 27 14:05:15.301592 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300346 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 27 14:05:15.301592 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300354 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 27 14:05:15.301592 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300357 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 27 14:05:15.301592 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300359 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 27 14:05:15.301592 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300361 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability May 27 14:05:15.301592 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300364 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 27 14:05:15.301592 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300366 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 27 14:05:15.301592 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300369 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 27 14:05:15.301592 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300371 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 27 14:05:15.301592 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300374 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 27 14:05:15.301592 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300376 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 27 14:05:15.301592 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300378 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 27 14:05:15.302094 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300381 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 27 14:05:15.302094 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300384 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 27 14:05:15.302094 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300387 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 27 14:05:15.302094 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300389 2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 27 14:05:15.302094 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300392 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores May 27 14:05:15.302094 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300394 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 27 14:05:15.302094 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300398 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 27 14:05:15.302094 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300401 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 27 14:05:15.302094 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300403 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 27 14:05:15.302094 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300406 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 27 14:05:15.302094 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300408 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 27 14:05:15.302094 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.300414 2563 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 27 14:05:15.302094 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300546 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 27 14:05:15.302094 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300551 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 27 14:05:15.302094 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300554 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 27 14:05:15.302462 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300558 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 27 14:05:15.302462 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300560 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 27 14:05:15.302462 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300563 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 27 14:05:15.302462 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300565 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 27 14:05:15.302462 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300568 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 27 14:05:15.302462 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300571 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability May 27 14:05:15.302462 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300573 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 27 14:05:15.302462 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300582 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 27 14:05:15.302462 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300584 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 27 14:05:15.302462 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300587 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 27 14:05:15.302462 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300590 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 27 14:05:15.302462 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300592 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 27 14:05:15.302462 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300595 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 27 14:05:15.302462 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300597 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores May 27 14:05:15.302462 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300600 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 27 14:05:15.302462 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300602 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 27 14:05:15.302462 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300605 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 27 14:05:15.302462 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300608 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 27 14:05:15.302462 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300611 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 27 14:05:15.302462 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300613 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 27 14:05:15.303069 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300615 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 27 14:05:15.303069 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300618 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 27 14:05:15.303069 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300622 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 27 14:05:15.303069 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300625 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 27 14:05:15.303069 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300628 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 27 14:05:15.303069 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300631 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 27 14:05:15.303069 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300633 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 27 14:05:15.303069 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300636 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 27 14:05:15.303069 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300638 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 27 14:05:15.303069 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300641 2563 feature_gate.go:328] unrecognized feature gate: DualReplica May 27 14:05:15.303069 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300643 2563 feature_gate.go:328] unrecognized feature gate: NewOLM May 27 14:05:15.303069 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300646 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 27 14:05:15.303069 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300648 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 27 14:05:15.303069 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300652 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 27 14:05:15.303069 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300655 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 27 14:05:15.303069 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300658 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 27 14:05:15.303069 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300661 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 27 14:05:15.303069 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300663 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 27 14:05:15.303069 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300666 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 27 14:05:15.303522 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300668 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 27 14:05:15.303522 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300676 2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 27 14:05:15.303522 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300679 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages May 27 14:05:15.303522 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300681 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 27 14:05:15.303522 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300684 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 27 14:05:15.303522 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300687 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 27 14:05:15.303522 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300689 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 27 14:05:15.303522 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300692 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 27 14:05:15.303522 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300694 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 27 14:05:15.303522 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300698 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 27 14:05:15.303522 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300701 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 27 14:05:15.303522 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300704 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 27 14:05:15.303522 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300707 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 27 14:05:15.303522 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300709 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 27 14:05:15.303522 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300712 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 27 14:05:15.303522 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300714 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 27 14:05:15.303522 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300717 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 27 14:05:15.303522 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300720 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 27 14:05:15.303522 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300723 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 27 14:05:15.304066 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300726 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 27 14:05:15.304066 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300729 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 27 14:05:15.304066 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300731 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 27 14:05:15.304066 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300734 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 27 14:05:15.304066 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300736 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 27 14:05:15.304066 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300739 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 27 14:05:15.304066 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300742 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 27 14:05:15.304066 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300744 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 27 14:05:15.304066 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300747 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 27 14:05:15.304066 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300749 2563 feature_gate.go:328] unrecognized feature gate: Example May 27 14:05:15.304066 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300752 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 27 14:05:15.304066 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300755 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 27 14:05:15.304066 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300757 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 27 14:05:15.304066 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300760 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 27 14:05:15.304066 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300762 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 27 14:05:15.304066 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300771 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 27 14:05:15.304066 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300774 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 27 14:05:15.304066 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300776 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 27 14:05:15.304066 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300779 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 27 14:05:15.304066 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300781 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 27 14:05:15.304606 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300784 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 27 14:05:15.304606 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300786 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 27 14:05:15.304606 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300789 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 27 14:05:15.304606 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300791 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 27 14:05:15.304606 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:15.300794 2563 feature_gate.go:328] unrecognized feature gate: Example2 May 27 14:05:15.304606 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.300799 2563 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 27 14:05:15.304606 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.301601 2563 server.go:962] "Client rotation is on, will bootstrap in background" May 27 14:05:15.304606 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.304059 2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 27 14:05:15.305118 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.305106 2563 server.go:1019] "Starting client certificate rotation" May 27 14:05:15.305244 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.305217 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 27 14:05:15.305300 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.305283 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 27 14:05:15.334152 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.334119 2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 27 14:05:15.336302 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.336261 2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 27 14:05:15.353607 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.353582 2563 log.go:25] "Validated CRI v1 runtime API" May 27 14:05:15.359726 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.359702 2563 log.go:25] "Validated CRI v1 image API" May 27 14:05:15.361317 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.361294 2563 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 27 14:05:15.363914 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.363871 2563 fs.go:135] Filesystem UUIDs: map[29fc3f50-b29a-484e-a87a-9a28f5586106:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 cb4cd769-a63b-4fb4-a862-057960f1fc81:/dev/nvme0n1p4] May 27 14:05:15.363991 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.363912 2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 27 14:05:15.368922 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.368793 2563 manager.go:217] Machine: {Timestamp:2026-05-27 14:05:15.368226604 +0000 UTC m=+0.468543560 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099641 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec29efde2d1d2e64af2a3abee52f056e SystemUUID:ec29efde-2d1d-2e64-af2a-3abee52f056e BootID:8312f1f9-20ad-4d61-a4df-b480af2ea975 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:2e:7e:c2:1c:b9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:2e:7e:c2:1c:b9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:3e:dc:d2:6e:08:41 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 27 14:05:15.369727 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.369715 2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 27 14:05:15.369829 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.369812 2563 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 27 14:05:15.373702 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.373664 2563 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 27 14:05:15.373858 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.373704 2563 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-198.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 27 14:05:15.373923 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.373868 2563 topology_manager.go:138] "Creating topology manager with none policy" May 27 14:05:15.373923 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.373876 2563 container_manager_linux.go:306] "Creating device plugin manager" May 27 14:05:15.373923 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.373883 2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 27 14:05:15.373923 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.373911 2563 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 27 14:05:15.374154 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.374138 2563 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 27 14:05:15.376474 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.376461 2563 state_mem.go:36] "Initialized new in-memory state store" May 27 14:05:15.376591 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.376582 2563 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 27 14:05:15.380089 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.380079 2563 kubelet.go:491] "Attempting to sync node with API server" May 27 14:05:15.380126 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.380096 2563 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 27 14:05:15.380126 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.380111 2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 27 14:05:15.380126 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.380120 2563 kubelet.go:397] "Adding apiserver pod source" May 27 14:05:15.380228 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.380129 2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 27 14:05:15.381385 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.381371 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 27 14:05:15.381435 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.381390 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 27 14:05:15.385036 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.385017 2563 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 27 14:05:15.387310 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.387296 2563 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 27 14:05:15.388306 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.388289 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 27 14:05:15.388306 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.388308 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 27 14:05:15.388306 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.388314 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 27 14:05:15.388520 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.388320 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 27 14:05:15.388520 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.388328 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 27 14:05:15.388520 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.388334 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 27 14:05:15.388520 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.388340 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 27 14:05:15.388520 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.388345 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 27 14:05:15.388520 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.388354 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 27 14:05:15.388520 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.388372 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 27 14:05:15.388520 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.388389 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 27 14:05:15.388776 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.388766 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 27 14:05:15.389783 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.389769 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 27 14:05:15.389783 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.389779 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 27 14:05:15.396585 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.396562 2563 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 27 14:05:15.396674 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.396611 2563 server.go:1295] "Started kubelet" May 27 14:05:15.396907 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.396864 2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 27 14:05:15.396988 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.396860 2563 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 27 14:05:15.396988 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.396947 2563 server_v1.go:47] "podresources" method="list" useActivePods=true May 27 14:05:15.397598 ip-10-0-136-198 systemd[1]: Started Kubernetes Kubelet. May 27 14:05:15.397796 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.397778 2563 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-198.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 27 14:05:15.398313 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.398294 2563 server.go:317] "Adding debug handlers to kubelet server" May 27 14:05:15.398507 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:15.398446 2563 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 27 14:05:15.398507 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:15.398446 2563 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-198.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 27 14:05:15.398674 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.398627 2563 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 27 14:05:15.406991 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.406976 2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 27 14:05:15.406991 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.406982 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 27 14:05:15.407126 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.407039 2563 volume_manager.go:295] "The desired_state_of_world populator starts" May 27 14:05:15.407126 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.407047 2563 volume_manager.go:297] "Starting Kubelet Volume Manager" May 27 14:05:15.407230 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.407154 2563 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 27 14:05:15.407503 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.407487 2563 reconstruct.go:97] "Volume reconstruction finished" May 27 14:05:15.407503 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.407505 2563 reconciler.go:26] "Reconciler: start to sync state" May 27 14:05:15.407981 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:15.407957 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-198.ec2.internal\" not found" May 27 14:05:15.408598 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:15.408538 2563 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 27 14:05:15.408674 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.408646 2563 factory.go:55] Registering systemd factory May 27 14:05:15.408674 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.408661 2563 factory.go:223] Registration of the systemd container factory successfully May 27 14:05:15.408906 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.408882 2563 factory.go:153] Registering CRI-O factory May 27 14:05:15.408959 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.408913 2563 factory.go:223] Registration of the crio container factory successfully May 27 14:05:15.409004 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.408968 2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 27 14:05:15.409004 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.408989 2563 factory.go:103] Registering Raw factory May 27 14:05:15.409004 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.409002 2563 manager.go:1196] Started watching for new ooms in manager May 27 14:05:15.409324 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.409308 2563 manager.go:319] Starting recovery of all containers May 27 14:05:15.415554 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:15.415422 2563 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" May 27 14:05:15.415554 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:15.415460 2563 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-198.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" May 27 14:05:15.416768 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:15.415604 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-198.ec2.internal.18b3712ce63ab0b5 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-198.ec2.internal,UID:ip-10-0-136-198.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-198.ec2.internal,},FirstTimestamp:2026-05-27 14:05:15.396583605 +0000 UTC m=+0.496900571,LastTimestamp:2026-05-27 14:05:15.396583605 +0000 UTC m=+0.496900571,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-198.ec2.internal,}" May 27 14:05:15.418880 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.418861 2563 manager.go:324] Recovery completed May 27 14:05:15.420841 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.420824 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wk5b8" May 27 14:05:15.423753 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.423742 2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 14:05:15.426384 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.426365 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-198.ec2.internal" event="NodeHasSufficientMemory" May 27 14:05:15.426450 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.426397 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-198.ec2.internal" event="NodeHasNoDiskPressure" May 27 14:05:15.426450 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.426409 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-198.ec2.internal" event="NodeHasSufficientPID" May 27 14:05:15.426857 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.426846 2563 cpu_manager.go:222] "Starting CPU manager" policy="none" May 27 14:05:15.426857 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.426855 2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 27 14:05:15.426944 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.426870 2563 state_mem.go:36] "Initialized new in-memory state store" May 27 14:05:15.428708 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:15.428590 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-198.ec2.internal.18b3712ce8016809 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-198.ec2.internal,UID:ip-10-0-136-198.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-198.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-198.ec2.internal,},FirstTimestamp:2026-05-27 14:05:15.426383881 +0000 UTC m=+0.526700838,LastTimestamp:2026-05-27 14:05:15.426383881 +0000 UTC m=+0.526700838,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-198.ec2.internal,}" May 27 14:05:15.428813 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.428749 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wk5b8" May 27 14:05:15.430842 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.430824 2563 policy_none.go:49] "None policy: Start" May 27 14:05:15.430951 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.430849 2563 memory_manager.go:186] "Starting memorymanager" policy="None" May 27 14:05:15.430951 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.430863 2563 state_mem.go:35] "Initializing new in-memory state store" May 27 14:05:15.470526 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.470500 2563 manager.go:341] "Starting Device Plugin manager" May 27 14:05:15.491996 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:15.470537 2563 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 27 14:05:15.491996 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.470548 2563 server.go:85] "Starting device plugin registration server" May 27 14:05:15.491996 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.470885 2563 eviction_manager.go:189] "Eviction manager: starting control loop" May 27 14:05:15.491996 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.470984 2563 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 27 14:05:15.491996 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.471093 2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 27 14:05:15.491996 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.471166 2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 27 14:05:15.491996 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.471173 2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 27 14:05:15.491996 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:15.471668 2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 27 14:05:15.491996 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:15.471708 2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-198.ec2.internal\" not found" May 27 14:05:15.536335 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.536206 2563 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 27 14:05:15.537514 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.537497 2563 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 27 14:05:15.537598 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.537522 2563 status_manager.go:230] "Starting to sync pod status with apiserver" May 27 14:05:15.537598 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.537548 2563 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 27 14:05:15.537598 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.537560 2563 kubelet.go:2451] "Starting kubelet main sync loop" May 27 14:05:15.537718 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:15.537610 2563 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 27 14:05:15.540005 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.539980 2563 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 27 14:05:15.571746 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.571722 2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 14:05:15.572633 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.572616 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-198.ec2.internal" event="NodeHasSufficientMemory" May 27 14:05:15.572718 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.572647 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-198.ec2.internal" event="NodeHasNoDiskPressure" May 27 14:05:15.572718 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.572664 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-198.ec2.internal" event="NodeHasSufficientPID" May 27 14:05:15.572718 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.572694 2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-198.ec2.internal" May 27 14:05:15.582168 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.582149 2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-198.ec2.internal" May 27 14:05:15.582234 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:15.582172 2563 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-198.ec2.internal\": node \"ip-10-0-136-198.ec2.internal\" not found" May 27 14:05:15.600849 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:15.600820 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-198.ec2.internal\" not found" May 27 14:05:15.638308 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.638281 2563 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-198.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-198.ec2.internal"] May 27 14:05:15.638428 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.638376 2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 14:05:15.639270 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.639254 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-198.ec2.internal" event="NodeHasSufficientMemory" May 27 14:05:15.639362 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.639287 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-198.ec2.internal" event="NodeHasNoDiskPressure" May 27 14:05:15.639362 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.639305 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-198.ec2.internal" event="NodeHasSufficientPID" May 27 14:05:15.640398 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.640384 2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 14:05:15.640549 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.640535 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-198.ec2.internal" May 27 14:05:15.640592 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.640566 2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 14:05:15.641135 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.641122 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-198.ec2.internal" event="NodeHasSufficientMemory" May 27 14:05:15.641204 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.641134 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-198.ec2.internal" event="NodeHasSufficientMemory" May 27 14:05:15.641204 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.641152 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-198.ec2.internal" event="NodeHasNoDiskPressure" May 27 14:05:15.641204 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.641157 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-198.ec2.internal" event="NodeHasNoDiskPressure" May 27 14:05:15.641204 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.641164 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-198.ec2.internal" event="NodeHasSufficientPID" May 27 14:05:15.641204 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.641173 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-198.ec2.internal" event="NodeHasSufficientPID" May 27 14:05:15.642176 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.642163 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-198.ec2.internal" May 27 14:05:15.642230 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.642187 2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 14:05:15.642830 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.642816 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-198.ec2.internal" event="NodeHasSufficientMemory" May 27 14:05:15.642911 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.642842 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-198.ec2.internal" event="NodeHasNoDiskPressure" May 27 14:05:15.642911 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.642852 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-198.ec2.internal" event="NodeHasSufficientPID" May 27 14:05:15.667636 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:15.667611 2563 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-198.ec2.internal\" not found" node="ip-10-0-136-198.ec2.internal" May 27 14:05:15.671228 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:15.671210 2563 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-198.ec2.internal\" not found" node="ip-10-0-136-198.ec2.internal" May 27 14:05:15.700926 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:15.700877 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-198.ec2.internal\" not found" May 27 14:05:15.708826 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.708802 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/444f839c172d5d32122711f23798b1f0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-198.ec2.internal\" (UID: \"444f839c172d5d32122711f23798b1f0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-198.ec2.internal" May 27 14:05:15.708963 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.708831 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/444f839c172d5d32122711f23798b1f0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-198.ec2.internal\" (UID: \"444f839c172d5d32122711f23798b1f0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-198.ec2.internal" May 27 14:05:15.708963 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.708853 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bdac52c688e8c8ccf183c0f228872be3-config\") pod \"kube-apiserver-proxy-ip-10-0-136-198.ec2.internal\" (UID: \"bdac52c688e8c8ccf183c0f228872be3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-198.ec2.internal" May 27 14:05:15.801308 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:15.801234 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-198.ec2.internal\" not found" May 27 14:05:15.809583 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.809564 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/444f839c172d5d32122711f23798b1f0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-198.ec2.internal\" (UID: \"444f839c172d5d32122711f23798b1f0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-198.ec2.internal" May 27 14:05:15.809649 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.809589 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/444f839c172d5d32122711f23798b1f0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-198.ec2.internal\" (UID: \"444f839c172d5d32122711f23798b1f0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-198.ec2.internal" May 27 14:05:15.809649 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.809608 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bdac52c688e8c8ccf183c0f228872be3-config\") pod \"kube-apiserver-proxy-ip-10-0-136-198.ec2.internal\" (UID: \"bdac52c688e8c8ccf183c0f228872be3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-198.ec2.internal" May 27 14:05:15.809716 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.809653 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bdac52c688e8c8ccf183c0f228872be3-config\") pod \"kube-apiserver-proxy-ip-10-0-136-198.ec2.internal\" (UID: \"bdac52c688e8c8ccf183c0f228872be3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-198.ec2.internal" May 27 14:05:15.809716 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.809672 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/444f839c172d5d32122711f23798b1f0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-198.ec2.internal\" (UID: \"444f839c172d5d32122711f23798b1f0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-198.ec2.internal" May 27 14:05:15.809716 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.809680 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/444f839c172d5d32122711f23798b1f0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-198.ec2.internal\" (UID: \"444f839c172d5d32122711f23798b1f0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-198.ec2.internal" May 27 14:05:15.902047 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:15.902013 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-198.ec2.internal\" not found" May 27 14:05:15.970501 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.970473 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-198.ec2.internal" May 27 14:05:15.973287 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:15.973270 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-198.ec2.internal" May 27 14:05:16.002760 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:16.002728 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-198.ec2.internal\" not found" May 27 14:05:16.103354 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:16.103264 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-198.ec2.internal\" not found" May 27 14:05:16.203788 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:16.203734 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-198.ec2.internal\" not found" May 27 14:05:16.304256 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:16.304221 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-198.ec2.internal\" not found" May 27 14:05:16.305312 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:16.305297 2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 27 14:05:16.305445 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:16.305430 2563 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 27 14:05:16.342129 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:16.342095 2563 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 27 14:05:16.378614 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:16.378543 2563 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 27 14:05:16.405238 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:16.405207 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-198.ec2.internal\" not found" May 27 14:05:16.407133 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:16.407115 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 27 14:05:16.422339 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:16.422307 2563 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 27 14:05:16.430636 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:16.430578 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-26 14:00:15 +0000 UTC" deadline="2027-12-01 06:43:28.40413914 +0000 UTC" May 27 14:05:16.430742 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:16.430637 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13264h38m11.973507557s" May 27 14:05:16.455000 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:16.454967 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-l9r6k" May 27 14:05:16.469633 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:16.469608 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-l9r6k" May 27 14:05:16.505546 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:16.505513 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-198.ec2.internal\" not found" May 27 14:05:16.542942 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:16.542915 2563 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 27 14:05:16.599084 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:16.599051 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod444f839c172d5d32122711f23798b1f0.slice/crio-1ab608ff4f308f34192168f338800f62f1d64155689f4eb11c78c206d84ad972 WatchSource:0}: Error finding container 1ab608ff4f308f34192168f338800f62f1d64155689f4eb11c78c206d84ad972: Status 404 returned error can't find the container with id 1ab608ff4f308f34192168f338800f62f1d64155689f4eb11c78c206d84ad972 May 27 14:05:16.599252 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:16.599239 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdac52c688e8c8ccf183c0f228872be3.slice/crio-956a0b162d5e3e28b09a2c8addb342da9659f5c9095fa326de446b75be7f972f WatchSource:0}: Error finding container 956a0b162d5e3e28b09a2c8addb342da9659f5c9095fa326de446b75be7f972f: Status 404 returned error can't find the container with id 956a0b162d5e3e28b09a2c8addb342da9659f5c9095fa326de446b75be7f972f May 27 14:05:16.602692 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:16.602675 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 27 14:05:16.608110 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:16.608070 2563 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-198.ec2.internal" May 27 14:05:16.622610 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:16.622587 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 27 14:05:16.623723 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:16.623710 2563 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-198.ec2.internal" May 27 14:05:16.632854 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:16.632814 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 27 14:05:17.381336 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.381050 2563 apiserver.go:52] "Watching apiserver" May 27 14:05:17.389491 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.389433 2563 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 27 14:05:17.389842 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.389805 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-b8xln","openshift-multus/network-metrics-daemon-txmmd","kube-system/konnectivity-agent-lkbl5","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ng4xc","openshift-image-registry/node-ca-jg92x","openshift-network-diagnostics/network-check-target-wbsgc","openshift-network-operator/iptables-alerter-wb972","openshift-ovn-kubernetes/ovnkube-node-fn9jd","kube-system/kube-apiserver-proxy-ip-10-0-136-198.ec2.internal","openshift-cluster-node-tuning-operator/tuned-27mm9","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-198.ec2.internal","openshift-multus/multus-additional-cni-plugins-tfnv8"] May 27 14:05:17.392552 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.392529 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-b8xln" May 27 14:05:17.396126 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.396106 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 27 14:05:17.396244 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.396137 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-ddpfk\"" May 27 14:05:17.396244 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.396108 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 27 14:05:17.396587 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.396564 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txmmd" May 27 14:05:17.396677 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.396589 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 27 14:05:17.396677 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:17.396642 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txmmd" podUID="3798bdf6-d616-43ed-b727-35b9407c33e7" May 27 14:05:17.396789 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.396756 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 27 14:05:17.398706 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.398686 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lkbl5" May 27 14:05:17.400906 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.400866 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ng4xc" May 27 14:05:17.402036 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.402019 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 27 14:05:17.402249 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.402219 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-ccftl\"" May 27 14:05:17.402358 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.402334 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 27 14:05:17.403165 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.403144 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jg92x" May 27 14:05:17.403401 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.403382 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 27 14:05:17.403742 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.403725 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 27 14:05:17.404093 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.404075 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 27 14:05:17.405027 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.405009 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-672v9\"" May 27 14:05:17.405398 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.405365 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wbsgc" May 27 14:05:17.405499 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:17.405439 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wbsgc" podUID="82e1095b-051d-4cd7-91f4-e3e2200e3812" May 27 14:05:17.406591 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.406574 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 27 14:05:17.407114 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.407090 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-sfs49\"" May 27 14:05:17.407310 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.407293 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 27 14:05:17.407593 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.407573 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wb972" May 27 14:05:17.408393 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.408359 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 27 14:05:17.411449 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.410802 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 27 14:05:17.411449 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.410817 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fn9jd" May 27 14:05:17.411449 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.410811 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-27mm9" May 27 14:05:17.412070 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.412048 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 27 14:05:17.412300 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.412283 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-rbnvp\"" May 27 14:05:17.412507 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.412468 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 27 14:05:17.413532 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.413482 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tfnv8" May 27 14:05:17.414270 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.414250 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 27 14:05:17.414626 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.414604 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-8c6kl\"" May 27 14:05:17.414788 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.414769 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 27 14:05:17.414867 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.414773 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-l5426\"" May 27 14:05:17.417270 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.417248 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 27 14:05:17.417359 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.417276 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 27 14:05:17.417359 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.417339 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 27 14:05:17.417492 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.417471 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 27 14:05:17.417586 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.417491 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 27 14:05:17.417586 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.417546 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 27 14:05:17.417586 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.417479 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 27 14:05:17.417690 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.417547 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 27 14:05:17.417775 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.417759 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-bnt65\"" May 27 14:05:17.418837 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.418817 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3ebbf10f-4f07-403c-93b2-97261749308d-systemd-units\") pod \"ovnkube-node-fn9jd\" (UID: \"3ebbf10f-4f07-403c-93b2-97261749308d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn9jd" May 27 14:05:17.418957 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.418851 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3ebbf10f-4f07-403c-93b2-97261749308d-env-overrides\") pod \"ovnkube-node-fn9jd\" (UID: \"3ebbf10f-4f07-403c-93b2-97261749308d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn9jd" May 27 14:05:17.418957 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.418880 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3ebbf10f-4f07-403c-93b2-97261749308d-ovn-node-metrics-cert\") pod \"ovnkube-node-fn9jd\" (UID: \"3ebbf10f-4f07-403c-93b2-97261749308d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn9jd" May 27 14:05:17.418957 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.418925 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r749p\" (UniqueName: \"kubernetes.io/projected/3ebbf10f-4f07-403c-93b2-97261749308d-kube-api-access-r749p\") pod \"ovnkube-node-fn9jd\" (UID: \"3ebbf10f-4f07-403c-93b2-97261749308d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn9jd" May 27 14:05:17.418957 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.418950 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf9dc0c7-ad34-420e-bb88-13ce42450ed0-host-var-lib-kubelet\") pod \"multus-b8xln\" (UID: \"bf9dc0c7-ad34-420e-bb88-13ce42450ed0\") " pod="openshift-multus/multus-b8xln" May 27 14:05:17.419154 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.418991 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3798bdf6-d616-43ed-b727-35b9407c33e7-metrics-certs\") pod \"network-metrics-daemon-txmmd\" (UID: \"3798bdf6-d616-43ed-b727-35b9407c33e7\") " pod="openshift-multus/network-metrics-daemon-txmmd" May 27 14:05:17.419154 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.419023 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e0c55f03-86a3-4759-9e7c-5cf53d4ea59d-konnectivity-ca\") pod \"konnectivity-agent-lkbl5\" (UID: \"e0c55f03-86a3-4759-9e7c-5cf53d4ea59d\") " pod="kube-system/konnectivity-agent-lkbl5" May 27 14:05:17.419154 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.419056 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3ebbf10f-4f07-403c-93b2-97261749308d-run-ovn\") pod \"ovnkube-node-fn9jd\" (UID: \"3ebbf10f-4f07-403c-93b2-97261749308d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn9jd" May 27 14:05:17.419154 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.419079 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3ebbf10f-4f07-403c-93b2-97261749308d-host-cni-bin\") pod \"ovnkube-node-fn9jd\" (UID: \"3ebbf10f-4f07-403c-93b2-97261749308d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn9jd" May 27 14:05:17.419154 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.419101 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vhb9\" (UniqueName: \"kubernetes.io/projected/bf9dc0c7-ad34-420e-bb88-13ce42450ed0-kube-api-access-7vhb9\") pod \"multus-b8xln\" (UID: \"bf9dc0c7-ad34-420e-bb88-13ce42450ed0\") " pod="openshift-multus/multus-b8xln" May 27 14:05:17.419154 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.419142 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e0c55f03-86a3-4759-9e7c-5cf53d4ea59d-agent-certs\") pod \"konnectivity-agent-lkbl5\" (UID: \"e0c55f03-86a3-4759-9e7c-5cf53d4ea59d\") " pod="kube-system/konnectivity-agent-lkbl5" May 27 14:05:17.419426 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.419166 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h47gk\" (UniqueName: \"kubernetes.io/projected/d5c39783-e332-4bc0-afe8-a3c254946252-kube-api-access-h47gk\") pod \"iptables-alerter-wb972\" (UID: \"d5c39783-e332-4bc0-afe8-a3c254946252\") " pod="openshift-network-operator/iptables-alerter-wb972" May 27 14:05:17.419426 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.419190 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ebbf10f-4f07-403c-93b2-97261749308d-run-openvswitch\") pod \"ovnkube-node-fn9jd\" (UID: \"3ebbf10f-4f07-403c-93b2-97261749308d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn9jd" May 27 14:05:17.419426 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.419214 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3ebbf10f-4f07-403c-93b2-97261749308d-log-socket\") pod \"ovnkube-node-fn9jd\" (UID: \"3ebbf10f-4f07-403c-93b2-97261749308d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn9jd" May 27 14:05:17.419426 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.419255 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57krs\" (UniqueName: \"kubernetes.io/projected/3798bdf6-d616-43ed-b727-35b9407c33e7-kube-api-access-57krs\") pod \"network-metrics-daemon-txmmd\" (UID: \"3798bdf6-d616-43ed-b727-35b9407c33e7\") " pod="openshift-multus/network-metrics-daemon-txmmd" May 27 14:05:17.419426 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.419293 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ebbf10f-4f07-403c-93b2-97261749308d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fn9jd\" (UID: \"3ebbf10f-4f07-403c-93b2-97261749308d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn9jd" May 27 14:05:17.419426 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.419325 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3ebbf10f-4f07-403c-93b2-97261749308d-host-slash\") pod \"ovnkube-node-fn9jd\" (UID: \"3ebbf10f-4f07-403c-93b2-97261749308d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn9jd" May 27 14:05:17.419426 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.419349 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bf9dc0c7-ad34-420e-bb88-13ce42450ed0-multus-daemon-config\") pod \"multus-b8xln\" (UID: \"bf9dc0c7-ad34-420e-bb88-13ce42450ed0\") " pod="openshift-multus/multus-b8xln" May 27 14:05:17.419426 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.419373 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bf9dc0c7-ad34-420e-bb88-13ce42450ed0-multus-conf-dir\") pod \"multus-b8xln\" (UID: \"bf9dc0c7-ad34-420e-bb88-13ce42450ed0\") " pod="openshift-multus/multus-b8xln" May 27 14:05:17.419426 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.419396 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1b57d88e-c349-4d40-92b8-757ec7474dc4-device-dir\") pod \"aws-ebs-csi-driver-node-ng4xc\" (UID: \"1b57d88e-c349-4d40-92b8-757ec7474dc4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ng4xc" May 27 14:05:17.419426 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.419420 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bf9dc0c7-ad34-420e-bb88-13ce42450ed0-system-cni-dir\") pod \"multus-b8xln\" (UID: \"bf9dc0c7-ad34-420e-bb88-13ce42450ed0\") " pod="openshift-multus/multus-b8xln" May 27 14:05:17.419877 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.419460 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bf9dc0c7-ad34-420e-bb88-13ce42450ed0-cni-binary-copy\") pod \"multus-b8xln\" (UID: \"bf9dc0c7-ad34-420e-bb88-13ce42450ed0\") " pod="openshift-multus/multus-b8xln" May 27 14:05:17.419877 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.419495 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bf9dc0c7-ad34-420e-bb88-13ce42450ed0-host-run-netns\") pod \"multus-b8xln\" (UID: \"bf9dc0c7-ad34-420e-bb88-13ce42450ed0\") " pod="openshift-multus/multus-b8xln" May 27 14:05:17.419877 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.419522 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1b57d88e-c349-4d40-92b8-757ec7474dc4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ng4xc\" (UID: \"1b57d88e-c349-4d40-92b8-757ec7474dc4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ng4xc" May 27 14:05:17.419877 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.419547 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1eeeff09-f3c8-453d-b9ca-d074d2cb10c8-host\") pod \"node-ca-jg92x\" (UID: \"1eeeff09-f3c8-453d-b9ca-d074d2cb10c8\") " pod="openshift-image-registry/node-ca-jg92x" May 27 14:05:17.419877 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.419572 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3ebbf10f-4f07-403c-93b2-97261749308d-ovnkube-config\") pod \"ovnkube-node-fn9jd\" (UID: \"3ebbf10f-4f07-403c-93b2-97261749308d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn9jd" May 27 14:05:17.419877 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.419606 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bf9dc0c7-ad34-420e-bb88-13ce42450ed0-cnibin\") pod \"multus-b8xln\" (UID: \"bf9dc0c7-ad34-420e-bb88-13ce42450ed0\") " pod="openshift-multus/multus-b8xln" May 27 14:05:17.419877 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.419642 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ebbf10f-4f07-403c-93b2-97261749308d-var-lib-openvswitch\") pod \"ovnkube-node-fn9jd\" (UID: \"3ebbf10f-4f07-403c-93b2-97261749308d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn9jd" May 27 14:05:17.419877 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.419675 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ebbf10f-4f07-403c-93b2-97261749308d-etc-openvswitch\") pod \"ovnkube-node-fn9jd\" (UID: \"3ebbf10f-4f07-403c-93b2-97261749308d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn9jd" May 27 14:05:17.419877 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.419700 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ebbf10f-4f07-403c-93b2-97261749308d-host-run-ovn-kubernetes\") pod \"ovnkube-node-fn9jd\" (UID: \"3ebbf10f-4f07-403c-93b2-97261749308d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn9jd" May 27 14:05:17.419877 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.419728 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ebbf10f-4f07-403c-93b2-97261749308d-host-kubelet\") pod \"ovnkube-node-fn9jd\" (UID: \"3ebbf10f-4f07-403c-93b2-97261749308d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn9jd" May 27 14:05:17.419877 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.419753 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bf9dc0c7-ad34-420e-bb88-13ce42450ed0-multus-socket-dir-parent\") pod \"multus-b8xln\" (UID: \"bf9dc0c7-ad34-420e-bb88-13ce42450ed0\") " pod="openshift-multus/multus-b8xln" May 27 14:05:17.419877 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.419790 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2mq9\" (UniqueName: \"kubernetes.io/projected/1b57d88e-c349-4d40-92b8-757ec7474dc4-kube-api-access-j2mq9\") pod \"aws-ebs-csi-driver-node-ng4xc\" (UID: \"1b57d88e-c349-4d40-92b8-757ec7474dc4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ng4xc" May 27 14:05:17.419877 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.419812 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bf9dc0c7-ad34-420e-bb88-13ce42450ed0-host-var-lib-cni-bin\") pod \"multus-b8xln\" (UID: \"bf9dc0c7-ad34-420e-bb88-13ce42450ed0\") " pod="openshift-multus/multus-b8xln" May 27 14:05:17.419877 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.419835 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bf9dc0c7-ad34-420e-bb88-13ce42450ed0-host-run-multus-certs\") pod \"multus-b8xln\" (UID: \"bf9dc0c7-ad34-420e-bb88-13ce42450ed0\") " pod="openshift-multus/multus-b8xln" May 27 14:05:17.419877 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.419856 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1b57d88e-c349-4d40-92b8-757ec7474dc4-socket-dir\") pod \"aws-ebs-csi-driver-node-ng4xc\" (UID: \"1b57d88e-c349-4d40-92b8-757ec7474dc4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ng4xc" May 27 14:05:17.420679 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.419887 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1b57d88e-c349-4d40-92b8-757ec7474dc4-etc-selinux\") pod \"aws-ebs-csi-driver-node-ng4xc\" (UID: \"1b57d88e-c349-4d40-92b8-757ec7474dc4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ng4xc" May 27 14:05:17.420679 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.419926 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54nnm\" (UniqueName: \"kubernetes.io/projected/1eeeff09-f3c8-453d-b9ca-d074d2cb10c8-kube-api-access-54nnm\") pod \"node-ca-jg92x\" (UID: \"1eeeff09-f3c8-453d-b9ca-d074d2cb10c8\") " pod="openshift-image-registry/node-ca-jg92x" May 27 14:05:17.420679 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.419988 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3ebbf10f-4f07-403c-93b2-97261749308d-host-run-netns\") pod \"ovnkube-node-fn9jd\" (UID: \"3ebbf10f-4f07-403c-93b2-97261749308d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn9jd" May 27 14:05:17.420679 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.420012 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bf9dc0c7-ad34-420e-bb88-13ce42450ed0-multus-cni-dir\") pod \"multus-b8xln\" (UID: \"bf9dc0c7-ad34-420e-bb88-13ce42450ed0\") " pod="openshift-multus/multus-b8xln" May 27 14:05:17.420679 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.420038 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3ebbf10f-4f07-403c-93b2-97261749308d-run-systemd\") pod \"ovnkube-node-fn9jd\" (UID: \"3ebbf10f-4f07-403c-93b2-97261749308d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn9jd" May 27 14:05:17.420679 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.420077 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3ebbf10f-4f07-403c-93b2-97261749308d-node-log\") pod \"ovnkube-node-fn9jd\" (UID: \"3ebbf10f-4f07-403c-93b2-97261749308d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn9jd" May 27 14:05:17.420679 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.420102 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bf9dc0c7-ad34-420e-bb88-13ce42450ed0-hostroot\") pod \"multus-b8xln\" (UID: \"bf9dc0c7-ad34-420e-bb88-13ce42450ed0\") " pod="openshift-multus/multus-b8xln" May 27 14:05:17.420679 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.420128 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1b57d88e-c349-4d40-92b8-757ec7474dc4-registration-dir\") pod \"aws-ebs-csi-driver-node-ng4xc\" (UID: \"1b57d88e-c349-4d40-92b8-757ec7474dc4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ng4xc" May 27 14:05:17.420679 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.420152 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1eeeff09-f3c8-453d-b9ca-d074d2cb10c8-serviceca\") pod \"node-ca-jg92x\" (UID: \"1eeeff09-f3c8-453d-b9ca-d074d2cb10c8\") " pod="openshift-image-registry/node-ca-jg92x" May 27 14:05:17.420679 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.420175 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d5c39783-e332-4bc0-afe8-a3c254946252-host-slash\") pod \"iptables-alerter-wb972\" (UID: \"d5c39783-e332-4bc0-afe8-a3c254946252\") " pod="openshift-network-operator/iptables-alerter-wb972" May 27 14:05:17.420679 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.420204 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3ebbf10f-4f07-403c-93b2-97261749308d-ovnkube-script-lib\") pod \"ovnkube-node-fn9jd\" (UID: \"3ebbf10f-4f07-403c-93b2-97261749308d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn9jd" May 27 14:05:17.420679 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.420225 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bf9dc0c7-ad34-420e-bb88-13ce42450ed0-host-var-lib-cni-multus\") pod \"multus-b8xln\" (UID: \"bf9dc0c7-ad34-420e-bb88-13ce42450ed0\") " pod="openshift-multus/multus-b8xln" May 27 14:05:17.420679 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.420239 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d5c39783-e332-4bc0-afe8-a3c254946252-iptables-alerter-script\") pod \"iptables-alerter-wb972\" (UID: \"d5c39783-e332-4bc0-afe8-a3c254946252\") " pod="openshift-network-operator/iptables-alerter-wb972" May 27 14:05:17.420679 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.420255 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bf9dc0c7-ad34-420e-bb88-13ce42450ed0-os-release\") pod \"multus-b8xln\" (UID: \"bf9dc0c7-ad34-420e-bb88-13ce42450ed0\") " pod="openshift-multus/multus-b8xln" May 27 14:05:17.420679 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.420277 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf9dc0c7-ad34-420e-bb88-13ce42450ed0-etc-kubernetes\") pod \"multus-b8xln\" (UID: \"bf9dc0c7-ad34-420e-bb88-13ce42450ed0\") " pod="openshift-multus/multus-b8xln" May 27 14:05:17.420679 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.420295 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blzm7\" (UniqueName: \"kubernetes.io/projected/82e1095b-051d-4cd7-91f4-e3e2200e3812-kube-api-access-blzm7\") pod \"network-check-target-wbsgc\" (UID: \"82e1095b-051d-4cd7-91f4-e3e2200e3812\") " pod="openshift-network-diagnostics/network-check-target-wbsgc" May 27 14:05:17.421395 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.420311 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1b57d88e-c349-4d40-92b8-757ec7474dc4-sys-fs\") pod \"aws-ebs-csi-driver-node-ng4xc\" (UID: \"1b57d88e-c349-4d40-92b8-757ec7474dc4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ng4xc" May 27 14:05:17.421395 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.420336 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3ebbf10f-4f07-403c-93b2-97261749308d-host-cni-netd\") pod \"ovnkube-node-fn9jd\" (UID: \"3ebbf10f-4f07-403c-93b2-97261749308d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn9jd" May 27 14:05:17.421395 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.420380 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bf9dc0c7-ad34-420e-bb88-13ce42450ed0-host-run-k8s-cni-cncf-io\") pod \"multus-b8xln\" (UID: \"bf9dc0c7-ad34-420e-bb88-13ce42450ed0\") " pod="openshift-multus/multus-b8xln" May 27 14:05:17.470531 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.470495 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-26 14:00:16 +0000 UTC" deadline="2027-12-15 17:18:35.221851144 +0000 UTC" May 27 14:05:17.470531 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.470530 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13611h13m17.751324587s" May 27 14:05:17.508057 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.508025 2563 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 27 14:05:17.520623 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.520570 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3ebbf10f-4f07-403c-93b2-97261749308d-systemd-units\") pod \"ovnkube-node-fn9jd\" (UID: \"3ebbf10f-4f07-403c-93b2-97261749308d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn9jd" May 27 14:05:17.520623 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.520620 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3ebbf10f-4f07-403c-93b2-97261749308d-env-overrides\") pod \"ovnkube-node-fn9jd\" (UID: \"3ebbf10f-4f07-403c-93b2-97261749308d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn9jd" May 27 14:05:17.520839 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.520646 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3ebbf10f-4f07-403c-93b2-97261749308d-ovn-node-metrics-cert\") pod \"ovnkube-node-fn9jd\" (UID: \"3ebbf10f-4f07-403c-93b2-97261749308d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn9jd" May 27 14:05:17.520839 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.520655 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3ebbf10f-4f07-403c-93b2-97261749308d-systemd-units\") pod \"ovnkube-node-fn9jd\" (UID: \"3ebbf10f-4f07-403c-93b2-97261749308d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn9jd" May 27 14:05:17.520839 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.520673 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r749p\" (UniqueName: \"kubernetes.io/projected/3ebbf10f-4f07-403c-93b2-97261749308d-kube-api-access-r749p\") pod \"ovnkube-node-fn9jd\" (UID: \"3ebbf10f-4f07-403c-93b2-97261749308d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn9jd" May 27 14:05:17.520839 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.520709 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf9dc0c7-ad34-420e-bb88-13ce42450ed0-host-var-lib-kubelet\") pod \"multus-b8xln\" (UID: \"bf9dc0c7-ad34-420e-bb88-13ce42450ed0\") " pod="openshift-multus/multus-b8xln" May 27 14:05:17.520839 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.520726 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3798bdf6-d616-43ed-b727-35b9407c33e7-metrics-certs\") pod \"network-metrics-daemon-txmmd\" (UID: \"3798bdf6-d616-43ed-b727-35b9407c33e7\") " pod="openshift-multus/network-metrics-daemon-txmmd" May 27 14:05:17.520839 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.520740 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e0c55f03-86a3-4759-9e7c-5cf53d4ea59d-konnectivity-ca\") pod \"konnectivity-agent-lkbl5\" (UID: \"e0c55f03-86a3-4759-9e7c-5cf53d4ea59d\") " pod="kube-system/konnectivity-agent-lkbl5" May 27 14:05:17.520839 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.520776 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dec3c402-9050-47e4-8002-9068ecb2ac0e-run\") pod \"tuned-27mm9\" (UID: \"dec3c402-9050-47e4-8002-9068ecb2ac0e\") " pod="openshift-cluster-node-tuning-operator/tuned-27mm9" May 27 14:05:17.520839 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.520801 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3ebbf10f-4f07-403c-93b2-97261749308d-run-ovn\") pod \"ovnkube-node-fn9jd\" (UID: \"3ebbf10f-4f07-403c-93b2-97261749308d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn9jd" May 27 14:05:17.520839 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.520820 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3ebbf10f-4f07-403c-93b2-97261749308d-host-cni-bin\") pod \"ovnkube-node-fn9jd\" (UID: \"3ebbf10f-4f07-403c-93b2-97261749308d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn9jd" May 27 14:05:17.521263 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.520859 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7vhb9\" (UniqueName: \"kubernetes.io/projected/bf9dc0c7-ad34-420e-bb88-13ce42450ed0-kube-api-access-7vhb9\") pod \"multus-b8xln\" (UID: \"bf9dc0c7-ad34-420e-bb88-13ce42450ed0\") " pod="openshift-multus/multus-b8xln" May 27 14:05:17.521263 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.520909 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e0c55f03-86a3-4759-9e7c-5cf53d4ea59d-agent-certs\") pod \"konnectivity-agent-lkbl5\" (UID: \"e0c55f03-86a3-4759-9e7c-5cf53d4ea59d\") " pod="kube-system/konnectivity-agent-lkbl5" May 27 14:05:17.521263 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.520947 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h47gk\" (UniqueName: \"kubernetes.io/projected/d5c39783-e332-4bc0-afe8-a3c254946252-kube-api-access-h47gk\") pod \"iptables-alerter-wb972\" (UID: \"d5c39783-e332-4bc0-afe8-a3c254946252\") " pod="openshift-network-operator/iptables-alerter-wb972" May 27 14:05:17.521263 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.520967 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0b4d0670-6986-4085-a211-e22549067d90-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tfnv8\" (UID: \"0b4d0670-6986-4085-a211-e22549067d90\") " pod="openshift-multus/multus-additional-cni-plugins-tfnv8" May 27 14:05:17.521263 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.521007 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ebbf10f-4f07-403c-93b2-97261749308d-run-openvswitch\") pod \"ovnkube-node-fn9jd\" (UID: \"3ebbf10f-4f07-403c-93b2-97261749308d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn9jd" May 27 14:05:17.521263 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.521067 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3ebbf10f-4f07-403c-93b2-97261749308d-log-socket\") pod \"ovnkube-node-fn9jd\" (UID: \"3ebbf10f-4f07-403c-93b2-97261749308d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn9jd" May 27 14:05:17.521263 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:17.521252 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 14:05:17.521574 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:17.521318 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3798bdf6-d616-43ed-b727-35b9407c33e7-metrics-certs podName:3798bdf6-d616-43ed-b727-35b9407c33e7 nodeName:}" failed. No retries permitted until 2026-05-27 14:05:18.021295274 +0000 UTC m=+3.121612240 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3798bdf6-d616-43ed-b727-35b9407c33e7-metrics-certs") pod "network-metrics-daemon-txmmd" (UID: "3798bdf6-d616-43ed-b727-35b9407c33e7") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 14:05:17.521574 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.521561 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e0c55f03-86a3-4759-9e7c-5cf53d4ea59d-konnectivity-ca\") pod \"konnectivity-agent-lkbl5\" (UID: \"e0c55f03-86a3-4759-9e7c-5cf53d4ea59d\") " pod="kube-system/konnectivity-agent-lkbl5" May 27 14:05:17.521689 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.521575 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ebbf10f-4f07-403c-93b2-97261749308d-run-openvswitch\") pod \"ovnkube-node-fn9jd\" (UID: \"3ebbf10f-4f07-403c-93b2-97261749308d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn9jd" May 27 14:05:17.521689 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.521634 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3ebbf10f-4f07-403c-93b2-97261749308d-run-ovn\") pod \"ovnkube-node-fn9jd\" (UID: \"3ebbf10f-4f07-403c-93b2-97261749308d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn9jd" May 27 14:05:17.521689 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.521682 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3ebbf10f-4f07-403c-93b2-97261749308d-host-cni-bin\") pod \"ovnkube-node-fn9jd\" (UID: \"3ebbf10f-4f07-403c-93b2-97261749308d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn9jd" May 27 14:05:17.521827 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.521702 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3ebbf10f-4f07-403c-93b2-97261749308d-log-socket\") pod \"ovnkube-node-fn9jd\" (UID: \"3ebbf10f-4f07-403c-93b2-97261749308d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn9jd" May 27 14:05:17.521827 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.521730 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf9dc0c7-ad34-420e-bb88-13ce42450ed0-host-var-lib-kubelet\") pod \"multus-b8xln\" (UID: \"bf9dc0c7-ad34-420e-bb88-13ce42450ed0\") " pod="openshift-multus/multus-b8xln" May 27 14:05:17.522202 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.522085 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-57krs\" (UniqueName: \"kubernetes.io/projected/3798bdf6-d616-43ed-b727-35b9407c33e7-kube-api-access-57krs\") pod \"network-metrics-daemon-txmmd\" (UID: \"3798bdf6-d616-43ed-b727-35b9407c33e7\") " pod="openshift-multus/network-metrics-daemon-txmmd" May 27 14:05:17.522202 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.522142 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ebbf10f-4f07-403c-93b2-97261749308d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fn9jd\" (UID: \"3ebbf10f-4f07-403c-93b2-97261749308d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn9jd" May 27 14:05:17.522334 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.522225 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ebbf10f-4f07-403c-93b2-97261749308d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fn9jd\" (UID: \"3ebbf10f-4f07-403c-93b2-97261749308d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn9jd" May 27 14:05:17.522431 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.522411 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3ebbf10f-4f07-403c-93b2-97261749308d-host-slash\") pod \"ovnkube-node-fn9jd\" (UID: \"3ebbf10f-4f07-403c-93b2-97261749308d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn9jd" May 27 14:05:17.522555 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.522523 2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 27 14:05:17.522729 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.522177 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3ebbf10f-4f07-403c-93b2-97261749308d-host-slash\") pod \"ovnkube-node-fn9jd\" (UID: \"3ebbf10f-4f07-403c-93b2-97261749308d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn9jd" May 27 14:05:17.522786 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.522749 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bf9dc0c7-ad34-420e-bb88-13ce42450ed0-multus-daemon-config\") pod \"multus-b8xln\" (UID: \"bf9dc0c7-ad34-420e-bb88-13ce42450ed0\") " pod="openshift-multus/multus-b8xln" May 27 14:05:17.522786 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.522776 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phtms\" (UniqueName: \"kubernetes.io/projected/0b4d0670-6986-4085-a211-e22549067d90-kube-api-access-phtms\") pod \"multus-additional-cni-plugins-tfnv8\" (UID: \"0b4d0670-6986-4085-a211-e22549067d90\") " pod="openshift-multus/multus-additional-cni-plugins-tfnv8" May 27 14:05:17.522881 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.522794 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bf9dc0c7-ad34-420e-bb88-13ce42450ed0-multus-conf-dir\") pod \"multus-b8xln\" (UID: \"bf9dc0c7-ad34-420e-bb88-13ce42450ed0\") " pod="openshift-multus/multus-b8xln" May 27 14:05:17.522881 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.522813 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1b57d88e-c349-4d40-92b8-757ec7474dc4-device-dir\") pod \"aws-ebs-csi-driver-node-ng4xc\" (UID: \"1b57d88e-c349-4d40-92b8-757ec7474dc4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ng4xc" May 27 14:05:17.523008 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.522917 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dec3c402-9050-47e4-8002-9068ecb2ac0e-etc-tuned\") pod \"tuned-27mm9\" (UID: \"dec3c402-9050-47e4-8002-9068ecb2ac0e\") " pod="openshift-cluster-node-tuning-operator/tuned-27mm9" May 27 14:05:17.523930 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.523870 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bf9dc0c7-ad34-420e-bb88-13ce42450ed0-system-cni-dir\") pod \"multus-b8xln\" (UID: \"bf9dc0c7-ad34-420e-bb88-13ce42450ed0\") " pod="openshift-multus/multus-b8xln" May 27 14:05:17.524012 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.522872 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3ebbf10f-4f07-403c-93b2-97261749308d-env-overrides\") pod \"ovnkube-node-fn9jd\" (UID: \"3ebbf10f-4f07-403c-93b2-97261749308d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn9jd" May 27 14:05:17.524012 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.523987 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bf9dc0c7-ad34-420e-bb88-13ce42450ed0-cni-binary-copy\") pod \"multus-b8xln\" (UID: \"bf9dc0c7-ad34-420e-bb88-13ce42450ed0\") " pod="openshift-multus/multus-b8xln" May 27 14:05:17.524012 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.524002 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1b57d88e-c349-4d40-92b8-757ec7474dc4-device-dir\") pod \"aws-ebs-csi-driver-node-ng4xc\" (UID: \"1b57d88e-c349-4d40-92b8-757ec7474dc4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ng4xc" May 27 14:05:17.524133 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.524033 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dec3c402-9050-47e4-8002-9068ecb2ac0e-etc-sysconfig\") pod \"tuned-27mm9\" (UID: \"dec3c402-9050-47e4-8002-9068ecb2ac0e\") " pod="openshift-cluster-node-tuning-operator/tuned-27mm9" May 27 14:05:17.524133 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.524069 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0b4d0670-6986-4085-a211-e22549067d90-system-cni-dir\") pod \"multus-additional-cni-plugins-tfnv8\" (UID: \"0b4d0670-6986-4085-a211-e22549067d90\") " pod="openshift-multus/multus-additional-cni-plugins-tfnv8" May 27 14:05:17.524133 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.524119 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0b4d0670-6986-4085-a211-e22549067d90-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tfnv8\" (UID: \"0b4d0670-6986-4085-a211-e22549067d90\") " pod="openshift-multus/multus-additional-cni-plugins-tfnv8" May 27 14:05:17.524273 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.524212 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bf9dc0c7-ad34-420e-bb88-13ce42450ed0-host-run-netns\") pod \"multus-b8xln\" (UID: \"bf9dc0c7-ad34-420e-bb88-13ce42450ed0\") " pod="openshift-multus/multus-b8xln" May 27 14:05:17.524328 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.524286 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1b57d88e-c349-4d40-92b8-757ec7474dc4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ng4xc\" (UID: \"1b57d88e-c349-4d40-92b8-757ec7474dc4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ng4xc" May 27 14:05:17.524382 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.524333 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1eeeff09-f3c8-453d-b9ca-d074d2cb10c8-host\") pod \"node-ca-jg92x\" (UID: \"1eeeff09-f3c8-453d-b9ca-d074d2cb10c8\") " pod="openshift-image-registry/node-ca-jg92x" May 27 14:05:17.524382 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.524367 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dec3c402-9050-47e4-8002-9068ecb2ac0e-sys\") pod \"tuned-27mm9\" (UID: \"dec3c402-9050-47e4-8002-9068ecb2ac0e\") " pod="openshift-cluster-node-tuning-operator/tuned-27mm9" May 27 14:05:17.524478 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.524404 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3ebbf10f-4f07-403c-93b2-97261749308d-ovnkube-config\") pod \"ovnkube-node-fn9jd\" (UID: \"3ebbf10f-4f07-403c-93b2-97261749308d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn9jd" May 27 14:05:17.524478 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.524425 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bf9dc0c7-ad34-420e-bb88-13ce42450ed0-cnibin\") pod \"multus-b8xln\" (UID: \"bf9dc0c7-ad34-420e-bb88-13ce42450ed0\") " pod="openshift-multus/multus-b8xln" May 27 14:05:17.525879 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.524650 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1eeeff09-f3c8-453d-b9ca-d074d2cb10c8-host\") pod \"node-ca-jg92x\" (UID: \"1eeeff09-f3c8-453d-b9ca-d074d2cb10c8\") " pod="openshift-image-registry/node-ca-jg92x" May 27 14:05:17.525879 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.524760 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bf9dc0c7-ad34-420e-bb88-13ce42450ed0-multus-daemon-config\") pod \"multus-b8xln\" (UID: \"bf9dc0c7-ad34-420e-bb88-13ce42450ed0\") " pod="openshift-multus/multus-b8xln" May 27 14:05:17.525879 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.524780 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bf9dc0c7-ad34-420e-bb88-13ce42450ed0-host-run-netns\") pod \"multus-b8xln\" (UID: \"bf9dc0c7-ad34-420e-bb88-13ce42450ed0\") " pod="openshift-multus/multus-b8xln" May 27 14:05:17.525879 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.524873 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1b57d88e-c349-4d40-92b8-757ec7474dc4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ng4xc\" (UID: \"1b57d88e-c349-4d40-92b8-757ec7474dc4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ng4xc" May 27 14:05:17.525879 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.524876 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bf9dc0c7-ad34-420e-bb88-13ce42450ed0-cni-binary-copy\") pod \"multus-b8xln\" (UID: \"bf9dc0c7-ad34-420e-bb88-13ce42450ed0\") " pod="openshift-multus/multus-b8xln" May 27 14:05:17.525879 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.525001 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bf9dc0c7-ad34-420e-bb88-13ce42450ed0-system-cni-dir\") pod \"multus-b8xln\" (UID: \"bf9dc0c7-ad34-420e-bb88-13ce42450ed0\") " pod="openshift-multus/multus-b8xln" May 27 14:05:17.525879 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.525082 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bf9dc0c7-ad34-420e-bb88-13ce42450ed0-cnibin\") pod \"multus-b8xln\" (UID: \"bf9dc0c7-ad34-420e-bb88-13ce42450ed0\") " pod="openshift-multus/multus-b8xln" May 27 14:05:17.525879 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.525128 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ebbf10f-4f07-403c-93b2-97261749308d-var-lib-openvswitch\") pod \"ovnkube-node-fn9jd\" (UID: \"3ebbf10f-4f07-403c-93b2-97261749308d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn9jd" May 27 14:05:17.525879 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.525157 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ebbf10f-4f07-403c-93b2-97261749308d-etc-openvswitch\") pod \"ovnkube-node-fn9jd\" (UID: \"3ebbf10f-4f07-403c-93b2-97261749308d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn9jd" May 27 14:05:17.525879 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.525189 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ebbf10f-4f07-403c-93b2-97261749308d-host-run-ovn-kubernetes\") pod \"ovnkube-node-fn9jd\" (UID: \"3ebbf10f-4f07-403c-93b2-97261749308d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn9jd" May 27 14:05:17.525879 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.525248 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0b4d0670-6986-4085-a211-e22549067d90-cni-binary-copy\") pod \"multus-additional-cni-plugins-tfnv8\" (UID: \"0b4d0670-6986-4085-a211-e22549067d90\") " pod="openshift-multus/multus-additional-cni-plugins-tfnv8" May 27 14:05:17.525879 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.525285 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ebbf10f-4f07-403c-93b2-97261749308d-host-kubelet\") pod \"ovnkube-node-fn9jd\" (UID: \"3ebbf10f-4f07-403c-93b2-97261749308d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn9jd" May 27 14:05:17.525879 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.525317 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bf9dc0c7-ad34-420e-bb88-13ce42450ed0-multus-socket-dir-parent\") pod \"multus-b8xln\" (UID: \"bf9dc0c7-ad34-420e-bb88-13ce42450ed0\") " pod="openshift-multus/multus-b8xln" May 27 14:05:17.525879 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.525326 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3ebbf10f-4f07-403c-93b2-97261749308d-ovnkube-config\") pod \"ovnkube-node-fn9jd\" (UID: \"3ebbf10f-4f07-403c-93b2-97261749308d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn9jd" May 27 14:05:17.525879 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.525349 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j2mq9\" (UniqueName: \"kubernetes.io/projected/1b57d88e-c349-4d40-92b8-757ec7474dc4-kube-api-access-j2mq9\") pod \"aws-ebs-csi-driver-node-ng4xc\" (UID: \"1b57d88e-c349-4d40-92b8-757ec7474dc4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ng4xc" May 27 14:05:17.525879 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.525391 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bf9dc0c7-ad34-420e-bb88-13ce42450ed0-host-var-lib-cni-bin\") pod \"multus-b8xln\" (UID: \"bf9dc0c7-ad34-420e-bb88-13ce42450ed0\") " pod="openshift-multus/multus-b8xln" May 27 14:05:17.525879 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.525430 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ebbf10f-4f07-403c-93b2-97261749308d-etc-openvswitch\") pod \"ovnkube-node-fn9jd\" (UID: \"3ebbf10f-4f07-403c-93b2-97261749308d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn9jd" May 27 14:05:17.525879 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.525605 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ebbf10f-4f07-403c-93b2-97261749308d-host-kubelet\") pod \"ovnkube-node-fn9jd\" (UID: \"3ebbf10f-4f07-403c-93b2-97261749308d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn9jd" May 27 14:05:17.526686 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.525679 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bf9dc0c7-ad34-420e-bb88-13ce42450ed0-multus-socket-dir-parent\") pod \"multus-b8xln\" (UID: \"bf9dc0c7-ad34-420e-bb88-13ce42450ed0\") " pod="openshift-multus/multus-b8xln" May 27 14:05:17.526686 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.525724 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bf9dc0c7-ad34-420e-bb88-13ce42450ed0-host-var-lib-cni-bin\") pod \"multus-b8xln\" (UID: \"bf9dc0c7-ad34-420e-bb88-13ce42450ed0\") " pod="openshift-multus/multus-b8xln" May 27 14:05:17.526686 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.525763 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bf9dc0c7-ad34-420e-bb88-13ce42450ed0-host-run-multus-certs\") pod \"multus-b8xln\" (UID: \"bf9dc0c7-ad34-420e-bb88-13ce42450ed0\") " pod="openshift-multus/multus-b8xln" May 27 14:05:17.526686 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.525822 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ebbf10f-4f07-403c-93b2-97261749308d-var-lib-openvswitch\") pod \"ovnkube-node-fn9jd\" (UID: \"3ebbf10f-4f07-403c-93b2-97261749308d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn9jd" May 27 14:05:17.526686 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.525826 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ebbf10f-4f07-403c-93b2-97261749308d-host-run-ovn-kubernetes\") pod \"ovnkube-node-fn9jd\" (UID: \"3ebbf10f-4f07-403c-93b2-97261749308d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn9jd" May 27 14:05:17.526686 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.525861 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1b57d88e-c349-4d40-92b8-757ec7474dc4-socket-dir\") pod \"aws-ebs-csi-driver-node-ng4xc\" (UID: \"1b57d88e-c349-4d40-92b8-757ec7474dc4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ng4xc" May 27 14:05:17.526686 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.525918 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1b57d88e-c349-4d40-92b8-757ec7474dc4-etc-selinux\") pod \"aws-ebs-csi-driver-node-ng4xc\" (UID: \"1b57d88e-c349-4d40-92b8-757ec7474dc4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ng4xc" May 27 14:05:17.526686 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.525978 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bf9dc0c7-ad34-420e-bb88-13ce42450ed0-host-run-multus-certs\") pod \"multus-b8xln\" (UID: \"bf9dc0c7-ad34-420e-bb88-13ce42450ed0\") " pod="openshift-multus/multus-b8xln" May 27 14:05:17.526686 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.526019 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-54nnm\" (UniqueName: \"kubernetes.io/projected/1eeeff09-f3c8-453d-b9ca-d074d2cb10c8-kube-api-access-54nnm\") pod \"node-ca-jg92x\" (UID: \"1eeeff09-f3c8-453d-b9ca-d074d2cb10c8\") " pod="openshift-image-registry/node-ca-jg92x" May 27 14:05:17.526686 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.526053 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dec3c402-9050-47e4-8002-9068ecb2ac0e-etc-kubernetes\") pod \"tuned-27mm9\" (UID: \"dec3c402-9050-47e4-8002-9068ecb2ac0e\") " pod="openshift-cluster-node-tuning-operator/tuned-27mm9" May 27 14:05:17.526686 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.526080 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dec3c402-9050-47e4-8002-9068ecb2ac0e-etc-sysctl-conf\") pod \"tuned-27mm9\" (UID: \"dec3c402-9050-47e4-8002-9068ecb2ac0e\") " pod="openshift-cluster-node-tuning-operator/tuned-27mm9" May 27 14:05:17.526686 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.526110 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dec3c402-9050-47e4-8002-9068ecb2ac0e-etc-systemd\") pod \"tuned-27mm9\" (UID: \"dec3c402-9050-47e4-8002-9068ecb2ac0e\") " pod="openshift-cluster-node-tuning-operator/tuned-27mm9" May 27 14:05:17.526686 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.526275 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3ebbf10f-4f07-403c-93b2-97261749308d-host-run-netns\") pod \"ovnkube-node-fn9jd\" (UID: \"3ebbf10f-4f07-403c-93b2-97261749308d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn9jd" May 27 14:05:17.526686 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.526307 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bf9dc0c7-ad34-420e-bb88-13ce42450ed0-multus-cni-dir\") pod \"multus-b8xln\" (UID: \"bf9dc0c7-ad34-420e-bb88-13ce42450ed0\") " pod="openshift-multus/multus-b8xln" May 27 14:05:17.526686 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.526340 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dec3c402-9050-47e4-8002-9068ecb2ac0e-var-lib-kubelet\") pod \"tuned-27mm9\" (UID: \"dec3c402-9050-47e4-8002-9068ecb2ac0e\") " pod="openshift-cluster-node-tuning-operator/tuned-27mm9" May 27 14:05:17.526686 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.526370 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jzwg\" (UniqueName: \"kubernetes.io/projected/dec3c402-9050-47e4-8002-9068ecb2ac0e-kube-api-access-8jzwg\") pod \"tuned-27mm9\" (UID: \"dec3c402-9050-47e4-8002-9068ecb2ac0e\") " pod="openshift-cluster-node-tuning-operator/tuned-27mm9" May 27 14:05:17.526686 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.526400 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0b4d0670-6986-4085-a211-e22549067d90-cnibin\") pod \"multus-additional-cni-plugins-tfnv8\" (UID: \"0b4d0670-6986-4085-a211-e22549067d90\") " pod="openshift-multus/multus-additional-cni-plugins-tfnv8" May 27 14:05:17.527474 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.526457 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3ebbf10f-4f07-403c-93b2-97261749308d-run-systemd\") pod \"ovnkube-node-fn9jd\" (UID: \"3ebbf10f-4f07-403c-93b2-97261749308d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn9jd" May 27 14:05:17.527474 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.526490 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3ebbf10f-4f07-403c-93b2-97261749308d-node-log\") pod \"ovnkube-node-fn9jd\" (UID: \"3ebbf10f-4f07-403c-93b2-97261749308d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn9jd" May 27 14:05:17.527474 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.526581 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dec3c402-9050-47e4-8002-9068ecb2ac0e-lib-modules\") pod \"tuned-27mm9\" (UID: \"dec3c402-9050-47e4-8002-9068ecb2ac0e\") " pod="openshift-cluster-node-tuning-operator/tuned-27mm9" May 27 14:05:17.527474 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.526613 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0b4d0670-6986-4085-a211-e22549067d90-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tfnv8\" (UID: \"0b4d0670-6986-4085-a211-e22549067d90\") " pod="openshift-multus/multus-additional-cni-plugins-tfnv8" May 27 14:05:17.527474 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.526645 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bf9dc0c7-ad34-420e-bb88-13ce42450ed0-hostroot\") pod \"multus-b8xln\" (UID: \"bf9dc0c7-ad34-420e-bb88-13ce42450ed0\") " pod="openshift-multus/multus-b8xln" May 27 14:05:17.527474 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.526675 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1b57d88e-c349-4d40-92b8-757ec7474dc4-registration-dir\") pod \"aws-ebs-csi-driver-node-ng4xc\" (UID: \"1b57d88e-c349-4d40-92b8-757ec7474dc4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ng4xc" May 27 14:05:17.527474 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.526702 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1eeeff09-f3c8-453d-b9ca-d074d2cb10c8-serviceca\") pod \"node-ca-jg92x\" (UID: \"1eeeff09-f3c8-453d-b9ca-d074d2cb10c8\") " pod="openshift-image-registry/node-ca-jg92x" May 27 14:05:17.527474 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.526730 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d5c39783-e332-4bc0-afe8-a3c254946252-host-slash\") pod \"iptables-alerter-wb972\" (UID: \"d5c39783-e332-4bc0-afe8-a3c254946252\") " pod="openshift-network-operator/iptables-alerter-wb972" May 27 14:05:17.527474 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.526761 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dec3c402-9050-47e4-8002-9068ecb2ac0e-etc-modprobe-d\") pod \"tuned-27mm9\" (UID: \"dec3c402-9050-47e4-8002-9068ecb2ac0e\") " pod="openshift-cluster-node-tuning-operator/tuned-27mm9" May 27 14:05:17.527474 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.526793 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3ebbf10f-4f07-403c-93b2-97261749308d-ovnkube-script-lib\") pod \"ovnkube-node-fn9jd\" (UID: \"3ebbf10f-4f07-403c-93b2-97261749308d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn9jd" May 27 14:05:17.527474 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.526824 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bf9dc0c7-ad34-420e-bb88-13ce42450ed0-host-var-lib-cni-multus\") pod \"multus-b8xln\" (UID: \"bf9dc0c7-ad34-420e-bb88-13ce42450ed0\") " pod="openshift-multus/multus-b8xln" May 27 14:05:17.527474 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.526856 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d5c39783-e332-4bc0-afe8-a3c254946252-iptables-alerter-script\") pod \"iptables-alerter-wb972\" (UID: \"d5c39783-e332-4bc0-afe8-a3c254946252\") " pod="openshift-network-operator/iptables-alerter-wb972" May 27 14:05:17.527474 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.526884 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dec3c402-9050-47e4-8002-9068ecb2ac0e-etc-sysctl-d\") pod \"tuned-27mm9\" (UID: \"dec3c402-9050-47e4-8002-9068ecb2ac0e\") " pod="openshift-cluster-node-tuning-operator/tuned-27mm9" May 27 14:05:17.527474 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.526931 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dec3c402-9050-47e4-8002-9068ecb2ac0e-tmp\") pod \"tuned-27mm9\" (UID: \"dec3c402-9050-47e4-8002-9068ecb2ac0e\") " pod="openshift-cluster-node-tuning-operator/tuned-27mm9" May 27 14:05:17.527474 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.526965 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0b4d0670-6986-4085-a211-e22549067d90-os-release\") pod \"multus-additional-cni-plugins-tfnv8\" (UID: \"0b4d0670-6986-4085-a211-e22549067d90\") " pod="openshift-multus/multus-additional-cni-plugins-tfnv8" May 27 14:05:17.527474 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.527000 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bf9dc0c7-ad34-420e-bb88-13ce42450ed0-os-release\") pod \"multus-b8xln\" (UID: \"bf9dc0c7-ad34-420e-bb88-13ce42450ed0\") " pod="openshift-multus/multus-b8xln" May 27 14:05:17.527474 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.527147 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf9dc0c7-ad34-420e-bb88-13ce42450ed0-etc-kubernetes\") pod \"multus-b8xln\" (UID: \"bf9dc0c7-ad34-420e-bb88-13ce42450ed0\") " pod="openshift-multus/multus-b8xln" May 27 14:05:17.529192 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.527180 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-blzm7\" (UniqueName: \"kubernetes.io/projected/82e1095b-051d-4cd7-91f4-e3e2200e3812-kube-api-access-blzm7\") pod \"network-check-target-wbsgc\" (UID: \"82e1095b-051d-4cd7-91f4-e3e2200e3812\") " pod="openshift-network-diagnostics/network-check-target-wbsgc" May 27 14:05:17.529192 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.527212 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dec3c402-9050-47e4-8002-9068ecb2ac0e-host\") pod \"tuned-27mm9\" (UID: \"dec3c402-9050-47e4-8002-9068ecb2ac0e\") " pod="openshift-cluster-node-tuning-operator/tuned-27mm9" May 27 14:05:17.529192 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.527244 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1b57d88e-c349-4d40-92b8-757ec7474dc4-sys-fs\") pod \"aws-ebs-csi-driver-node-ng4xc\" (UID: \"1b57d88e-c349-4d40-92b8-757ec7474dc4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ng4xc" May 27 14:05:17.529192 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.527275 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3ebbf10f-4f07-403c-93b2-97261749308d-host-cni-netd\") pod \"ovnkube-node-fn9jd\" (UID: \"3ebbf10f-4f07-403c-93b2-97261749308d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn9jd" May 27 14:05:17.529192 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.527303 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bf9dc0c7-ad34-420e-bb88-13ce42450ed0-host-run-k8s-cni-cncf-io\") pod \"multus-b8xln\" (UID: \"bf9dc0c7-ad34-420e-bb88-13ce42450ed0\") " pod="openshift-multus/multus-b8xln" May 27 14:05:17.529192 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.527398 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bf9dc0c7-ad34-420e-bb88-13ce42450ed0-host-run-k8s-cni-cncf-io\") pod \"multus-b8xln\" (UID: \"bf9dc0c7-ad34-420e-bb88-13ce42450ed0\") " pod="openshift-multus/multus-b8xln" May 27 14:05:17.529192 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.527497 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bf9dc0c7-ad34-420e-bb88-13ce42450ed0-os-release\") pod \"multus-b8xln\" (UID: \"bf9dc0c7-ad34-420e-bb88-13ce42450ed0\") " pod="openshift-multus/multus-b8xln" May 27 14:05:17.529192 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.527529 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3ebbf10f-4f07-403c-93b2-97261749308d-node-log\") pod \"ovnkube-node-fn9jd\" (UID: \"3ebbf10f-4f07-403c-93b2-97261749308d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn9jd" May 27 14:05:17.529192 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.527606 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1b57d88e-c349-4d40-92b8-757ec7474dc4-etc-selinux\") pod \"aws-ebs-csi-driver-node-ng4xc\" (UID: \"1b57d88e-c349-4d40-92b8-757ec7474dc4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ng4xc" May 27 14:05:17.529192 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.527708 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1b57d88e-c349-4d40-92b8-757ec7474dc4-socket-dir\") pod \"aws-ebs-csi-driver-node-ng4xc\" (UID: \"1b57d88e-c349-4d40-92b8-757ec7474dc4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ng4xc" May 27 14:05:17.529192 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.527979 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bf9dc0c7-ad34-420e-bb88-13ce42450ed0-multus-conf-dir\") pod \"multus-b8xln\" (UID: \"bf9dc0c7-ad34-420e-bb88-13ce42450ed0\") " pod="openshift-multus/multus-b8xln" May 27 14:05:17.529192 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.527995 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3ebbf10f-4f07-403c-93b2-97261749308d-host-run-netns\") pod \"ovnkube-node-fn9jd\" (UID: \"3ebbf10f-4f07-403c-93b2-97261749308d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn9jd" May 27 14:05:17.529192 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.528034 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bf9dc0c7-ad34-420e-bb88-13ce42450ed0-multus-cni-dir\") pod \"multus-b8xln\" (UID: \"bf9dc0c7-ad34-420e-bb88-13ce42450ed0\") " pod="openshift-multus/multus-b8xln" May 27 14:05:17.529192 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.528080 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bf9dc0c7-ad34-420e-bb88-13ce42450ed0-host-var-lib-cni-multus\") pod \"multus-b8xln\" (UID: \"bf9dc0c7-ad34-420e-bb88-13ce42450ed0\") " pod="openshift-multus/multus-b8xln" May 27 14:05:17.529192 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.528395 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf9dc0c7-ad34-420e-bb88-13ce42450ed0-etc-kubernetes\") pod \"multus-b8xln\" (UID: \"bf9dc0c7-ad34-420e-bb88-13ce42450ed0\") " pod="openshift-multus/multus-b8xln" May 27 14:05:17.529192 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.528508 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3ebbf10f-4f07-403c-93b2-97261749308d-run-systemd\") pod \"ovnkube-node-fn9jd\" (UID: \"3ebbf10f-4f07-403c-93b2-97261749308d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn9jd" May 27 14:05:17.529192 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.528577 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d5c39783-e332-4bc0-afe8-a3c254946252-iptables-alerter-script\") pod \"iptables-alerter-wb972\" (UID: \"d5c39783-e332-4bc0-afe8-a3c254946252\") " pod="openshift-network-operator/iptables-alerter-wb972" May 27 14:05:17.529192 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.528648 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1b57d88e-c349-4d40-92b8-757ec7474dc4-sys-fs\") pod \"aws-ebs-csi-driver-node-ng4xc\" (UID: \"1b57d88e-c349-4d40-92b8-757ec7474dc4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ng4xc" May 27 14:05:17.530033 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.528908 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bf9dc0c7-ad34-420e-bb88-13ce42450ed0-hostroot\") pod \"multus-b8xln\" (UID: \"bf9dc0c7-ad34-420e-bb88-13ce42450ed0\") " pod="openshift-multus/multus-b8xln" May 27 14:05:17.530033 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.529078 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d5c39783-e332-4bc0-afe8-a3c254946252-host-slash\") pod \"iptables-alerter-wb972\" (UID: \"d5c39783-e332-4bc0-afe8-a3c254946252\") " pod="openshift-network-operator/iptables-alerter-wb972" May 27 14:05:17.530033 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.529142 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1b57d88e-c349-4d40-92b8-757ec7474dc4-registration-dir\") pod \"aws-ebs-csi-driver-node-ng4xc\" (UID: \"1b57d88e-c349-4d40-92b8-757ec7474dc4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ng4xc" May 27 14:05:17.530033 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.529198 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3ebbf10f-4f07-403c-93b2-97261749308d-host-cni-netd\") pod \"ovnkube-node-fn9jd\" (UID: \"3ebbf10f-4f07-403c-93b2-97261749308d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn9jd" May 27 14:05:17.530033 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.529229 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1eeeff09-f3c8-453d-b9ca-d074d2cb10c8-serviceca\") pod \"node-ca-jg92x\" (UID: \"1eeeff09-f3c8-453d-b9ca-d074d2cb10c8\") " pod="openshift-image-registry/node-ca-jg92x" May 27 14:05:17.530033 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.529307 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3ebbf10f-4f07-403c-93b2-97261749308d-ovn-node-metrics-cert\") pod \"ovnkube-node-fn9jd\" (UID: \"3ebbf10f-4f07-403c-93b2-97261749308d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn9jd" May 27 14:05:17.530033 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.529599 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3ebbf10f-4f07-403c-93b2-97261749308d-ovnkube-script-lib\") pod \"ovnkube-node-fn9jd\" (UID: \"3ebbf10f-4f07-403c-93b2-97261749308d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn9jd" May 27 14:05:17.531253 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.530927 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e0c55f03-86a3-4759-9e7c-5cf53d4ea59d-agent-certs\") pod \"konnectivity-agent-lkbl5\" (UID: \"e0c55f03-86a3-4759-9e7c-5cf53d4ea59d\") " pod="kube-system/konnectivity-agent-lkbl5" May 27 14:05:17.538022 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:17.537405 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 14:05:17.538022 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:17.537430 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 14:05:17.538022 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:17.537445 2563 projected.go:194] Error preparing data for projected volume kube-api-access-blzm7 for pod openshift-network-diagnostics/network-check-target-wbsgc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 14:05:17.538022 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:17.537505 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82e1095b-051d-4cd7-91f4-e3e2200e3812-kube-api-access-blzm7 podName:82e1095b-051d-4cd7-91f4-e3e2200e3812 nodeName:}" failed. No retries permitted until 2026-05-27 14:05:18.03748746 +0000 UTC m=+3.137804419 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-blzm7" (UniqueName: "kubernetes.io/projected/82e1095b-051d-4cd7-91f4-e3e2200e3812-kube-api-access-blzm7") pod "network-check-target-wbsgc" (UID: "82e1095b-051d-4cd7-91f4-e3e2200e3812") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 14:05:17.538022 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.537958 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r749p\" (UniqueName: \"kubernetes.io/projected/3ebbf10f-4f07-403c-93b2-97261749308d-kube-api-access-r749p\") pod \"ovnkube-node-fn9jd\" (UID: \"3ebbf10f-4f07-403c-93b2-97261749308d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn9jd" May 27 14:05:17.538350 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.538219 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2mq9\" (UniqueName: \"kubernetes.io/projected/1b57d88e-c349-4d40-92b8-757ec7474dc4-kube-api-access-j2mq9\") pod \"aws-ebs-csi-driver-node-ng4xc\" (UID: \"1b57d88e-c349-4d40-92b8-757ec7474dc4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ng4xc" May 27 14:05:17.538714 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.538659 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h47gk\" (UniqueName: \"kubernetes.io/projected/d5c39783-e332-4bc0-afe8-a3c254946252-kube-api-access-h47gk\") pod \"iptables-alerter-wb972\" (UID: \"d5c39783-e332-4bc0-afe8-a3c254946252\") " pod="openshift-network-operator/iptables-alerter-wb972" May 27 14:05:17.539050 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.539003 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-54nnm\" (UniqueName: \"kubernetes.io/projected/1eeeff09-f3c8-453d-b9ca-d074d2cb10c8-kube-api-access-54nnm\") pod \"node-ca-jg92x\" (UID: \"1eeeff09-f3c8-453d-b9ca-d074d2cb10c8\") " pod="openshift-image-registry/node-ca-jg92x" May 27 14:05:17.539427 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.539407 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vhb9\" (UniqueName: \"kubernetes.io/projected/bf9dc0c7-ad34-420e-bb88-13ce42450ed0-kube-api-access-7vhb9\") pod \"multus-b8xln\" (UID: \"bf9dc0c7-ad34-420e-bb88-13ce42450ed0\") " pod="openshift-multus/multus-b8xln" May 27 14:05:17.539747 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.539724 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-57krs\" (UniqueName: \"kubernetes.io/projected/3798bdf6-d616-43ed-b727-35b9407c33e7-kube-api-access-57krs\") pod \"network-metrics-daemon-txmmd\" (UID: \"3798bdf6-d616-43ed-b727-35b9407c33e7\") " pod="openshift-multus/network-metrics-daemon-txmmd" May 27 14:05:17.542708 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.542601 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-198.ec2.internal" event={"ID":"444f839c172d5d32122711f23798b1f0","Type":"ContainerStarted","Data":"1ab608ff4f308f34192168f338800f62f1d64155689f4eb11c78c206d84ad972"} May 27 14:05:17.544031 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.543996 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-198.ec2.internal" event={"ID":"bdac52c688e8c8ccf183c0f228872be3","Type":"ContainerStarted","Data":"956a0b162d5e3e28b09a2c8addb342da9659f5c9095fa326de446b75be7f972f"} May 27 14:05:17.595057 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.595029 2563 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 27 14:05:17.627639 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.627607 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dec3c402-9050-47e4-8002-9068ecb2ac0e-etc-tuned\") pod \"tuned-27mm9\" (UID: \"dec3c402-9050-47e4-8002-9068ecb2ac0e\") " pod="openshift-cluster-node-tuning-operator/tuned-27mm9" May 27 14:05:17.627639 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.627645 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dec3c402-9050-47e4-8002-9068ecb2ac0e-etc-sysconfig\") pod \"tuned-27mm9\" (UID: \"dec3c402-9050-47e4-8002-9068ecb2ac0e\") " pod="openshift-cluster-node-tuning-operator/tuned-27mm9" May 27 14:05:17.627881 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.627668 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0b4d0670-6986-4085-a211-e22549067d90-system-cni-dir\") pod \"multus-additional-cni-plugins-tfnv8\" (UID: \"0b4d0670-6986-4085-a211-e22549067d90\") " pod="openshift-multus/multus-additional-cni-plugins-tfnv8" May 27 14:05:17.627881 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.627693 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0b4d0670-6986-4085-a211-e22549067d90-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tfnv8\" (UID: \"0b4d0670-6986-4085-a211-e22549067d90\") " pod="openshift-multus/multus-additional-cni-plugins-tfnv8" May 27 14:05:17.627881 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.627719 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dec3c402-9050-47e4-8002-9068ecb2ac0e-sys\") pod \"tuned-27mm9\" (UID: \"dec3c402-9050-47e4-8002-9068ecb2ac0e\") " pod="openshift-cluster-node-tuning-operator/tuned-27mm9" May 27 14:05:17.627881 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.627742 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0b4d0670-6986-4085-a211-e22549067d90-cni-binary-copy\") pod \"multus-additional-cni-plugins-tfnv8\" (UID: \"0b4d0670-6986-4085-a211-e22549067d90\") " pod="openshift-multus/multus-additional-cni-plugins-tfnv8" May 27 14:05:17.627881 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.627740 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dec3c402-9050-47e4-8002-9068ecb2ac0e-etc-sysconfig\") pod \"tuned-27mm9\" (UID: \"dec3c402-9050-47e4-8002-9068ecb2ac0e\") " pod="openshift-cluster-node-tuning-operator/tuned-27mm9" May 27 14:05:17.627881 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.627768 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0b4d0670-6986-4085-a211-e22549067d90-system-cni-dir\") pod \"multus-additional-cni-plugins-tfnv8\" (UID: \"0b4d0670-6986-4085-a211-e22549067d90\") " pod="openshift-multus/multus-additional-cni-plugins-tfnv8" May 27 14:05:17.627881 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.627777 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dec3c402-9050-47e4-8002-9068ecb2ac0e-etc-kubernetes\") pod \"tuned-27mm9\" (UID: \"dec3c402-9050-47e4-8002-9068ecb2ac0e\") " pod="openshift-cluster-node-tuning-operator/tuned-27mm9" May 27 14:05:17.627881 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.627820 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dec3c402-9050-47e4-8002-9068ecb2ac0e-etc-sysctl-conf\") pod \"tuned-27mm9\" (UID: \"dec3c402-9050-47e4-8002-9068ecb2ac0e\") " pod="openshift-cluster-node-tuning-operator/tuned-27mm9" May 27 14:05:17.627881 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.627834 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dec3c402-9050-47e4-8002-9068ecb2ac0e-sys\") pod \"tuned-27mm9\" (UID: \"dec3c402-9050-47e4-8002-9068ecb2ac0e\") " pod="openshift-cluster-node-tuning-operator/tuned-27mm9" May 27 14:05:17.627881 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.627845 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dec3c402-9050-47e4-8002-9068ecb2ac0e-etc-systemd\") pod \"tuned-27mm9\" (UID: \"dec3c402-9050-47e4-8002-9068ecb2ac0e\") " pod="openshift-cluster-node-tuning-operator/tuned-27mm9" May 27 14:05:17.628408 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.627911 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dec3c402-9050-47e4-8002-9068ecb2ac0e-var-lib-kubelet\") pod \"tuned-27mm9\" (UID: \"dec3c402-9050-47e4-8002-9068ecb2ac0e\") " pod="openshift-cluster-node-tuning-operator/tuned-27mm9" May 27 14:05:17.628408 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.627921 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dec3c402-9050-47e4-8002-9068ecb2ac0e-etc-kubernetes\") pod \"tuned-27mm9\" (UID: \"dec3c402-9050-47e4-8002-9068ecb2ac0e\") " pod="openshift-cluster-node-tuning-operator/tuned-27mm9" May 27 14:05:17.628408 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.627936 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8jzwg\" (UniqueName: \"kubernetes.io/projected/dec3c402-9050-47e4-8002-9068ecb2ac0e-kube-api-access-8jzwg\") pod \"tuned-27mm9\" (UID: \"dec3c402-9050-47e4-8002-9068ecb2ac0e\") " pod="openshift-cluster-node-tuning-operator/tuned-27mm9" May 27 14:05:17.628408 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.627962 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0b4d0670-6986-4085-a211-e22549067d90-cnibin\") pod \"multus-additional-cni-plugins-tfnv8\" (UID: \"0b4d0670-6986-4085-a211-e22549067d90\") " pod="openshift-multus/multus-additional-cni-plugins-tfnv8" May 27 14:05:17.628408 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.627979 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dec3c402-9050-47e4-8002-9068ecb2ac0e-etc-systemd\") pod \"tuned-27mm9\" (UID: \"dec3c402-9050-47e4-8002-9068ecb2ac0e\") " pod="openshift-cluster-node-tuning-operator/tuned-27mm9" May 27 14:05:17.628408 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.627988 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dec3c402-9050-47e4-8002-9068ecb2ac0e-lib-modules\") pod \"tuned-27mm9\" (UID: \"dec3c402-9050-47e4-8002-9068ecb2ac0e\") " pod="openshift-cluster-node-tuning-operator/tuned-27mm9" May 27 14:05:17.628408 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.628006 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dec3c402-9050-47e4-8002-9068ecb2ac0e-etc-sysctl-conf\") pod \"tuned-27mm9\" (UID: \"dec3c402-9050-47e4-8002-9068ecb2ac0e\") " pod="openshift-cluster-node-tuning-operator/tuned-27mm9" May 27 14:05:17.628408 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.628017 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0b4d0670-6986-4085-a211-e22549067d90-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tfnv8\" (UID: \"0b4d0670-6986-4085-a211-e22549067d90\") " pod="openshift-multus/multus-additional-cni-plugins-tfnv8" May 27 14:05:17.628408 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.628057 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dec3c402-9050-47e4-8002-9068ecb2ac0e-etc-modprobe-d\") pod \"tuned-27mm9\" (UID: \"dec3c402-9050-47e4-8002-9068ecb2ac0e\") " pod="openshift-cluster-node-tuning-operator/tuned-27mm9" May 27 14:05:17.628408 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.628086 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dec3c402-9050-47e4-8002-9068ecb2ac0e-etc-sysctl-d\") pod \"tuned-27mm9\" (UID: \"dec3c402-9050-47e4-8002-9068ecb2ac0e\") " pod="openshift-cluster-node-tuning-operator/tuned-27mm9" May 27 14:05:17.628408 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.628113 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dec3c402-9050-47e4-8002-9068ecb2ac0e-tmp\") pod \"tuned-27mm9\" (UID: \"dec3c402-9050-47e4-8002-9068ecb2ac0e\") " pod="openshift-cluster-node-tuning-operator/tuned-27mm9" May 27 14:05:17.628408 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.628138 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0b4d0670-6986-4085-a211-e22549067d90-os-release\") pod \"multus-additional-cni-plugins-tfnv8\" (UID: \"0b4d0670-6986-4085-a211-e22549067d90\") " pod="openshift-multus/multus-additional-cni-plugins-tfnv8" May 27 14:05:17.628408 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.628165 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0b4d0670-6986-4085-a211-e22549067d90-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tfnv8\" (UID: \"0b4d0670-6986-4085-a211-e22549067d90\") " pod="openshift-multus/multus-additional-cni-plugins-tfnv8" May 27 14:05:17.628408 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.628176 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dec3c402-9050-47e4-8002-9068ecb2ac0e-host\") pod \"tuned-27mm9\" (UID: \"dec3c402-9050-47e4-8002-9068ecb2ac0e\") " pod="openshift-cluster-node-tuning-operator/tuned-27mm9" May 27 14:05:17.628408 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.628222 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dec3c402-9050-47e4-8002-9068ecb2ac0e-run\") pod \"tuned-27mm9\" (UID: \"dec3c402-9050-47e4-8002-9068ecb2ac0e\") " pod="openshift-cluster-node-tuning-operator/tuned-27mm9" May 27 14:05:17.628408 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.628266 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0b4d0670-6986-4085-a211-e22549067d90-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tfnv8\" (UID: \"0b4d0670-6986-4085-a211-e22549067d90\") " pod="openshift-multus/multus-additional-cni-plugins-tfnv8" May 27 14:05:17.628408 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.628289 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dec3c402-9050-47e4-8002-9068ecb2ac0e-lib-modules\") pod \"tuned-27mm9\" (UID: \"dec3c402-9050-47e4-8002-9068ecb2ac0e\") " pod="openshift-cluster-node-tuning-operator/tuned-27mm9" May 27 14:05:17.629250 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.628294 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0b4d0670-6986-4085-a211-e22549067d90-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tfnv8\" (UID: \"0b4d0670-6986-4085-a211-e22549067d90\") " pod="openshift-multus/multus-additional-cni-plugins-tfnv8" May 27 14:05:17.629250 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.628301 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-phtms\" (UniqueName: \"kubernetes.io/projected/0b4d0670-6986-4085-a211-e22549067d90-kube-api-access-phtms\") pod \"multus-additional-cni-plugins-tfnv8\" (UID: \"0b4d0670-6986-4085-a211-e22549067d90\") " pod="openshift-multus/multus-additional-cni-plugins-tfnv8" May 27 14:05:17.629250 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.628302 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0b4d0670-6986-4085-a211-e22549067d90-cni-binary-copy\") pod \"multus-additional-cni-plugins-tfnv8\" (UID: \"0b4d0670-6986-4085-a211-e22549067d90\") " pod="openshift-multus/multus-additional-cni-plugins-tfnv8" May 27 14:05:17.629250 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.628303 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dec3c402-9050-47e4-8002-9068ecb2ac0e-etc-sysctl-d\") pod \"tuned-27mm9\" (UID: \"dec3c402-9050-47e4-8002-9068ecb2ac0e\") " pod="openshift-cluster-node-tuning-operator/tuned-27mm9" May 27 14:05:17.629250 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.628057 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0b4d0670-6986-4085-a211-e22549067d90-cnibin\") pod \"multus-additional-cni-plugins-tfnv8\" (UID: \"0b4d0670-6986-4085-a211-e22549067d90\") " pod="openshift-multus/multus-additional-cni-plugins-tfnv8" May 27 14:05:17.629250 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.628349 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dec3c402-9050-47e4-8002-9068ecb2ac0e-var-lib-kubelet\") pod \"tuned-27mm9\" (UID: \"dec3c402-9050-47e4-8002-9068ecb2ac0e\") " pod="openshift-cluster-node-tuning-operator/tuned-27mm9" May 27 14:05:17.629250 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.628441 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dec3c402-9050-47e4-8002-9068ecb2ac0e-run\") pod \"tuned-27mm9\" (UID: \"dec3c402-9050-47e4-8002-9068ecb2ac0e\") " pod="openshift-cluster-node-tuning-operator/tuned-27mm9" May 27 14:05:17.629250 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.628471 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dec3c402-9050-47e4-8002-9068ecb2ac0e-etc-modprobe-d\") pod \"tuned-27mm9\" (UID: \"dec3c402-9050-47e4-8002-9068ecb2ac0e\") " pod="openshift-cluster-node-tuning-operator/tuned-27mm9" May 27 14:05:17.629250 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.628517 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0b4d0670-6986-4085-a211-e22549067d90-os-release\") pod \"multus-additional-cni-plugins-tfnv8\" (UID: \"0b4d0670-6986-4085-a211-e22549067d90\") " pod="openshift-multus/multus-additional-cni-plugins-tfnv8" May 27 14:05:17.629250 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.628521 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dec3c402-9050-47e4-8002-9068ecb2ac0e-host\") pod \"tuned-27mm9\" (UID: \"dec3c402-9050-47e4-8002-9068ecb2ac0e\") " pod="openshift-cluster-node-tuning-operator/tuned-27mm9" May 27 14:05:17.629250 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.628841 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0b4d0670-6986-4085-a211-e22549067d90-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tfnv8\" (UID: \"0b4d0670-6986-4085-a211-e22549067d90\") " pod="openshift-multus/multus-additional-cni-plugins-tfnv8" May 27 14:05:17.630447 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.630430 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dec3c402-9050-47e4-8002-9068ecb2ac0e-etc-tuned\") pod \"tuned-27mm9\" (UID: \"dec3c402-9050-47e4-8002-9068ecb2ac0e\") " pod="openshift-cluster-node-tuning-operator/tuned-27mm9" May 27 14:05:17.630536 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.630490 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dec3c402-9050-47e4-8002-9068ecb2ac0e-tmp\") pod \"tuned-27mm9\" (UID: \"dec3c402-9050-47e4-8002-9068ecb2ac0e\") " pod="openshift-cluster-node-tuning-operator/tuned-27mm9" May 27 14:05:17.637114 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.637086 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jzwg\" (UniqueName: \"kubernetes.io/projected/dec3c402-9050-47e4-8002-9068ecb2ac0e-kube-api-access-8jzwg\") pod \"tuned-27mm9\" (UID: \"dec3c402-9050-47e4-8002-9068ecb2ac0e\") " pod="openshift-cluster-node-tuning-operator/tuned-27mm9" May 27 14:05:17.637528 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.637506 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-phtms\" (UniqueName: \"kubernetes.io/projected/0b4d0670-6986-4085-a211-e22549067d90-kube-api-access-phtms\") pod \"multus-additional-cni-plugins-tfnv8\" (UID: \"0b4d0670-6986-4085-a211-e22549067d90\") " pod="openshift-multus/multus-additional-cni-plugins-tfnv8" May 27 14:05:17.706703 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.706661 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-b8xln" May 27 14:05:17.716743 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.716708 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lkbl5" May 27 14:05:17.725613 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.725586 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ng4xc" May 27 14:05:17.732354 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.732332 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jg92x" May 27 14:05:17.747962 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.747932 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wb972" May 27 14:05:17.754682 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.754663 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fn9jd" May 27 14:05:17.762353 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.762332 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-27mm9" May 27 14:05:17.767932 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:17.767910 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tfnv8" May 27 14:05:18.031294 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:18.031217 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3798bdf6-d616-43ed-b727-35b9407c33e7-metrics-certs\") pod \"network-metrics-daemon-txmmd\" (UID: \"3798bdf6-d616-43ed-b727-35b9407c33e7\") " pod="openshift-multus/network-metrics-daemon-txmmd" May 27 14:05:18.031453 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:18.031340 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 14:05:18.031453 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:18.031412 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3798bdf6-d616-43ed-b727-35b9407c33e7-metrics-certs podName:3798bdf6-d616-43ed-b727-35b9407c33e7 nodeName:}" failed. No retries permitted until 2026-05-27 14:05:19.031394317 +0000 UTC m=+4.131711275 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3798bdf6-d616-43ed-b727-35b9407c33e7-metrics-certs") pod "network-metrics-daemon-txmmd" (UID: "3798bdf6-d616-43ed-b727-35b9407c33e7") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 14:05:18.131939 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:18.131885 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-blzm7\" (UniqueName: \"kubernetes.io/projected/82e1095b-051d-4cd7-91f4-e3e2200e3812-kube-api-access-blzm7\") pod \"network-check-target-wbsgc\" (UID: \"82e1095b-051d-4cd7-91f4-e3e2200e3812\") " pod="openshift-network-diagnostics/network-check-target-wbsgc" May 27 14:05:18.132114 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:18.132061 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 14:05:18.132114 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:18.132082 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 14:05:18.132114 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:18.132103 2563 projected.go:194] Error preparing data for projected volume kube-api-access-blzm7 for pod openshift-network-diagnostics/network-check-target-wbsgc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 14:05:18.132240 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:18.132208 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82e1095b-051d-4cd7-91f4-e3e2200e3812-kube-api-access-blzm7 podName:82e1095b-051d-4cd7-91f4-e3e2200e3812 nodeName:}" failed. No retries permitted until 2026-05-27 14:05:19.132179422 +0000 UTC m=+4.232496367 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-blzm7" (UniqueName: "kubernetes.io/projected/82e1095b-051d-4cd7-91f4-e3e2200e3812-kube-api-access-blzm7") pod "network-check-target-wbsgc" (UID: "82e1095b-051d-4cd7-91f4-e3e2200e3812") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 14:05:18.344360 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:18.344148 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5c39783_e332_4bc0_afe8_a3c254946252.slice/crio-11c4a1692c6827507996547a67cc5a1e85347d5c2b11b8ddad378bdab9a65491 WatchSource:0}: Error finding container 11c4a1692c6827507996547a67cc5a1e85347d5c2b11b8ddad378bdab9a65491: Status 404 returned error can't find the container with id 11c4a1692c6827507996547a67cc5a1e85347d5c2b11b8ddad378bdab9a65491 May 27 14:05:18.347073 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:18.347051 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ebbf10f_4f07_403c_93b2_97261749308d.slice/crio-7318d556933fd0811d590952bd6dee8576c9e16ca12dcb7f92489065ef30d736 WatchSource:0}: Error finding container 7318d556933fd0811d590952bd6dee8576c9e16ca12dcb7f92489065ef30d736: Status 404 returned error can't find the container with id 7318d556933fd0811d590952bd6dee8576c9e16ca12dcb7f92489065ef30d736 May 27 14:05:18.348215 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:18.348189 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1eeeff09_f3c8_453d_b9ca_d074d2cb10c8.slice/crio-857e6b0bb238726e14c834f15277acfb2cf413472aae391136cfb060068984fd WatchSource:0}: Error finding container 857e6b0bb238726e14c834f15277acfb2cf413472aae391136cfb060068984fd: Status 404 returned error can't find the container with id 857e6b0bb238726e14c834f15277acfb2cf413472aae391136cfb060068984fd May 27 14:05:18.348828 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:18.348804 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddec3c402_9050_47e4_8002_9068ecb2ac0e.slice/crio-b144877f5b1318d6694f2bc19918405498891ce99033809428d9042b5aee1ba0 WatchSource:0}: Error finding container b144877f5b1318d6694f2bc19918405498891ce99033809428d9042b5aee1ba0: Status 404 returned error can't find the container with id b144877f5b1318d6694f2bc19918405498891ce99033809428d9042b5aee1ba0 May 27 14:05:18.350489 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:18.350465 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b57d88e_c349_4d40_92b8_757ec7474dc4.slice/crio-bb7af1a02a1e8f36450e0531aad7ff613a098aa4da4925709a3e8e914e8ad60f WatchSource:0}: Error finding container bb7af1a02a1e8f36450e0531aad7ff613a098aa4da4925709a3e8e914e8ad60f: Status 404 returned error can't find the container with id bb7af1a02a1e8f36450e0531aad7ff613a098aa4da4925709a3e8e914e8ad60f May 27 14:05:18.351424 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:18.351401 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b4d0670_6986_4085_a211_e22549067d90.slice/crio-dc6cdffc63b54f0d24324153e04bc216501be0b9ed9465b99ebdb6116e44f9b8 WatchSource:0}: Error finding container dc6cdffc63b54f0d24324153e04bc216501be0b9ed9465b99ebdb6116e44f9b8: Status 404 returned error can't find the container with id dc6cdffc63b54f0d24324153e04bc216501be0b9ed9465b99ebdb6116e44f9b8 May 27 14:05:18.352773 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:18.352720 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0c55f03_86a3_4759_9e7c_5cf53d4ea59d.slice/crio-8af843dc8216c298f4eb72742a7170bc879674fd91929ad9144e9b8542900d26 WatchSource:0}: Error finding container 8af843dc8216c298f4eb72742a7170bc879674fd91929ad9144e9b8542900d26: Status 404 returned error can't find the container with id 8af843dc8216c298f4eb72742a7170bc879674fd91929ad9144e9b8542900d26 May 27 14:05:18.353407 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:18.353383 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf9dc0c7_ad34_420e_bb88_13ce42450ed0.slice/crio-c6b5530b31b6ae5c7e8f4c427c9f15dd50bb98dcb9640f7cf7809227f0092052 WatchSource:0}: Error finding container c6b5530b31b6ae5c7e8f4c427c9f15dd50bb98dcb9640f7cf7809227f0092052: Status 404 returned error can't find the container with id c6b5530b31b6ae5c7e8f4c427c9f15dd50bb98dcb9640f7cf7809227f0092052 May 27 14:05:18.471223 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:18.471185 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-26 14:00:16 +0000 UTC" deadline="2028-01-26 04:51:57.668257051 +0000 UTC" May 27 14:05:18.471223 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:18.471218 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14606h46m39.197043032s" May 27 14:05:18.546889 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:18.546823 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wb972" event={"ID":"d5c39783-e332-4bc0-afe8-a3c254946252","Type":"ContainerStarted","Data":"11c4a1692c6827507996547a67cc5a1e85347d5c2b11b8ddad378bdab9a65491"} May 27 14:05:18.548557 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:18.548532 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tfnv8" event={"ID":"0b4d0670-6986-4085-a211-e22549067d90","Type":"ContainerStarted","Data":"dc6cdffc63b54f0d24324153e04bc216501be0b9ed9465b99ebdb6116e44f9b8"} May 27 14:05:18.549479 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:18.549453 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-27mm9" event={"ID":"dec3c402-9050-47e4-8002-9068ecb2ac0e","Type":"ContainerStarted","Data":"b144877f5b1318d6694f2bc19918405498891ce99033809428d9042b5aee1ba0"} May 27 14:05:18.550339 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:18.550310 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jg92x" event={"ID":"1eeeff09-f3c8-453d-b9ca-d074d2cb10c8","Type":"ContainerStarted","Data":"857e6b0bb238726e14c834f15277acfb2cf413472aae391136cfb060068984fd"} May 27 14:05:18.551417 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:18.551395 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fn9jd" event={"ID":"3ebbf10f-4f07-403c-93b2-97261749308d","Type":"ContainerStarted","Data":"7318d556933fd0811d590952bd6dee8576c9e16ca12dcb7f92489065ef30d736"} May 27 14:05:18.552937 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:18.552914 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-198.ec2.internal" event={"ID":"bdac52c688e8c8ccf183c0f228872be3","Type":"ContainerStarted","Data":"0c88bc0fc6f62bfd97ba970a9facd9a2661dc73597dbd917ce32ddb6d0e91abe"} May 27 14:05:18.553919 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:18.553868 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-b8xln" event={"ID":"bf9dc0c7-ad34-420e-bb88-13ce42450ed0","Type":"ContainerStarted","Data":"c6b5530b31b6ae5c7e8f4c427c9f15dd50bb98dcb9640f7cf7809227f0092052"} May 27 14:05:18.554836 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:18.554815 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lkbl5" event={"ID":"e0c55f03-86a3-4759-9e7c-5cf53d4ea59d","Type":"ContainerStarted","Data":"8af843dc8216c298f4eb72742a7170bc879674fd91929ad9144e9b8542900d26"} May 27 14:05:18.555715 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:18.555696 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ng4xc" event={"ID":"1b57d88e-c349-4d40-92b8-757ec7474dc4","Type":"ContainerStarted","Data":"bb7af1a02a1e8f36450e0531aad7ff613a098aa4da4925709a3e8e914e8ad60f"} May 27 14:05:18.560473 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:18.560450 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-px2cq"] May 27 14:05:18.561868 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:18.561849 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-px2cq" May 27 14:05:18.561963 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:18.561946 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-px2cq" podUID="5a97ff24-1b84-4127-87cf-f53d545ce361" May 27 14:05:18.580205 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:18.580164 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-198.ec2.internal" podStartSLOduration=2.580151242 podStartE2EDuration="2.580151242s" podCreationTimestamp="2026-05-27 14:05:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 14:05:18.580142382 +0000 UTC m=+3.680459347" watchObservedRunningTime="2026-05-27 14:05:18.580151242 +0000 UTC m=+3.680468208" May 27 14:05:18.634705 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:18.634683 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5a97ff24-1b84-4127-87cf-f53d545ce361-original-pull-secret\") pod \"global-pull-secret-syncer-px2cq\" (UID: \"5a97ff24-1b84-4127-87cf-f53d545ce361\") " pod="kube-system/global-pull-secret-syncer-px2cq" May 27 14:05:18.634771 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:18.634724 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5a97ff24-1b84-4127-87cf-f53d545ce361-dbus\") pod \"global-pull-secret-syncer-px2cq\" (UID: \"5a97ff24-1b84-4127-87cf-f53d545ce361\") " pod="kube-system/global-pull-secret-syncer-px2cq" May 27 14:05:18.634771 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:18.634745 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5a97ff24-1b84-4127-87cf-f53d545ce361-kubelet-config\") pod \"global-pull-secret-syncer-px2cq\" (UID: \"5a97ff24-1b84-4127-87cf-f53d545ce361\") " pod="kube-system/global-pull-secret-syncer-px2cq" May 27 14:05:18.736055 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:18.736007 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5a97ff24-1b84-4127-87cf-f53d545ce361-original-pull-secret\") pod \"global-pull-secret-syncer-px2cq\" (UID: \"5a97ff24-1b84-4127-87cf-f53d545ce361\") " pod="kube-system/global-pull-secret-syncer-px2cq" May 27 14:05:18.736226 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:18.736069 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5a97ff24-1b84-4127-87cf-f53d545ce361-dbus\") pod \"global-pull-secret-syncer-px2cq\" (UID: \"5a97ff24-1b84-4127-87cf-f53d545ce361\") " pod="kube-system/global-pull-secret-syncer-px2cq" May 27 14:05:18.736226 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:18.736098 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5a97ff24-1b84-4127-87cf-f53d545ce361-kubelet-config\") pod \"global-pull-secret-syncer-px2cq\" (UID: \"5a97ff24-1b84-4127-87cf-f53d545ce361\") " pod="kube-system/global-pull-secret-syncer-px2cq" May 27 14:05:18.736226 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:18.736175 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 27 14:05:18.736323 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:18.736249 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a97ff24-1b84-4127-87cf-f53d545ce361-original-pull-secret podName:5a97ff24-1b84-4127-87cf-f53d545ce361 nodeName:}" failed. No retries permitted until 2026-05-27 14:05:19.236233246 +0000 UTC m=+4.336550195 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5a97ff24-1b84-4127-87cf-f53d545ce361-original-pull-secret") pod "global-pull-secret-syncer-px2cq" (UID: "5a97ff24-1b84-4127-87cf-f53d545ce361") : object "kube-system"/"original-pull-secret" not registered May 27 14:05:18.736323 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:18.736254 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5a97ff24-1b84-4127-87cf-f53d545ce361-kubelet-config\") pod \"global-pull-secret-syncer-px2cq\" (UID: \"5a97ff24-1b84-4127-87cf-f53d545ce361\") " pod="kube-system/global-pull-secret-syncer-px2cq" May 27 14:05:18.736323 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:18.736274 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5a97ff24-1b84-4127-87cf-f53d545ce361-dbus\") pod \"global-pull-secret-syncer-px2cq\" (UID: \"5a97ff24-1b84-4127-87cf-f53d545ce361\") " pod="kube-system/global-pull-secret-syncer-px2cq" May 27 14:05:19.039349 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:19.038694 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3798bdf6-d616-43ed-b727-35b9407c33e7-metrics-certs\") pod \"network-metrics-daemon-txmmd\" (UID: \"3798bdf6-d616-43ed-b727-35b9407c33e7\") " pod="openshift-multus/network-metrics-daemon-txmmd" May 27 14:05:19.039349 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:19.038854 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 14:05:19.039349 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:19.038936 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3798bdf6-d616-43ed-b727-35b9407c33e7-metrics-certs podName:3798bdf6-d616-43ed-b727-35b9407c33e7 nodeName:}" failed. No retries permitted until 2026-05-27 14:05:21.038916609 +0000 UTC m=+6.139233560 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3798bdf6-d616-43ed-b727-35b9407c33e7-metrics-certs") pod "network-metrics-daemon-txmmd" (UID: "3798bdf6-d616-43ed-b727-35b9407c33e7") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 14:05:19.140529 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:19.139859 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-blzm7\" (UniqueName: \"kubernetes.io/projected/82e1095b-051d-4cd7-91f4-e3e2200e3812-kube-api-access-blzm7\") pod \"network-check-target-wbsgc\" (UID: \"82e1095b-051d-4cd7-91f4-e3e2200e3812\") " pod="openshift-network-diagnostics/network-check-target-wbsgc" May 27 14:05:19.140529 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:19.140082 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 14:05:19.140529 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:19.140102 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 14:05:19.140529 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:19.140116 2563 projected.go:194] Error preparing data for projected volume kube-api-access-blzm7 for pod openshift-network-diagnostics/network-check-target-wbsgc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 14:05:19.140529 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:19.140173 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82e1095b-051d-4cd7-91f4-e3e2200e3812-kube-api-access-blzm7 podName:82e1095b-051d-4cd7-91f4-e3e2200e3812 nodeName:}" failed. No retries permitted until 2026-05-27 14:05:21.140155574 +0000 UTC m=+6.240472520 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-blzm7" (UniqueName: "kubernetes.io/projected/82e1095b-051d-4cd7-91f4-e3e2200e3812-kube-api-access-blzm7") pod "network-check-target-wbsgc" (UID: "82e1095b-051d-4cd7-91f4-e3e2200e3812") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 14:05:19.242813 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:19.242205 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5a97ff24-1b84-4127-87cf-f53d545ce361-original-pull-secret\") pod \"global-pull-secret-syncer-px2cq\" (UID: \"5a97ff24-1b84-4127-87cf-f53d545ce361\") " pod="kube-system/global-pull-secret-syncer-px2cq" May 27 14:05:19.242813 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:19.242364 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 27 14:05:19.242813 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:19.242427 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a97ff24-1b84-4127-87cf-f53d545ce361-original-pull-secret podName:5a97ff24-1b84-4127-87cf-f53d545ce361 nodeName:}" failed. No retries permitted until 2026-05-27 14:05:20.242409222 +0000 UTC m=+5.342726169 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5a97ff24-1b84-4127-87cf-f53d545ce361-original-pull-secret") pod "global-pull-secret-syncer-px2cq" (UID: "5a97ff24-1b84-4127-87cf-f53d545ce361") : object "kube-system"/"original-pull-secret" not registered May 27 14:05:19.539217 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:19.539127 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wbsgc" May 27 14:05:19.539811 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:19.539266 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wbsgc" podUID="82e1095b-051d-4cd7-91f4-e3e2200e3812" May 27 14:05:19.539811 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:19.539313 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txmmd" May 27 14:05:19.539811 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:19.539418 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txmmd" podUID="3798bdf6-d616-43ed-b727-35b9407c33e7" May 27 14:05:19.579923 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:19.579021 2563 generic.go:358] "Generic (PLEG): container finished" podID="444f839c172d5d32122711f23798b1f0" containerID="49d8d074be54513a7a25741b6db151f4d320f605e7fb239be67d1357ba997991" exitCode=0 May 27 14:05:19.580091 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:19.579969 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-198.ec2.internal" event={"ID":"444f839c172d5d32122711f23798b1f0","Type":"ContainerDied","Data":"49d8d074be54513a7a25741b6db151f4d320f605e7fb239be67d1357ba997991"} May 27 14:05:20.251488 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:20.251403 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5a97ff24-1b84-4127-87cf-f53d545ce361-original-pull-secret\") pod \"global-pull-secret-syncer-px2cq\" (UID: \"5a97ff24-1b84-4127-87cf-f53d545ce361\") " pod="kube-system/global-pull-secret-syncer-px2cq" May 27 14:05:20.251645 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:20.251577 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 27 14:05:20.251645 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:20.251641 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a97ff24-1b84-4127-87cf-f53d545ce361-original-pull-secret podName:5a97ff24-1b84-4127-87cf-f53d545ce361 nodeName:}" failed. No retries permitted until 2026-05-27 14:05:22.251622271 +0000 UTC m=+7.351939232 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5a97ff24-1b84-4127-87cf-f53d545ce361-original-pull-secret") pod "global-pull-secret-syncer-px2cq" (UID: "5a97ff24-1b84-4127-87cf-f53d545ce361") : object "kube-system"/"original-pull-secret" not registered May 27 14:05:20.539078 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:20.538490 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-px2cq" May 27 14:05:20.539078 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:20.538633 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-px2cq" podUID="5a97ff24-1b84-4127-87cf-f53d545ce361" May 27 14:05:20.600728 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:20.600687 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-198.ec2.internal" event={"ID":"444f839c172d5d32122711f23798b1f0","Type":"ContainerStarted","Data":"13986cbf45b5b9a677b0ddbe1f48ed2a92a6e2530551a609d886fe5435a3261a"} May 27 14:05:20.617159 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:20.617094 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-198.ec2.internal" podStartSLOduration=4.617076325 podStartE2EDuration="4.617076325s" podCreationTimestamp="2026-05-27 14:05:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 14:05:20.6162318 +0000 UTC m=+5.716548767" watchObservedRunningTime="2026-05-27 14:05:20.617076325 +0000 UTC m=+5.717393291" May 27 14:05:21.058749 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:21.058707 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3798bdf6-d616-43ed-b727-35b9407c33e7-metrics-certs\") pod \"network-metrics-daemon-txmmd\" (UID: \"3798bdf6-d616-43ed-b727-35b9407c33e7\") " pod="openshift-multus/network-metrics-daemon-txmmd" May 27 14:05:21.058946 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:21.058883 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 14:05:21.059007 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:21.058963 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3798bdf6-d616-43ed-b727-35b9407c33e7-metrics-certs podName:3798bdf6-d616-43ed-b727-35b9407c33e7 nodeName:}" failed. No retries permitted until 2026-05-27 14:05:25.058943649 +0000 UTC m=+10.159260600 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3798bdf6-d616-43ed-b727-35b9407c33e7-metrics-certs") pod "network-metrics-daemon-txmmd" (UID: "3798bdf6-d616-43ed-b727-35b9407c33e7") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 14:05:21.159832 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:21.159691 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-blzm7\" (UniqueName: \"kubernetes.io/projected/82e1095b-051d-4cd7-91f4-e3e2200e3812-kube-api-access-blzm7\") pod \"network-check-target-wbsgc\" (UID: \"82e1095b-051d-4cd7-91f4-e3e2200e3812\") " pod="openshift-network-diagnostics/network-check-target-wbsgc" May 27 14:05:21.160028 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:21.159856 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 14:05:21.160028 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:21.159877 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 14:05:21.160028 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:21.159889 2563 projected.go:194] Error preparing data for projected volume kube-api-access-blzm7 for pod openshift-network-diagnostics/network-check-target-wbsgc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 14:05:21.160028 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:21.159962 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82e1095b-051d-4cd7-91f4-e3e2200e3812-kube-api-access-blzm7 podName:82e1095b-051d-4cd7-91f4-e3e2200e3812 nodeName:}" failed. No retries permitted until 2026-05-27 14:05:25.159943992 +0000 UTC m=+10.260260950 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-blzm7" (UniqueName: "kubernetes.io/projected/82e1095b-051d-4cd7-91f4-e3e2200e3812-kube-api-access-blzm7") pod "network-check-target-wbsgc" (UID: "82e1095b-051d-4cd7-91f4-e3e2200e3812") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 14:05:21.538576 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:21.538033 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wbsgc" May 27 14:05:21.538576 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:21.538178 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wbsgc" podUID="82e1095b-051d-4cd7-91f4-e3e2200e3812" May 27 14:05:21.538576 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:21.538255 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txmmd" May 27 14:05:21.538576 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:21.538478 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txmmd" podUID="3798bdf6-d616-43ed-b727-35b9407c33e7" May 27 14:05:22.271111 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:22.271069 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5a97ff24-1b84-4127-87cf-f53d545ce361-original-pull-secret\") pod \"global-pull-secret-syncer-px2cq\" (UID: \"5a97ff24-1b84-4127-87cf-f53d545ce361\") " pod="kube-system/global-pull-secret-syncer-px2cq" May 27 14:05:22.271553 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:22.271372 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 27 14:05:22.271553 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:22.271438 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a97ff24-1b84-4127-87cf-f53d545ce361-original-pull-secret podName:5a97ff24-1b84-4127-87cf-f53d545ce361 nodeName:}" failed. No retries permitted until 2026-05-27 14:05:26.27141965 +0000 UTC m=+11.371736610 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5a97ff24-1b84-4127-87cf-f53d545ce361-original-pull-secret") pod "global-pull-secret-syncer-px2cq" (UID: "5a97ff24-1b84-4127-87cf-f53d545ce361") : object "kube-system"/"original-pull-secret" not registered May 27 14:05:22.538112 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:22.537823 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-px2cq" May 27 14:05:22.538112 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:22.537991 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-px2cq" podUID="5a97ff24-1b84-4127-87cf-f53d545ce361" May 27 14:05:23.540084 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:23.538425 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wbsgc" May 27 14:05:23.540084 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:23.538573 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wbsgc" podUID="82e1095b-051d-4cd7-91f4-e3e2200e3812" May 27 14:05:23.540084 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:23.539105 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txmmd" May 27 14:05:23.540084 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:23.539227 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txmmd" podUID="3798bdf6-d616-43ed-b727-35b9407c33e7" May 27 14:05:24.538590 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:24.538551 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-px2cq" May 27 14:05:24.538773 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:24.538701 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-px2cq" podUID="5a97ff24-1b84-4127-87cf-f53d545ce361" May 27 14:05:25.095221 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:25.095187 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3798bdf6-d616-43ed-b727-35b9407c33e7-metrics-certs\") pod \"network-metrics-daemon-txmmd\" (UID: \"3798bdf6-d616-43ed-b727-35b9407c33e7\") " pod="openshift-multus/network-metrics-daemon-txmmd" May 27 14:05:25.095676 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:25.095336 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 14:05:25.095676 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:25.095407 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3798bdf6-d616-43ed-b727-35b9407c33e7-metrics-certs podName:3798bdf6-d616-43ed-b727-35b9407c33e7 nodeName:}" failed. No retries permitted until 2026-05-27 14:05:33.095386291 +0000 UTC m=+18.195703239 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3798bdf6-d616-43ed-b727-35b9407c33e7-metrics-certs") pod "network-metrics-daemon-txmmd" (UID: "3798bdf6-d616-43ed-b727-35b9407c33e7") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 14:05:25.196084 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:25.196045 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-blzm7\" (UniqueName: \"kubernetes.io/projected/82e1095b-051d-4cd7-91f4-e3e2200e3812-kube-api-access-blzm7\") pod \"network-check-target-wbsgc\" (UID: \"82e1095b-051d-4cd7-91f4-e3e2200e3812\") " pod="openshift-network-diagnostics/network-check-target-wbsgc" May 27 14:05:25.196266 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:25.196215 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 14:05:25.196266 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:25.196238 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 14:05:25.196266 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:25.196253 2563 projected.go:194] Error preparing data for projected volume kube-api-access-blzm7 for pod openshift-network-diagnostics/network-check-target-wbsgc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 14:05:25.196414 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:25.196312 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82e1095b-051d-4cd7-91f4-e3e2200e3812-kube-api-access-blzm7 podName:82e1095b-051d-4cd7-91f4-e3e2200e3812 nodeName:}" failed. No retries permitted until 2026-05-27 14:05:33.196295919 +0000 UTC m=+18.296612884 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-blzm7" (UniqueName: "kubernetes.io/projected/82e1095b-051d-4cd7-91f4-e3e2200e3812-kube-api-access-blzm7") pod "network-check-target-wbsgc" (UID: "82e1095b-051d-4cd7-91f4-e3e2200e3812") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 14:05:25.544001 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:25.542865 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wbsgc" May 27 14:05:25.544001 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:25.543087 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txmmd" May 27 14:05:25.544001 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:25.543102 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wbsgc" podUID="82e1095b-051d-4cd7-91f4-e3e2200e3812" May 27 14:05:25.544001 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:25.543228 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txmmd" podUID="3798bdf6-d616-43ed-b727-35b9407c33e7" May 27 14:05:26.305743 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:26.305706 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5a97ff24-1b84-4127-87cf-f53d545ce361-original-pull-secret\") pod \"global-pull-secret-syncer-px2cq\" (UID: \"5a97ff24-1b84-4127-87cf-f53d545ce361\") " pod="kube-system/global-pull-secret-syncer-px2cq" May 27 14:05:26.306227 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:26.305888 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 27 14:05:26.306227 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:26.305978 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a97ff24-1b84-4127-87cf-f53d545ce361-original-pull-secret podName:5a97ff24-1b84-4127-87cf-f53d545ce361 nodeName:}" failed. No retries permitted until 2026-05-27 14:05:34.305958848 +0000 UTC m=+19.406275795 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5a97ff24-1b84-4127-87cf-f53d545ce361-original-pull-secret") pod "global-pull-secret-syncer-px2cq" (UID: "5a97ff24-1b84-4127-87cf-f53d545ce361") : object "kube-system"/"original-pull-secret" not registered May 27 14:05:26.538134 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:26.538096 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-px2cq" May 27 14:05:26.538304 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:26.538242 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-px2cq" podUID="5a97ff24-1b84-4127-87cf-f53d545ce361" May 27 14:05:27.538415 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:27.538378 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wbsgc" May 27 14:05:27.538839 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:27.538503 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wbsgc" podUID="82e1095b-051d-4cd7-91f4-e3e2200e3812" May 27 14:05:27.538839 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:27.538561 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txmmd" May 27 14:05:27.538839 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:27.538695 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txmmd" podUID="3798bdf6-d616-43ed-b727-35b9407c33e7" May 27 14:05:28.538638 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:28.538551 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-px2cq" May 27 14:05:28.539114 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:28.538692 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-px2cq" podUID="5a97ff24-1b84-4127-87cf-f53d545ce361" May 27 14:05:29.542014 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:29.541960 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txmmd" May 27 14:05:29.542459 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:29.541961 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wbsgc" May 27 14:05:29.542459 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:29.542117 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txmmd" podUID="3798bdf6-d616-43ed-b727-35b9407c33e7" May 27 14:05:29.542459 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:29.542164 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wbsgc" podUID="82e1095b-051d-4cd7-91f4-e3e2200e3812" May 27 14:05:30.538078 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:30.538043 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-px2cq" May 27 14:05:30.538261 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:30.538175 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-px2cq" podUID="5a97ff24-1b84-4127-87cf-f53d545ce361" May 27 14:05:31.537977 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:31.537945 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wbsgc" May 27 14:05:31.538451 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:31.537948 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txmmd" May 27 14:05:31.538451 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:31.538060 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wbsgc" podUID="82e1095b-051d-4cd7-91f4-e3e2200e3812" May 27 14:05:31.538451 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:31.538136 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txmmd" podUID="3798bdf6-d616-43ed-b727-35b9407c33e7" May 27 14:05:32.538564 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:32.538306 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-px2cq" May 27 14:05:32.539045 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:32.538606 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-px2cq" podUID="5a97ff24-1b84-4127-87cf-f53d545ce361" May 27 14:05:33.159148 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:33.159117 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3798bdf6-d616-43ed-b727-35b9407c33e7-metrics-certs\") pod \"network-metrics-daemon-txmmd\" (UID: \"3798bdf6-d616-43ed-b727-35b9407c33e7\") " pod="openshift-multus/network-metrics-daemon-txmmd" May 27 14:05:33.159358 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:33.159253 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 14:05:33.159358 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:33.159316 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3798bdf6-d616-43ed-b727-35b9407c33e7-metrics-certs podName:3798bdf6-d616-43ed-b727-35b9407c33e7 nodeName:}" failed. No retries permitted until 2026-05-27 14:05:49.159298189 +0000 UTC m=+34.259615148 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3798bdf6-d616-43ed-b727-35b9407c33e7-metrics-certs") pod "network-metrics-daemon-txmmd" (UID: "3798bdf6-d616-43ed-b727-35b9407c33e7") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 14:05:33.259677 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:33.259640 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-blzm7\" (UniqueName: \"kubernetes.io/projected/82e1095b-051d-4cd7-91f4-e3e2200e3812-kube-api-access-blzm7\") pod \"network-check-target-wbsgc\" (UID: \"82e1095b-051d-4cd7-91f4-e3e2200e3812\") " pod="openshift-network-diagnostics/network-check-target-wbsgc" May 27 14:05:33.259909 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:33.259827 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 14:05:33.259909 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:33.259846 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 14:05:33.259909 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:33.259856 2563 projected.go:194] Error preparing data for projected volume kube-api-access-blzm7 for pod openshift-network-diagnostics/network-check-target-wbsgc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 14:05:33.260071 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:33.259921 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82e1095b-051d-4cd7-91f4-e3e2200e3812-kube-api-access-blzm7 podName:82e1095b-051d-4cd7-91f4-e3e2200e3812 nodeName:}" failed. No retries permitted until 2026-05-27 14:05:49.259904567 +0000 UTC m=+34.360221525 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-blzm7" (UniqueName: "kubernetes.io/projected/82e1095b-051d-4cd7-91f4-e3e2200e3812-kube-api-access-blzm7") pod "network-check-target-wbsgc" (UID: "82e1095b-051d-4cd7-91f4-e3e2200e3812") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 14:05:33.538582 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:33.538505 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txmmd" May 27 14:05:33.539013 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:33.538505 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wbsgc" May 27 14:05:33.539013 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:33.538627 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txmmd" podUID="3798bdf6-d616-43ed-b727-35b9407c33e7" May 27 14:05:33.539013 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:33.538725 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wbsgc" podUID="82e1095b-051d-4cd7-91f4-e3e2200e3812" May 27 14:05:34.369057 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:34.369016 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5a97ff24-1b84-4127-87cf-f53d545ce361-original-pull-secret\") pod \"global-pull-secret-syncer-px2cq\" (UID: \"5a97ff24-1b84-4127-87cf-f53d545ce361\") " pod="kube-system/global-pull-secret-syncer-px2cq" May 27 14:05:34.369204 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:34.369157 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 27 14:05:34.369261 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:34.369226 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a97ff24-1b84-4127-87cf-f53d545ce361-original-pull-secret podName:5a97ff24-1b84-4127-87cf-f53d545ce361 nodeName:}" failed. No retries permitted until 2026-05-27 14:05:50.369209182 +0000 UTC m=+35.469526130 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5a97ff24-1b84-4127-87cf-f53d545ce361-original-pull-secret") pod "global-pull-secret-syncer-px2cq" (UID: "5a97ff24-1b84-4127-87cf-f53d545ce361") : object "kube-system"/"original-pull-secret" not registered May 27 14:05:34.537756 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:34.537719 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-px2cq" May 27 14:05:34.537952 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:34.537927 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-px2cq" podUID="5a97ff24-1b84-4127-87cf-f53d545ce361" May 27 14:05:35.538566 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:35.538532 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wbsgc" May 27 14:05:35.539013 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:35.538623 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txmmd" May 27 14:05:35.539013 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:35.538647 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wbsgc" podUID="82e1095b-051d-4cd7-91f4-e3e2200e3812" May 27 14:05:35.539013 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:35.538740 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txmmd" podUID="3798bdf6-d616-43ed-b727-35b9407c33e7" May 27 14:05:36.538365 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:36.538334 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-px2cq" May 27 14:05:36.538491 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:36.538439 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-px2cq" podUID="5a97ff24-1b84-4127-87cf-f53d545ce361" May 27 14:05:36.630135 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:36.629966 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-27mm9" event={"ID":"dec3c402-9050-47e4-8002-9068ecb2ac0e","Type":"ContainerStarted","Data":"b6e31b77183c6e72f49194f668d7ecc1157599fef05e1ce6b9e3749a6f6178f3"} May 27 14:05:36.631271 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:36.631248 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jg92x" event={"ID":"1eeeff09-f3c8-453d-b9ca-d074d2cb10c8","Type":"ContainerStarted","Data":"e477a75a383c728ba3eed9071c8ee779226df8e51d1f754db5bb429f9abda598"} May 27 14:05:36.633023 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:36.633006 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fn9jd_3ebbf10f-4f07-403c-93b2-97261749308d/ovn-acl-logging/0.log" May 27 14:05:36.633274 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:36.633249 2563 generic.go:358] "Generic (PLEG): container finished" podID="3ebbf10f-4f07-403c-93b2-97261749308d" containerID="f709aab00ba42c7f4e9a1a86f837673a688c6e70e7994e1c4f1cc3935c685255" exitCode=1 May 27 14:05:36.633339 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:36.633305 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fn9jd" event={"ID":"3ebbf10f-4f07-403c-93b2-97261749308d","Type":"ContainerStarted","Data":"315d3d14ead821e5285dfe2601d8984f0331cdb505f6403f6a34b0e09b130165"} May 27 14:05:36.633339 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:36.633333 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fn9jd" event={"ID":"3ebbf10f-4f07-403c-93b2-97261749308d","Type":"ContainerStarted","Data":"aec113dc332be7be45f85cf6609e04eededd3dc055cde0bba764eccd85712422"} May 27 14:05:36.633421 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:36.633342 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fn9jd" event={"ID":"3ebbf10f-4f07-403c-93b2-97261749308d","Type":"ContainerDied","Data":"f709aab00ba42c7f4e9a1a86f837673a688c6e70e7994e1c4f1cc3935c685255"} May 27 14:05:36.633421 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:36.633353 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fn9jd" event={"ID":"3ebbf10f-4f07-403c-93b2-97261749308d","Type":"ContainerStarted","Data":"664c6113b606d73124dcff8821244a2e3135aa52512641094c0872df7bf1c44f"} May 27 14:05:36.634465 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:36.634443 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-b8xln" event={"ID":"bf9dc0c7-ad34-420e-bb88-13ce42450ed0","Type":"ContainerStarted","Data":"c0b37c1c4c20dfe65ce9397c8e42c4cb59dde4d8d2d1852a7f0b20715850b6bf"} May 27 14:05:36.635552 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:36.635531 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lkbl5" event={"ID":"e0c55f03-86a3-4759-9e7c-5cf53d4ea59d","Type":"ContainerStarted","Data":"76215d812b64bfe7d0ad0c5b5fc6c0319d524198e6e68538594b365531001c00"} May 27 14:05:36.636559 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:36.636542 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ng4xc" event={"ID":"1b57d88e-c349-4d40-92b8-757ec7474dc4","Type":"ContainerStarted","Data":"8ac1b9ce2b11df07632f21508070b0aa6167902ce18d042b933a3653b45ed6be"} May 27 14:05:36.637611 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:36.637593 2563 generic.go:358] "Generic (PLEG): container finished" podID="0b4d0670-6986-4085-a211-e22549067d90" containerID="7e8ce2fae311d52cad6813bd4a8d36bb72f19821c688d998be902199965492f6" exitCode=0 May 27 14:05:36.637677 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:36.637625 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tfnv8" event={"ID":"0b4d0670-6986-4085-a211-e22549067d90","Type":"ContainerDied","Data":"7e8ce2fae311d52cad6813bd4a8d36bb72f19821c688d998be902199965492f6"} May 27 14:05:36.679706 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:36.679659 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-27mm9" podStartSLOduration=3.9819013500000002 podStartE2EDuration="21.679642662s" podCreationTimestamp="2026-05-27 14:05:15 +0000 UTC" firstStartedPulling="2026-05-27 14:05:18.350709046 +0000 UTC m=+3.451025990" lastFinishedPulling="2026-05-27 14:05:36.048450343 +0000 UTC m=+21.148767302" observedRunningTime="2026-05-27 14:05:36.657208787 +0000 UTC m=+21.757525755" watchObservedRunningTime="2026-05-27 14:05:36.679642662 +0000 UTC m=+21.779959627" May 27 14:05:36.739869 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:36.739828 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-b8xln" podStartSLOduration=3.993073591 podStartE2EDuration="21.739814395s" podCreationTimestamp="2026-05-27 14:05:15 +0000 UTC" firstStartedPulling="2026-05-27 14:05:18.358036622 +0000 UTC m=+3.458353569" lastFinishedPulling="2026-05-27 14:05:36.104777423 +0000 UTC m=+21.205094373" observedRunningTime="2026-05-27 14:05:36.680274194 +0000 UTC m=+21.780591150" watchObservedRunningTime="2026-05-27 14:05:36.739814395 +0000 UTC m=+21.840131360" May 27 14:05:36.769050 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:36.769003 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-lkbl5" podStartSLOduration=4.079504298 podStartE2EDuration="21.768989314s" podCreationTimestamp="2026-05-27 14:05:15 +0000 UTC" firstStartedPulling="2026-05-27 14:05:18.357396719 +0000 UTC m=+3.457713668" lastFinishedPulling="2026-05-27 14:05:36.046881738 +0000 UTC m=+21.147198684" observedRunningTime="2026-05-27 14:05:36.768858495 +0000 UTC m=+21.869175460" watchObservedRunningTime="2026-05-27 14:05:36.768989314 +0000 UTC m=+21.869306280" May 27 14:05:37.537845 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:37.537789 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wbsgc" May 27 14:05:37.537845 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:37.537836 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txmmd" May 27 14:05:37.538123 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:37.537945 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wbsgc" podUID="82e1095b-051d-4cd7-91f4-e3e2200e3812" May 27 14:05:37.538123 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:37.538076 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txmmd" podUID="3798bdf6-d616-43ed-b727-35b9407c33e7" May 27 14:05:37.559764 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:37.559723 2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 27 14:05:37.642241 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:37.642216 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fn9jd_3ebbf10f-4f07-403c-93b2-97261749308d/ovn-acl-logging/0.log" May 27 14:05:37.643049 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:37.642619 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fn9jd" event={"ID":"3ebbf10f-4f07-403c-93b2-97261749308d","Type":"ContainerStarted","Data":"a2bb35c36c0017735a59f0f4454561b6b2a3d49cf955d90feca153353ddee0ad"} May 27 14:05:37.643049 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:37.642657 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fn9jd" event={"ID":"3ebbf10f-4f07-403c-93b2-97261749308d","Type":"ContainerStarted","Data":"1d227b9ee080ea897866be535931bec920d1e444c3fe309e43fcd53735a342e0"} May 27 14:05:37.644398 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:37.644371 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ng4xc" event={"ID":"1b57d88e-c349-4d40-92b8-757ec7474dc4","Type":"ContainerStarted","Data":"5a58aa7824160dcd54f53d7229a701919921321ade57c3564ad47127710c2d0a"} May 27 14:05:37.645805 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:37.645776 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wb972" event={"ID":"d5c39783-e332-4bc0-afe8-a3c254946252","Type":"ContainerStarted","Data":"b868360b939dc98b37540628d1943f367923d506a5eebd812326dcd10ff8b6a2"} May 27 14:05:37.676265 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:37.676138 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-jg92x" podStartSLOduration=8.798197823 podStartE2EDuration="22.67612092s" podCreationTimestamp="2026-05-27 14:05:15 +0000 UTC" firstStartedPulling="2026-05-27 14:05:18.350411069 +0000 UTC m=+3.450728026" lastFinishedPulling="2026-05-27 14:05:32.228334164 +0000 UTC m=+17.328651123" observedRunningTime="2026-05-27 14:05:36.783842262 +0000 UTC m=+21.884159228" watchObservedRunningTime="2026-05-27 14:05:37.67612092 +0000 UTC m=+22.776437889" May 27 14:05:38.483057 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:38.482956 2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-27T14:05:37.559756465Z","UUID":"e1eaee55-c08f-443c-bb9c-b06cfcca07ac","Handler":null,"Name":"","Endpoint":""} May 27 14:05:38.485100 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:38.485074 2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 27 14:05:38.485100 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:38.485104 2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 27 14:05:38.538258 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:38.538228 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-px2cq" May 27 14:05:38.538433 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:38.538333 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-px2cq" podUID="5a97ff24-1b84-4127-87cf-f53d545ce361" May 27 14:05:39.538823 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:39.538594 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txmmd" May 27 14:05:39.539286 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:39.538633 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wbsgc" May 27 14:05:39.539286 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:39.538944 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txmmd" podUID="3798bdf6-d616-43ed-b727-35b9407c33e7" May 27 14:05:39.539286 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:39.538978 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wbsgc" podUID="82e1095b-051d-4cd7-91f4-e3e2200e3812" May 27 14:05:39.650777 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:39.650741 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ng4xc" event={"ID":"1b57d88e-c349-4d40-92b8-757ec7474dc4","Type":"ContainerStarted","Data":"8c4cf96dc3e9d9660137e66eb03b41badaf2dcc09e3245940509816eabe137a7"} May 27 14:05:39.653175 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:39.653154 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fn9jd_3ebbf10f-4f07-403c-93b2-97261749308d/ovn-acl-logging/0.log" May 27 14:05:39.653419 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:39.653401 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fn9jd" event={"ID":"3ebbf10f-4f07-403c-93b2-97261749308d","Type":"ContainerStarted","Data":"887546fde57b79025cbbedc152fbf9980b5da619c3a1837c711ffe0fb8461204"} May 27 14:05:39.683223 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:39.683156 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-wb972" podStartSLOduration=6.982422839 podStartE2EDuration="24.683133909s" podCreationTimestamp="2026-05-27 14:05:15 +0000 UTC" firstStartedPulling="2026-05-27 14:05:18.34598309 +0000 UTC m=+3.446300035" lastFinishedPulling="2026-05-27 14:05:36.046694146 +0000 UTC m=+21.147011105" observedRunningTime="2026-05-27 14:05:37.675403639 +0000 UTC m=+22.775720605" watchObservedRunningTime="2026-05-27 14:05:39.683133909 +0000 UTC m=+24.783450877" May 27 14:05:39.684176 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:39.684134 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ng4xc" podStartSLOduration=4.4820247 podStartE2EDuration="24.684121207s" podCreationTimestamp="2026-05-27 14:05:15 +0000 UTC" firstStartedPulling="2026-05-27 14:05:18.353257702 +0000 UTC m=+3.453574652" lastFinishedPulling="2026-05-27 14:05:38.555354199 +0000 UTC m=+23.655671159" observedRunningTime="2026-05-27 14:05:39.682927511 +0000 UTC m=+24.783244474" watchObservedRunningTime="2026-05-27 14:05:39.684121207 +0000 UTC m=+24.784438174" May 27 14:05:40.538163 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:40.538130 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-px2cq" May 27 14:05:40.538360 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:40.538259 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-px2cq" podUID="5a97ff24-1b84-4127-87cf-f53d545ce361" May 27 14:05:41.323870 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:41.323793 2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-lkbl5" May 27 14:05:41.325370 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:41.324508 2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-lkbl5" May 27 14:05:41.537890 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:41.537799 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txmmd" May 27 14:05:41.537890 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:41.537799 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wbsgc" May 27 14:05:41.538069 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:41.537950 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txmmd" podUID="3798bdf6-d616-43ed-b727-35b9407c33e7" May 27 14:05:41.538069 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:41.537991 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wbsgc" podUID="82e1095b-051d-4cd7-91f4-e3e2200e3812" May 27 14:05:41.659426 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:41.659171 2563 generic.go:358] "Generic (PLEG): container finished" podID="0b4d0670-6986-4085-a211-e22549067d90" containerID="9a4e65331ee145e8f318151a0c90351364b5300fd1624cb14bf066e3c02f5075" exitCode=0 May 27 14:05:41.659604 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:41.659259 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tfnv8" event={"ID":"0b4d0670-6986-4085-a211-e22549067d90","Type":"ContainerDied","Data":"9a4e65331ee145e8f318151a0c90351364b5300fd1624cb14bf066e3c02f5075"} May 27 14:05:41.662554 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:41.662538 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fn9jd_3ebbf10f-4f07-403c-93b2-97261749308d/ovn-acl-logging/0.log" May 27 14:05:41.662956 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:41.662928 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fn9jd" event={"ID":"3ebbf10f-4f07-403c-93b2-97261749308d","Type":"ContainerStarted","Data":"3a64627e5c9c5e6fe75ee36d1c0da0bee03444363e2764a14c11a20a2374d3b1"} May 27 14:05:41.663563 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:41.663365 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-lkbl5" May 27 14:05:41.663563 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:41.663396 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fn9jd" May 27 14:05:41.663563 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:41.663410 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fn9jd" May 27 14:05:41.663563 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:41.663420 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fn9jd" May 27 14:05:41.663563 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:41.663394 2563 scope.go:117] "RemoveContainer" containerID="f709aab00ba42c7f4e9a1a86f837673a688c6e70e7994e1c4f1cc3935c685255" May 27 14:05:41.663852 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:41.663774 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-lkbl5" May 27 14:05:41.681044 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:41.681022 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fn9jd" May 27 14:05:41.681701 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:41.681689 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fn9jd" May 27 14:05:42.538093 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:42.537799 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-px2cq" May 27 14:05:42.538093 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:42.537929 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-px2cq" podUID="5a97ff24-1b84-4127-87cf-f53d545ce361" May 27 14:05:42.666695 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:42.666658 2563 generic.go:358] "Generic (PLEG): container finished" podID="0b4d0670-6986-4085-a211-e22549067d90" containerID="06ffba352b12dc60d0e2d0f1adc7a27fef35c2a830134ddc118eae0f892be1d0" exitCode=0 May 27 14:05:42.666860 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:42.666743 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tfnv8" event={"ID":"0b4d0670-6986-4085-a211-e22549067d90","Type":"ContainerDied","Data":"06ffba352b12dc60d0e2d0f1adc7a27fef35c2a830134ddc118eae0f892be1d0"} May 27 14:05:42.670315 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:42.670299 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fn9jd_3ebbf10f-4f07-403c-93b2-97261749308d/ovn-acl-logging/0.log" May 27 14:05:42.670692 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:42.670670 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fn9jd" event={"ID":"3ebbf10f-4f07-403c-93b2-97261749308d","Type":"ContainerStarted","Data":"e093b752f8dd14c8ba8c42bc7e1315ee9f3cf34bd5dada4c3a653d58b094de51"} May 27 14:05:42.723046 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:42.722932 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-fn9jd" podStartSLOduration=9.983745605 podStartE2EDuration="27.72291361s" podCreationTimestamp="2026-05-27 14:05:15 +0000 UTC" firstStartedPulling="2026-05-27 14:05:18.34881497 +0000 UTC m=+3.449131915" lastFinishedPulling="2026-05-27 14:05:36.087982969 +0000 UTC m=+21.188299920" observedRunningTime="2026-05-27 14:05:42.722356578 +0000 UTC m=+27.822673545" watchObservedRunningTime="2026-05-27 14:05:42.72291361 +0000 UTC m=+27.823230571" May 27 14:05:43.183174 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:43.183067 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-px2cq"] May 27 14:05:43.183174 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:43.183163 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-px2cq" May 27 14:05:43.183375 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:43.183244 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-px2cq" podUID="5a97ff24-1b84-4127-87cf-f53d545ce361" May 27 14:05:43.187207 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:43.187181 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wbsgc"] May 27 14:05:43.187316 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:43.187298 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wbsgc" May 27 14:05:43.187381 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:43.187365 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wbsgc" podUID="82e1095b-051d-4cd7-91f4-e3e2200e3812" May 27 14:05:43.201604 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:43.201580 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-txmmd"] May 27 14:05:43.201730 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:43.201689 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txmmd" May 27 14:05:43.201835 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:43.201806 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txmmd" podUID="3798bdf6-d616-43ed-b727-35b9407c33e7" May 27 14:05:43.675114 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:43.675076 2563 generic.go:358] "Generic (PLEG): container finished" podID="0b4d0670-6986-4085-a211-e22549067d90" containerID="5058abf2c689e3c543bbb6f4a09b1c5c29a658fbd2927daf77d8d3d5a8ea351f" exitCode=0 May 27 14:05:43.675599 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:43.675147 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tfnv8" event={"ID":"0b4d0670-6986-4085-a211-e22549067d90","Type":"ContainerDied","Data":"5058abf2c689e3c543bbb6f4a09b1c5c29a658fbd2927daf77d8d3d5a8ea351f"} May 27 14:05:44.538126 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:44.538096 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wbsgc" May 27 14:05:44.538306 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:44.538130 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-px2cq" May 27 14:05:44.538306 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:44.538158 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txmmd" May 27 14:05:44.538306 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:44.538248 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-px2cq" podUID="5a97ff24-1b84-4127-87cf-f53d545ce361" May 27 14:05:44.538474 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:44.538339 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wbsgc" podUID="82e1095b-051d-4cd7-91f4-e3e2200e3812" May 27 14:05:44.538474 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:44.538424 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txmmd" podUID="3798bdf6-d616-43ed-b727-35b9407c33e7" May 27 14:05:45.272413 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:45.272377 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-j85ns"] May 27 14:05:45.288600 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:45.288569 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-j85ns" May 27 14:05:45.291921 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:45.291623 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-dgz9p\"" May 27 14:05:45.291921 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:45.291648 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 27 14:05:45.291921 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:45.291674 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 27 14:05:45.451870 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:45.451797 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f5e2da5b-e345-4b11-ac5e-19f844c185e8-hosts-file\") pod \"node-resolver-j85ns\" (UID: \"f5e2da5b-e345-4b11-ac5e-19f844c185e8\") " pod="openshift-dns/node-resolver-j85ns" May 27 14:05:45.451870 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:45.451829 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f5e2da5b-e345-4b11-ac5e-19f844c185e8-tmp-dir\") pod \"node-resolver-j85ns\" (UID: \"f5e2da5b-e345-4b11-ac5e-19f844c185e8\") " pod="openshift-dns/node-resolver-j85ns" May 27 14:05:45.451870 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:45.451852 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqct6\" (UniqueName: \"kubernetes.io/projected/f5e2da5b-e345-4b11-ac5e-19f844c185e8-kube-api-access-bqct6\") pod \"node-resolver-j85ns\" (UID: \"f5e2da5b-e345-4b11-ac5e-19f844c185e8\") " pod="openshift-dns/node-resolver-j85ns" May 27 14:05:45.552605 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:45.552576 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f5e2da5b-e345-4b11-ac5e-19f844c185e8-hosts-file\") pod \"node-resolver-j85ns\" (UID: \"f5e2da5b-e345-4b11-ac5e-19f844c185e8\") " pod="openshift-dns/node-resolver-j85ns" May 27 14:05:45.552605 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:45.552610 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f5e2da5b-e345-4b11-ac5e-19f844c185e8-tmp-dir\") pod \"node-resolver-j85ns\" (UID: \"f5e2da5b-e345-4b11-ac5e-19f844c185e8\") " pod="openshift-dns/node-resolver-j85ns" May 27 14:05:45.552826 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:45.552631 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bqct6\" (UniqueName: \"kubernetes.io/projected/f5e2da5b-e345-4b11-ac5e-19f844c185e8-kube-api-access-bqct6\") pod \"node-resolver-j85ns\" (UID: \"f5e2da5b-e345-4b11-ac5e-19f844c185e8\") " pod="openshift-dns/node-resolver-j85ns" May 27 14:05:45.552826 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:45.552749 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f5e2da5b-e345-4b11-ac5e-19f844c185e8-hosts-file\") pod \"node-resolver-j85ns\" (UID: \"f5e2da5b-e345-4b11-ac5e-19f844c185e8\") " pod="openshift-dns/node-resolver-j85ns" May 27 14:05:45.553010 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:45.552989 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f5e2da5b-e345-4b11-ac5e-19f844c185e8-tmp-dir\") pod \"node-resolver-j85ns\" (UID: \"f5e2da5b-e345-4b11-ac5e-19f844c185e8\") " pod="openshift-dns/node-resolver-j85ns" May 27 14:05:45.568120 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:45.568087 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqct6\" (UniqueName: \"kubernetes.io/projected/f5e2da5b-e345-4b11-ac5e-19f844c185e8-kube-api-access-bqct6\") pod \"node-resolver-j85ns\" (UID: \"f5e2da5b-e345-4b11-ac5e-19f844c185e8\") " pod="openshift-dns/node-resolver-j85ns" May 27 14:05:45.600504 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:45.600461 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-j85ns" May 27 14:05:45.611682 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:45.611479 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5e2da5b_e345_4b11_ac5e_19f844c185e8.slice/crio-a109f6e6d6cccf6521cb5c19bca71076bfd8ab030301d567329ce216a40b58a5 WatchSource:0}: Error finding container a109f6e6d6cccf6521cb5c19bca71076bfd8ab030301d567329ce216a40b58a5: Status 404 returned error can't find the container with id a109f6e6d6cccf6521cb5c19bca71076bfd8ab030301d567329ce216a40b58a5 May 27 14:05:45.681065 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:45.681026 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-j85ns" event={"ID":"f5e2da5b-e345-4b11-ac5e-19f844c185e8","Type":"ContainerStarted","Data":"a109f6e6d6cccf6521cb5c19bca71076bfd8ab030301d567329ce216a40b58a5"} May 27 14:05:46.538715 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:46.538676 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-px2cq" May 27 14:05:46.538715 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:46.538676 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wbsgc" May 27 14:05:46.539366 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:46.538694 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txmmd" May 27 14:05:46.539366 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:46.538800 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-px2cq" podUID="5a97ff24-1b84-4127-87cf-f53d545ce361" May 27 14:05:46.539366 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:46.538867 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txmmd" podUID="3798bdf6-d616-43ed-b727-35b9407c33e7" May 27 14:05:46.539366 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:46.538966 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wbsgc" podUID="82e1095b-051d-4cd7-91f4-e3e2200e3812" May 27 14:05:46.684961 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:46.684926 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-j85ns" event={"ID":"f5e2da5b-e345-4b11-ac5e-19f844c185e8","Type":"ContainerStarted","Data":"ab483d6c75d1daa9a680e1d9b0a13a4b8807bf89c24cc1a03f6dabf6eff4cbf3"} May 27 14:05:46.700594 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:46.700547 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-j85ns" podStartSLOduration=1.700529899 podStartE2EDuration="1.700529899s" podCreationTimestamp="2026-05-27 14:05:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 14:05:46.700059667 +0000 UTC m=+31.800376634" watchObservedRunningTime="2026-05-27 14:05:46.700529899 +0000 UTC m=+31.800846863" May 27 14:05:48.538081 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:48.538041 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wbsgc" May 27 14:05:48.538579 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:48.538046 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txmmd" May 27 14:05:48.538579 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:48.538172 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wbsgc" podUID="82e1095b-051d-4cd7-91f4-e3e2200e3812" May 27 14:05:48.538579 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:48.538279 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txmmd" podUID="3798bdf6-d616-43ed-b727-35b9407c33e7" May 27 14:05:48.538579 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:48.538046 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-px2cq" May 27 14:05:48.538579 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:48.538400 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-px2cq" podUID="5a97ff24-1b84-4127-87cf-f53d545ce361" May 27 14:05:49.176872 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.176765 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3798bdf6-d616-43ed-b727-35b9407c33e7-metrics-certs\") pod \"network-metrics-daemon-txmmd\" (UID: \"3798bdf6-d616-43ed-b727-35b9407c33e7\") " pod="openshift-multus/network-metrics-daemon-txmmd" May 27 14:05:49.177057 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:49.176944 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 14:05:49.177057 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:49.177016 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3798bdf6-d616-43ed-b727-35b9407c33e7-metrics-certs podName:3798bdf6-d616-43ed-b727-35b9407c33e7 nodeName:}" failed. No retries permitted until 2026-05-27 14:06:21.177000782 +0000 UTC m=+66.277317731 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3798bdf6-d616-43ed-b727-35b9407c33e7-metrics-certs") pod "network-metrics-daemon-txmmd" (UID: "3798bdf6-d616-43ed-b727-35b9407c33e7") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 14:05:49.204458 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.204421 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-198.ec2.internal" event="NodeReady" May 27 14:05:49.204621 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.204587 2563 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 27 14:05:49.277907 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.277871 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-blzm7\" (UniqueName: \"kubernetes.io/projected/82e1095b-051d-4cd7-91f4-e3e2200e3812-kube-api-access-blzm7\") pod \"network-check-target-wbsgc\" (UID: \"82e1095b-051d-4cd7-91f4-e3e2200e3812\") " pod="openshift-network-diagnostics/network-check-target-wbsgc" May 27 14:05:49.278088 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:49.278055 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 14:05:49.278088 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:49.278078 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 14:05:49.278088 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:49.278088 2563 projected.go:194] Error preparing data for projected volume kube-api-access-blzm7 for pod openshift-network-diagnostics/network-check-target-wbsgc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 14:05:49.278205 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:49.278143 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82e1095b-051d-4cd7-91f4-e3e2200e3812-kube-api-access-blzm7 podName:82e1095b-051d-4cd7-91f4-e3e2200e3812 nodeName:}" failed. No retries permitted until 2026-05-27 14:06:21.278126885 +0000 UTC m=+66.378443849 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-blzm7" (UniqueName: "kubernetes.io/projected/82e1095b-051d-4cd7-91f4-e3e2200e3812-kube-api-access-blzm7") pod "network-check-target-wbsgc" (UID: "82e1095b-051d-4cd7-91f4-e3e2200e3812") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 14:05:49.281660 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.281633 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-69cfc4ffb6-cbl6j"] May 27 14:05:49.345451 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.345417 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-7lb8j"] May 27 14:05:49.345631 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.345611 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69cfc4ffb6-cbl6j" May 27 14:05:49.349747 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.349722 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 27 14:05:49.349916 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.349868 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-w599p\"" May 27 14:05:49.351192 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.351170 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 27 14:05:49.351504 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.351483 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 27 14:05:49.357992 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.357972 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-g2b6v"] May 27 14:05:49.358143 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.358127 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-7lb8j" May 27 14:05:49.366224 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.366143 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 27 14:05:49.366678 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.366606 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-t95z9\"" May 27 14:05:49.368530 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.368504 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 27 14:05:49.368621 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.368550 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 27 14:05:49.368912 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.368876 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" May 27 14:05:49.372275 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.371945 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" May 27 14:05:49.375107 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.375086 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" May 27 14:05:49.380235 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.380213 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-5g8bd"] May 27 14:05:49.380423 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.380402 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-g2b6v" May 27 14:05:49.386841 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.386796 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" May 27 14:05:49.387117 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.387095 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-vwm8c\"" May 27 14:05:49.387255 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.387233 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 27 14:05:49.387327 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.387148 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 27 14:05:49.388363 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.388342 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" May 27 14:05:49.398284 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.398254 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-qwh27"] May 27 14:05:49.398437 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.398412 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-5g8bd" May 27 14:05:49.402685 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.402663 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" May 27 14:05:49.403347 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.403322 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" May 27 14:05:49.405197 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.403881 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" May 27 14:05:49.413482 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.413443 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-89v2p\"" May 27 14:05:49.413645 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.413582 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" May 27 14:05:49.413716 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.413698 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-69cfc4ffb6-cbl6j"] May 27 14:05:49.413716 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.413716 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-qwh27"] May 27 14:05:49.413815 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.413730 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-g2b6v"] May 27 14:05:49.413815 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.413743 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-5g8bd"] May 27 14:05:49.413815 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.413755 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-7lb8j"] May 27 14:05:49.413815 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.413769 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-f8t8t"] May 27 14:05:49.414006 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.413849 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-qwh27" May 27 14:05:49.418109 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.418084 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" May 27 14:05:49.423991 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.423963 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" May 27 14:05:49.423991 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.423989 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" May 27 14:05:49.424158 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.423969 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" May 27 14:05:49.424158 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.423963 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" May 27 14:05:49.425472 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.425451 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-gbtfz\"" May 27 14:05:49.427509 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.427461 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-799b5db656-96kw4"] May 27 14:05:49.427656 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.427640 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-f8t8t" May 27 14:05:49.431973 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.431949 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 27 14:05:49.432211 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.432194 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 27 14:05:49.432297 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.432247 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dcgs8\"" May 27 14:05:49.439566 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.439539 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-klfdl"] May 27 14:05:49.439703 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.439687 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-799b5db656-96kw4" May 27 14:05:49.445074 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.445045 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 27 14:05:49.445410 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.445277 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" May 27 14:05:49.445410 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.445298 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" May 27 14:05:49.445586 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.445571 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" May 27 14:05:49.445663 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.445646 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-knf2q\"" May 27 14:05:49.445744 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.445682 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" May 27 14:05:49.445744 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.445574 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 27 14:05:49.454550 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.454521 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-26d7g"] May 27 14:05:49.454694 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.454676 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-klfdl" May 27 14:05:49.460996 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.460972 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" May 27 14:05:49.461151 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.461130 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-lf9rg\"" May 27 14:05:49.461238 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.461149 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" May 27 14:05:49.461238 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.461230 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" May 27 14:05:49.461708 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.461689 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" May 27 14:05:49.467265 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.467245 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-t6kzq"] May 27 14:05:49.467417 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.467400 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-26d7g" May 27 14:05:49.472436 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.472416 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" May 27 14:05:49.472665 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.472648 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" May 27 14:05:49.472750 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.472650 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-bhpr2\"" May 27 14:05:49.479641 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.479619 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jwtx\" (UniqueName: \"kubernetes.io/projected/69c8ab79-2afc-44ae-ba1f-7bbd76642023-kube-api-access-6jwtx\") pod \"insights-operator-78bdfb888c-7lb8j\" (UID: \"69c8ab79-2afc-44ae-ba1f-7bbd76642023\") " pod="openshift-insights/insights-operator-78bdfb888c-7lb8j" May 27 14:05:49.479751 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.479651 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b74fdc34-9e61-4170-840c-d8522b71dcb5-image-registry-private-configuration\") pod \"image-registry-69cfc4ffb6-cbl6j\" (UID: \"b74fdc34-9e61-4170-840c-d8522b71dcb5\") " pod="openshift-image-registry/image-registry-69cfc4ffb6-cbl6j" May 27 14:05:49.479751 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.479671 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b74fdc34-9e61-4170-840c-d8522b71dcb5-installation-pull-secrets\") pod \"image-registry-69cfc4ffb6-cbl6j\" (UID: \"b74fdc34-9e61-4170-840c-d8522b71dcb5\") " pod="openshift-image-registry/image-registry-69cfc4ffb6-cbl6j" May 27 14:05:49.479751 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.479705 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b74fdc34-9e61-4170-840c-d8522b71dcb5-ca-trust-extracted\") pod \"image-registry-69cfc4ffb6-cbl6j\" (UID: \"b74fdc34-9e61-4170-840c-d8522b71dcb5\") " pod="openshift-image-registry/image-registry-69cfc4ffb6-cbl6j" May 27 14:05:49.479751 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.479725 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b74fdc34-9e61-4170-840c-d8522b71dcb5-registry-certificates\") pod \"image-registry-69cfc4ffb6-cbl6j\" (UID: \"b74fdc34-9e61-4170-840c-d8522b71dcb5\") " pod="openshift-image-registry/image-registry-69cfc4ffb6-cbl6j" May 27 14:05:49.479925 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.479764 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzhgf\" (UniqueName: \"kubernetes.io/projected/b74fdc34-9e61-4170-840c-d8522b71dcb5-kube-api-access-mzhgf\") pod \"image-registry-69cfc4ffb6-cbl6j\" (UID: \"b74fdc34-9e61-4170-840c-d8522b71dcb5\") " pod="openshift-image-registry/image-registry-69cfc4ffb6-cbl6j" May 27 14:05:49.479925 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.479842 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/69c8ab79-2afc-44ae-ba1f-7bbd76642023-tmp\") pod \"insights-operator-78bdfb888c-7lb8j\" (UID: \"69c8ab79-2afc-44ae-ba1f-7bbd76642023\") " pod="openshift-insights/insights-operator-78bdfb888c-7lb8j" May 27 14:05:49.480031 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.479930 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69c8ab79-2afc-44ae-ba1f-7bbd76642023-service-ca-bundle\") pod \"insights-operator-78bdfb888c-7lb8j\" (UID: \"69c8ab79-2afc-44ae-ba1f-7bbd76642023\") " pod="openshift-insights/insights-operator-78bdfb888c-7lb8j" May 27 14:05:49.480031 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.479966 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9c8g\" (UniqueName: \"kubernetes.io/projected/4ab50ff1-44f8-4599-9e35-5998ed988cfd-kube-api-access-x9c8g\") pod \"cluster-monitoring-operator-6c75959455-g2b6v\" (UID: \"4ab50ff1-44f8-4599-9e35-5998ed988cfd\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-g2b6v" May 27 14:05:49.480031 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.480015 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b74fdc34-9e61-4170-840c-d8522b71dcb5-registry-tls\") pod \"image-registry-69cfc4ffb6-cbl6j\" (UID: \"b74fdc34-9e61-4170-840c-d8522b71dcb5\") " pod="openshift-image-registry/image-registry-69cfc4ffb6-cbl6j" May 27 14:05:49.480165 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.480041 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b74fdc34-9e61-4170-840c-d8522b71dcb5-bound-sa-token\") pod \"image-registry-69cfc4ffb6-cbl6j\" (UID: \"b74fdc34-9e61-4170-840c-d8522b71dcb5\") " pod="openshift-image-registry/image-registry-69cfc4ffb6-cbl6j" May 27 14:05:49.480165 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.480100 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b74fdc34-9e61-4170-840c-d8522b71dcb5-trusted-ca\") pod \"image-registry-69cfc4ffb6-cbl6j\" (UID: \"b74fdc34-9e61-4170-840c-d8522b71dcb5\") " pod="openshift-image-registry/image-registry-69cfc4ffb6-cbl6j" May 27 14:05:49.480165 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.480147 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69c8ab79-2afc-44ae-ba1f-7bbd76642023-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-7lb8j\" (UID: \"69c8ab79-2afc-44ae-ba1f-7bbd76642023\") " pod="openshift-insights/insights-operator-78bdfb888c-7lb8j" May 27 14:05:49.480288 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.480182 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4ab50ff1-44f8-4599-9e35-5998ed988cfd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-g2b6v\" (UID: \"4ab50ff1-44f8-4599-9e35-5998ed988cfd\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-g2b6v" May 27 14:05:49.480288 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.480227 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4ab50ff1-44f8-4599-9e35-5998ed988cfd-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-g2b6v\" (UID: \"4ab50ff1-44f8-4599-9e35-5998ed988cfd\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-g2b6v" May 27 14:05:49.480351 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.480295 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/69c8ab79-2afc-44ae-ba1f-7bbd76642023-serving-cert\") pod \"insights-operator-78bdfb888c-7lb8j\" (UID: \"69c8ab79-2afc-44ae-ba1f-7bbd76642023\") " pod="openshift-insights/insights-operator-78bdfb888c-7lb8j" May 27 14:05:49.480351 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.480321 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/69c8ab79-2afc-44ae-ba1f-7bbd76642023-snapshots\") pod \"insights-operator-78bdfb888c-7lb8j\" (UID: \"69c8ab79-2afc-44ae-ba1f-7bbd76642023\") " pod="openshift-insights/insights-operator-78bdfb888c-7lb8j" May 27 14:05:49.483551 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.483529 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-jqf48"] May 27 14:05:49.483687 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.483661 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-t6kzq" May 27 14:05:49.488058 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.488034 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" May 27 14:05:49.488058 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.488036 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" May 27 14:05:49.488766 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.488748 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-2ldp2\"" May 27 14:05:49.500083 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.500012 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-68ntw"] May 27 14:05:49.500529 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.500504 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-jqf48" May 27 14:05:49.503485 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.503462 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" May 27 14:05:49.503790 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.503773 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-46prk\"" May 27 14:05:49.504025 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.504007 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" May 27 14:05:49.504310 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.504292 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" May 27 14:05:49.510438 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.510413 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-t6kzq"] May 27 14:05:49.510542 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.510532 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-26d7g"] May 27 14:05:49.510606 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.510549 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-799b5db656-96kw4"] May 27 14:05:49.510606 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.510561 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-f8t8t"] May 27 14:05:49.510606 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.510586 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-lx84l"] May 27 14:05:49.510606 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.510588 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-68ntw" May 27 14:05:49.514653 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.514575 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 27 14:05:49.514653 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.514620 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-qfz52\"" May 27 14:05:49.514653 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.514649 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 27 14:05:49.521259 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.520826 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-68ntw"] May 27 14:05:49.521259 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.520856 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-jqf48"] May 27 14:05:49.521259 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.520874 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-klfdl"] May 27 14:05:49.521259 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.520887 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lx84l"] May 27 14:05:49.521259 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.521029 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lx84l" May 27 14:05:49.523862 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.523839 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 27 14:05:49.523976 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.523882 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 27 14:05:49.523976 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.523958 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-rb76g\"" May 27 14:05:49.524213 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.524197 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 27 14:05:49.581282 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.581245 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4ab50ff1-44f8-4599-9e35-5998ed988cfd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-g2b6v\" (UID: \"4ab50ff1-44f8-4599-9e35-5998ed988cfd\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-g2b6v" May 27 14:05:49.581654 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.581297 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bd3304d-9bda-4253-ac96-0dfca56dd2e1-service-ca-bundle\") pod \"router-default-799b5db656-96kw4\" (UID: \"1bd3304d-9bda-4253-ac96-0dfca56dd2e1\") " pod="openshift-ingress/router-default-799b5db656-96kw4" May 27 14:05:49.581654 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.581328 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5ed1e6d4-18f5-4adf-82a7-2560aa07f855-config\") pod \"service-ca-operator-57b5b68b8-klfdl\" (UID: \"5ed1e6d4-18f5-4adf-82a7-2560aa07f855\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-klfdl" May 27 14:05:49.581654 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.581358 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4ab50ff1-44f8-4599-9e35-5998ed988cfd-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-g2b6v\" (UID: \"4ab50ff1-44f8-4599-9e35-5998ed988cfd\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-g2b6v" May 27 14:05:49.581654 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.581389 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2wnl\" (UniqueName: \"kubernetes.io/projected/1bd3304d-9bda-4253-ac96-0dfca56dd2e1-kube-api-access-w2wnl\") pod \"router-default-799b5db656-96kw4\" (UID: \"1bd3304d-9bda-4253-ac96-0dfca56dd2e1\") " pod="openshift-ingress/router-default-799b5db656-96kw4" May 27 14:05:49.581654 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:49.581406 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 27 14:05:49.581654 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:49.581460 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ab50ff1-44f8-4599-9e35-5998ed988cfd-cluster-monitoring-operator-tls podName:4ab50ff1-44f8-4599-9e35-5998ed988cfd nodeName:}" failed. No retries permitted until 2026-05-27 14:05:50.081444707 +0000 UTC m=+35.181761654 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4ab50ff1-44f8-4599-9e35-5998ed988cfd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-g2b6v" (UID: "4ab50ff1-44f8-4599-9e35-5998ed988cfd") : secret "cluster-monitoring-operator-tls" not found May 27 14:05:49.581654 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.581455 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/69c8ab79-2afc-44ae-ba1f-7bbd76642023-snapshots\") pod \"insights-operator-78bdfb888c-7lb8j\" (UID: \"69c8ab79-2afc-44ae-ba1f-7bbd76642023\") " pod="openshift-insights/insights-operator-78bdfb888c-7lb8j" May 27 14:05:49.581654 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.581499 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b74fdc34-9e61-4170-840c-d8522b71dcb5-image-registry-private-configuration\") pod \"image-registry-69cfc4ffb6-cbl6j\" (UID: \"b74fdc34-9e61-4170-840c-d8522b71dcb5\") " pod="openshift-image-registry/image-registry-69cfc4ffb6-cbl6j" May 27 14:05:49.581654 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.581530 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6jwtx\" (UniqueName: \"kubernetes.io/projected/69c8ab79-2afc-44ae-ba1f-7bbd76642023-kube-api-access-6jwtx\") pod \"insights-operator-78bdfb888c-7lb8j\" (UID: \"69c8ab79-2afc-44ae-ba1f-7bbd76642023\") " pod="openshift-insights/insights-operator-78bdfb888c-7lb8j" May 27 14:05:49.581654 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.581559 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e2bc8d1f-4404-42a0-ae30-056843788536-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-26d7g\" (UID: \"e2bc8d1f-4404-42a0-ae30-056843788536\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-26d7g" May 27 14:05:49.581654 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.581588 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/1bd3304d-9bda-4253-ac96-0dfca56dd2e1-default-certificate\") pod \"router-default-799b5db656-96kw4\" (UID: \"1bd3304d-9bda-4253-ac96-0dfca56dd2e1\") " pod="openshift-ingress/router-default-799b5db656-96kw4" May 27 14:05:49.581654 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.581639 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pb9tg\" (UniqueName: \"kubernetes.io/projected/5ed1e6d4-18f5-4adf-82a7-2560aa07f855-kube-api-access-pb9tg\") pod \"service-ca-operator-57b5b68b8-klfdl\" (UID: \"5ed1e6d4-18f5-4adf-82a7-2560aa07f855\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-klfdl" May 27 14:05:49.582242 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.581685 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bk976\" (UniqueName: \"kubernetes.io/projected/11cf11df-4ac4-41ac-9294-bd472eb60b20-kube-api-access-bk976\") pod \"dns-default-f8t8t\" (UID: \"11cf11df-4ac4-41ac-9294-bd472eb60b20\") " pod="openshift-dns/dns-default-f8t8t" May 27 14:05:49.582242 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.581721 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b74fdc34-9e61-4170-840c-d8522b71dcb5-registry-certificates\") pod \"image-registry-69cfc4ffb6-cbl6j\" (UID: \"b74fdc34-9e61-4170-840c-d8522b71dcb5\") " pod="openshift-image-registry/image-registry-69cfc4ffb6-cbl6j" May 27 14:05:49.582242 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.581749 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mzhgf\" (UniqueName: \"kubernetes.io/projected/b74fdc34-9e61-4170-840c-d8522b71dcb5-kube-api-access-mzhgf\") pod \"image-registry-69cfc4ffb6-cbl6j\" (UID: \"b74fdc34-9e61-4170-840c-d8522b71dcb5\") " pod="openshift-image-registry/image-registry-69cfc4ffb6-cbl6j" May 27 14:05:49.582242 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.581778 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5ed1e6d4-18f5-4adf-82a7-2560aa07f855-serving-cert\") pod \"service-ca-operator-57b5b68b8-klfdl\" (UID: \"5ed1e6d4-18f5-4adf-82a7-2560aa07f855\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-klfdl" May 27 14:05:49.582242 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.581811 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6dfeff02-a96c-4202-bac6-7346398337d3-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-qwh27\" (UID: \"6dfeff02-a96c-4202-bac6-7346398337d3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-qwh27" May 27 14:05:49.582242 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.581962 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4589d4df-d2d2-43e2-af93-da49d130d20d-config\") pod \"console-operator-76dff48d59-5g8bd\" (UID: \"4589d4df-d2d2-43e2-af93-da49d130d20d\") " pod="openshift-console-operator/console-operator-76dff48d59-5g8bd" May 27 14:05:49.582242 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.582005 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69c8ab79-2afc-44ae-ba1f-7bbd76642023-service-ca-bundle\") pod \"insights-operator-78bdfb888c-7lb8j\" (UID: \"69c8ab79-2afc-44ae-ba1f-7bbd76642023\") " pod="openshift-insights/insights-operator-78bdfb888c-7lb8j" May 27 14:05:49.582242 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.582043 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1bd3304d-9bda-4253-ac96-0dfca56dd2e1-metrics-certs\") pod \"router-default-799b5db656-96kw4\" (UID: \"1bd3304d-9bda-4253-ac96-0dfca56dd2e1\") " pod="openshift-ingress/router-default-799b5db656-96kw4" May 27 14:05:49.582242 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.582132 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/11cf11df-4ac4-41ac-9294-bd472eb60b20-config-volume\") pod \"dns-default-f8t8t\" (UID: \"11cf11df-4ac4-41ac-9294-bd472eb60b20\") " pod="openshift-dns/dns-default-f8t8t" May 27 14:05:49.582242 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.582156 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/69c8ab79-2afc-44ae-ba1f-7bbd76642023-snapshots\") pod \"insights-operator-78bdfb888c-7lb8j\" (UID: \"69c8ab79-2afc-44ae-ba1f-7bbd76642023\") " pod="openshift-insights/insights-operator-78bdfb888c-7lb8j" May 27 14:05:49.582242 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.582159 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6dfeff02-a96c-4202-bac6-7346398337d3-config\") pod \"kube-storage-version-migrator-operator-565644f49-qwh27\" (UID: \"6dfeff02-a96c-4202-bac6-7346398337d3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-qwh27" May 27 14:05:49.582242 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.582209 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4ab50ff1-44f8-4599-9e35-5998ed988cfd-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-g2b6v\" (UID: \"4ab50ff1-44f8-4599-9e35-5998ed988cfd\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-g2b6v" May 27 14:05:49.582242 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.582233 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b74fdc34-9e61-4170-840c-d8522b71dcb5-trusted-ca\") pod \"image-registry-69cfc4ffb6-cbl6j\" (UID: \"b74fdc34-9e61-4170-840c-d8522b71dcb5\") " pod="openshift-image-registry/image-registry-69cfc4ffb6-cbl6j" May 27 14:05:49.582817 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.582261 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b74fdc34-9e61-4170-840c-d8522b71dcb5-registry-certificates\") pod \"image-registry-69cfc4ffb6-cbl6j\" (UID: \"b74fdc34-9e61-4170-840c-d8522b71dcb5\") " pod="openshift-image-registry/image-registry-69cfc4ffb6-cbl6j" May 27 14:05:49.582817 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.582265 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/1bd3304d-9bda-4253-ac96-0dfca56dd2e1-stats-auth\") pod \"router-default-799b5db656-96kw4\" (UID: \"1bd3304d-9bda-4253-ac96-0dfca56dd2e1\") " pod="openshift-ingress/router-default-799b5db656-96kw4" May 27 14:05:49.582817 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.582311 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/11cf11df-4ac4-41ac-9294-bd472eb60b20-metrics-tls\") pod \"dns-default-f8t8t\" (UID: \"11cf11df-4ac4-41ac-9294-bd472eb60b20\") " pod="openshift-dns/dns-default-f8t8t" May 27 14:05:49.582817 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.582335 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4p4q\" (UniqueName: \"kubernetes.io/projected/4589d4df-d2d2-43e2-af93-da49d130d20d-kube-api-access-n4p4q\") pod \"console-operator-76dff48d59-5g8bd\" (UID: \"4589d4df-d2d2-43e2-af93-da49d130d20d\") " pod="openshift-console-operator/console-operator-76dff48d59-5g8bd" May 27 14:05:49.582817 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.582359 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e2bc8d1f-4404-42a0-ae30-056843788536-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-26d7g\" (UID: \"e2bc8d1f-4404-42a0-ae30-056843788536\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-26d7g" May 27 14:05:49.582817 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.582385 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4589d4df-d2d2-43e2-af93-da49d130d20d-serving-cert\") pod \"console-operator-76dff48d59-5g8bd\" (UID: \"4589d4df-d2d2-43e2-af93-da49d130d20d\") " pod="openshift-console-operator/console-operator-76dff48d59-5g8bd" May 27 14:05:49.582817 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.582407 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/69c8ab79-2afc-44ae-ba1f-7bbd76642023-serving-cert\") pod \"insights-operator-78bdfb888c-7lb8j\" (UID: \"69c8ab79-2afc-44ae-ba1f-7bbd76642023\") " pod="openshift-insights/insights-operator-78bdfb888c-7lb8j" May 27 14:05:49.582817 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.582430 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b74fdc34-9e61-4170-840c-d8522b71dcb5-installation-pull-secrets\") pod \"image-registry-69cfc4ffb6-cbl6j\" (UID: \"b74fdc34-9e61-4170-840c-d8522b71dcb5\") " pod="openshift-image-registry/image-registry-69cfc4ffb6-cbl6j" May 27 14:05:49.582817 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.582452 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6grz8\" (UniqueName: \"kubernetes.io/projected/97247087-636a-4f55-9a2a-47cc162238d2-kube-api-access-6grz8\") pod \"volume-data-source-validator-5cf8c89d64-t6kzq\" (UID: \"97247087-636a-4f55-9a2a-47cc162238d2\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-t6kzq" May 27 14:05:49.582817 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.582530 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69c8ab79-2afc-44ae-ba1f-7bbd76642023-service-ca-bundle\") pod \"insights-operator-78bdfb888c-7lb8j\" (UID: \"69c8ab79-2afc-44ae-ba1f-7bbd76642023\") " pod="openshift-insights/insights-operator-78bdfb888c-7lb8j" May 27 14:05:49.582817 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.582542 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jh2sg\" (UniqueName: \"kubernetes.io/projected/6dfeff02-a96c-4202-bac6-7346398337d3-kube-api-access-jh2sg\") pod \"kube-storage-version-migrator-operator-565644f49-qwh27\" (UID: \"6dfeff02-a96c-4202-bac6-7346398337d3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-qwh27" May 27 14:05:49.582817 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.582575 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b74fdc34-9e61-4170-840c-d8522b71dcb5-ca-trust-extracted\") pod \"image-registry-69cfc4ffb6-cbl6j\" (UID: \"b74fdc34-9e61-4170-840c-d8522b71dcb5\") " pod="openshift-image-registry/image-registry-69cfc4ffb6-cbl6j" May 27 14:05:49.582817 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.582605 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/11cf11df-4ac4-41ac-9294-bd472eb60b20-tmp-dir\") pod \"dns-default-f8t8t\" (UID: \"11cf11df-4ac4-41ac-9294-bd472eb60b20\") " pod="openshift-dns/dns-default-f8t8t" May 27 14:05:49.582817 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.582633 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/69c8ab79-2afc-44ae-ba1f-7bbd76642023-tmp\") pod \"insights-operator-78bdfb888c-7lb8j\" (UID: \"69c8ab79-2afc-44ae-ba1f-7bbd76642023\") " pod="openshift-insights/insights-operator-78bdfb888c-7lb8j" May 27 14:05:49.582817 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.582659 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x9c8g\" (UniqueName: \"kubernetes.io/projected/4ab50ff1-44f8-4599-9e35-5998ed988cfd-kube-api-access-x9c8g\") pod \"cluster-monitoring-operator-6c75959455-g2b6v\" (UID: \"4ab50ff1-44f8-4599-9e35-5998ed988cfd\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-g2b6v" May 27 14:05:49.583434 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.582696 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b74fdc34-9e61-4170-840c-d8522b71dcb5-registry-tls\") pod \"image-registry-69cfc4ffb6-cbl6j\" (UID: \"b74fdc34-9e61-4170-840c-d8522b71dcb5\") " pod="openshift-image-registry/image-registry-69cfc4ffb6-cbl6j" May 27 14:05:49.583434 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.582738 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b74fdc34-9e61-4170-840c-d8522b71dcb5-bound-sa-token\") pod \"image-registry-69cfc4ffb6-cbl6j\" (UID: \"b74fdc34-9e61-4170-840c-d8522b71dcb5\") " pod="openshift-image-registry/image-registry-69cfc4ffb6-cbl6j" May 27 14:05:49.583434 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:49.582773 2563 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 27 14:05:49.583434 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:49.582786 2563 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69cfc4ffb6-cbl6j: secret "image-registry-tls" not found May 27 14:05:49.583434 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.582805 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4589d4df-d2d2-43e2-af93-da49d130d20d-trusted-ca\") pod \"console-operator-76dff48d59-5g8bd\" (UID: \"4589d4df-d2d2-43e2-af93-da49d130d20d\") " pod="openshift-console-operator/console-operator-76dff48d59-5g8bd" May 27 14:05:49.583434 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.582839 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69c8ab79-2afc-44ae-ba1f-7bbd76642023-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-7lb8j\" (UID: \"69c8ab79-2afc-44ae-ba1f-7bbd76642023\") " pod="openshift-insights/insights-operator-78bdfb888c-7lb8j" May 27 14:05:49.583434 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:49.582852 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b74fdc34-9e61-4170-840c-d8522b71dcb5-registry-tls podName:b74fdc34-9e61-4170-840c-d8522b71dcb5 nodeName:}" failed. No retries permitted until 2026-05-27 14:05:50.082835219 +0000 UTC m=+35.183152182 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b74fdc34-9e61-4170-840c-d8522b71dcb5-registry-tls") pod "image-registry-69cfc4ffb6-cbl6j" (UID: "b74fdc34-9e61-4170-840c-d8522b71dcb5") : secret "image-registry-tls" not found May 27 14:05:49.583434 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.583148 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b74fdc34-9e61-4170-840c-d8522b71dcb5-trusted-ca\") pod \"image-registry-69cfc4ffb6-cbl6j\" (UID: \"b74fdc34-9e61-4170-840c-d8522b71dcb5\") " pod="openshift-image-registry/image-registry-69cfc4ffb6-cbl6j" May 27 14:05:49.583434 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.583216 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/69c8ab79-2afc-44ae-ba1f-7bbd76642023-tmp\") pod \"insights-operator-78bdfb888c-7lb8j\" (UID: \"69c8ab79-2afc-44ae-ba1f-7bbd76642023\") " pod="openshift-insights/insights-operator-78bdfb888c-7lb8j" May 27 14:05:49.583853 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.583519 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b74fdc34-9e61-4170-840c-d8522b71dcb5-ca-trust-extracted\") pod \"image-registry-69cfc4ffb6-cbl6j\" (UID: \"b74fdc34-9e61-4170-840c-d8522b71dcb5\") " pod="openshift-image-registry/image-registry-69cfc4ffb6-cbl6j" May 27 14:05:49.583853 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.583562 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69c8ab79-2afc-44ae-ba1f-7bbd76642023-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-7lb8j\" (UID: \"69c8ab79-2afc-44ae-ba1f-7bbd76642023\") " pod="openshift-insights/insights-operator-78bdfb888c-7lb8j" May 27 14:05:49.586124 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.586102 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b74fdc34-9e61-4170-840c-d8522b71dcb5-installation-pull-secrets\") pod \"image-registry-69cfc4ffb6-cbl6j\" (UID: \"b74fdc34-9e61-4170-840c-d8522b71dcb5\") " pod="openshift-image-registry/image-registry-69cfc4ffb6-cbl6j" May 27 14:05:49.586222 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.586104 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/69c8ab79-2afc-44ae-ba1f-7bbd76642023-serving-cert\") pod \"insights-operator-78bdfb888c-7lb8j\" (UID: \"69c8ab79-2afc-44ae-ba1f-7bbd76642023\") " pod="openshift-insights/insights-operator-78bdfb888c-7lb8j" May 27 14:05:49.586222 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.586164 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b74fdc34-9e61-4170-840c-d8522b71dcb5-image-registry-private-configuration\") pod \"image-registry-69cfc4ffb6-cbl6j\" (UID: \"b74fdc34-9e61-4170-840c-d8522b71dcb5\") " pod="openshift-image-registry/image-registry-69cfc4ffb6-cbl6j" May 27 14:05:49.590055 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.590027 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jwtx\" (UniqueName: \"kubernetes.io/projected/69c8ab79-2afc-44ae-ba1f-7bbd76642023-kube-api-access-6jwtx\") pod \"insights-operator-78bdfb888c-7lb8j\" (UID: \"69c8ab79-2afc-44ae-ba1f-7bbd76642023\") " pod="openshift-insights/insights-operator-78bdfb888c-7lb8j" May 27 14:05:49.590303 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.590288 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzhgf\" (UniqueName: \"kubernetes.io/projected/b74fdc34-9e61-4170-840c-d8522b71dcb5-kube-api-access-mzhgf\") pod \"image-registry-69cfc4ffb6-cbl6j\" (UID: \"b74fdc34-9e61-4170-840c-d8522b71dcb5\") " pod="openshift-image-registry/image-registry-69cfc4ffb6-cbl6j" May 27 14:05:49.591270 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.591243 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9c8g\" (UniqueName: \"kubernetes.io/projected/4ab50ff1-44f8-4599-9e35-5998ed988cfd-kube-api-access-x9c8g\") pod \"cluster-monitoring-operator-6c75959455-g2b6v\" (UID: \"4ab50ff1-44f8-4599-9e35-5998ed988cfd\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-g2b6v" May 27 14:05:49.593644 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.593622 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b74fdc34-9e61-4170-840c-d8522b71dcb5-bound-sa-token\") pod \"image-registry-69cfc4ffb6-cbl6j\" (UID: \"b74fdc34-9e61-4170-840c-d8522b71dcb5\") " pod="openshift-image-registry/image-registry-69cfc4ffb6-cbl6j" May 27 14:05:49.669325 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.669290 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-7lb8j" May 27 14:05:49.684036 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.684009 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bd3304d-9bda-4253-ac96-0dfca56dd2e1-service-ca-bundle\") pod \"router-default-799b5db656-96kw4\" (UID: \"1bd3304d-9bda-4253-ac96-0dfca56dd2e1\") " pod="openshift-ingress/router-default-799b5db656-96kw4" May 27 14:05:49.684170 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.684047 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5ed1e6d4-18f5-4adf-82a7-2560aa07f855-config\") pod \"service-ca-operator-57b5b68b8-klfdl\" (UID: \"5ed1e6d4-18f5-4adf-82a7-2560aa07f855\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-klfdl" May 27 14:05:49.684170 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.684080 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w2wnl\" (UniqueName: \"kubernetes.io/projected/1bd3304d-9bda-4253-ac96-0dfca56dd2e1-kube-api-access-w2wnl\") pod \"router-default-799b5db656-96kw4\" (UID: \"1bd3304d-9bda-4253-ac96-0dfca56dd2e1\") " pod="openshift-ingress/router-default-799b5db656-96kw4" May 27 14:05:49.684170 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.684113 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1f3d65a9-4971-4574-94a4-84534b8c8e6b-cert\") pod \"ingress-canary-lx84l\" (UID: \"1f3d65a9-4971-4574-94a4-84534b8c8e6b\") " pod="openshift-ingress-canary/ingress-canary-lx84l" May 27 14:05:49.684170 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.684137 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e2bc8d1f-4404-42a0-ae30-056843788536-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-26d7g\" (UID: \"e2bc8d1f-4404-42a0-ae30-056843788536\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-26d7g" May 27 14:05:49.684170 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.684162 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/1bd3304d-9bda-4253-ac96-0dfca56dd2e1-default-certificate\") pod \"router-default-799b5db656-96kw4\" (UID: \"1bd3304d-9bda-4253-ac96-0dfca56dd2e1\") " pod="openshift-ingress/router-default-799b5db656-96kw4" May 27 14:05:49.684422 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.684183 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pb9tg\" (UniqueName: \"kubernetes.io/projected/5ed1e6d4-18f5-4adf-82a7-2560aa07f855-kube-api-access-pb9tg\") pod \"service-ca-operator-57b5b68b8-klfdl\" (UID: \"5ed1e6d4-18f5-4adf-82a7-2560aa07f855\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-klfdl" May 27 14:05:49.684422 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.684206 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtcg4\" (UniqueName: \"kubernetes.io/projected/664f678a-372f-4a96-8bab-2cd2a68a1eaf-kube-api-access-jtcg4\") pod \"cluster-samples-operator-697587599-jqf48\" (UID: \"664f678a-372f-4a96-8bab-2cd2a68a1eaf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-jqf48" May 27 14:05:49.684422 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.684226 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bk976\" (UniqueName: \"kubernetes.io/projected/11cf11df-4ac4-41ac-9294-bd472eb60b20-kube-api-access-bk976\") pod \"dns-default-f8t8t\" (UID: \"11cf11df-4ac4-41ac-9294-bd472eb60b20\") " pod="openshift-dns/dns-default-f8t8t" May 27 14:05:49.684422 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.684245 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnwcv\" (UniqueName: \"kubernetes.io/projected/1f3d65a9-4971-4574-94a4-84534b8c8e6b-kube-api-access-fnwcv\") pod \"ingress-canary-lx84l\" (UID: \"1f3d65a9-4971-4574-94a4-84534b8c8e6b\") " pod="openshift-ingress-canary/ingress-canary-lx84l" May 27 14:05:49.684422 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.684270 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5ed1e6d4-18f5-4adf-82a7-2560aa07f855-serving-cert\") pod \"service-ca-operator-57b5b68b8-klfdl\" (UID: \"5ed1e6d4-18f5-4adf-82a7-2560aa07f855\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-klfdl" May 27 14:05:49.684422 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.684289 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6dfeff02-a96c-4202-bac6-7346398337d3-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-qwh27\" (UID: \"6dfeff02-a96c-4202-bac6-7346398337d3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-qwh27" May 27 14:05:49.684422 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.684342 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4589d4df-d2d2-43e2-af93-da49d130d20d-config\") pod \"console-operator-76dff48d59-5g8bd\" (UID: \"4589d4df-d2d2-43e2-af93-da49d130d20d\") " pod="openshift-console-operator/console-operator-76dff48d59-5g8bd" May 27 14:05:49.684422 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.684363 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1bd3304d-9bda-4253-ac96-0dfca56dd2e1-metrics-certs\") pod \"router-default-799b5db656-96kw4\" (UID: \"1bd3304d-9bda-4253-ac96-0dfca56dd2e1\") " pod="openshift-ingress/router-default-799b5db656-96kw4" May 27 14:05:49.684422 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.684391 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/11cf11df-4ac4-41ac-9294-bd472eb60b20-config-volume\") pod \"dns-default-f8t8t\" (UID: \"11cf11df-4ac4-41ac-9294-bd472eb60b20\") " pod="openshift-dns/dns-default-f8t8t" May 27 14:05:49.684422 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.684413 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6dfeff02-a96c-4202-bac6-7346398337d3-config\") pod \"kube-storage-version-migrator-operator-565644f49-qwh27\" (UID: \"6dfeff02-a96c-4202-bac6-7346398337d3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-qwh27" May 27 14:05:49.684913 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.684438 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrxp5\" (UniqueName: \"kubernetes.io/projected/3dbd3e72-1e12-450b-b88a-d4fd7f54fa96-kube-api-access-vrxp5\") pod \"network-check-source-7f44b6dd87-68ntw\" (UID: \"3dbd3e72-1e12-450b-b88a-d4fd7f54fa96\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-68ntw" May 27 14:05:49.684913 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.684467 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/1bd3304d-9bda-4253-ac96-0dfca56dd2e1-stats-auth\") pod \"router-default-799b5db656-96kw4\" (UID: \"1bd3304d-9bda-4253-ac96-0dfca56dd2e1\") " pod="openshift-ingress/router-default-799b5db656-96kw4" May 27 14:05:49.684913 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.684488 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/11cf11df-4ac4-41ac-9294-bd472eb60b20-metrics-tls\") pod \"dns-default-f8t8t\" (UID: \"11cf11df-4ac4-41ac-9294-bd472eb60b20\") " pod="openshift-dns/dns-default-f8t8t" May 27 14:05:49.684913 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.684507 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n4p4q\" (UniqueName: \"kubernetes.io/projected/4589d4df-d2d2-43e2-af93-da49d130d20d-kube-api-access-n4p4q\") pod \"console-operator-76dff48d59-5g8bd\" (UID: \"4589d4df-d2d2-43e2-af93-da49d130d20d\") " pod="openshift-console-operator/console-operator-76dff48d59-5g8bd" May 27 14:05:49.684913 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.684523 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e2bc8d1f-4404-42a0-ae30-056843788536-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-26d7g\" (UID: \"e2bc8d1f-4404-42a0-ae30-056843788536\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-26d7g" May 27 14:05:49.684913 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.684540 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4589d4df-d2d2-43e2-af93-da49d130d20d-serving-cert\") pod \"console-operator-76dff48d59-5g8bd\" (UID: \"4589d4df-d2d2-43e2-af93-da49d130d20d\") " pod="openshift-console-operator/console-operator-76dff48d59-5g8bd" May 27 14:05:49.684913 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.684569 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6grz8\" (UniqueName: \"kubernetes.io/projected/97247087-636a-4f55-9a2a-47cc162238d2-kube-api-access-6grz8\") pod \"volume-data-source-validator-5cf8c89d64-t6kzq\" (UID: \"97247087-636a-4f55-9a2a-47cc162238d2\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-t6kzq" May 27 14:05:49.684913 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.684588 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jh2sg\" (UniqueName: \"kubernetes.io/projected/6dfeff02-a96c-4202-bac6-7346398337d3-kube-api-access-jh2sg\") pod \"kube-storage-version-migrator-operator-565644f49-qwh27\" (UID: \"6dfeff02-a96c-4202-bac6-7346398337d3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-qwh27" May 27 14:05:49.684913 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.684610 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/11cf11df-4ac4-41ac-9294-bd472eb60b20-tmp-dir\") pod \"dns-default-f8t8t\" (UID: \"11cf11df-4ac4-41ac-9294-bd472eb60b20\") " pod="openshift-dns/dns-default-f8t8t" May 27 14:05:49.684913 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.684637 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/664f678a-372f-4a96-8bab-2cd2a68a1eaf-samples-operator-tls\") pod \"cluster-samples-operator-697587599-jqf48\" (UID: \"664f678a-372f-4a96-8bab-2cd2a68a1eaf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-jqf48" May 27 14:05:49.684913 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.684677 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4589d4df-d2d2-43e2-af93-da49d130d20d-trusted-ca\") pod \"console-operator-76dff48d59-5g8bd\" (UID: \"4589d4df-d2d2-43e2-af93-da49d130d20d\") " pod="openshift-console-operator/console-operator-76dff48d59-5g8bd" May 27 14:05:49.685483 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:49.685437 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 27 14:05:49.685542 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:49.685524 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2bc8d1f-4404-42a0-ae30-056843788536-networking-console-plugin-cert podName:e2bc8d1f-4404-42a0-ae30-056843788536 nodeName:}" failed. No retries permitted until 2026-05-27 14:05:50.18550465 +0000 UTC m=+35.285821601 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e2bc8d1f-4404-42a0-ae30-056843788536-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-26d7g" (UID: "e2bc8d1f-4404-42a0-ae30-056843788536") : secret "networking-console-plugin-cert" not found May 27 14:05:49.685619 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.685597 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4589d4df-d2d2-43e2-af93-da49d130d20d-trusted-ca\") pod \"console-operator-76dff48d59-5g8bd\" (UID: \"4589d4df-d2d2-43e2-af93-da49d130d20d\") " pod="openshift-console-operator/console-operator-76dff48d59-5g8bd" May 27 14:05:49.686996 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:49.685742 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 14:05:49.686996 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:49.685828 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11cf11df-4ac4-41ac-9294-bd472eb60b20-metrics-tls podName:11cf11df-4ac4-41ac-9294-bd472eb60b20 nodeName:}" failed. No retries permitted until 2026-05-27 14:05:50.185786255 +0000 UTC m=+35.286103201 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/11cf11df-4ac4-41ac-9294-bd472eb60b20-metrics-tls") pod "dns-default-f8t8t" (UID: "11cf11df-4ac4-41ac-9294-bd472eb60b20") : secret "dns-default-metrics-tls" not found May 27 14:05:49.686996 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.686263 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6dfeff02-a96c-4202-bac6-7346398337d3-config\") pod \"kube-storage-version-migrator-operator-565644f49-qwh27\" (UID: \"6dfeff02-a96c-4202-bac6-7346398337d3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-qwh27" May 27 14:05:49.686996 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:49.686371 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1bd3304d-9bda-4253-ac96-0dfca56dd2e1-service-ca-bundle podName:1bd3304d-9bda-4253-ac96-0dfca56dd2e1 nodeName:}" failed. No retries permitted until 2026-05-27 14:05:50.186354347 +0000 UTC m=+35.286671315 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1bd3304d-9bda-4253-ac96-0dfca56dd2e1-service-ca-bundle") pod "router-default-799b5db656-96kw4" (UID: "1bd3304d-9bda-4253-ac96-0dfca56dd2e1") : configmap references non-existent config key: service-ca.crt May 27 14:05:49.686996 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:49.686444 2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 27 14:05:49.686996 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:49.686476 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bd3304d-9bda-4253-ac96-0dfca56dd2e1-metrics-certs podName:1bd3304d-9bda-4253-ac96-0dfca56dd2e1 nodeName:}" failed. No retries permitted until 2026-05-27 14:05:50.186465892 +0000 UTC m=+35.286782839 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1bd3304d-9bda-4253-ac96-0dfca56dd2e1-metrics-certs") pod "router-default-799b5db656-96kw4" (UID: "1bd3304d-9bda-4253-ac96-0dfca56dd2e1") : secret "router-metrics-certs-default" not found May 27 14:05:49.686996 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.686578 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4589d4df-d2d2-43e2-af93-da49d130d20d-config\") pod \"console-operator-76dff48d59-5g8bd\" (UID: \"4589d4df-d2d2-43e2-af93-da49d130d20d\") " pod="openshift-console-operator/console-operator-76dff48d59-5g8bd" May 27 14:05:49.686996 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.686657 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5ed1e6d4-18f5-4adf-82a7-2560aa07f855-config\") pod \"service-ca-operator-57b5b68b8-klfdl\" (UID: \"5ed1e6d4-18f5-4adf-82a7-2560aa07f855\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-klfdl" May 27 14:05:49.686996 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.686667 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e2bc8d1f-4404-42a0-ae30-056843788536-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-26d7g\" (UID: \"e2bc8d1f-4404-42a0-ae30-056843788536\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-26d7g" May 27 14:05:49.686996 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.686966 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/11cf11df-4ac4-41ac-9294-bd472eb60b20-tmp-dir\") pod \"dns-default-f8t8t\" (UID: \"11cf11df-4ac4-41ac-9294-bd472eb60b20\") " pod="openshift-dns/dns-default-f8t8t" May 27 14:05:49.686996 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.686986 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/11cf11df-4ac4-41ac-9294-bd472eb60b20-config-volume\") pod \"dns-default-f8t8t\" (UID: \"11cf11df-4ac4-41ac-9294-bd472eb60b20\") " pod="openshift-dns/dns-default-f8t8t" May 27 14:05:49.688954 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.688931 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/1bd3304d-9bda-4253-ac96-0dfca56dd2e1-default-certificate\") pod \"router-default-799b5db656-96kw4\" (UID: \"1bd3304d-9bda-4253-ac96-0dfca56dd2e1\") " pod="openshift-ingress/router-default-799b5db656-96kw4" May 27 14:05:49.689233 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.689209 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6dfeff02-a96c-4202-bac6-7346398337d3-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-qwh27\" (UID: \"6dfeff02-a96c-4202-bac6-7346398337d3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-qwh27" May 27 14:05:49.689666 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.689646 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4589d4df-d2d2-43e2-af93-da49d130d20d-serving-cert\") pod \"console-operator-76dff48d59-5g8bd\" (UID: \"4589d4df-d2d2-43e2-af93-da49d130d20d\") " pod="openshift-console-operator/console-operator-76dff48d59-5g8bd" May 27 14:05:49.689844 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.689819 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5ed1e6d4-18f5-4adf-82a7-2560aa07f855-serving-cert\") pod \"service-ca-operator-57b5b68b8-klfdl\" (UID: \"5ed1e6d4-18f5-4adf-82a7-2560aa07f855\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-klfdl" May 27 14:05:49.690737 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.690719 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/1bd3304d-9bda-4253-ac96-0dfca56dd2e1-stats-auth\") pod \"router-default-799b5db656-96kw4\" (UID: \"1bd3304d-9bda-4253-ac96-0dfca56dd2e1\") " pod="openshift-ingress/router-default-799b5db656-96kw4" May 27 14:05:49.694490 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.694457 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pb9tg\" (UniqueName: \"kubernetes.io/projected/5ed1e6d4-18f5-4adf-82a7-2560aa07f855-kube-api-access-pb9tg\") pod \"service-ca-operator-57b5b68b8-klfdl\" (UID: \"5ed1e6d4-18f5-4adf-82a7-2560aa07f855\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-klfdl" May 27 14:05:49.694950 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.694886 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6grz8\" (UniqueName: \"kubernetes.io/projected/97247087-636a-4f55-9a2a-47cc162238d2-kube-api-access-6grz8\") pod \"volume-data-source-validator-5cf8c89d64-t6kzq\" (UID: \"97247087-636a-4f55-9a2a-47cc162238d2\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-t6kzq" May 27 14:05:49.695428 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.695408 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4p4q\" (UniqueName: \"kubernetes.io/projected/4589d4df-d2d2-43e2-af93-da49d130d20d-kube-api-access-n4p4q\") pod \"console-operator-76dff48d59-5g8bd\" (UID: \"4589d4df-d2d2-43e2-af93-da49d130d20d\") " pod="openshift-console-operator/console-operator-76dff48d59-5g8bd" May 27 14:05:49.695528 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.695467 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bk976\" (UniqueName: \"kubernetes.io/projected/11cf11df-4ac4-41ac-9294-bd472eb60b20-kube-api-access-bk976\") pod \"dns-default-f8t8t\" (UID: \"11cf11df-4ac4-41ac-9294-bd472eb60b20\") " pod="openshift-dns/dns-default-f8t8t" May 27 14:05:49.695528 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.695464 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jh2sg\" (UniqueName: \"kubernetes.io/projected/6dfeff02-a96c-4202-bac6-7346398337d3-kube-api-access-jh2sg\") pod \"kube-storage-version-migrator-operator-565644f49-qwh27\" (UID: \"6dfeff02-a96c-4202-bac6-7346398337d3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-qwh27" May 27 14:05:49.696496 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.696479 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2wnl\" (UniqueName: \"kubernetes.io/projected/1bd3304d-9bda-4253-ac96-0dfca56dd2e1-kube-api-access-w2wnl\") pod \"router-default-799b5db656-96kw4\" (UID: \"1bd3304d-9bda-4253-ac96-0dfca56dd2e1\") " pod="openshift-ingress/router-default-799b5db656-96kw4" May 27 14:05:49.711161 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.711139 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-5g8bd" May 27 14:05:49.724838 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.724812 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-qwh27" May 27 14:05:49.764446 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.764415 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-klfdl" May 27 14:05:49.785727 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.785699 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/664f678a-372f-4a96-8bab-2cd2a68a1eaf-samples-operator-tls\") pod \"cluster-samples-operator-697587599-jqf48\" (UID: \"664f678a-372f-4a96-8bab-2cd2a68a1eaf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-jqf48" May 27 14:05:49.785864 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:49.785844 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 27 14:05:49.785939 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.785918 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1f3d65a9-4971-4574-94a4-84534b8c8e6b-cert\") pod \"ingress-canary-lx84l\" (UID: \"1f3d65a9-4971-4574-94a4-84534b8c8e6b\") " pod="openshift-ingress-canary/ingress-canary-lx84l" May 27 14:05:49.785989 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:49.785947 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/664f678a-372f-4a96-8bab-2cd2a68a1eaf-samples-operator-tls podName:664f678a-372f-4a96-8bab-2cd2a68a1eaf nodeName:}" failed. No retries permitted until 2026-05-27 14:05:50.28592943 +0000 UTC m=+35.386246373 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/664f678a-372f-4a96-8bab-2cd2a68a1eaf-samples-operator-tls") pod "cluster-samples-operator-697587599-jqf48" (UID: "664f678a-372f-4a96-8bab-2cd2a68a1eaf") : secret "samples-operator-tls" not found May 27 14:05:49.786051 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.785992 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jtcg4\" (UniqueName: \"kubernetes.io/projected/664f678a-372f-4a96-8bab-2cd2a68a1eaf-kube-api-access-jtcg4\") pod \"cluster-samples-operator-697587599-jqf48\" (UID: \"664f678a-372f-4a96-8bab-2cd2a68a1eaf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-jqf48" May 27 14:05:49.786051 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.786016 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fnwcv\" (UniqueName: \"kubernetes.io/projected/1f3d65a9-4971-4574-94a4-84534b8c8e6b-kube-api-access-fnwcv\") pod \"ingress-canary-lx84l\" (UID: \"1f3d65a9-4971-4574-94a4-84534b8c8e6b\") " pod="openshift-ingress-canary/ingress-canary-lx84l" May 27 14:05:49.786051 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:49.786020 2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 14:05:49.786191 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:49.786075 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f3d65a9-4971-4574-94a4-84534b8c8e6b-cert podName:1f3d65a9-4971-4574-94a4-84534b8c8e6b nodeName:}" failed. No retries permitted until 2026-05-27 14:05:50.286057848 +0000 UTC m=+35.386374805 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1f3d65a9-4971-4574-94a4-84534b8c8e6b-cert") pod "ingress-canary-lx84l" (UID: "1f3d65a9-4971-4574-94a4-84534b8c8e6b") : secret "canary-serving-cert" not found May 27 14:05:49.786191 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.786127 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vrxp5\" (UniqueName: \"kubernetes.io/projected/3dbd3e72-1e12-450b-b88a-d4fd7f54fa96-kube-api-access-vrxp5\") pod \"network-check-source-7f44b6dd87-68ntw\" (UID: \"3dbd3e72-1e12-450b-b88a-d4fd7f54fa96\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-68ntw" May 27 14:05:49.792580 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.792558 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-t6kzq" May 27 14:05:49.797961 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.797939 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnwcv\" (UniqueName: \"kubernetes.io/projected/1f3d65a9-4971-4574-94a4-84534b8c8e6b-kube-api-access-fnwcv\") pod \"ingress-canary-lx84l\" (UID: \"1f3d65a9-4971-4574-94a4-84534b8c8e6b\") " pod="openshift-ingress-canary/ingress-canary-lx84l" May 27 14:05:49.798054 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.797986 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtcg4\" (UniqueName: \"kubernetes.io/projected/664f678a-372f-4a96-8bab-2cd2a68a1eaf-kube-api-access-jtcg4\") pod \"cluster-samples-operator-697587599-jqf48\" (UID: \"664f678a-372f-4a96-8bab-2cd2a68a1eaf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-jqf48" May 27 14:05:49.798110 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.798094 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrxp5\" (UniqueName: \"kubernetes.io/projected/3dbd3e72-1e12-450b-b88a-d4fd7f54fa96-kube-api-access-vrxp5\") pod \"network-check-source-7f44b6dd87-68ntw\" (UID: \"3dbd3e72-1e12-450b-b88a-d4fd7f54fa96\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-68ntw" May 27 14:05:49.820062 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.820032 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-68ntw" May 27 14:05:49.830836 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:49.830790 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-7lb8j"] May 27 14:05:50.023839 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:50.023497 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-qwh27"] May 27 14:05:50.026435 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:50.026407 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dfeff02_a96c_4202_bac6_7346398337d3.slice/crio-978a80913940104cbc2b1a72fbfada702dea260b6cc09a5f257da70412e17470 WatchSource:0}: Error finding container 978a80913940104cbc2b1a72fbfada702dea260b6cc09a5f257da70412e17470: Status 404 returned error can't find the container with id 978a80913940104cbc2b1a72fbfada702dea260b6cc09a5f257da70412e17470 May 27 14:05:50.030157 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:50.030129 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-5g8bd"] May 27 14:05:50.032961 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:50.032935 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4589d4df_d2d2_43e2_af93_da49d130d20d.slice/crio-52485f3b122f7db21b5875cc6880fd6fdd185798581dd461af76189b859f38f9 WatchSource:0}: Error finding container 52485f3b122f7db21b5875cc6880fd6fdd185798581dd461af76189b859f38f9: Status 404 returned error can't find the container with id 52485f3b122f7db21b5875cc6880fd6fdd185798581dd461af76189b859f38f9 May 27 14:05:50.036867 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:50.036844 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-68ntw"] May 27 14:05:50.040089 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:50.040035 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-t6kzq"] May 27 14:05:50.041312 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:50.041288 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-klfdl"] May 27 14:05:50.042440 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:50.042408 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3dbd3e72_1e12_450b_b88a_d4fd7f54fa96.slice/crio-85a558925fdd61eb9d33a3a02f8ef51d8555cf30a3a117ece71f923bdf6a4c02 WatchSource:0}: Error finding container 85a558925fdd61eb9d33a3a02f8ef51d8555cf30a3a117ece71f923bdf6a4c02: Status 404 returned error can't find the container with id 85a558925fdd61eb9d33a3a02f8ef51d8555cf30a3a117ece71f923bdf6a4c02 May 27 14:05:50.043925 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:50.043851 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ed1e6d4_18f5_4adf_82a7_2560aa07f855.slice/crio-9b8428fe67c4242f03cee38c72e58c57399e873200d0e975151aa07d79696967 WatchSource:0}: Error finding container 9b8428fe67c4242f03cee38c72e58c57399e873200d0e975151aa07d79696967: Status 404 returned error can't find the container with id 9b8428fe67c4242f03cee38c72e58c57399e873200d0e975151aa07d79696967 May 27 14:05:50.044568 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:05:50.044340 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97247087_636a_4f55_9a2a_47cc162238d2.slice/crio-e3bb8ca2d3e40cd5f5148c107bc5829b7ef8a532c11ed139c2103de0122cbf22 WatchSource:0}: Error finding container e3bb8ca2d3e40cd5f5148c107bc5829b7ef8a532c11ed139c2103de0122cbf22: Status 404 returned error can't find the container with id e3bb8ca2d3e40cd5f5148c107bc5829b7ef8a532c11ed139c2103de0122cbf22 May 27 14:05:50.088658 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:50.088623 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4ab50ff1-44f8-4599-9e35-5998ed988cfd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-g2b6v\" (UID: \"4ab50ff1-44f8-4599-9e35-5998ed988cfd\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-g2b6v" May 27 14:05:50.088834 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:50.088776 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 27 14:05:50.088834 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:50.088812 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b74fdc34-9e61-4170-840c-d8522b71dcb5-registry-tls\") pod \"image-registry-69cfc4ffb6-cbl6j\" (UID: \"b74fdc34-9e61-4170-840c-d8522b71dcb5\") " pod="openshift-image-registry/image-registry-69cfc4ffb6-cbl6j" May 27 14:05:50.088920 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:50.088840 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ab50ff1-44f8-4599-9e35-5998ed988cfd-cluster-monitoring-operator-tls podName:4ab50ff1-44f8-4599-9e35-5998ed988cfd nodeName:}" failed. No retries permitted until 2026-05-27 14:05:51.088822271 +0000 UTC m=+36.189139233 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4ab50ff1-44f8-4599-9e35-5998ed988cfd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-g2b6v" (UID: "4ab50ff1-44f8-4599-9e35-5998ed988cfd") : secret "cluster-monitoring-operator-tls" not found May 27 14:05:50.088920 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:50.088882 2563 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 27 14:05:50.089002 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:50.088921 2563 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69cfc4ffb6-cbl6j: secret "image-registry-tls" not found May 27 14:05:50.089002 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:50.088959 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b74fdc34-9e61-4170-840c-d8522b71dcb5-registry-tls podName:b74fdc34-9e61-4170-840c-d8522b71dcb5 nodeName:}" failed. No retries permitted until 2026-05-27 14:05:51.088950864 +0000 UTC m=+36.189267808 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b74fdc34-9e61-4170-840c-d8522b71dcb5-registry-tls") pod "image-registry-69cfc4ffb6-cbl6j" (UID: "b74fdc34-9e61-4170-840c-d8522b71dcb5") : secret "image-registry-tls" not found May 27 14:05:50.190307 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:50.190262 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bd3304d-9bda-4253-ac96-0dfca56dd2e1-service-ca-bundle\") pod \"router-default-799b5db656-96kw4\" (UID: \"1bd3304d-9bda-4253-ac96-0dfca56dd2e1\") " pod="openshift-ingress/router-default-799b5db656-96kw4" May 27 14:05:50.190466 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:50.190340 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e2bc8d1f-4404-42a0-ae30-056843788536-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-26d7g\" (UID: \"e2bc8d1f-4404-42a0-ae30-056843788536\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-26d7g" May 27 14:05:50.190466 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:50.190381 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1bd3304d-9bda-4253-ac96-0dfca56dd2e1-metrics-certs\") pod \"router-default-799b5db656-96kw4\" (UID: \"1bd3304d-9bda-4253-ac96-0dfca56dd2e1\") " pod="openshift-ingress/router-default-799b5db656-96kw4" May 27 14:05:50.190466 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:50.190435 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/11cf11df-4ac4-41ac-9294-bd472eb60b20-metrics-tls\") pod \"dns-default-f8t8t\" (UID: \"11cf11df-4ac4-41ac-9294-bd472eb60b20\") " pod="openshift-dns/dns-default-f8t8t" May 27 14:05:50.190466 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:50.190461 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1bd3304d-9bda-4253-ac96-0dfca56dd2e1-service-ca-bundle podName:1bd3304d-9bda-4253-ac96-0dfca56dd2e1 nodeName:}" failed. No retries permitted until 2026-05-27 14:05:51.190436738 +0000 UTC m=+36.290753685 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1bd3304d-9bda-4253-ac96-0dfca56dd2e1-service-ca-bundle") pod "router-default-799b5db656-96kw4" (UID: "1bd3304d-9bda-4253-ac96-0dfca56dd2e1") : configmap references non-existent config key: service-ca.crt May 27 14:05:50.190676 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:50.190513 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 14:05:50.190676 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:50.190531 2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 27 14:05:50.190676 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:50.190552 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 27 14:05:50.190676 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:50.190567 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11cf11df-4ac4-41ac-9294-bd472eb60b20-metrics-tls podName:11cf11df-4ac4-41ac-9294-bd472eb60b20 nodeName:}" failed. No retries permitted until 2026-05-27 14:05:51.190552317 +0000 UTC m=+36.290869279 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/11cf11df-4ac4-41ac-9294-bd472eb60b20-metrics-tls") pod "dns-default-f8t8t" (UID: "11cf11df-4ac4-41ac-9294-bd472eb60b20") : secret "dns-default-metrics-tls" not found May 27 14:05:50.190676 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:50.190583 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bd3304d-9bda-4253-ac96-0dfca56dd2e1-metrics-certs podName:1bd3304d-9bda-4253-ac96-0dfca56dd2e1 nodeName:}" failed. No retries permitted until 2026-05-27 14:05:51.190574977 +0000 UTC m=+36.290891923 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1bd3304d-9bda-4253-ac96-0dfca56dd2e1-metrics-certs") pod "router-default-799b5db656-96kw4" (UID: "1bd3304d-9bda-4253-ac96-0dfca56dd2e1") : secret "router-metrics-certs-default" not found May 27 14:05:50.190676 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:50.190597 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2bc8d1f-4404-42a0-ae30-056843788536-networking-console-plugin-cert podName:e2bc8d1f-4404-42a0-ae30-056843788536 nodeName:}" failed. No retries permitted until 2026-05-27 14:05:51.190589407 +0000 UTC m=+36.290906350 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e2bc8d1f-4404-42a0-ae30-056843788536-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-26d7g" (UID: "e2bc8d1f-4404-42a0-ae30-056843788536") : secret "networking-console-plugin-cert" not found May 27 14:05:50.291227 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:50.291188 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/664f678a-372f-4a96-8bab-2cd2a68a1eaf-samples-operator-tls\") pod \"cluster-samples-operator-697587599-jqf48\" (UID: \"664f678a-372f-4a96-8bab-2cd2a68a1eaf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-jqf48" May 27 14:05:50.291414 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:50.291283 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1f3d65a9-4971-4574-94a4-84534b8c8e6b-cert\") pod \"ingress-canary-lx84l\" (UID: \"1f3d65a9-4971-4574-94a4-84534b8c8e6b\") " pod="openshift-ingress-canary/ingress-canary-lx84l" May 27 14:05:50.291414 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:50.291339 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 27 14:05:50.291414 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:50.291408 2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 14:05:50.291538 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:50.291417 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/664f678a-372f-4a96-8bab-2cd2a68a1eaf-samples-operator-tls podName:664f678a-372f-4a96-8bab-2cd2a68a1eaf nodeName:}" failed. No retries permitted until 2026-05-27 14:05:51.291396243 +0000 UTC m=+36.391713205 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/664f678a-372f-4a96-8bab-2cd2a68a1eaf-samples-operator-tls") pod "cluster-samples-operator-697587599-jqf48" (UID: "664f678a-372f-4a96-8bab-2cd2a68a1eaf") : secret "samples-operator-tls" not found May 27 14:05:50.291538 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:50.291495 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f3d65a9-4971-4574-94a4-84534b8c8e6b-cert podName:1f3d65a9-4971-4574-94a4-84534b8c8e6b nodeName:}" failed. No retries permitted until 2026-05-27 14:05:51.291481671 +0000 UTC m=+36.391798634 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1f3d65a9-4971-4574-94a4-84534b8c8e6b-cert") pod "ingress-canary-lx84l" (UID: "1f3d65a9-4971-4574-94a4-84534b8c8e6b") : secret "canary-serving-cert" not found May 27 14:05:50.392200 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:50.392167 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5a97ff24-1b84-4127-87cf-f53d545ce361-original-pull-secret\") pod \"global-pull-secret-syncer-px2cq\" (UID: \"5a97ff24-1b84-4127-87cf-f53d545ce361\") " pod="kube-system/global-pull-secret-syncer-px2cq" May 27 14:05:50.392398 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:50.392314 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 27 14:05:50.392398 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:50.392385 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a97ff24-1b84-4127-87cf-f53d545ce361-original-pull-secret podName:5a97ff24-1b84-4127-87cf-f53d545ce361 nodeName:}" failed. No retries permitted until 2026-05-27 14:06:22.392370099 +0000 UTC m=+67.492687062 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5a97ff24-1b84-4127-87cf-f53d545ce361-original-pull-secret") pod "global-pull-secret-syncer-px2cq" (UID: "5a97ff24-1b84-4127-87cf-f53d545ce361") : object "kube-system"/"original-pull-secret" not registered May 27 14:05:50.537958 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:50.537925 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wbsgc" May 27 14:05:50.538127 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:50.538053 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txmmd" May 27 14:05:50.538503 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:50.538347 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-px2cq" May 27 14:05:50.541434 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:50.541000 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 27 14:05:50.541434 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:50.541041 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 27 14:05:50.541434 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:50.541121 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kjqwb\"" May 27 14:05:50.541434 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:50.541253 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jlrrx\"" May 27 14:05:50.698414 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:50.698348 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-klfdl" event={"ID":"5ed1e6d4-18f5-4adf-82a7-2560aa07f855","Type":"ContainerStarted","Data":"9b8428fe67c4242f03cee38c72e58c57399e873200d0e975151aa07d79696967"} May 27 14:05:50.700632 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:50.700570 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-7lb8j" event={"ID":"69c8ab79-2afc-44ae-ba1f-7bbd76642023","Type":"ContainerStarted","Data":"67536285a0f3209d083e08fd4f17298602f9f561f087abc053bfb611a8287d17"} May 27 14:05:50.705605 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:50.704830 2563 generic.go:358] "Generic (PLEG): container finished" podID="0b4d0670-6986-4085-a211-e22549067d90" containerID="bc8f3ab84b7489d8bbaabaa02faf7d4b1371c1629afb255fe902d636a5aa3f0a" exitCode=0 May 27 14:05:50.705605 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:50.704998 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tfnv8" event={"ID":"0b4d0670-6986-4085-a211-e22549067d90","Type":"ContainerDied","Data":"bc8f3ab84b7489d8bbaabaa02faf7d4b1371c1629afb255fe902d636a5aa3f0a"} May 27 14:05:50.706387 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:50.706336 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-68ntw" event={"ID":"3dbd3e72-1e12-450b-b88a-d4fd7f54fa96","Type":"ContainerStarted","Data":"85a558925fdd61eb9d33a3a02f8ef51d8555cf30a3a117ece71f923bdf6a4c02"} May 27 14:05:50.708208 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:50.708144 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-5g8bd" event={"ID":"4589d4df-d2d2-43e2-af93-da49d130d20d","Type":"ContainerStarted","Data":"52485f3b122f7db21b5875cc6880fd6fdd185798581dd461af76189b859f38f9"} May 27 14:05:50.712001 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:50.711788 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-qwh27" event={"ID":"6dfeff02-a96c-4202-bac6-7346398337d3","Type":"ContainerStarted","Data":"978a80913940104cbc2b1a72fbfada702dea260b6cc09a5f257da70412e17470"} May 27 14:05:50.713954 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:50.713284 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-t6kzq" event={"ID":"97247087-636a-4f55-9a2a-47cc162238d2","Type":"ContainerStarted","Data":"e3bb8ca2d3e40cd5f5148c107bc5829b7ef8a532c11ed139c2103de0122cbf22"} May 27 14:05:51.100455 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:51.099649 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b74fdc34-9e61-4170-840c-d8522b71dcb5-registry-tls\") pod \"image-registry-69cfc4ffb6-cbl6j\" (UID: \"b74fdc34-9e61-4170-840c-d8522b71dcb5\") " pod="openshift-image-registry/image-registry-69cfc4ffb6-cbl6j" May 27 14:05:51.100455 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:51.099732 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4ab50ff1-44f8-4599-9e35-5998ed988cfd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-g2b6v\" (UID: \"4ab50ff1-44f8-4599-9e35-5998ed988cfd\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-g2b6v" May 27 14:05:51.100455 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:51.100010 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 27 14:05:51.100455 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:51.100079 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ab50ff1-44f8-4599-9e35-5998ed988cfd-cluster-monitoring-operator-tls podName:4ab50ff1-44f8-4599-9e35-5998ed988cfd nodeName:}" failed. No retries permitted until 2026-05-27 14:05:53.100059573 +0000 UTC m=+38.200376528 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4ab50ff1-44f8-4599-9e35-5998ed988cfd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-g2b6v" (UID: "4ab50ff1-44f8-4599-9e35-5998ed988cfd") : secret "cluster-monitoring-operator-tls" not found May 27 14:05:51.100455 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:51.100319 2563 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 27 14:05:51.100455 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:51.100334 2563 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69cfc4ffb6-cbl6j: secret "image-registry-tls" not found May 27 14:05:51.100455 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:51.100380 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b74fdc34-9e61-4170-840c-d8522b71dcb5-registry-tls podName:b74fdc34-9e61-4170-840c-d8522b71dcb5 nodeName:}" failed. No retries permitted until 2026-05-27 14:05:53.100365779 +0000 UTC m=+38.200682725 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b74fdc34-9e61-4170-840c-d8522b71dcb5-registry-tls") pod "image-registry-69cfc4ffb6-cbl6j" (UID: "b74fdc34-9e61-4170-840c-d8522b71dcb5") : secret "image-registry-tls" not found May 27 14:05:51.201600 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:51.200541 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bd3304d-9bda-4253-ac96-0dfca56dd2e1-service-ca-bundle\") pod \"router-default-799b5db656-96kw4\" (UID: \"1bd3304d-9bda-4253-ac96-0dfca56dd2e1\") " pod="openshift-ingress/router-default-799b5db656-96kw4" May 27 14:05:51.201600 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:51.200611 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e2bc8d1f-4404-42a0-ae30-056843788536-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-26d7g\" (UID: \"e2bc8d1f-4404-42a0-ae30-056843788536\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-26d7g" May 27 14:05:51.201600 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:51.200666 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1bd3304d-9bda-4253-ac96-0dfca56dd2e1-metrics-certs\") pod \"router-default-799b5db656-96kw4\" (UID: \"1bd3304d-9bda-4253-ac96-0dfca56dd2e1\") " pod="openshift-ingress/router-default-799b5db656-96kw4" May 27 14:05:51.201600 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:51.200722 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/11cf11df-4ac4-41ac-9294-bd472eb60b20-metrics-tls\") pod \"dns-default-f8t8t\" (UID: \"11cf11df-4ac4-41ac-9294-bd472eb60b20\") " pod="openshift-dns/dns-default-f8t8t" May 27 14:05:51.201600 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:51.200850 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 14:05:51.201600 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:51.200925 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11cf11df-4ac4-41ac-9294-bd472eb60b20-metrics-tls podName:11cf11df-4ac4-41ac-9294-bd472eb60b20 nodeName:}" failed. No retries permitted until 2026-05-27 14:05:53.200905815 +0000 UTC m=+38.301222773 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/11cf11df-4ac4-41ac-9294-bd472eb60b20-metrics-tls") pod "dns-default-f8t8t" (UID: "11cf11df-4ac4-41ac-9294-bd472eb60b20") : secret "dns-default-metrics-tls" not found May 27 14:05:51.201600 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:51.201359 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1bd3304d-9bda-4253-ac96-0dfca56dd2e1-service-ca-bundle podName:1bd3304d-9bda-4253-ac96-0dfca56dd2e1 nodeName:}" failed. No retries permitted until 2026-05-27 14:05:53.201342262 +0000 UTC m=+38.301659220 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1bd3304d-9bda-4253-ac96-0dfca56dd2e1-service-ca-bundle") pod "router-default-799b5db656-96kw4" (UID: "1bd3304d-9bda-4253-ac96-0dfca56dd2e1") : configmap references non-existent config key: service-ca.crt May 27 14:05:51.201600 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:51.201446 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 27 14:05:51.201600 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:51.201485 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2bc8d1f-4404-42a0-ae30-056843788536-networking-console-plugin-cert podName:e2bc8d1f-4404-42a0-ae30-056843788536 nodeName:}" failed. No retries permitted until 2026-05-27 14:05:53.20147315 +0000 UTC m=+38.301790095 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e2bc8d1f-4404-42a0-ae30-056843788536-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-26d7g" (UID: "e2bc8d1f-4404-42a0-ae30-056843788536") : secret "networking-console-plugin-cert" not found May 27 14:05:51.201600 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:51.201536 2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 27 14:05:51.201600 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:51.201567 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bd3304d-9bda-4253-ac96-0dfca56dd2e1-metrics-certs podName:1bd3304d-9bda-4253-ac96-0dfca56dd2e1 nodeName:}" failed. No retries permitted until 2026-05-27 14:05:53.201557303 +0000 UTC m=+38.301874262 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1bd3304d-9bda-4253-ac96-0dfca56dd2e1-metrics-certs") pod "router-default-799b5db656-96kw4" (UID: "1bd3304d-9bda-4253-ac96-0dfca56dd2e1") : secret "router-metrics-certs-default" not found May 27 14:05:51.302819 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:51.301853 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/664f678a-372f-4a96-8bab-2cd2a68a1eaf-samples-operator-tls\") pod \"cluster-samples-operator-697587599-jqf48\" (UID: \"664f678a-372f-4a96-8bab-2cd2a68a1eaf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-jqf48" May 27 14:05:51.302819 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:51.301994 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1f3d65a9-4971-4574-94a4-84534b8c8e6b-cert\") pod \"ingress-canary-lx84l\" (UID: \"1f3d65a9-4971-4574-94a4-84534b8c8e6b\") " pod="openshift-ingress-canary/ingress-canary-lx84l" May 27 14:05:51.302819 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:51.302244 2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 14:05:51.302819 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:51.302310 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f3d65a9-4971-4574-94a4-84534b8c8e6b-cert podName:1f3d65a9-4971-4574-94a4-84534b8c8e6b nodeName:}" failed. No retries permitted until 2026-05-27 14:05:53.30228929 +0000 UTC m=+38.402606239 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1f3d65a9-4971-4574-94a4-84534b8c8e6b-cert") pod "ingress-canary-lx84l" (UID: "1f3d65a9-4971-4574-94a4-84534b8c8e6b") : secret "canary-serving-cert" not found May 27 14:05:51.302819 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:51.302721 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 27 14:05:51.302819 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:51.302777 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/664f678a-372f-4a96-8bab-2cd2a68a1eaf-samples-operator-tls podName:664f678a-372f-4a96-8bab-2cd2a68a1eaf nodeName:}" failed. No retries permitted until 2026-05-27 14:05:53.302758602 +0000 UTC m=+38.403075551 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/664f678a-372f-4a96-8bab-2cd2a68a1eaf-samples-operator-tls") pod "cluster-samples-operator-697587599-jqf48" (UID: "664f678a-372f-4a96-8bab-2cd2a68a1eaf") : secret "samples-operator-tls" not found May 27 14:05:51.721918 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:51.721000 2563 generic.go:358] "Generic (PLEG): container finished" podID="0b4d0670-6986-4085-a211-e22549067d90" containerID="350c4497361ca75ab670e1fc9e7227dc457def4a262239bec4c80bc616818623" exitCode=0 May 27 14:05:51.721918 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:51.721079 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tfnv8" event={"ID":"0b4d0670-6986-4085-a211-e22549067d90","Type":"ContainerDied","Data":"350c4497361ca75ab670e1fc9e7227dc457def4a262239bec4c80bc616818623"} May 27 14:05:53.122499 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:53.122460 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b74fdc34-9e61-4170-840c-d8522b71dcb5-registry-tls\") pod \"image-registry-69cfc4ffb6-cbl6j\" (UID: \"b74fdc34-9e61-4170-840c-d8522b71dcb5\") " pod="openshift-image-registry/image-registry-69cfc4ffb6-cbl6j" May 27 14:05:53.123038 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:53.122535 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4ab50ff1-44f8-4599-9e35-5998ed988cfd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-g2b6v\" (UID: \"4ab50ff1-44f8-4599-9e35-5998ed988cfd\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-g2b6v" May 27 14:05:53.123038 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:53.122594 2563 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 27 14:05:53.123038 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:53.122612 2563 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69cfc4ffb6-cbl6j: secret "image-registry-tls" not found May 27 14:05:53.123038 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:53.122647 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 27 14:05:53.123038 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:53.122679 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b74fdc34-9e61-4170-840c-d8522b71dcb5-registry-tls podName:b74fdc34-9e61-4170-840c-d8522b71dcb5 nodeName:}" failed. No retries permitted until 2026-05-27 14:05:57.122660716 +0000 UTC m=+42.222977679 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b74fdc34-9e61-4170-840c-d8522b71dcb5-registry-tls") pod "image-registry-69cfc4ffb6-cbl6j" (UID: "b74fdc34-9e61-4170-840c-d8522b71dcb5") : secret "image-registry-tls" not found May 27 14:05:53.123038 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:53.122696 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ab50ff1-44f8-4599-9e35-5998ed988cfd-cluster-monitoring-operator-tls podName:4ab50ff1-44f8-4599-9e35-5998ed988cfd nodeName:}" failed. No retries permitted until 2026-05-27 14:05:57.122687867 +0000 UTC m=+42.223004811 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4ab50ff1-44f8-4599-9e35-5998ed988cfd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-g2b6v" (UID: "4ab50ff1-44f8-4599-9e35-5998ed988cfd") : secret "cluster-monitoring-operator-tls" not found May 27 14:05:53.223510 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:53.223470 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/11cf11df-4ac4-41ac-9294-bd472eb60b20-metrics-tls\") pod \"dns-default-f8t8t\" (UID: \"11cf11df-4ac4-41ac-9294-bd472eb60b20\") " pod="openshift-dns/dns-default-f8t8t" May 27 14:05:53.223712 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:53.223595 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bd3304d-9bda-4253-ac96-0dfca56dd2e1-service-ca-bundle\") pod \"router-default-799b5db656-96kw4\" (UID: \"1bd3304d-9bda-4253-ac96-0dfca56dd2e1\") " pod="openshift-ingress/router-default-799b5db656-96kw4" May 27 14:05:53.223712 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:53.223635 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 14:05:53.223712 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:53.223653 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e2bc8d1f-4404-42a0-ae30-056843788536-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-26d7g\" (UID: \"e2bc8d1f-4404-42a0-ae30-056843788536\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-26d7g" May 27 14:05:53.223712 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:53.223712 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11cf11df-4ac4-41ac-9294-bd472eb60b20-metrics-tls podName:11cf11df-4ac4-41ac-9294-bd472eb60b20 nodeName:}" failed. No retries permitted until 2026-05-27 14:05:57.223689502 +0000 UTC m=+42.324006460 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/11cf11df-4ac4-41ac-9294-bd472eb60b20-metrics-tls") pod "dns-default-f8t8t" (UID: "11cf11df-4ac4-41ac-9294-bd472eb60b20") : secret "dns-default-metrics-tls" not found May 27 14:05:53.223973 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:53.223767 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 27 14:05:53.223973 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:53.223786 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1bd3304d-9bda-4253-ac96-0dfca56dd2e1-service-ca-bundle podName:1bd3304d-9bda-4253-ac96-0dfca56dd2e1 nodeName:}" failed. No retries permitted until 2026-05-27 14:05:57.22376799 +0000 UTC m=+42.324084946 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1bd3304d-9bda-4253-ac96-0dfca56dd2e1-service-ca-bundle") pod "router-default-799b5db656-96kw4" (UID: "1bd3304d-9bda-4253-ac96-0dfca56dd2e1") : configmap references non-existent config key: service-ca.crt May 27 14:05:53.223973 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:53.223765 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1bd3304d-9bda-4253-ac96-0dfca56dd2e1-metrics-certs\") pod \"router-default-799b5db656-96kw4\" (UID: \"1bd3304d-9bda-4253-ac96-0dfca56dd2e1\") " pod="openshift-ingress/router-default-799b5db656-96kw4" May 27 14:05:53.223973 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:53.223810 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2bc8d1f-4404-42a0-ae30-056843788536-networking-console-plugin-cert podName:e2bc8d1f-4404-42a0-ae30-056843788536 nodeName:}" failed. No retries permitted until 2026-05-27 14:05:57.223799698 +0000 UTC m=+42.324116642 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e2bc8d1f-4404-42a0-ae30-056843788536-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-26d7g" (UID: "e2bc8d1f-4404-42a0-ae30-056843788536") : secret "networking-console-plugin-cert" not found May 27 14:05:53.223973 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:53.223832 2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 27 14:05:53.223973 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:53.223874 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bd3304d-9bda-4253-ac96-0dfca56dd2e1-metrics-certs podName:1bd3304d-9bda-4253-ac96-0dfca56dd2e1 nodeName:}" failed. No retries permitted until 2026-05-27 14:05:57.223857598 +0000 UTC m=+42.324174557 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1bd3304d-9bda-4253-ac96-0dfca56dd2e1-metrics-certs") pod "router-default-799b5db656-96kw4" (UID: "1bd3304d-9bda-4253-ac96-0dfca56dd2e1") : secret "router-metrics-certs-default" not found May 27 14:05:53.325171 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:53.325138 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1f3d65a9-4971-4574-94a4-84534b8c8e6b-cert\") pod \"ingress-canary-lx84l\" (UID: \"1f3d65a9-4971-4574-94a4-84534b8c8e6b\") " pod="openshift-ingress-canary/ingress-canary-lx84l" May 27 14:05:53.325346 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:53.325296 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/664f678a-372f-4a96-8bab-2cd2a68a1eaf-samples-operator-tls\") pod \"cluster-samples-operator-697587599-jqf48\" (UID: \"664f678a-372f-4a96-8bab-2cd2a68a1eaf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-jqf48" May 27 14:05:53.325346 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:53.325314 2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 14:05:53.325436 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:53.325385 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f3d65a9-4971-4574-94a4-84534b8c8e6b-cert podName:1f3d65a9-4971-4574-94a4-84534b8c8e6b nodeName:}" failed. No retries permitted until 2026-05-27 14:05:57.32536448 +0000 UTC m=+42.425681439 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1f3d65a9-4971-4574-94a4-84534b8c8e6b-cert") pod "ingress-canary-lx84l" (UID: "1f3d65a9-4971-4574-94a4-84534b8c8e6b") : secret "canary-serving-cert" not found May 27 14:05:53.325490 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:53.325442 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 27 14:05:53.325535 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:53.325501 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/664f678a-372f-4a96-8bab-2cd2a68a1eaf-samples-operator-tls podName:664f678a-372f-4a96-8bab-2cd2a68a1eaf nodeName:}" failed. No retries permitted until 2026-05-27 14:05:57.325485211 +0000 UTC m=+42.425802169 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/664f678a-372f-4a96-8bab-2cd2a68a1eaf-samples-operator-tls") pod "cluster-samples-operator-697587599-jqf48" (UID: "664f678a-372f-4a96-8bab-2cd2a68a1eaf") : secret "samples-operator-tls" not found May 27 14:05:56.737970 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:56.737928 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tfnv8" event={"ID":"0b4d0670-6986-4085-a211-e22549067d90","Type":"ContainerStarted","Data":"0f89c53360fa82a7355535057adffeaf8a26771a1c280afa62909a6c2c47d95c"} May 27 14:05:56.739367 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:56.739306 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-qwh27" event={"ID":"6dfeff02-a96c-4202-bac6-7346398337d3","Type":"ContainerStarted","Data":"559749e4f6674e186c1cb94569b8ae11637a8a332021310822ac9c826d43f087"} May 27 14:05:56.740702 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:56.740667 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-t6kzq" event={"ID":"97247087-636a-4f55-9a2a-47cc162238d2","Type":"ContainerStarted","Data":"34c5b13af1bdde17fd417cdc1790f9b5b86cb0b602c09bb8cec199d00c93af5b"} May 27 14:05:56.742065 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:56.742042 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-klfdl" event={"ID":"5ed1e6d4-18f5-4adf-82a7-2560aa07f855","Type":"ContainerStarted","Data":"fd4b49ba799211130330f71130d2cf3d0b6af323d66170d60d060dc321e14e27"} May 27 14:05:56.743450 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:56.743427 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-7lb8j" event={"ID":"69c8ab79-2afc-44ae-ba1f-7bbd76642023","Type":"ContainerStarted","Data":"9137e26ee04250032f54e038b32a3e55d0915c2d25686dbcff25532e60173bee"} May 27 14:05:56.764970 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:56.764882 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-tfnv8" podStartSLOduration=10.281978553 podStartE2EDuration="41.76486116s" podCreationTimestamp="2026-05-27 14:05:15 +0000 UTC" firstStartedPulling="2026-05-27 14:05:18.355379313 +0000 UTC m=+3.455696260" lastFinishedPulling="2026-05-27 14:05:49.838261909 +0000 UTC m=+34.938578867" observedRunningTime="2026-05-27 14:05:56.762567082 +0000 UTC m=+41.862884067" watchObservedRunningTime="2026-05-27 14:05:56.76486116 +0000 UTC m=+41.865178128" May 27 14:05:56.782500 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:56.782279 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-klfdl" podStartSLOduration=23.3597269 podStartE2EDuration="29.78226121s" podCreationTimestamp="2026-05-27 14:05:27 +0000 UTC" firstStartedPulling="2026-05-27 14:05:50.046468059 +0000 UTC m=+35.146785003" lastFinishedPulling="2026-05-27 14:05:56.469002355 +0000 UTC m=+41.569319313" observedRunningTime="2026-05-27 14:05:56.781033418 +0000 UTC m=+41.881350385" watchObservedRunningTime="2026-05-27 14:05:56.78226121 +0000 UTC m=+41.882578178" May 27 14:05:56.801606 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:56.801556 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-t6kzq" podStartSLOduration=23.381039514 podStartE2EDuration="29.801540158s" podCreationTimestamp="2026-05-27 14:05:27 +0000 UTC" firstStartedPulling="2026-05-27 14:05:50.046359719 +0000 UTC m=+35.146676663" lastFinishedPulling="2026-05-27 14:05:56.466860348 +0000 UTC m=+41.567177307" observedRunningTime="2026-05-27 14:05:56.800200096 +0000 UTC m=+41.900517062" watchObservedRunningTime="2026-05-27 14:05:56.801540158 +0000 UTC m=+41.901857125" May 27 14:05:56.819629 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:56.819579 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-qwh27" podStartSLOduration=23.379278819 podStartE2EDuration="29.819565279s" podCreationTimestamp="2026-05-27 14:05:27 +0000 UTC" firstStartedPulling="2026-05-27 14:05:50.028788199 +0000 UTC m=+35.129105156" lastFinishedPulling="2026-05-27 14:05:56.469074668 +0000 UTC m=+41.569391616" observedRunningTime="2026-05-27 14:05:56.819102197 +0000 UTC m=+41.919419185" watchObservedRunningTime="2026-05-27 14:05:56.819565279 +0000 UTC m=+41.919882265" May 27 14:05:56.839820 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:56.839762 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-78bdfb888c-7lb8j" podStartSLOduration=24.209515426 podStartE2EDuration="30.839727881s" podCreationTimestamp="2026-05-27 14:05:26 +0000 UTC" firstStartedPulling="2026-05-27 14:05:49.838854631 +0000 UTC m=+34.939171575" lastFinishedPulling="2026-05-27 14:05:56.469067084 +0000 UTC m=+41.569384030" observedRunningTime="2026-05-27 14:05:56.838143841 +0000 UTC m=+41.938460833" watchObservedRunningTime="2026-05-27 14:05:56.839727881 +0000 UTC m=+41.940044830" May 27 14:05:57.155027 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:57.154918 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4ab50ff1-44f8-4599-9e35-5998ed988cfd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-g2b6v\" (UID: \"4ab50ff1-44f8-4599-9e35-5998ed988cfd\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-g2b6v" May 27 14:05:57.155218 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:57.155023 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 27 14:05:57.155218 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:57.155110 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ab50ff1-44f8-4599-9e35-5998ed988cfd-cluster-monitoring-operator-tls podName:4ab50ff1-44f8-4599-9e35-5998ed988cfd nodeName:}" failed. No retries permitted until 2026-05-27 14:06:05.155088848 +0000 UTC m=+50.255405794 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4ab50ff1-44f8-4599-9e35-5998ed988cfd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-g2b6v" (UID: "4ab50ff1-44f8-4599-9e35-5998ed988cfd") : secret "cluster-monitoring-operator-tls" not found May 27 14:05:57.155218 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:57.155173 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b74fdc34-9e61-4170-840c-d8522b71dcb5-registry-tls\") pod \"image-registry-69cfc4ffb6-cbl6j\" (UID: \"b74fdc34-9e61-4170-840c-d8522b71dcb5\") " pod="openshift-image-registry/image-registry-69cfc4ffb6-cbl6j" May 27 14:05:57.155380 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:57.155309 2563 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 27 14:05:57.155380 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:57.155324 2563 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69cfc4ffb6-cbl6j: secret "image-registry-tls" not found May 27 14:05:57.155380 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:57.155370 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b74fdc34-9e61-4170-840c-d8522b71dcb5-registry-tls podName:b74fdc34-9e61-4170-840c-d8522b71dcb5 nodeName:}" failed. No retries permitted until 2026-05-27 14:06:05.15535424 +0000 UTC m=+50.255671203 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b74fdc34-9e61-4170-840c-d8522b71dcb5-registry-tls") pod "image-registry-69cfc4ffb6-cbl6j" (UID: "b74fdc34-9e61-4170-840c-d8522b71dcb5") : secret "image-registry-tls" not found May 27 14:05:57.256039 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:57.255976 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bd3304d-9bda-4253-ac96-0dfca56dd2e1-service-ca-bundle\") pod \"router-default-799b5db656-96kw4\" (UID: \"1bd3304d-9bda-4253-ac96-0dfca56dd2e1\") " pod="openshift-ingress/router-default-799b5db656-96kw4" May 27 14:05:57.256238 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:57.256062 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e2bc8d1f-4404-42a0-ae30-056843788536-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-26d7g\" (UID: \"e2bc8d1f-4404-42a0-ae30-056843788536\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-26d7g" May 27 14:05:57.256238 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:57.256113 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1bd3304d-9bda-4253-ac96-0dfca56dd2e1-metrics-certs\") pod \"router-default-799b5db656-96kw4\" (UID: \"1bd3304d-9bda-4253-ac96-0dfca56dd2e1\") " pod="openshift-ingress/router-default-799b5db656-96kw4" May 27 14:05:57.256238 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:57.256181 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1bd3304d-9bda-4253-ac96-0dfca56dd2e1-service-ca-bundle podName:1bd3304d-9bda-4253-ac96-0dfca56dd2e1 nodeName:}" failed. No retries permitted until 2026-05-27 14:06:05.256158066 +0000 UTC m=+50.356475016 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1bd3304d-9bda-4253-ac96-0dfca56dd2e1-service-ca-bundle") pod "router-default-799b5db656-96kw4" (UID: "1bd3304d-9bda-4253-ac96-0dfca56dd2e1") : configmap references non-existent config key: service-ca.crt May 27 14:05:57.256238 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:57.256218 2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 27 14:05:57.256449 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:57.256254 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/11cf11df-4ac4-41ac-9294-bd472eb60b20-metrics-tls\") pod \"dns-default-f8t8t\" (UID: \"11cf11df-4ac4-41ac-9294-bd472eb60b20\") " pod="openshift-dns/dns-default-f8t8t" May 27 14:05:57.256449 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:57.256270 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bd3304d-9bda-4253-ac96-0dfca56dd2e1-metrics-certs podName:1bd3304d-9bda-4253-ac96-0dfca56dd2e1 nodeName:}" failed. No retries permitted until 2026-05-27 14:06:05.256254907 +0000 UTC m=+50.356571858 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1bd3304d-9bda-4253-ac96-0dfca56dd2e1-metrics-certs") pod "router-default-799b5db656-96kw4" (UID: "1bd3304d-9bda-4253-ac96-0dfca56dd2e1") : secret "router-metrics-certs-default" not found May 27 14:05:57.256449 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:57.256285 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 27 14:05:57.256449 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:57.256318 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 14:05:57.256449 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:57.256338 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2bc8d1f-4404-42a0-ae30-056843788536-networking-console-plugin-cert podName:e2bc8d1f-4404-42a0-ae30-056843788536 nodeName:}" failed. No retries permitted until 2026-05-27 14:06:05.256322557 +0000 UTC m=+50.356639522 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e2bc8d1f-4404-42a0-ae30-056843788536-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-26d7g" (UID: "e2bc8d1f-4404-42a0-ae30-056843788536") : secret "networking-console-plugin-cert" not found May 27 14:05:57.256449 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:57.256359 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11cf11df-4ac4-41ac-9294-bd472eb60b20-metrics-tls podName:11cf11df-4ac4-41ac-9294-bd472eb60b20 nodeName:}" failed. No retries permitted until 2026-05-27 14:06:05.256346333 +0000 UTC m=+50.356663282 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/11cf11df-4ac4-41ac-9294-bd472eb60b20-metrics-tls") pod "dns-default-f8t8t" (UID: "11cf11df-4ac4-41ac-9294-bd472eb60b20") : secret "dns-default-metrics-tls" not found May 27 14:05:57.357654 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:57.357610 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1f3d65a9-4971-4574-94a4-84534b8c8e6b-cert\") pod \"ingress-canary-lx84l\" (UID: \"1f3d65a9-4971-4574-94a4-84534b8c8e6b\") " pod="openshift-ingress-canary/ingress-canary-lx84l" May 27 14:05:57.357851 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:57.357774 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/664f678a-372f-4a96-8bab-2cd2a68a1eaf-samples-operator-tls\") pod \"cluster-samples-operator-697587599-jqf48\" (UID: \"664f678a-372f-4a96-8bab-2cd2a68a1eaf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-jqf48" May 27 14:05:57.357851 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:57.357783 2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 14:05:57.357985 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:57.357856 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f3d65a9-4971-4574-94a4-84534b8c8e6b-cert podName:1f3d65a9-4971-4574-94a4-84534b8c8e6b nodeName:}" failed. No retries permitted until 2026-05-27 14:06:05.357835029 +0000 UTC m=+50.458151988 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1f3d65a9-4971-4574-94a4-84534b8c8e6b-cert") pod "ingress-canary-lx84l" (UID: "1f3d65a9-4971-4574-94a4-84534b8c8e6b") : secret "canary-serving-cert" not found May 27 14:05:57.357985 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:57.357931 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 27 14:05:57.357985 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:57.357981 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/664f678a-372f-4a96-8bab-2cd2a68a1eaf-samples-operator-tls podName:664f678a-372f-4a96-8bab-2cd2a68a1eaf nodeName:}" failed. No retries permitted until 2026-05-27 14:06:05.357964501 +0000 UTC m=+50.458281449 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/664f678a-372f-4a96-8bab-2cd2a68a1eaf-samples-operator-tls") pod "cluster-samples-operator-697587599-jqf48" (UID: "664f678a-372f-4a96-8bab-2cd2a68a1eaf") : secret "samples-operator-tls" not found May 27 14:05:57.747475 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:57.747431 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-68ntw" event={"ID":"3dbd3e72-1e12-450b-b88a-d4fd7f54fa96","Type":"ContainerStarted","Data":"74ac5ed7b01a479e438450415c3a6528e405f47e189f9be10ff3385918c85ccf"} May 27 14:05:57.749156 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:57.749129 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-5g8bd_4589d4df-d2d2-43e2-af93-da49d130d20d/console-operator/0.log" May 27 14:05:57.749314 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:57.749179 2563 generic.go:358] "Generic (PLEG): container finished" podID="4589d4df-d2d2-43e2-af93-da49d130d20d" containerID="751ec8b9c44ef85e0f71f099b2c288c0ccc832c905509f732ed0baf2516f9977" exitCode=255 May 27 14:05:57.749314 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:57.749293 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-5g8bd" event={"ID":"4589d4df-d2d2-43e2-af93-da49d130d20d","Type":"ContainerDied","Data":"751ec8b9c44ef85e0f71f099b2c288c0ccc832c905509f732ed0baf2516f9977"} May 27 14:05:57.749498 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:57.749483 2563 scope.go:117] "RemoveContainer" containerID="751ec8b9c44ef85e0f71f099b2c288c0ccc832c905509f732ed0baf2516f9977" May 27 14:05:57.771538 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:57.769339 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-68ntw" podStartSLOduration=24.043331913 podStartE2EDuration="30.769320563s" podCreationTimestamp="2026-05-27 14:05:27 +0000 UTC" firstStartedPulling="2026-05-27 14:05:50.044871386 +0000 UTC m=+35.145188340" lastFinishedPulling="2026-05-27 14:05:56.770860032 +0000 UTC m=+41.871176990" observedRunningTime="2026-05-27 14:05:57.768218843 +0000 UTC m=+42.868535813" watchObservedRunningTime="2026-05-27 14:05:57.769320563 +0000 UTC m=+42.869637529" May 27 14:05:58.753283 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:58.753253 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-5g8bd_4589d4df-d2d2-43e2-af93-da49d130d20d/console-operator/1.log" May 27 14:05:58.753710 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:58.753693 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-5g8bd_4589d4df-d2d2-43e2-af93-da49d130d20d/console-operator/0.log" May 27 14:05:58.753766 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:58.753732 2563 generic.go:358] "Generic (PLEG): container finished" podID="4589d4df-d2d2-43e2-af93-da49d130d20d" containerID="b5e4240ba96a258094a9a356f8273d4420066f6159ae720d6aaa5248e8ad6411" exitCode=255 May 27 14:05:58.753818 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:58.753771 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-5g8bd" event={"ID":"4589d4df-d2d2-43e2-af93-da49d130d20d","Type":"ContainerDied","Data":"b5e4240ba96a258094a9a356f8273d4420066f6159ae720d6aaa5248e8ad6411"} May 27 14:05:58.753868 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:58.753822 2563 scope.go:117] "RemoveContainer" containerID="751ec8b9c44ef85e0f71f099b2c288c0ccc832c905509f732ed0baf2516f9977" May 27 14:05:58.754094 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:58.754077 2563 scope.go:117] "RemoveContainer" containerID="b5e4240ba96a258094a9a356f8273d4420066f6159ae720d6aaa5248e8ad6411" May 27 14:05:58.754343 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:58.754317 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-5g8bd_openshift-console-operator(4589d4df-d2d2-43e2-af93-da49d130d20d)\"" pod="openshift-console-operator/console-operator-76dff48d59-5g8bd" podUID="4589d4df-d2d2-43e2-af93-da49d130d20d" May 27 14:05:59.711830 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:59.711791 2563 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-5g8bd" May 27 14:05:59.711830 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:59.711829 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-5g8bd" May 27 14:05:59.759970 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:59.759939 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-5g8bd_4589d4df-d2d2-43e2-af93-da49d130d20d/console-operator/1.log" May 27 14:05:59.760318 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:59.760291 2563 scope.go:117] "RemoveContainer" containerID="b5e4240ba96a258094a9a356f8273d4420066f6159ae720d6aaa5248e8ad6411" May 27 14:05:59.760491 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:05:59.760474 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-5g8bd_openshift-console-operator(4589d4df-d2d2-43e2-af93-da49d130d20d)\"" pod="openshift-console-operator/console-operator-76dff48d59-5g8bd" podUID="4589d4df-d2d2-43e2-af93-da49d130d20d" May 27 14:05:59.908725 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:05:59.908696 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-j85ns_f5e2da5b-e345-4b11-ac5e-19f844c185e8/dns-node-resolver/0.log" May 27 14:06:00.762793 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:00.762768 2563 scope.go:117] "RemoveContainer" containerID="b5e4240ba96a258094a9a356f8273d4420066f6159ae720d6aaa5248e8ad6411" May 27 14:06:00.763214 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:06:00.762958 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-5g8bd_openshift-console-operator(4589d4df-d2d2-43e2-af93-da49d130d20d)\"" pod="openshift-console-operator/console-operator-76dff48d59-5g8bd" podUID="4589d4df-d2d2-43e2-af93-da49d130d20d" May 27 14:06:01.107337 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:01.107259 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jg92x_1eeeff09-f3c8-453d-b9ca-d074d2cb10c8/node-ca/0.log" May 27 14:06:05.226965 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:05.226913 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b74fdc34-9e61-4170-840c-d8522b71dcb5-registry-tls\") pod \"image-registry-69cfc4ffb6-cbl6j\" (UID: \"b74fdc34-9e61-4170-840c-d8522b71dcb5\") " pod="openshift-image-registry/image-registry-69cfc4ffb6-cbl6j" May 27 14:06:05.226965 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:05.226982 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4ab50ff1-44f8-4599-9e35-5998ed988cfd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-g2b6v\" (UID: \"4ab50ff1-44f8-4599-9e35-5998ed988cfd\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-g2b6v" May 27 14:06:05.227442 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:06:05.227102 2563 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 27 14:06:05.227442 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:06:05.227128 2563 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69cfc4ffb6-cbl6j: secret "image-registry-tls" not found May 27 14:06:05.227442 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:06:05.227129 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 27 14:06:05.227442 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:06:05.227204 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b74fdc34-9e61-4170-840c-d8522b71dcb5-registry-tls podName:b74fdc34-9e61-4170-840c-d8522b71dcb5 nodeName:}" failed. No retries permitted until 2026-05-27 14:06:21.227183352 +0000 UTC m=+66.327500316 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b74fdc34-9e61-4170-840c-d8522b71dcb5-registry-tls") pod "image-registry-69cfc4ffb6-cbl6j" (UID: "b74fdc34-9e61-4170-840c-d8522b71dcb5") : secret "image-registry-tls" not found May 27 14:06:05.227442 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:06:05.227225 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ab50ff1-44f8-4599-9e35-5998ed988cfd-cluster-monitoring-operator-tls podName:4ab50ff1-44f8-4599-9e35-5998ed988cfd nodeName:}" failed. No retries permitted until 2026-05-27 14:06:21.227215202 +0000 UTC m=+66.327532147 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4ab50ff1-44f8-4599-9e35-5998ed988cfd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-g2b6v" (UID: "4ab50ff1-44f8-4599-9e35-5998ed988cfd") : secret "cluster-monitoring-operator-tls" not found May 27 14:06:05.327570 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:05.327531 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/11cf11df-4ac4-41ac-9294-bd472eb60b20-metrics-tls\") pod \"dns-default-f8t8t\" (UID: \"11cf11df-4ac4-41ac-9294-bd472eb60b20\") " pod="openshift-dns/dns-default-f8t8t" May 27 14:06:05.327759 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:05.327683 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bd3304d-9bda-4253-ac96-0dfca56dd2e1-service-ca-bundle\") pod \"router-default-799b5db656-96kw4\" (UID: \"1bd3304d-9bda-4253-ac96-0dfca56dd2e1\") " pod="openshift-ingress/router-default-799b5db656-96kw4" May 27 14:06:05.327759 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:06:05.327689 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 14:06:05.327759 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:05.327726 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e2bc8d1f-4404-42a0-ae30-056843788536-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-26d7g\" (UID: \"e2bc8d1f-4404-42a0-ae30-056843788536\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-26d7g" May 27 14:06:05.327759 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:06:05.327756 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11cf11df-4ac4-41ac-9294-bd472eb60b20-metrics-tls podName:11cf11df-4ac4-41ac-9294-bd472eb60b20 nodeName:}" failed. No retries permitted until 2026-05-27 14:06:21.327740866 +0000 UTC m=+66.428057811 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/11cf11df-4ac4-41ac-9294-bd472eb60b20-metrics-tls") pod "dns-default-f8t8t" (UID: "11cf11df-4ac4-41ac-9294-bd472eb60b20") : secret "dns-default-metrics-tls" not found May 27 14:06:05.327979 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:06:05.327797 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 27 14:06:05.327979 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:05.327810 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1bd3304d-9bda-4253-ac96-0dfca56dd2e1-metrics-certs\") pod \"router-default-799b5db656-96kw4\" (UID: \"1bd3304d-9bda-4253-ac96-0dfca56dd2e1\") " pod="openshift-ingress/router-default-799b5db656-96kw4" May 27 14:06:05.327979 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:06:05.327839 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2bc8d1f-4404-42a0-ae30-056843788536-networking-console-plugin-cert podName:e2bc8d1f-4404-42a0-ae30-056843788536 nodeName:}" failed. No retries permitted until 2026-05-27 14:06:21.327828009 +0000 UTC m=+66.428144953 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e2bc8d1f-4404-42a0-ae30-056843788536-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-26d7g" (UID: "e2bc8d1f-4404-42a0-ae30-056843788536") : secret "networking-console-plugin-cert" not found May 27 14:06:05.327979 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:06:05.327852 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1bd3304d-9bda-4253-ac96-0dfca56dd2e1-service-ca-bundle podName:1bd3304d-9bda-4253-ac96-0dfca56dd2e1 nodeName:}" failed. No retries permitted until 2026-05-27 14:06:21.32784523 +0000 UTC m=+66.428162174 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1bd3304d-9bda-4253-ac96-0dfca56dd2e1-service-ca-bundle") pod "router-default-799b5db656-96kw4" (UID: "1bd3304d-9bda-4253-ac96-0dfca56dd2e1") : configmap references non-existent config key: service-ca.crt May 27 14:06:05.327979 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:06:05.327886 2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 27 14:06:05.327979 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:06:05.327946 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bd3304d-9bda-4253-ac96-0dfca56dd2e1-metrics-certs podName:1bd3304d-9bda-4253-ac96-0dfca56dd2e1 nodeName:}" failed. No retries permitted until 2026-05-27 14:06:21.327935513 +0000 UTC m=+66.428252460 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1bd3304d-9bda-4253-ac96-0dfca56dd2e1-metrics-certs") pod "router-default-799b5db656-96kw4" (UID: "1bd3304d-9bda-4253-ac96-0dfca56dd2e1") : secret "router-metrics-certs-default" not found May 27 14:06:05.428718 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:05.428681 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/664f678a-372f-4a96-8bab-2cd2a68a1eaf-samples-operator-tls\") pod \"cluster-samples-operator-697587599-jqf48\" (UID: \"664f678a-372f-4a96-8bab-2cd2a68a1eaf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-jqf48" May 27 14:06:05.428927 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:05.428759 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1f3d65a9-4971-4574-94a4-84534b8c8e6b-cert\") pod \"ingress-canary-lx84l\" (UID: \"1f3d65a9-4971-4574-94a4-84534b8c8e6b\") " pod="openshift-ingress-canary/ingress-canary-lx84l" May 27 14:06:05.428927 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:06:05.428828 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 27 14:06:05.429008 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:06:05.428926 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/664f678a-372f-4a96-8bab-2cd2a68a1eaf-samples-operator-tls podName:664f678a-372f-4a96-8bab-2cd2a68a1eaf nodeName:}" failed. No retries permitted until 2026-05-27 14:06:21.428881122 +0000 UTC m=+66.529198070 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/664f678a-372f-4a96-8bab-2cd2a68a1eaf-samples-operator-tls") pod "cluster-samples-operator-697587599-jqf48" (UID: "664f678a-372f-4a96-8bab-2cd2a68a1eaf") : secret "samples-operator-tls" not found May 27 14:06:05.429008 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:06:05.428935 2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 14:06:05.429008 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:06:05.428974 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f3d65a9-4971-4574-94a4-84534b8c8e6b-cert podName:1f3d65a9-4971-4574-94a4-84534b8c8e6b nodeName:}" failed. No retries permitted until 2026-05-27 14:06:21.428962714 +0000 UTC m=+66.529279675 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1f3d65a9-4971-4574-94a4-84534b8c8e6b-cert") pod "ingress-canary-lx84l" (UID: "1f3d65a9-4971-4574-94a4-84534b8c8e6b") : secret "canary-serving-cert" not found May 27 14:06:13.686345 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:13.686317 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fn9jd" May 27 14:06:14.538711 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:14.538682 2563 scope.go:117] "RemoveContainer" containerID="b5e4240ba96a258094a9a356f8273d4420066f6159ae720d6aaa5248e8ad6411" May 27 14:06:14.798535 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:14.798454 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-5g8bd_4589d4df-d2d2-43e2-af93-da49d130d20d/console-operator/1.log" May 27 14:06:14.798535 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:14.798502 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-5g8bd" event={"ID":"4589d4df-d2d2-43e2-af93-da49d130d20d","Type":"ContainerStarted","Data":"9366dce4c8ac7306275342ded280bd828c020c712fa64203f20f29a2ef64dbf3"} May 27 14:06:14.798970 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:14.798771 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-5g8bd" May 27 14:06:15.126719 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:15.126631 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-76dff48d59-5g8bd" May 27 14:06:15.162673 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:15.162619 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-76dff48d59-5g8bd" podStartSLOduration=41.725132744 podStartE2EDuration="48.162603351s" podCreationTimestamp="2026-05-27 14:05:27 +0000 UTC" firstStartedPulling="2026-05-27 14:05:50.035394756 +0000 UTC m=+35.135711701" lastFinishedPulling="2026-05-27 14:05:56.47286536 +0000 UTC m=+41.573182308" observedRunningTime="2026-05-27 14:06:14.823003486 +0000 UTC m=+59.923320453" watchObservedRunningTime="2026-05-27 14:06:15.162603351 +0000 UTC m=+60.262920316" May 27 14:06:21.056715 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.056682 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bdd89c474-cwlnm"] May 27 14:06:21.087427 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.087399 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bdd89c474-cwlnm"] May 27 14:06:21.087609 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.087527 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bdd89c474-cwlnm" May 27 14:06:21.090701 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.090673 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" May 27 14:06:21.090904 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.090869 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" May 27 14:06:21.091090 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.091072 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" May 27 14:06:21.091824 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.091791 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" May 27 14:06:21.091824 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.091818 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" May 27 14:06:21.096357 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.096340 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" May 27 14:06:21.097025 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.097004 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" May 27 14:06:21.179684 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.179652 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/50f249ee-869f-46fc-9d94-2c4a06c66af2-hub\") pod \"cluster-proxy-proxy-agent-6bdd89c474-cwlnm\" (UID: \"50f249ee-869f-46fc-9d94-2c4a06c66af2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bdd89c474-cwlnm" May 27 14:06:21.179684 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.179684 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/50f249ee-869f-46fc-9d94-2c4a06c66af2-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-6bdd89c474-cwlnm\" (UID: \"50f249ee-869f-46fc-9d94-2c4a06c66af2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bdd89c474-cwlnm" May 27 14:06:21.179885 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.179717 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3798bdf6-d616-43ed-b727-35b9407c33e7-metrics-certs\") pod \"network-metrics-daemon-txmmd\" (UID: \"3798bdf6-d616-43ed-b727-35b9407c33e7\") " pod="openshift-multus/network-metrics-daemon-txmmd" May 27 14:06:21.179885 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.179783 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/50f249ee-869f-46fc-9d94-2c4a06c66af2-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6bdd89c474-cwlnm\" (UID: \"50f249ee-869f-46fc-9d94-2c4a06c66af2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bdd89c474-cwlnm" May 27 14:06:21.179885 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.179857 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/50f249ee-869f-46fc-9d94-2c4a06c66af2-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6bdd89c474-cwlnm\" (UID: \"50f249ee-869f-46fc-9d94-2c4a06c66af2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bdd89c474-cwlnm" May 27 14:06:21.180019 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.179957 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbrgf\" (UniqueName: \"kubernetes.io/projected/50f249ee-869f-46fc-9d94-2c4a06c66af2-kube-api-access-xbrgf\") pod \"cluster-proxy-proxy-agent-6bdd89c474-cwlnm\" (UID: \"50f249ee-869f-46fc-9d94-2c4a06c66af2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bdd89c474-cwlnm" May 27 14:06:21.180056 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.180043 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/50f249ee-869f-46fc-9d94-2c4a06c66af2-ca\") pod \"cluster-proxy-proxy-agent-6bdd89c474-cwlnm\" (UID: \"50f249ee-869f-46fc-9d94-2c4a06c66af2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bdd89c474-cwlnm" May 27 14:06:21.184455 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.184432 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 27 14:06:21.187869 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.187847 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-wllmb"] May 27 14:06:21.194161 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.194139 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3798bdf6-d616-43ed-b727-35b9407c33e7-metrics-certs\") pod \"network-metrics-daemon-txmmd\" (UID: \"3798bdf6-d616-43ed-b727-35b9407c33e7\") " pod="openshift-multus/network-metrics-daemon-txmmd" May 27 14:06:21.203865 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.203845 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wllmb" May 27 14:06:21.206813 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.206794 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 27 14:06:21.206958 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.206863 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 27 14:06:21.207949 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.207928 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wllmb"] May 27 14:06:21.213835 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.213815 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6zlr5\"" May 27 14:06:21.281114 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.281078 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-blzm7\" (UniqueName: \"kubernetes.io/projected/82e1095b-051d-4cd7-91f4-e3e2200e3812-kube-api-access-blzm7\") pod \"network-check-target-wbsgc\" (UID: \"82e1095b-051d-4cd7-91f4-e3e2200e3812\") " pod="openshift-network-diagnostics/network-check-target-wbsgc" May 27 14:06:21.281114 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.281123 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/50f249ee-869f-46fc-9d94-2c4a06c66af2-ca\") pod \"cluster-proxy-proxy-agent-6bdd89c474-cwlnm\" (UID: \"50f249ee-869f-46fc-9d94-2c4a06c66af2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bdd89c474-cwlnm" May 27 14:06:21.281374 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.281154 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qg29v\" (UniqueName: \"kubernetes.io/projected/09689767-b9d7-467f-a864-b35738fd6d49-kube-api-access-qg29v\") pod \"insights-runtime-extractor-wllmb\" (UID: \"09689767-b9d7-467f-a864-b35738fd6d49\") " pod="openshift-insights/insights-runtime-extractor-wllmb" May 27 14:06:21.281374 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.281185 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/09689767-b9d7-467f-a864-b35738fd6d49-data-volume\") pod \"insights-runtime-extractor-wllmb\" (UID: \"09689767-b9d7-467f-a864-b35738fd6d49\") " pod="openshift-insights/insights-runtime-extractor-wllmb" May 27 14:06:21.281374 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.281335 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/50f249ee-869f-46fc-9d94-2c4a06c66af2-hub\") pod \"cluster-proxy-proxy-agent-6bdd89c474-cwlnm\" (UID: \"50f249ee-869f-46fc-9d94-2c4a06c66af2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bdd89c474-cwlnm" May 27 14:06:21.281374 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.281367 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/50f249ee-869f-46fc-9d94-2c4a06c66af2-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-6bdd89c474-cwlnm\" (UID: \"50f249ee-869f-46fc-9d94-2c4a06c66af2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bdd89c474-cwlnm" May 27 14:06:21.281624 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.281391 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/09689767-b9d7-467f-a864-b35738fd6d49-crio-socket\") pod \"insights-runtime-extractor-wllmb\" (UID: \"09689767-b9d7-467f-a864-b35738fd6d49\") " pod="openshift-insights/insights-runtime-extractor-wllmb" May 27 14:06:21.281624 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.281421 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b74fdc34-9e61-4170-840c-d8522b71dcb5-registry-tls\") pod \"image-registry-69cfc4ffb6-cbl6j\" (UID: \"b74fdc34-9e61-4170-840c-d8522b71dcb5\") " pod="openshift-image-registry/image-registry-69cfc4ffb6-cbl6j" May 27 14:06:21.281624 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.281550 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/50f249ee-869f-46fc-9d94-2c4a06c66af2-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6bdd89c474-cwlnm\" (UID: \"50f249ee-869f-46fc-9d94-2c4a06c66af2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bdd89c474-cwlnm" May 27 14:06:21.281624 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.281585 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4ab50ff1-44f8-4599-9e35-5998ed988cfd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-g2b6v\" (UID: \"4ab50ff1-44f8-4599-9e35-5998ed988cfd\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-g2b6v" May 27 14:06:21.281815 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.281636 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/09689767-b9d7-467f-a864-b35738fd6d49-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wllmb\" (UID: \"09689767-b9d7-467f-a864-b35738fd6d49\") " pod="openshift-insights/insights-runtime-extractor-wllmb" May 27 14:06:21.281815 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.281681 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/50f249ee-869f-46fc-9d94-2c4a06c66af2-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6bdd89c474-cwlnm\" (UID: \"50f249ee-869f-46fc-9d94-2c4a06c66af2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bdd89c474-cwlnm" May 27 14:06:21.281815 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.281724 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/09689767-b9d7-467f-a864-b35738fd6d49-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wllmb\" (UID: \"09689767-b9d7-467f-a864-b35738fd6d49\") " pod="openshift-insights/insights-runtime-extractor-wllmb" May 27 14:06:21.281815 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.281764 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xbrgf\" (UniqueName: \"kubernetes.io/projected/50f249ee-869f-46fc-9d94-2c4a06c66af2-kube-api-access-xbrgf\") pod \"cluster-proxy-proxy-agent-6bdd89c474-cwlnm\" (UID: \"50f249ee-869f-46fc-9d94-2c4a06c66af2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bdd89c474-cwlnm" May 27 14:06:21.282362 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.282113 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/50f249ee-869f-46fc-9d94-2c4a06c66af2-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-6bdd89c474-cwlnm\" (UID: \"50f249ee-869f-46fc-9d94-2c4a06c66af2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bdd89c474-cwlnm" May 27 14:06:21.284143 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.284116 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/50f249ee-869f-46fc-9d94-2c4a06c66af2-ca\") pod \"cluster-proxy-proxy-agent-6bdd89c474-cwlnm\" (UID: \"50f249ee-869f-46fc-9d94-2c4a06c66af2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bdd89c474-cwlnm" May 27 14:06:21.284280 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.284258 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-blzm7\" (UniqueName: \"kubernetes.io/projected/82e1095b-051d-4cd7-91f4-e3e2200e3812-kube-api-access-blzm7\") pod \"network-check-target-wbsgc\" (UID: \"82e1095b-051d-4cd7-91f4-e3e2200e3812\") " pod="openshift-network-diagnostics/network-check-target-wbsgc" May 27 14:06:21.284343 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.284305 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b74fdc34-9e61-4170-840c-d8522b71dcb5-registry-tls\") pod \"image-registry-69cfc4ffb6-cbl6j\" (UID: \"b74fdc34-9e61-4170-840c-d8522b71dcb5\") " pod="openshift-image-registry/image-registry-69cfc4ffb6-cbl6j" May 27 14:06:21.284398 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.284350 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/50f249ee-869f-46fc-9d94-2c4a06c66af2-hub\") pod \"cluster-proxy-proxy-agent-6bdd89c474-cwlnm\" (UID: \"50f249ee-869f-46fc-9d94-2c4a06c66af2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bdd89c474-cwlnm" May 27 14:06:21.284461 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.284444 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/50f249ee-869f-46fc-9d94-2c4a06c66af2-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6bdd89c474-cwlnm\" (UID: \"50f249ee-869f-46fc-9d94-2c4a06c66af2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bdd89c474-cwlnm" May 27 14:06:21.284675 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.284657 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/50f249ee-869f-46fc-9d94-2c4a06c66af2-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6bdd89c474-cwlnm\" (UID: \"50f249ee-869f-46fc-9d94-2c4a06c66af2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bdd89c474-cwlnm" May 27 14:06:21.285076 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.285055 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4ab50ff1-44f8-4599-9e35-5998ed988cfd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-g2b6v\" (UID: \"4ab50ff1-44f8-4599-9e35-5998ed988cfd\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-g2b6v" May 27 14:06:21.310078 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.310016 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbrgf\" (UniqueName: \"kubernetes.io/projected/50f249ee-869f-46fc-9d94-2c4a06c66af2-kube-api-access-xbrgf\") pod \"cluster-proxy-proxy-agent-6bdd89c474-cwlnm\" (UID: \"50f249ee-869f-46fc-9d94-2c4a06c66af2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bdd89c474-cwlnm" May 27 14:06:21.383139 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.383101 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/09689767-b9d7-467f-a864-b35738fd6d49-data-volume\") pod \"insights-runtime-extractor-wllmb\" (UID: \"09689767-b9d7-467f-a864-b35738fd6d49\") " pod="openshift-insights/insights-runtime-extractor-wllmb" May 27 14:06:21.383321 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.383158 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/09689767-b9d7-467f-a864-b35738fd6d49-crio-socket\") pod \"insights-runtime-extractor-wllmb\" (UID: \"09689767-b9d7-467f-a864-b35738fd6d49\") " pod="openshift-insights/insights-runtime-extractor-wllmb" May 27 14:06:21.383321 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.383186 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bd3304d-9bda-4253-ac96-0dfca56dd2e1-service-ca-bundle\") pod \"router-default-799b5db656-96kw4\" (UID: \"1bd3304d-9bda-4253-ac96-0dfca56dd2e1\") " pod="openshift-ingress/router-default-799b5db656-96kw4" May 27 14:06:21.383321 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.383213 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/09689767-b9d7-467f-a864-b35738fd6d49-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wllmb\" (UID: \"09689767-b9d7-467f-a864-b35738fd6d49\") " pod="openshift-insights/insights-runtime-extractor-wllmb" May 27 14:06:21.383321 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.383256 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e2bc8d1f-4404-42a0-ae30-056843788536-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-26d7g\" (UID: \"e2bc8d1f-4404-42a0-ae30-056843788536\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-26d7g" May 27 14:06:21.383321 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.383267 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/09689767-b9d7-467f-a864-b35738fd6d49-crio-socket\") pod \"insights-runtime-extractor-wllmb\" (UID: \"09689767-b9d7-467f-a864-b35738fd6d49\") " pod="openshift-insights/insights-runtime-extractor-wllmb" May 27 14:06:21.383321 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.383277 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/09689767-b9d7-467f-a864-b35738fd6d49-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wllmb\" (UID: \"09689767-b9d7-467f-a864-b35738fd6d49\") " pod="openshift-insights/insights-runtime-extractor-wllmb" May 27 14:06:21.383630 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.383363 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1bd3304d-9bda-4253-ac96-0dfca56dd2e1-metrics-certs\") pod \"router-default-799b5db656-96kw4\" (UID: \"1bd3304d-9bda-4253-ac96-0dfca56dd2e1\") " pod="openshift-ingress/router-default-799b5db656-96kw4" May 27 14:06:21.383630 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.383405 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/11cf11df-4ac4-41ac-9294-bd472eb60b20-metrics-tls\") pod \"dns-default-f8t8t\" (UID: \"11cf11df-4ac4-41ac-9294-bd472eb60b20\") " pod="openshift-dns/dns-default-f8t8t" May 27 14:06:21.383630 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.383434 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qg29v\" (UniqueName: \"kubernetes.io/projected/09689767-b9d7-467f-a864-b35738fd6d49-kube-api-access-qg29v\") pod \"insights-runtime-extractor-wllmb\" (UID: \"09689767-b9d7-467f-a864-b35738fd6d49\") " pod="openshift-insights/insights-runtime-extractor-wllmb" May 27 14:06:21.383801 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.383663 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/09689767-b9d7-467f-a864-b35738fd6d49-data-volume\") pod \"insights-runtime-extractor-wllmb\" (UID: \"09689767-b9d7-467f-a864-b35738fd6d49\") " pod="openshift-insights/insights-runtime-extractor-wllmb" May 27 14:06:21.383975 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.383928 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bd3304d-9bda-4253-ac96-0dfca56dd2e1-service-ca-bundle\") pod \"router-default-799b5db656-96kw4\" (UID: \"1bd3304d-9bda-4253-ac96-0dfca56dd2e1\") " pod="openshift-ingress/router-default-799b5db656-96kw4" May 27 14:06:21.384254 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.384191 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/09689767-b9d7-467f-a864-b35738fd6d49-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wllmb\" (UID: \"09689767-b9d7-467f-a864-b35738fd6d49\") " pod="openshift-insights/insights-runtime-extractor-wllmb" May 27 14:06:21.385880 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.385857 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/11cf11df-4ac4-41ac-9294-bd472eb60b20-metrics-tls\") pod \"dns-default-f8t8t\" (UID: \"11cf11df-4ac4-41ac-9294-bd472eb60b20\") " pod="openshift-dns/dns-default-f8t8t" May 27 14:06:21.385991 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.385975 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e2bc8d1f-4404-42a0-ae30-056843788536-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-26d7g\" (UID: \"e2bc8d1f-4404-42a0-ae30-056843788536\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-26d7g" May 27 14:06:21.386209 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.386162 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/09689767-b9d7-467f-a864-b35738fd6d49-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wllmb\" (UID: \"09689767-b9d7-467f-a864-b35738fd6d49\") " pod="openshift-insights/insights-runtime-extractor-wllmb" May 27 14:06:21.386309 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.386281 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1bd3304d-9bda-4253-ac96-0dfca56dd2e1-metrics-certs\") pod \"router-default-799b5db656-96kw4\" (UID: \"1bd3304d-9bda-4253-ac96-0dfca56dd2e1\") " pod="openshift-ingress/router-default-799b5db656-96kw4" May 27 14:06:21.399059 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.399031 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qg29v\" (UniqueName: \"kubernetes.io/projected/09689767-b9d7-467f-a864-b35738fd6d49-kube-api-access-qg29v\") pod \"insights-runtime-extractor-wllmb\" (UID: \"09689767-b9d7-467f-a864-b35738fd6d49\") " pod="openshift-insights/insights-runtime-extractor-wllmb" May 27 14:06:21.406060 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.406038 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bdd89c474-cwlnm" May 27 14:06:21.456621 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.456528 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kjqwb\"" May 27 14:06:21.459217 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.459193 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-w599p\"" May 27 14:06:21.462230 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.461799 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wbsgc" May 27 14:06:21.462766 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.462749 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jlrrx\"" May 27 14:06:21.467006 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.466938 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69cfc4ffb6-cbl6j" May 27 14:06:21.470794 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.470776 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txmmd" May 27 14:06:21.484939 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.484839 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1f3d65a9-4971-4574-94a4-84534b8c8e6b-cert\") pod \"ingress-canary-lx84l\" (UID: \"1f3d65a9-4971-4574-94a4-84534b8c8e6b\") " pod="openshift-ingress-canary/ingress-canary-lx84l" May 27 14:06:21.486150 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.485691 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/664f678a-372f-4a96-8bab-2cd2a68a1eaf-samples-operator-tls\") pod \"cluster-samples-operator-697587599-jqf48\" (UID: \"664f678a-372f-4a96-8bab-2cd2a68a1eaf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-jqf48" May 27 14:06:21.491435 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.491388 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/664f678a-372f-4a96-8bab-2cd2a68a1eaf-samples-operator-tls\") pod \"cluster-samples-operator-697587599-jqf48\" (UID: \"664f678a-372f-4a96-8bab-2cd2a68a1eaf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-jqf48" May 27 14:06:21.492859 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.492813 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1f3d65a9-4971-4574-94a4-84534b8c8e6b-cert\") pod \"ingress-canary-lx84l\" (UID: \"1f3d65a9-4971-4574-94a4-84534b8c8e6b\") " pod="openshift-ingress-canary/ingress-canary-lx84l" May 27 14:06:21.493818 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.493744 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-vwm8c\"" May 27 14:06:21.501349 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.500942 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-g2b6v" May 27 14:06:21.513852 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.513789 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wllmb" May 27 14:06:21.577025 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.566635 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dcgs8\"" May 27 14:06:21.577025 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.568102 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bdd89c474-cwlnm"] May 27 14:06:21.577025 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.568320 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-knf2q\"" May 27 14:06:21.577025 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.568502 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-f8t8t" May 27 14:06:21.579103 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.578691 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-799b5db656-96kw4" May 27 14:06:21.584832 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.583173 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-bhpr2\"" May 27 14:06:21.589565 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.589259 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-26d7g" May 27 14:06:21.618371 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.618206 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-46prk\"" May 27 14:06:21.627860 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.627833 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-jqf48" May 27 14:06:21.642856 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.642634 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-rb76g\"" May 27 14:06:21.655324 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.651732 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lx84l" May 27 14:06:21.723339 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.723155 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-txmmd"] May 27 14:06:21.739384 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:06:21.736464 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3798bdf6_d616_43ed_b727_35b9407c33e7.slice/crio-2ea043d81051090f5183f7c66a70a8da4e54bb0e917c5c58fc4be1fe07fc25ec WatchSource:0}: Error finding container 2ea043d81051090f5183f7c66a70a8da4e54bb0e917c5c58fc4be1fe07fc25ec: Status 404 returned error can't find the container with id 2ea043d81051090f5183f7c66a70a8da4e54bb0e917c5c58fc4be1fe07fc25ec May 27 14:06:21.763794 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.763554 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-69cfc4ffb6-cbl6j"] May 27 14:06:21.772443 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.772401 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wbsgc"] May 27 14:06:21.799090 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.797769 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-g2b6v"] May 27 14:06:21.820216 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.820154 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-69cfc4ffb6-cbl6j" event={"ID":"b74fdc34-9e61-4170-840c-d8522b71dcb5","Type":"ContainerStarted","Data":"4af13d8ce92ff113c931e40a2ef7007455b3e39a975f6f2afb6f4e61fcdf63c5"} May 27 14:06:21.821717 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.821678 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-g2b6v" event={"ID":"4ab50ff1-44f8-4599-9e35-5998ed988cfd","Type":"ContainerStarted","Data":"20c18d0e0be5ed9ea0b6b5af3e92c811c0eb2693f2198a3bc22062b534d5ceb1"} May 27 14:06:21.829125 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.829066 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wbsgc" event={"ID":"82e1095b-051d-4cd7-91f4-e3e2200e3812","Type":"ContainerStarted","Data":"4663aca55a150b04ee8d9594851290a937c5e04e4ce305dd177116b9ef34ddc0"} May 27 14:06:21.832592 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.832548 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wllmb"] May 27 14:06:21.833399 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.833170 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-txmmd" event={"ID":"3798bdf6-d616-43ed-b727-35b9407c33e7","Type":"ContainerStarted","Data":"2ea043d81051090f5183f7c66a70a8da4e54bb0e917c5c58fc4be1fe07fc25ec"} May 27 14:06:21.835116 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.835095 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bdd89c474-cwlnm" event={"ID":"50f249ee-869f-46fc-9d94-2c4a06c66af2","Type":"ContainerStarted","Data":"ee04ef1989bfa9ee434cd94f9733b8fe57ff4c32f7cb75284eeab597e09f8c6c"} May 27 14:06:21.839367 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:06:21.839064 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09689767_b9d7_467f_a864_b35738fd6d49.slice/crio-69cd81aba227e82408aa005956b47d4fcf1550d7c2fbb537f1ada496625b7103 WatchSource:0}: Error finding container 69cd81aba227e82408aa005956b47d4fcf1550d7c2fbb537f1ada496625b7103: Status 404 returned error can't find the container with id 69cd81aba227e82408aa005956b47d4fcf1550d7c2fbb537f1ada496625b7103 May 27 14:06:21.878098 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.877945 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-26d7g"] May 27 14:06:21.897753 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.896911 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-f8t8t"] May 27 14:06:21.902396 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:06:21.902367 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11cf11df_4ac4_41ac_9294_bd472eb60b20.slice/crio-b37dfa7b663b237c670530a0bcd37a70a5c7bd4ad8a613606f36a656e651f1a2 WatchSource:0}: Error finding container b37dfa7b663b237c670530a0bcd37a70a5c7bd4ad8a613606f36a656e651f1a2: Status 404 returned error can't find the container with id b37dfa7b663b237c670530a0bcd37a70a5c7bd4ad8a613606f36a656e651f1a2 May 27 14:06:21.907310 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:21.907286 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-799b5db656-96kw4"] May 27 14:06:21.909735 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:06:21.909713 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bd3304d_9bda_4253_ac96_0dfca56dd2e1.slice/crio-b5bd4b5f1e6dca782d73164e8eb49e6e40484001d0675beaf127ef6fe5bcb28c WatchSource:0}: Error finding container b5bd4b5f1e6dca782d73164e8eb49e6e40484001d0675beaf127ef6fe5bcb28c: Status 404 returned error can't find the container with id b5bd4b5f1e6dca782d73164e8eb49e6e40484001d0675beaf127ef6fe5bcb28c May 27 14:06:22.135760 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:22.135666 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lx84l"] May 27 14:06:22.139716 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:22.139678 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-jqf48"] May 27 14:06:22.140601 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:06:22.140567 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f3d65a9_4971_4574_94a4_84534b8c8e6b.slice/crio-4f91b2dec1ba6c59be93fbe3c9fb079267b70c66c9f5573527b8372a4ad50574 WatchSource:0}: Error finding container 4f91b2dec1ba6c59be93fbe3c9fb079267b70c66c9f5573527b8372a4ad50574: Status 404 returned error can't find the container with id 4f91b2dec1ba6c59be93fbe3c9fb079267b70c66c9f5573527b8372a4ad50574 May 27 14:06:22.400678 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:22.400592 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5a97ff24-1b84-4127-87cf-f53d545ce361-original-pull-secret\") pod \"global-pull-secret-syncer-px2cq\" (UID: \"5a97ff24-1b84-4127-87cf-f53d545ce361\") " pod="kube-system/global-pull-secret-syncer-px2cq" May 27 14:06:22.403920 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:22.403876 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 27 14:06:22.414118 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:22.414057 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5a97ff24-1b84-4127-87cf-f53d545ce361-original-pull-secret\") pod \"global-pull-secret-syncer-px2cq\" (UID: \"5a97ff24-1b84-4127-87cf-f53d545ce361\") " pod="kube-system/global-pull-secret-syncer-px2cq" May 27 14:06:22.668429 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:22.667982 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-px2cq" May 27 14:06:22.851143 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:22.849694 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-jqf48" event={"ID":"664f678a-372f-4a96-8bab-2cd2a68a1eaf","Type":"ContainerStarted","Data":"64d69b270f59e42547f1b9737f0b171a914ca3a897f7902f09715a8b845d60e1"} May 27 14:06:22.853642 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:22.853132 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lx84l" event={"ID":"1f3d65a9-4971-4574-94a4-84534b8c8e6b","Type":"ContainerStarted","Data":"4f91b2dec1ba6c59be93fbe3c9fb079267b70c66c9f5573527b8372a4ad50574"} May 27 14:06:22.855532 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:22.855506 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-f8t8t" event={"ID":"11cf11df-4ac4-41ac-9294-bd472eb60b20","Type":"ContainerStarted","Data":"b37dfa7b663b237c670530a0bcd37a70a5c7bd4ad8a613606f36a656e651f1a2"} May 27 14:06:22.859867 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:22.859817 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-69cfc4ffb6-cbl6j" event={"ID":"b74fdc34-9e61-4170-840c-d8522b71dcb5","Type":"ContainerStarted","Data":"b5050091dd3c0fb7edab861a0732b00555d9c86fe86983c2c34a11da7a91efd4"} May 27 14:06:22.860670 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:22.860650 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-69cfc4ffb6-cbl6j" May 27 14:06:22.862397 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:22.862329 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wllmb" event={"ID":"09689767-b9d7-467f-a864-b35738fd6d49","Type":"ContainerStarted","Data":"31528f82cb3732b7ea38772294c5aa5dbd7cdc62684fe1c5ada1c16cc69e2dae"} May 27 14:06:22.862397 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:22.862356 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wllmb" event={"ID":"09689767-b9d7-467f-a864-b35738fd6d49","Type":"ContainerStarted","Data":"69cd81aba227e82408aa005956b47d4fcf1550d7c2fbb537f1ada496625b7103"} May 27 14:06:22.865414 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:22.864880 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wbsgc" event={"ID":"82e1095b-051d-4cd7-91f4-e3e2200e3812","Type":"ContainerStarted","Data":"87cd987f73d05895c7a9d2d0d1329187762e56cb622341d3247755cc56662f51"} May 27 14:06:22.865414 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:22.865278 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-wbsgc" May 27 14:06:22.866732 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:22.866706 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-26d7g" event={"ID":"e2bc8d1f-4404-42a0-ae30-056843788536","Type":"ContainerStarted","Data":"6705276dc8218a544031bbce1a77afa28d71ef40b3b4767557875748e96256bd"} May 27 14:06:22.868466 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:22.868433 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-799b5db656-96kw4" event={"ID":"1bd3304d-9bda-4253-ac96-0dfca56dd2e1","Type":"ContainerStarted","Data":"cc4aa7f290334e5886940218831c24616a2715b090441d558f22af7455f34da8"} May 27 14:06:22.868466 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:22.868463 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-799b5db656-96kw4" event={"ID":"1bd3304d-9bda-4253-ac96-0dfca56dd2e1","Type":"ContainerStarted","Data":"b5bd4b5f1e6dca782d73164e8eb49e6e40484001d0675beaf127ef6fe5bcb28c"} May 27 14:06:22.914423 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:22.914363 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-799b5db656-96kw4" podStartSLOduration=55.91434348 podStartE2EDuration="55.91434348s" podCreationTimestamp="2026-05-27 14:05:27 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 14:06:22.913116715 +0000 UTC m=+68.013433682" watchObservedRunningTime="2026-05-27 14:06:22.91434348 +0000 UTC m=+68.014660448" May 27 14:06:22.914592 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:22.914515 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-69cfc4ffb6-cbl6j" podStartSLOduration=66.914504308 podStartE2EDuration="1m6.914504308s" podCreationTimestamp="2026-05-27 14:05:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 14:06:22.887016872 +0000 UTC m=+67.987333839" watchObservedRunningTime="2026-05-27 14:06:22.914504308 +0000 UTC m=+68.014821274" May 27 14:06:22.932237 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:22.932099 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-wbsgc" podStartSLOduration=67.932080753 podStartE2EDuration="1m7.932080753s" podCreationTimestamp="2026-05-27 14:05:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 14:06:22.931342432 +0000 UTC m=+68.031659398" watchObservedRunningTime="2026-05-27 14:06:22.932080753 +0000 UTC m=+68.032397817" May 27 14:06:23.580228 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:23.580170 2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-799b5db656-96kw4" May 27 14:06:23.583943 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:23.583674 2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-799b5db656-96kw4" May 27 14:06:23.873328 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:23.873238 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-799b5db656-96kw4" May 27 14:06:23.875050 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:23.874740 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-799b5db656-96kw4" May 27 14:06:26.003679 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:26.003642 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-px2cq"] May 27 14:06:26.985231 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:06:26.985201 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a97ff24_1b84_4127_87cf_f53d545ce361.slice/crio-049515d89bb219ab516443b29645a4f5a755e5076d24ba65caa65b94f1215000 WatchSource:0}: Error finding container 049515d89bb219ab516443b29645a4f5a755e5076d24ba65caa65b94f1215000: Status 404 returned error can't find the container with id 049515d89bb219ab516443b29645a4f5a755e5076d24ba65caa65b94f1215000 May 27 14:06:27.886541 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:27.886497 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bdd89c474-cwlnm" event={"ID":"50f249ee-869f-46fc-9d94-2c4a06c66af2","Type":"ContainerStarted","Data":"fc28e2c3d139801b15e9ece5a4837d85c957d912cfab571cd1f7017214571e9d"} May 27 14:06:27.888155 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:27.888123 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-g2b6v" event={"ID":"4ab50ff1-44f8-4599-9e35-5998ed988cfd","Type":"ContainerStarted","Data":"131b2f4c56de6aac10201d81ba70f03f5a46390ac54c10c493bb0fc5502213a1"} May 27 14:06:27.889762 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:27.889736 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-26d7g" event={"ID":"e2bc8d1f-4404-42a0-ae30-056843788536","Type":"ContainerStarted","Data":"ffa096d259d345183d9402df64c782b227f5d1b1ca3198d38e846301649517c1"} May 27 14:06:27.891538 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:27.891499 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wllmb" event={"ID":"09689767-b9d7-467f-a864-b35738fd6d49","Type":"ContainerStarted","Data":"425b743d23620615e63f0224ed796c85717dd37ef7b658686dad204285db619d"} May 27 14:06:27.893301 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:27.893264 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-txmmd" event={"ID":"3798bdf6-d616-43ed-b727-35b9407c33e7","Type":"ContainerStarted","Data":"9357d51c88ddde5a53f42761dd7cda4eae47afda8c076c20a25c8309b0678ccf"} May 27 14:06:27.893301 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:27.893294 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-txmmd" event={"ID":"3798bdf6-d616-43ed-b727-35b9407c33e7","Type":"ContainerStarted","Data":"dab729e62131bdf00403405c7d106341d067e13176172853e273d0b9cdb79b60"} May 27 14:06:27.895484 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:27.895365 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-jqf48" event={"ID":"664f678a-372f-4a96-8bab-2cd2a68a1eaf","Type":"ContainerStarted","Data":"06fd6b09e0e8b3a9ebd4d75d9398c978cb48860ade482870e58a0fb0eafeacd2"} May 27 14:06:27.895484 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:27.895395 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-jqf48" event={"ID":"664f678a-372f-4a96-8bab-2cd2a68a1eaf","Type":"ContainerStarted","Data":"9e864728b216e395fd7c54f61f37c01c63253c1b5ac2020e5e702e55996ec0cb"} May 27 14:06:27.897569 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:27.897496 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-f8t8t" event={"ID":"11cf11df-4ac4-41ac-9294-bd472eb60b20","Type":"ContainerStarted","Data":"92825660eaeb095ac7d344ed31138ee7c12887731467b0e48ae33505cd1c7e22"} May 27 14:06:27.897569 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:27.897528 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-f8t8t" event={"ID":"11cf11df-4ac4-41ac-9294-bd472eb60b20","Type":"ContainerStarted","Data":"47e091f294824258223823ff4b662c50e7a2d8ccbd12921fa18ff1390cc97a06"} May 27 14:06:27.897722 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:27.897663 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-f8t8t" May 27 14:06:27.898983 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:27.898958 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-px2cq" event={"ID":"5a97ff24-1b84-4127-87cf-f53d545ce361","Type":"ContainerStarted","Data":"049515d89bb219ab516443b29645a4f5a755e5076d24ba65caa65b94f1215000"} May 27 14:06:27.900426 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:27.900393 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lx84l" event={"ID":"1f3d65a9-4971-4574-94a4-84534b8c8e6b","Type":"ContainerStarted","Data":"aa3b5fca6b1a295947c319c4225cb3e48cae50757302b5cf05154589d1a4fc4b"} May 27 14:06:27.905810 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:27.905748 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-g2b6v" podStartSLOduration=55.660936418 podStartE2EDuration="1m0.905733042s" podCreationTimestamp="2026-05-27 14:05:27 +0000 UTC" firstStartedPulling="2026-05-27 14:06:21.807252559 +0000 UTC m=+66.907569509" lastFinishedPulling="2026-05-27 14:06:27.052049169 +0000 UTC m=+72.152366133" observedRunningTime="2026-05-27 14:06:27.905344937 +0000 UTC m=+73.005661905" watchObservedRunningTime="2026-05-27 14:06:27.905733042 +0000 UTC m=+73.006050011" May 27 14:06:27.924434 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:27.924072 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-lx84l" podStartSLOduration=34.005433843 podStartE2EDuration="38.924055644s" podCreationTimestamp="2026-05-27 14:05:49 +0000 UTC" firstStartedPulling="2026-05-27 14:06:22.143587125 +0000 UTC m=+67.243904084" lastFinishedPulling="2026-05-27 14:06:27.062208928 +0000 UTC m=+72.162525885" observedRunningTime="2026-05-27 14:06:27.922272133 +0000 UTC m=+73.022589100" watchObservedRunningTime="2026-05-27 14:06:27.924055644 +0000 UTC m=+73.024372611" May 27 14:06:27.940608 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:27.940370 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-26d7g" podStartSLOduration=52.3093154 podStartE2EDuration="56.940353265s" podCreationTimestamp="2026-05-27 14:05:31 +0000 UTC" firstStartedPulling="2026-05-27 14:06:21.88348668 +0000 UTC m=+66.983803624" lastFinishedPulling="2026-05-27 14:06:26.514524531 +0000 UTC m=+71.614841489" observedRunningTime="2026-05-27 14:06:27.938255837 +0000 UTC m=+73.038572808" watchObservedRunningTime="2026-05-27 14:06:27.940353265 +0000 UTC m=+73.040670228" May 27 14:06:27.961708 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:27.959672 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-txmmd" podStartSLOduration=68.191276448 podStartE2EDuration="1m12.959629527s" podCreationTimestamp="2026-05-27 14:05:15 +0000 UTC" firstStartedPulling="2026-05-27 14:06:21.746171956 +0000 UTC m=+66.846488907" lastFinishedPulling="2026-05-27 14:06:26.514525031 +0000 UTC m=+71.614841986" observedRunningTime="2026-05-27 14:06:27.958312558 +0000 UTC m=+73.058629526" watchObservedRunningTime="2026-05-27 14:06:27.959629527 +0000 UTC m=+73.059946496" May 27 14:06:27.981881 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:27.981013 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-f8t8t" podStartSLOduration=33.843995508 podStartE2EDuration="38.980990555s" podCreationTimestamp="2026-05-27 14:05:49 +0000 UTC" firstStartedPulling="2026-05-27 14:06:21.906315175 +0000 UTC m=+67.006632127" lastFinishedPulling="2026-05-27 14:06:27.043310212 +0000 UTC m=+72.143627174" observedRunningTime="2026-05-27 14:06:27.979665701 +0000 UTC m=+73.079982664" watchObservedRunningTime="2026-05-27 14:06:27.980990555 +0000 UTC m=+73.081307522" May 27 14:06:28.000524 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:27.999875 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-jqf48" podStartSLOduration=56.130486913 podStartE2EDuration="1m0.999855225s" podCreationTimestamp="2026-05-27 14:05:27 +0000 UTC" firstStartedPulling="2026-05-27 14:06:22.183471739 +0000 UTC m=+67.283788688" lastFinishedPulling="2026-05-27 14:06:27.052840041 +0000 UTC m=+72.153157000" observedRunningTime="2026-05-27 14:06:27.999046002 +0000 UTC m=+73.099362970" watchObservedRunningTime="2026-05-27 14:06:27.999855225 +0000 UTC m=+73.100172192" May 27 14:06:32.923891 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:32.923848 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bdd89c474-cwlnm" event={"ID":"50f249ee-869f-46fc-9d94-2c4a06c66af2","Type":"ContainerStarted","Data":"59046c9a855da8f41991ee0d4fb72023c39779a9370274ba0ade1c25d6ab557c"} May 27 14:06:32.924305 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:32.923916 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bdd89c474-cwlnm" event={"ID":"50f249ee-869f-46fc-9d94-2c4a06c66af2","Type":"ContainerStarted","Data":"27b5e6d99b57f0c7154c3e9e5bacdfde370adcd6a1ddb0f9e6d67c8b0227d11f"} May 27 14:06:32.925614 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:32.925595 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wllmb" event={"ID":"09689767-b9d7-467f-a864-b35738fd6d49","Type":"ContainerStarted","Data":"ff4404b166c1d38d912fd5b3bad87d2e5ea78b2c955e308c39e59392b36a27d7"} May 27 14:06:32.926774 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:32.926750 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-px2cq" event={"ID":"5a97ff24-1b84-4127-87cf-f53d545ce361","Type":"ContainerStarted","Data":"c1bf81014baed2eb54935fff34c81eb3e6d21c3a41a3f58be2edf01473ea32a7"} May 27 14:06:32.946099 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:32.945724 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bdd89c474-cwlnm" podStartSLOduration=1.094644891 podStartE2EDuration="11.945704976s" podCreationTimestamp="2026-05-27 14:06:21 +0000 UTC" firstStartedPulling="2026-05-27 14:06:21.589966679 +0000 UTC m=+66.690283627" lastFinishedPulling="2026-05-27 14:06:32.441026763 +0000 UTC m=+77.541343712" observedRunningTime="2026-05-27 14:06:32.944693362 +0000 UTC m=+78.045010328" watchObservedRunningTime="2026-05-27 14:06:32.945704976 +0000 UTC m=+78.046021943" May 27 14:06:32.963648 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:32.963591 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-wllmb" podStartSLOduration=1.457353303 podStartE2EDuration="11.963563306s" podCreationTimestamp="2026-05-27 14:06:21 +0000 UTC" firstStartedPulling="2026-05-27 14:06:21.926862266 +0000 UTC m=+67.027179209" lastFinishedPulling="2026-05-27 14:06:32.433072269 +0000 UTC m=+77.533389212" observedRunningTime="2026-05-27 14:06:32.963554919 +0000 UTC m=+78.063871885" watchObservedRunningTime="2026-05-27 14:06:32.963563306 +0000 UTC m=+78.063880271" May 27 14:06:32.985139 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:32.985088 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-px2cq" podStartSLOduration=69.58289407 podStartE2EDuration="1m14.985071864s" podCreationTimestamp="2026-05-27 14:05:18 +0000 UTC" firstStartedPulling="2026-05-27 14:06:27.043496184 +0000 UTC m=+72.143813146" lastFinishedPulling="2026-05-27 14:06:32.445673993 +0000 UTC m=+77.545990940" observedRunningTime="2026-05-27 14:06:32.983872356 +0000 UTC m=+78.084189325" watchObservedRunningTime="2026-05-27 14:06:32.985071864 +0000 UTC m=+78.085388871" May 27 14:06:37.913734 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:37.913599 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-f8t8t" May 27 14:06:40.202135 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:40.202102 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-6cv6p"] May 27 14:06:40.206711 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:40.206689 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6cv6p" May 27 14:06:40.209366 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:40.209343 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 27 14:06:40.209483 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:40.209371 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 27 14:06:40.209483 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:40.209420 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 27 14:06:40.209483 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:40.209435 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 27 14:06:40.209644 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:40.209496 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-cdvtl\"" May 27 14:06:40.253113 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:40.253086 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a65514ec-c8e3-4420-8a77-710b934c35c1-node-exporter-textfile\") pod \"node-exporter-6cv6p\" (UID: \"a65514ec-c8e3-4420-8a77-710b934c35c1\") " pod="openshift-monitoring/node-exporter-6cv6p" May 27 14:06:40.253113 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:40.253117 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a65514ec-c8e3-4420-8a77-710b934c35c1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6cv6p\" (UID: \"a65514ec-c8e3-4420-8a77-710b934c35c1\") " pod="openshift-monitoring/node-exporter-6cv6p" May 27 14:06:40.253294 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:40.253144 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a65514ec-c8e3-4420-8a77-710b934c35c1-metrics-client-ca\") pod \"node-exporter-6cv6p\" (UID: \"a65514ec-c8e3-4420-8a77-710b934c35c1\") " pod="openshift-monitoring/node-exporter-6cv6p" May 27 14:06:40.253294 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:40.253220 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a65514ec-c8e3-4420-8a77-710b934c35c1-root\") pod \"node-exporter-6cv6p\" (UID: \"a65514ec-c8e3-4420-8a77-710b934c35c1\") " pod="openshift-monitoring/node-exporter-6cv6p" May 27 14:06:40.253294 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:40.253248 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a65514ec-c8e3-4420-8a77-710b934c35c1-node-exporter-wtmp\") pod \"node-exporter-6cv6p\" (UID: \"a65514ec-c8e3-4420-8a77-710b934c35c1\") " pod="openshift-monitoring/node-exporter-6cv6p" May 27 14:06:40.253294 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:40.253290 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mwtm\" (UniqueName: \"kubernetes.io/projected/a65514ec-c8e3-4420-8a77-710b934c35c1-kube-api-access-6mwtm\") pod \"node-exporter-6cv6p\" (UID: \"a65514ec-c8e3-4420-8a77-710b934c35c1\") " pod="openshift-monitoring/node-exporter-6cv6p" May 27 14:06:40.253499 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:40.253429 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a65514ec-c8e3-4420-8a77-710b934c35c1-sys\") pod \"node-exporter-6cv6p\" (UID: \"a65514ec-c8e3-4420-8a77-710b934c35c1\") " pod="openshift-monitoring/node-exporter-6cv6p" May 27 14:06:40.253499 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:40.253466 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a65514ec-c8e3-4420-8a77-710b934c35c1-node-exporter-tls\") pod \"node-exporter-6cv6p\" (UID: \"a65514ec-c8e3-4420-8a77-710b934c35c1\") " pod="openshift-monitoring/node-exporter-6cv6p" May 27 14:06:40.253588 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:40.253497 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a65514ec-c8e3-4420-8a77-710b934c35c1-node-exporter-accelerators-collector-config\") pod \"node-exporter-6cv6p\" (UID: \"a65514ec-c8e3-4420-8a77-710b934c35c1\") " pod="openshift-monitoring/node-exporter-6cv6p" May 27 14:06:40.354675 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:40.354624 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a65514ec-c8e3-4420-8a77-710b934c35c1-sys\") pod \"node-exporter-6cv6p\" (UID: \"a65514ec-c8e3-4420-8a77-710b934c35c1\") " pod="openshift-monitoring/node-exporter-6cv6p" May 27 14:06:40.354675 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:40.354678 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a65514ec-c8e3-4420-8a77-710b934c35c1-node-exporter-tls\") pod \"node-exporter-6cv6p\" (UID: \"a65514ec-c8e3-4420-8a77-710b934c35c1\") " pod="openshift-monitoring/node-exporter-6cv6p" May 27 14:06:40.354945 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:40.354748 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a65514ec-c8e3-4420-8a77-710b934c35c1-sys\") pod \"node-exporter-6cv6p\" (UID: \"a65514ec-c8e3-4420-8a77-710b934c35c1\") " pod="openshift-monitoring/node-exporter-6cv6p" May 27 14:06:40.354945 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:06:40.354770 2563 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found May 27 14:06:40.354945 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:40.354793 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a65514ec-c8e3-4420-8a77-710b934c35c1-node-exporter-accelerators-collector-config\") pod \"node-exporter-6cv6p\" (UID: \"a65514ec-c8e3-4420-8a77-710b934c35c1\") " pod="openshift-monitoring/node-exporter-6cv6p" May 27 14:06:40.354945 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:06:40.354842 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a65514ec-c8e3-4420-8a77-710b934c35c1-node-exporter-tls podName:a65514ec-c8e3-4420-8a77-710b934c35c1 nodeName:}" failed. No retries permitted until 2026-05-27 14:06:40.854821617 +0000 UTC m=+85.955138575 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/a65514ec-c8e3-4420-8a77-710b934c35c1-node-exporter-tls") pod "node-exporter-6cv6p" (UID: "a65514ec-c8e3-4420-8a77-710b934c35c1") : secret "node-exporter-tls" not found May 27 14:06:40.354945 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:40.354868 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a65514ec-c8e3-4420-8a77-710b934c35c1-node-exporter-textfile\") pod \"node-exporter-6cv6p\" (UID: \"a65514ec-c8e3-4420-8a77-710b934c35c1\") " pod="openshift-monitoring/node-exporter-6cv6p" May 27 14:06:40.354945 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:40.354924 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a65514ec-c8e3-4420-8a77-710b934c35c1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6cv6p\" (UID: \"a65514ec-c8e3-4420-8a77-710b934c35c1\") " pod="openshift-monitoring/node-exporter-6cv6p" May 27 14:06:40.355148 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:40.354960 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a65514ec-c8e3-4420-8a77-710b934c35c1-metrics-client-ca\") pod \"node-exporter-6cv6p\" (UID: \"a65514ec-c8e3-4420-8a77-710b934c35c1\") " pod="openshift-monitoring/node-exporter-6cv6p" May 27 14:06:40.355148 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:40.355008 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a65514ec-c8e3-4420-8a77-710b934c35c1-root\") pod \"node-exporter-6cv6p\" (UID: \"a65514ec-c8e3-4420-8a77-710b934c35c1\") " pod="openshift-monitoring/node-exporter-6cv6p" May 27 14:06:40.355148 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:40.355034 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a65514ec-c8e3-4420-8a77-710b934c35c1-node-exporter-wtmp\") pod \"node-exporter-6cv6p\" (UID: \"a65514ec-c8e3-4420-8a77-710b934c35c1\") " pod="openshift-monitoring/node-exporter-6cv6p" May 27 14:06:40.355148 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:40.355060 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6mwtm\" (UniqueName: \"kubernetes.io/projected/a65514ec-c8e3-4420-8a77-710b934c35c1-kube-api-access-6mwtm\") pod \"node-exporter-6cv6p\" (UID: \"a65514ec-c8e3-4420-8a77-710b934c35c1\") " pod="openshift-monitoring/node-exporter-6cv6p" May 27 14:06:40.355278 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:40.355154 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a65514ec-c8e3-4420-8a77-710b934c35c1-root\") pod \"node-exporter-6cv6p\" (UID: \"a65514ec-c8e3-4420-8a77-710b934c35c1\") " pod="openshift-monitoring/node-exporter-6cv6p" May 27 14:06:40.355310 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:40.355272 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a65514ec-c8e3-4420-8a77-710b934c35c1-node-exporter-textfile\") pod \"node-exporter-6cv6p\" (UID: \"a65514ec-c8e3-4420-8a77-710b934c35c1\") " pod="openshift-monitoring/node-exporter-6cv6p" May 27 14:06:40.355435 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:40.355408 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a65514ec-c8e3-4420-8a77-710b934c35c1-node-exporter-wtmp\") pod \"node-exporter-6cv6p\" (UID: \"a65514ec-c8e3-4420-8a77-710b934c35c1\") " pod="openshift-monitoring/node-exporter-6cv6p" May 27 14:06:40.355540 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:40.355485 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a65514ec-c8e3-4420-8a77-710b934c35c1-node-exporter-accelerators-collector-config\") pod \"node-exporter-6cv6p\" (UID: \"a65514ec-c8e3-4420-8a77-710b934c35c1\") " pod="openshift-monitoring/node-exporter-6cv6p" May 27 14:06:40.355627 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:40.355578 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a65514ec-c8e3-4420-8a77-710b934c35c1-metrics-client-ca\") pod \"node-exporter-6cv6p\" (UID: \"a65514ec-c8e3-4420-8a77-710b934c35c1\") " pod="openshift-monitoring/node-exporter-6cv6p" May 27 14:06:40.357251 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:40.357232 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a65514ec-c8e3-4420-8a77-710b934c35c1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6cv6p\" (UID: \"a65514ec-c8e3-4420-8a77-710b934c35c1\") " pod="openshift-monitoring/node-exporter-6cv6p" May 27 14:06:40.364565 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:40.364539 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mwtm\" (UniqueName: \"kubernetes.io/projected/a65514ec-c8e3-4420-8a77-710b934c35c1-kube-api-access-6mwtm\") pod \"node-exporter-6cv6p\" (UID: \"a65514ec-c8e3-4420-8a77-710b934c35c1\") " pod="openshift-monitoring/node-exporter-6cv6p" May 27 14:06:40.860315 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:40.860273 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a65514ec-c8e3-4420-8a77-710b934c35c1-node-exporter-tls\") pod \"node-exporter-6cv6p\" (UID: \"a65514ec-c8e3-4420-8a77-710b934c35c1\") " pod="openshift-monitoring/node-exporter-6cv6p" May 27 14:06:40.862618 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:40.862588 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a65514ec-c8e3-4420-8a77-710b934c35c1-node-exporter-tls\") pod \"node-exporter-6cv6p\" (UID: \"a65514ec-c8e3-4420-8a77-710b934c35c1\") " pod="openshift-monitoring/node-exporter-6cv6p" May 27 14:06:41.116121 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:41.116024 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6cv6p" May 27 14:06:41.127056 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:06:41.127026 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda65514ec_c8e3_4420_8a77_710b934c35c1.slice/crio-82228d64211ac43dcd1515555d3e85eb612b990db00f3ddca5d5f3375faa44be WatchSource:0}: Error finding container 82228d64211ac43dcd1515555d3e85eb612b990db00f3ddca5d5f3375faa44be: Status 404 returned error can't find the container with id 82228d64211ac43dcd1515555d3e85eb612b990db00f3ddca5d5f3375faa44be May 27 14:06:41.472746 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:41.472667 2563 patch_prober.go:28] interesting pod/image-registry-69cfc4ffb6-cbl6j container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 27 14:06:41.472746 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:41.472727 2563 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-69cfc4ffb6-cbl6j" podUID="b74fdc34-9e61-4170-840c-d8522b71dcb5" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 27 14:06:41.959555 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:41.959521 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6cv6p" event={"ID":"a65514ec-c8e3-4420-8a77-710b934c35c1","Type":"ContainerStarted","Data":"82228d64211ac43dcd1515555d3e85eb612b990db00f3ddca5d5f3375faa44be"} May 27 14:06:42.964435 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:42.964402 2563 generic.go:358] "Generic (PLEG): container finished" podID="a65514ec-c8e3-4420-8a77-710b934c35c1" containerID="248b9cb57feb0c21988a28f1cd43137edf85e09ccdab486e7488c9c9b8bf73d2" exitCode=0 May 27 14:06:42.964796 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:42.964451 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6cv6p" event={"ID":"a65514ec-c8e3-4420-8a77-710b934c35c1","Type":"ContainerDied","Data":"248b9cb57feb0c21988a28f1cd43137edf85e09ccdab486e7488c9c9b8bf73d2"} May 27 14:06:43.969059 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:43.969021 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6cv6p" event={"ID":"a65514ec-c8e3-4420-8a77-710b934c35c1","Type":"ContainerStarted","Data":"aef98263239198e5bc8b62aa15e6f9b022d657553eae1cf16d4a3f92078e6888"} May 27 14:06:43.969059 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:43.969065 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6cv6p" event={"ID":"a65514ec-c8e3-4420-8a77-710b934c35c1","Type":"ContainerStarted","Data":"9a72c4756eb53af2b9f002df1b6a3be1b60f401e12bc67049e96536fc7e43fc6"} May 27 14:06:43.993135 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:43.993067 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-6cv6p" podStartSLOduration=2.9276593269999998 podStartE2EDuration="3.993047231s" podCreationTimestamp="2026-05-27 14:06:40 +0000 UTC" firstStartedPulling="2026-05-27 14:06:41.129080658 +0000 UTC m=+86.229397602" lastFinishedPulling="2026-05-27 14:06:42.194468561 +0000 UTC m=+87.294785506" observedRunningTime="2026-05-27 14:06:43.990764231 +0000 UTC m=+89.091081197" watchObservedRunningTime="2026-05-27 14:06:43.993047231 +0000 UTC m=+89.093364199" May 27 14:06:44.560869 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:44.560835 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-69cfc4ffb6-cbl6j"] May 27 14:06:44.564754 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:44.564733 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-69cfc4ffb6-cbl6j" May 27 14:06:53.876190 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:06:53.876155 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-wbsgc" May 27 14:07:03.025252 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:07:03.025215 2563 generic.go:358] "Generic (PLEG): container finished" podID="69c8ab79-2afc-44ae-ba1f-7bbd76642023" containerID="9137e26ee04250032f54e038b32a3e55d0915c2d25686dbcff25532e60173bee" exitCode=0 May 27 14:07:03.025669 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:07:03.025285 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-7lb8j" event={"ID":"69c8ab79-2afc-44ae-ba1f-7bbd76642023","Type":"ContainerDied","Data":"9137e26ee04250032f54e038b32a3e55d0915c2d25686dbcff25532e60173bee"} May 27 14:07:03.025669 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:07:03.025651 2563 scope.go:117] "RemoveContainer" containerID="9137e26ee04250032f54e038b32a3e55d0915c2d25686dbcff25532e60173bee" May 27 14:07:04.030944 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:07:04.030883 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-7lb8j" event={"ID":"69c8ab79-2afc-44ae-ba1f-7bbd76642023","Type":"ContainerStarted","Data":"07989e413246fcbddd6207ddb9721da088dc90c179f487e2f5647108e9526be1"} May 27 14:07:04.075124 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:07:04.075090 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-799b5db656-96kw4_1bd3304d-9bda-4253-ac96-0dfca56dd2e1/router/0.log" May 27 14:07:04.090361 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:07:04.090337 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lx84l_1f3d65a9-4971-4574-94a4-84534b8c8e6b/serve-healthcheck-canary/0.log" May 27 14:07:09.579569 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:07:09.579522 2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-69cfc4ffb6-cbl6j" podUID="b74fdc34-9e61-4170-840c-d8522b71dcb5" containerName="registry" containerID="cri-o://b5050091dd3c0fb7edab861a0732b00555d9c86fe86983c2c34a11da7a91efd4" gracePeriod=30 May 27 14:07:09.834139 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:07:09.834065 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69cfc4ffb6-cbl6j" May 27 14:07:09.904677 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:07:09.904640 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b74fdc34-9e61-4170-840c-d8522b71dcb5-image-registry-private-configuration\") pod \"b74fdc34-9e61-4170-840c-d8522b71dcb5\" (UID: \"b74fdc34-9e61-4170-840c-d8522b71dcb5\") " May 27 14:07:09.904677 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:07:09.904679 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b74fdc34-9e61-4170-840c-d8522b71dcb5-trusted-ca\") pod \"b74fdc34-9e61-4170-840c-d8522b71dcb5\" (UID: \"b74fdc34-9e61-4170-840c-d8522b71dcb5\") " May 27 14:07:09.905000 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:07:09.904714 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b74fdc34-9e61-4170-840c-d8522b71dcb5-ca-trust-extracted\") pod \"b74fdc34-9e61-4170-840c-d8522b71dcb5\" (UID: \"b74fdc34-9e61-4170-840c-d8522b71dcb5\") " May 27 14:07:09.905000 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:07:09.904743 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b74fdc34-9e61-4170-840c-d8522b71dcb5-registry-tls\") pod \"b74fdc34-9e61-4170-840c-d8522b71dcb5\" (UID: \"b74fdc34-9e61-4170-840c-d8522b71dcb5\") " May 27 14:07:09.905000 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:07:09.904773 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b74fdc34-9e61-4170-840c-d8522b71dcb5-installation-pull-secrets\") pod \"b74fdc34-9e61-4170-840c-d8522b71dcb5\" (UID: \"b74fdc34-9e61-4170-840c-d8522b71dcb5\") " May 27 14:07:09.905000 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:07:09.904793 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b74fdc34-9e61-4170-840c-d8522b71dcb5-registry-certificates\") pod \"b74fdc34-9e61-4170-840c-d8522b71dcb5\" (UID: \"b74fdc34-9e61-4170-840c-d8522b71dcb5\") " May 27 14:07:09.905000 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:07:09.904886 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b74fdc34-9e61-4170-840c-d8522b71dcb5-bound-sa-token\") pod \"b74fdc34-9e61-4170-840c-d8522b71dcb5\" (UID: \"b74fdc34-9e61-4170-840c-d8522b71dcb5\") " May 27 14:07:09.905000 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:07:09.904952 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mzhgf\" (UniqueName: \"kubernetes.io/projected/b74fdc34-9e61-4170-840c-d8522b71dcb5-kube-api-access-mzhgf\") pod \"b74fdc34-9e61-4170-840c-d8522b71dcb5\" (UID: \"b74fdc34-9e61-4170-840c-d8522b71dcb5\") " May 27 14:07:09.905291 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:07:09.905260 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b74fdc34-9e61-4170-840c-d8522b71dcb5-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "b74fdc34-9e61-4170-840c-d8522b71dcb5" (UID: "b74fdc34-9e61-4170-840c-d8522b71dcb5"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 14:07:09.905347 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:07:09.905319 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b74fdc34-9e61-4170-840c-d8522b71dcb5-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "b74fdc34-9e61-4170-840c-d8522b71dcb5" (UID: "b74fdc34-9e61-4170-840c-d8522b71dcb5"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 14:07:09.907533 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:07:09.907480 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b74fdc34-9e61-4170-840c-d8522b71dcb5-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "b74fdc34-9e61-4170-840c-d8522b71dcb5" (UID: "b74fdc34-9e61-4170-840c-d8522b71dcb5"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 14:07:09.907692 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:07:09.907578 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b74fdc34-9e61-4170-840c-d8522b71dcb5-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "b74fdc34-9e61-4170-840c-d8522b71dcb5" (UID: "b74fdc34-9e61-4170-840c-d8522b71dcb5"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 14:07:09.907692 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:07:09.907646 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b74fdc34-9e61-4170-840c-d8522b71dcb5-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "b74fdc34-9e61-4170-840c-d8522b71dcb5" (UID: "b74fdc34-9e61-4170-840c-d8522b71dcb5"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 14:07:09.907807 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:07:09.907768 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b74fdc34-9e61-4170-840c-d8522b71dcb5-kube-api-access-mzhgf" (OuterVolumeSpecName: "kube-api-access-mzhgf") pod "b74fdc34-9e61-4170-840c-d8522b71dcb5" (UID: "b74fdc34-9e61-4170-840c-d8522b71dcb5"). InnerVolumeSpecName "kube-api-access-mzhgf". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 14:07:09.907878 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:07:09.907853 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b74fdc34-9e61-4170-840c-d8522b71dcb5-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "b74fdc34-9e61-4170-840c-d8522b71dcb5" (UID: "b74fdc34-9e61-4170-840c-d8522b71dcb5"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 14:07:09.913737 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:07:09.913707 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b74fdc34-9e61-4170-840c-d8522b71dcb5-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "b74fdc34-9e61-4170-840c-d8522b71dcb5" (UID: "b74fdc34-9e61-4170-840c-d8522b71dcb5"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 14:07:10.005732 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:07:10.005687 2563 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b74fdc34-9e61-4170-840c-d8522b71dcb5-bound-sa-token\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" May 27 14:07:10.005732 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:07:10.005722 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mzhgf\" (UniqueName: \"kubernetes.io/projected/b74fdc34-9e61-4170-840c-d8522b71dcb5-kube-api-access-mzhgf\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" May 27 14:07:10.005732 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:07:10.005737 2563 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b74fdc34-9e61-4170-840c-d8522b71dcb5-image-registry-private-configuration\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" May 27 14:07:10.006016 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:07:10.005748 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b74fdc34-9e61-4170-840c-d8522b71dcb5-trusted-ca\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" May 27 14:07:10.006016 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:07:10.005757 2563 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b74fdc34-9e61-4170-840c-d8522b71dcb5-ca-trust-extracted\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" May 27 14:07:10.006016 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:07:10.005766 2563 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b74fdc34-9e61-4170-840c-d8522b71dcb5-registry-tls\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" May 27 14:07:10.006016 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:07:10.005775 2563 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b74fdc34-9e61-4170-840c-d8522b71dcb5-installation-pull-secrets\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" May 27 14:07:10.006016 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:07:10.005783 2563 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b74fdc34-9e61-4170-840c-d8522b71dcb5-registry-certificates\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" May 27 14:07:10.051888 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:07:10.051849 2563 generic.go:358] "Generic (PLEG): container finished" podID="b74fdc34-9e61-4170-840c-d8522b71dcb5" containerID="b5050091dd3c0fb7edab861a0732b00555d9c86fe86983c2c34a11da7a91efd4" exitCode=0 May 27 14:07:10.051888 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:07:10.051913 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-69cfc4ffb6-cbl6j" event={"ID":"b74fdc34-9e61-4170-840c-d8522b71dcb5","Type":"ContainerDied","Data":"b5050091dd3c0fb7edab861a0732b00555d9c86fe86983c2c34a11da7a91efd4"} May 27 14:07:10.052132 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:07:10.051945 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-69cfc4ffb6-cbl6j" event={"ID":"b74fdc34-9e61-4170-840c-d8522b71dcb5","Type":"ContainerDied","Data":"4af13d8ce92ff113c931e40a2ef7007455b3e39a975f6f2afb6f4e61fcdf63c5"} May 27 14:07:10.052132 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:07:10.051960 2563 scope.go:117] "RemoveContainer" containerID="b5050091dd3c0fb7edab861a0732b00555d9c86fe86983c2c34a11da7a91efd4" May 27 14:07:10.052132 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:07:10.051978 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69cfc4ffb6-cbl6j" May 27 14:07:10.060618 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:07:10.060598 2563 scope.go:117] "RemoveContainer" containerID="b5050091dd3c0fb7edab861a0732b00555d9c86fe86983c2c34a11da7a91efd4" May 27 14:07:10.060944 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:07:10.060920 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5050091dd3c0fb7edab861a0732b00555d9c86fe86983c2c34a11da7a91efd4\": container with ID starting with b5050091dd3c0fb7edab861a0732b00555d9c86fe86983c2c34a11da7a91efd4 not found: ID does not exist" containerID="b5050091dd3c0fb7edab861a0732b00555d9c86fe86983c2c34a11da7a91efd4" May 27 14:07:10.061047 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:07:10.060949 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5050091dd3c0fb7edab861a0732b00555d9c86fe86983c2c34a11da7a91efd4"} err="failed to get container status \"b5050091dd3c0fb7edab861a0732b00555d9c86fe86983c2c34a11da7a91efd4\": rpc error: code = NotFound desc = could not find container \"b5050091dd3c0fb7edab861a0732b00555d9c86fe86983c2c34a11da7a91efd4\": container with ID starting with b5050091dd3c0fb7edab861a0732b00555d9c86fe86983c2c34a11da7a91efd4 not found: ID does not exist" May 27 14:07:10.076501 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:07:10.076460 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-69cfc4ffb6-cbl6j"] May 27 14:07:10.080695 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:07:10.080662 2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-69cfc4ffb6-cbl6j"] May 27 14:07:11.542340 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:07:11.542307 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b74fdc34-9e61-4170-840c-d8522b71dcb5" path="/var/lib/kubelet/pods/b74fdc34-9e61-4170-840c-d8522b71dcb5/volumes" May 27 14:07:13.063697 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:07:13.063661 2563 generic.go:358] "Generic (PLEG): container finished" podID="5ed1e6d4-18f5-4adf-82a7-2560aa07f855" containerID="fd4b49ba799211130330f71130d2cf3d0b6af323d66170d60d060dc321e14e27" exitCode=0 May 27 14:07:13.064101 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:07:13.063727 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-klfdl" event={"ID":"5ed1e6d4-18f5-4adf-82a7-2560aa07f855","Type":"ContainerDied","Data":"fd4b49ba799211130330f71130d2cf3d0b6af323d66170d60d060dc321e14e27"} May 27 14:07:13.064101 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:07:13.064043 2563 scope.go:117] "RemoveContainer" containerID="fd4b49ba799211130330f71130d2cf3d0b6af323d66170d60d060dc321e14e27" May 27 14:07:14.068425 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:07:14.068390 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-klfdl" event={"ID":"5ed1e6d4-18f5-4adf-82a7-2560aa07f855","Type":"ContainerStarted","Data":"3cb7300f9baf60e7704a2572b100850ee3e0d2897a1864569aafd81f1b393a36"} May 27 14:07:29.111915 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:07:29.111843 2563 generic.go:358] "Generic (PLEG): container finished" podID="6dfeff02-a96c-4202-bac6-7346398337d3" containerID="559749e4f6674e186c1cb94569b8ae11637a8a332021310822ac9c826d43f087" exitCode=0 May 27 14:07:29.112314 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:07:29.111923 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-qwh27" event={"ID":"6dfeff02-a96c-4202-bac6-7346398337d3","Type":"ContainerDied","Data":"559749e4f6674e186c1cb94569b8ae11637a8a332021310822ac9c826d43f087"} May 27 14:07:29.112314 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:07:29.112242 2563 scope.go:117] "RemoveContainer" containerID="559749e4f6674e186c1cb94569b8ae11637a8a332021310822ac9c826d43f087" May 27 14:07:30.116513 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:07:30.116473 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-qwh27" event={"ID":"6dfeff02-a96c-4202-bac6-7346398337d3","Type":"ContainerStarted","Data":"43ee4eb36cf47a9059e34b49415f3e27048a945357522179f113156ac6373cfb"} May 27 14:10:15.421281 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:10:15.421254 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-5g8bd_4589d4df-d2d2-43e2-af93-da49d130d20d/console-operator/1.log" May 27 14:10:15.421833 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:10:15.421253 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-5g8bd_4589d4df-d2d2-43e2-af93-da49d130d20d/console-operator/1.log" May 27 14:10:15.428411 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:10:15.428385 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fn9jd_3ebbf10f-4f07-403c-93b2-97261749308d/ovn-acl-logging/0.log" May 27 14:10:15.428702 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:10:15.428684 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fn9jd_3ebbf10f-4f07-403c-93b2-97261749308d/ovn-acl-logging/0.log" May 27 14:10:15.431830 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:10:15.431806 2563 kubelet.go:1628] "Image garbage collection succeeded" May 27 14:10:20.273962 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:10:20.273926 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f4c796d7c-xrrb6"] May 27 14:10:20.276236 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:10:20.274298 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b74fdc34-9e61-4170-840c-d8522b71dcb5" containerName="registry" May 27 14:10:20.276236 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:10:20.274313 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b74fdc34-9e61-4170-840c-d8522b71dcb5" containerName="registry" May 27 14:10:20.276236 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:10:20.274372 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="b74fdc34-9e61-4170-840c-d8522b71dcb5" containerName="registry" May 27 14:10:20.277110 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:10:20.277095 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5f4c796d7c-xrrb6" May 27 14:10:20.281556 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:10:20.281534 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 27 14:10:20.281556 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:10:20.281548 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 27 14:10:20.281744 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:10:20.281538 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 27 14:10:20.282011 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:10:20.281994 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-5l4zf\"" May 27 14:10:20.282098 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:10:20.282004 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 27 14:10:20.303799 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:10:20.303774 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f4c796d7c-xrrb6"] May 27 14:10:20.380207 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:10:20.380166 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/85444e95-12c4-4b7c-9925-b6cc4e4b365f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f4c796d7c-xrrb6\" (UID: \"85444e95-12c4-4b7c-9925-b6cc4e4b365f\") " pod="opendatahub/opendatahub-operator-controller-manager-5f4c796d7c-xrrb6" May 27 14:10:20.380366 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:10:20.380218 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/85444e95-12c4-4b7c-9925-b6cc4e4b365f-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f4c796d7c-xrrb6\" (UID: \"85444e95-12c4-4b7c-9925-b6cc4e4b365f\") " pod="opendatahub/opendatahub-operator-controller-manager-5f4c796d7c-xrrb6" May 27 14:10:20.380366 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:10:20.380305 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpmx4\" (UniqueName: \"kubernetes.io/projected/85444e95-12c4-4b7c-9925-b6cc4e4b365f-kube-api-access-gpmx4\") pod \"opendatahub-operator-controller-manager-5f4c796d7c-xrrb6\" (UID: \"85444e95-12c4-4b7c-9925-b6cc4e4b365f\") " pod="opendatahub/opendatahub-operator-controller-manager-5f4c796d7c-xrrb6" May 27 14:10:20.480794 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:10:20.480742 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gpmx4\" (UniqueName: \"kubernetes.io/projected/85444e95-12c4-4b7c-9925-b6cc4e4b365f-kube-api-access-gpmx4\") pod \"opendatahub-operator-controller-manager-5f4c796d7c-xrrb6\" (UID: \"85444e95-12c4-4b7c-9925-b6cc4e4b365f\") " pod="opendatahub/opendatahub-operator-controller-manager-5f4c796d7c-xrrb6" May 27 14:10:20.480992 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:10:20.480816 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/85444e95-12c4-4b7c-9925-b6cc4e4b365f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f4c796d7c-xrrb6\" (UID: \"85444e95-12c4-4b7c-9925-b6cc4e4b365f\") " pod="opendatahub/opendatahub-operator-controller-manager-5f4c796d7c-xrrb6" May 27 14:10:20.480992 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:10:20.480871 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/85444e95-12c4-4b7c-9925-b6cc4e4b365f-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f4c796d7c-xrrb6\" (UID: \"85444e95-12c4-4b7c-9925-b6cc4e4b365f\") " pod="opendatahub/opendatahub-operator-controller-manager-5f4c796d7c-xrrb6" May 27 14:10:20.483262 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:10:20.483239 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/85444e95-12c4-4b7c-9925-b6cc4e4b365f-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f4c796d7c-xrrb6\" (UID: \"85444e95-12c4-4b7c-9925-b6cc4e4b365f\") " pod="opendatahub/opendatahub-operator-controller-manager-5f4c796d7c-xrrb6" May 27 14:10:20.483377 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:10:20.483329 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/85444e95-12c4-4b7c-9925-b6cc4e4b365f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f4c796d7c-xrrb6\" (UID: \"85444e95-12c4-4b7c-9925-b6cc4e4b365f\") " pod="opendatahub/opendatahub-operator-controller-manager-5f4c796d7c-xrrb6" May 27 14:10:20.490229 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:10:20.490208 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpmx4\" (UniqueName: \"kubernetes.io/projected/85444e95-12c4-4b7c-9925-b6cc4e4b365f-kube-api-access-gpmx4\") pod \"opendatahub-operator-controller-manager-5f4c796d7c-xrrb6\" (UID: \"85444e95-12c4-4b7c-9925-b6cc4e4b365f\") " pod="opendatahub/opendatahub-operator-controller-manager-5f4c796d7c-xrrb6" May 27 14:10:20.587262 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:10:20.587177 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5f4c796d7c-xrrb6" May 27 14:10:20.729723 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:10:20.729699 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f4c796d7c-xrrb6"] May 27 14:10:20.732102 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:10:20.732071 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85444e95_12c4_4b7c_9925_b6cc4e4b365f.slice/crio-b547ac50585cb7e893f8cf917a2fb4d2c777bcd1c833f4a275c2d54494b6a3a3 WatchSource:0}: Error finding container b547ac50585cb7e893f8cf917a2fb4d2c777bcd1c833f4a275c2d54494b6a3a3: Status 404 returned error can't find the container with id b547ac50585cb7e893f8cf917a2fb4d2c777bcd1c833f4a275c2d54494b6a3a3 May 27 14:10:20.733678 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:10:20.733663 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 27 14:10:21.592443 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:10:21.592376 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f4c796d7c-xrrb6" event={"ID":"85444e95-12c4-4b7c-9925-b6cc4e4b365f","Type":"ContainerStarted","Data":"b547ac50585cb7e893f8cf917a2fb4d2c777bcd1c833f4a275c2d54494b6a3a3"} May 27 14:10:23.600302 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:10:23.600264 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f4c796d7c-xrrb6" event={"ID":"85444e95-12c4-4b7c-9925-b6cc4e4b365f","Type":"ContainerStarted","Data":"45047dc2ac5b25bace3302a59cb0317435d1c5491f24886f95eaa76643f9daae"} May 27 14:10:23.600713 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:10:23.600405 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5f4c796d7c-xrrb6" May 27 14:10:23.625854 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:10:23.625801 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5f4c796d7c-xrrb6" podStartSLOduration=1.178284471 podStartE2EDuration="3.625786553s" podCreationTimestamp="2026-05-27 14:10:20 +0000 UTC" firstStartedPulling="2026-05-27 14:10:20.733784048 +0000 UTC m=+305.834100994" lastFinishedPulling="2026-05-27 14:10:23.181286118 +0000 UTC m=+308.281603076" observedRunningTime="2026-05-27 14:10:23.62366423 +0000 UTC m=+308.723981195" watchObservedRunningTime="2026-05-27 14:10:23.625786553 +0000 UTC m=+308.726103519" May 27 14:10:33.338641 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:10:33.338600 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5b46f7f598-prm68"] May 27 14:10:33.342059 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:10:33.342040 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5b46f7f598-prm68" May 27 14:10:33.346714 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:10:33.346691 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" May 27 14:10:33.346832 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:10:33.346711 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" May 27 14:10:33.346832 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:10:33.346691 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" May 27 14:10:33.346832 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:10:33.346804 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-96bvr\"" May 27 14:10:33.347007 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:10:33.346934 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" May 27 14:10:33.347007 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:10:33.346945 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" May 27 14:10:33.359904 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:10:33.359869 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5b46f7f598-prm68"] May 27 14:10:33.482971 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:10:33.482931 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6d70f6e1-8e48-46fa-8715-194fe32c6bca-metrics-cert\") pod \"lws-controller-manager-5b46f7f598-prm68\" (UID: \"6d70f6e1-8e48-46fa-8715-194fe32c6bca\") " pod="openshift-lws-operator/lws-controller-manager-5b46f7f598-prm68" May 27 14:10:33.483178 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:10:33.482983 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6d70f6e1-8e48-46fa-8715-194fe32c6bca-cert\") pod \"lws-controller-manager-5b46f7f598-prm68\" (UID: \"6d70f6e1-8e48-46fa-8715-194fe32c6bca\") " pod="openshift-lws-operator/lws-controller-manager-5b46f7f598-prm68" May 27 14:10:33.483178 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:10:33.483037 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gctsm\" (UniqueName: \"kubernetes.io/projected/6d70f6e1-8e48-46fa-8715-194fe32c6bca-kube-api-access-gctsm\") pod \"lws-controller-manager-5b46f7f598-prm68\" (UID: \"6d70f6e1-8e48-46fa-8715-194fe32c6bca\") " pod="openshift-lws-operator/lws-controller-manager-5b46f7f598-prm68" May 27 14:10:33.483178 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:10:33.483058 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6d70f6e1-8e48-46fa-8715-194fe32c6bca-manager-config\") pod \"lws-controller-manager-5b46f7f598-prm68\" (UID: \"6d70f6e1-8e48-46fa-8715-194fe32c6bca\") " pod="openshift-lws-operator/lws-controller-manager-5b46f7f598-prm68" May 27 14:10:33.583884 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:10:33.583842 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6d70f6e1-8e48-46fa-8715-194fe32c6bca-manager-config\") pod \"lws-controller-manager-5b46f7f598-prm68\" (UID: \"6d70f6e1-8e48-46fa-8715-194fe32c6bca\") " pod="openshift-lws-operator/lws-controller-manager-5b46f7f598-prm68" May 27 14:10:33.584076 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:10:33.583927 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6d70f6e1-8e48-46fa-8715-194fe32c6bca-metrics-cert\") pod \"lws-controller-manager-5b46f7f598-prm68\" (UID: \"6d70f6e1-8e48-46fa-8715-194fe32c6bca\") " pod="openshift-lws-operator/lws-controller-manager-5b46f7f598-prm68" May 27 14:10:33.584076 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:10:33.583980 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6d70f6e1-8e48-46fa-8715-194fe32c6bca-cert\") pod \"lws-controller-manager-5b46f7f598-prm68\" (UID: \"6d70f6e1-8e48-46fa-8715-194fe32c6bca\") " pod="openshift-lws-operator/lws-controller-manager-5b46f7f598-prm68" May 27 14:10:33.584076 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:10:33.584028 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gctsm\" (UniqueName: \"kubernetes.io/projected/6d70f6e1-8e48-46fa-8715-194fe32c6bca-kube-api-access-gctsm\") pod \"lws-controller-manager-5b46f7f598-prm68\" (UID: \"6d70f6e1-8e48-46fa-8715-194fe32c6bca\") " pod="openshift-lws-operator/lws-controller-manager-5b46f7f598-prm68" May 27 14:10:33.584618 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:10:33.584590 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6d70f6e1-8e48-46fa-8715-194fe32c6bca-manager-config\") pod \"lws-controller-manager-5b46f7f598-prm68\" (UID: \"6d70f6e1-8e48-46fa-8715-194fe32c6bca\") " pod="openshift-lws-operator/lws-controller-manager-5b46f7f598-prm68" May 27 14:10:33.586375 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:10:33.586353 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6d70f6e1-8e48-46fa-8715-194fe32c6bca-cert\") pod \"lws-controller-manager-5b46f7f598-prm68\" (UID: \"6d70f6e1-8e48-46fa-8715-194fe32c6bca\") " pod="openshift-lws-operator/lws-controller-manager-5b46f7f598-prm68" May 27 14:10:33.586460 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:10:33.586407 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6d70f6e1-8e48-46fa-8715-194fe32c6bca-metrics-cert\") pod \"lws-controller-manager-5b46f7f598-prm68\" (UID: \"6d70f6e1-8e48-46fa-8715-194fe32c6bca\") " pod="openshift-lws-operator/lws-controller-manager-5b46f7f598-prm68" May 27 14:10:33.596497 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:10:33.596443 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gctsm\" (UniqueName: \"kubernetes.io/projected/6d70f6e1-8e48-46fa-8715-194fe32c6bca-kube-api-access-gctsm\") pod \"lws-controller-manager-5b46f7f598-prm68\" (UID: \"6d70f6e1-8e48-46fa-8715-194fe32c6bca\") " pod="openshift-lws-operator/lws-controller-manager-5b46f7f598-prm68" May 27 14:10:33.651621 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:10:33.651587 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5b46f7f598-prm68" May 27 14:10:33.819931 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:10:33.819877 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5b46f7f598-prm68"] May 27 14:10:33.822886 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:10:33.822858 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d70f6e1_8e48_46fa_8715_194fe32c6bca.slice/crio-02c62113a92d48fe1db89a527207a95fe5703d834ec161c5b4e5e56ed41111b3 WatchSource:0}: Error finding container 02c62113a92d48fe1db89a527207a95fe5703d834ec161c5b4e5e56ed41111b3: Status 404 returned error can't find the container with id 02c62113a92d48fe1db89a527207a95fe5703d834ec161c5b4e5e56ed41111b3 May 27 14:10:34.605512 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:10:34.605481 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5f4c796d7c-xrrb6" May 27 14:10:34.632774 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:10:34.632734 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5b46f7f598-prm68" event={"ID":"6d70f6e1-8e48-46fa-8715-194fe32c6bca","Type":"ContainerStarted","Data":"02c62113a92d48fe1db89a527207a95fe5703d834ec161c5b4e5e56ed41111b3"} May 27 14:10:37.643489 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:10:37.643400 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5b46f7f598-prm68" event={"ID":"6d70f6e1-8e48-46fa-8715-194fe32c6bca","Type":"ContainerStarted","Data":"b1ce8c0c23faa66999629ec0be0b26e206137201d9dabc77396a2b4ce81a6e61"} May 27 14:10:37.643849 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:10:37.643520 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5b46f7f598-prm68" May 27 14:10:37.687378 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:10:37.687319 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5b46f7f598-prm68" podStartSLOduration=1.2589340199999999 podStartE2EDuration="4.687301501s" podCreationTimestamp="2026-05-27 14:10:33 +0000 UTC" firstStartedPulling="2026-05-27 14:10:33.824611849 +0000 UTC m=+318.924928796" lastFinishedPulling="2026-05-27 14:10:37.252979333 +0000 UTC m=+322.353296277" observedRunningTime="2026-05-27 14:10:37.685572265 +0000 UTC m=+322.785889231" watchObservedRunningTime="2026-05-27 14:10:37.687301501 +0000 UTC m=+322.787618468" May 27 14:10:48.648986 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:10:48.648948 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5b46f7f598-prm68" May 27 14:11:01.523539 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:11:01.523494 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4brfq7h"] May 27 14:11:01.531217 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:11:01.531190 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4brfq7h" May 27 14:11:01.537059 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:11:01.537031 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" May 27 14:11:01.537059 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:11:01.537050 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-pbw7s\"" May 27 14:11:01.584679 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:11:01.584645 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4brfq7h"] May 27 14:11:01.615684 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:11:01.615645 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f26726ec-db76-4bda-b71c-f6e916e9e898-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4brfq7h\" (UID: \"f26726ec-db76-4bda-b71c-f6e916e9e898\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4brfq7h" May 27 14:11:01.615684 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:11:01.615687 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f26726ec-db76-4bda-b71c-f6e916e9e898-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4brfq7h\" (UID: \"f26726ec-db76-4bda-b71c-f6e916e9e898\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4brfq7h" May 27 14:11:01.615954 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:11:01.615766 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f26726ec-db76-4bda-b71c-f6e916e9e898-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4brfq7h\" (UID: \"f26726ec-db76-4bda-b71c-f6e916e9e898\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4brfq7h" May 27 14:11:01.615954 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:11:01.615804 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f26726ec-db76-4bda-b71c-f6e916e9e898-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4brfq7h\" (UID: \"f26726ec-db76-4bda-b71c-f6e916e9e898\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4brfq7h" May 27 14:11:01.615954 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:11:01.615848 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f26726ec-db76-4bda-b71c-f6e916e9e898-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4brfq7h\" (UID: \"f26726ec-db76-4bda-b71c-f6e916e9e898\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4brfq7h" May 27 14:11:01.615954 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:11:01.615945 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f26726ec-db76-4bda-b71c-f6e916e9e898-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4brfq7h\" (UID: \"f26726ec-db76-4bda-b71c-f6e916e9e898\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4brfq7h" May 27 14:11:01.616080 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:11:01.615982 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f26726ec-db76-4bda-b71c-f6e916e9e898-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4brfq7h\" (UID: \"f26726ec-db76-4bda-b71c-f6e916e9e898\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4brfq7h" May 27 14:11:01.616080 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:11:01.616026 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2f29\" (UniqueName: \"kubernetes.io/projected/f26726ec-db76-4bda-b71c-f6e916e9e898-kube-api-access-c2f29\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4brfq7h\" (UID: \"f26726ec-db76-4bda-b71c-f6e916e9e898\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4brfq7h" May 27 14:11:01.616080 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:11:01.616050 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f26726ec-db76-4bda-b71c-f6e916e9e898-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4brfq7h\" (UID: \"f26726ec-db76-4bda-b71c-f6e916e9e898\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4brfq7h" May 27 14:11:01.716440 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:11:01.716410 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f26726ec-db76-4bda-b71c-f6e916e9e898-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4brfq7h\" (UID: \"f26726ec-db76-4bda-b71c-f6e916e9e898\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4brfq7h" May 27 14:11:01.716625 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:11:01.716446 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f26726ec-db76-4bda-b71c-f6e916e9e898-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4brfq7h\" (UID: \"f26726ec-db76-4bda-b71c-f6e916e9e898\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4brfq7h" May 27 14:11:01.716625 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:11:01.716471 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f26726ec-db76-4bda-b71c-f6e916e9e898-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4brfq7h\" (UID: \"f26726ec-db76-4bda-b71c-f6e916e9e898\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4brfq7h" May 27 14:11:01.716625 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:11:01.716496 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c2f29\" (UniqueName: \"kubernetes.io/projected/f26726ec-db76-4bda-b71c-f6e916e9e898-kube-api-access-c2f29\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4brfq7h\" (UID: \"f26726ec-db76-4bda-b71c-f6e916e9e898\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4brfq7h" May 27 14:11:01.716625 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:11:01.716607 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f26726ec-db76-4bda-b71c-f6e916e9e898-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4brfq7h\" (UID: \"f26726ec-db76-4bda-b71c-f6e916e9e898\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4brfq7h" May 27 14:11:01.716821 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:11:01.716668 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f26726ec-db76-4bda-b71c-f6e916e9e898-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4brfq7h\" (UID: \"f26726ec-db76-4bda-b71c-f6e916e9e898\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4brfq7h" May 27 14:11:01.716821 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:11:01.716705 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f26726ec-db76-4bda-b71c-f6e916e9e898-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4brfq7h\" (UID: \"f26726ec-db76-4bda-b71c-f6e916e9e898\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4brfq7h" May 27 14:11:01.716821 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:11:01.716768 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f26726ec-db76-4bda-b71c-f6e916e9e898-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4brfq7h\" (UID: \"f26726ec-db76-4bda-b71c-f6e916e9e898\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4brfq7h" May 27 14:11:01.716821 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:11:01.716802 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f26726ec-db76-4bda-b71c-f6e916e9e898-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4brfq7h\" (UID: \"f26726ec-db76-4bda-b71c-f6e916e9e898\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4brfq7h" May 27 14:11:01.716983 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:11:01.716842 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f26726ec-db76-4bda-b71c-f6e916e9e898-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4brfq7h\" (UID: \"f26726ec-db76-4bda-b71c-f6e916e9e898\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4brfq7h" May 27 14:11:01.717026 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:11:01.716973 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f26726ec-db76-4bda-b71c-f6e916e9e898-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4brfq7h\" (UID: \"f26726ec-db76-4bda-b71c-f6e916e9e898\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4brfq7h" May 27 14:11:01.717230 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:11:01.717212 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f26726ec-db76-4bda-b71c-f6e916e9e898-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4brfq7h\" (UID: \"f26726ec-db76-4bda-b71c-f6e916e9e898\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4brfq7h" May 27 14:11:01.717545 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:11:01.717519 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f26726ec-db76-4bda-b71c-f6e916e9e898-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4brfq7h\" (UID: \"f26726ec-db76-4bda-b71c-f6e916e9e898\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4brfq7h" May 27 14:11:01.717545 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:11:01.717519 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f26726ec-db76-4bda-b71c-f6e916e9e898-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4brfq7h\" (UID: \"f26726ec-db76-4bda-b71c-f6e916e9e898\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4brfq7h" May 27 14:11:01.718993 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:11:01.718973 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f26726ec-db76-4bda-b71c-f6e916e9e898-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4brfq7h\" (UID: \"f26726ec-db76-4bda-b71c-f6e916e9e898\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4brfq7h" May 27 14:11:01.719470 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:11:01.719453 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f26726ec-db76-4bda-b71c-f6e916e9e898-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4brfq7h\" (UID: \"f26726ec-db76-4bda-b71c-f6e916e9e898\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4brfq7h" May 27 14:11:01.728541 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:11:01.728512 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2f29\" (UniqueName: \"kubernetes.io/projected/f26726ec-db76-4bda-b71c-f6e916e9e898-kube-api-access-c2f29\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4brfq7h\" (UID: \"f26726ec-db76-4bda-b71c-f6e916e9e898\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4brfq7h" May 27 14:11:01.728830 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:11:01.728811 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f26726ec-db76-4bda-b71c-f6e916e9e898-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4brfq7h\" (UID: \"f26726ec-db76-4bda-b71c-f6e916e9e898\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4brfq7h" May 27 14:11:01.842463 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:11:01.842367 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4brfq7h" May 27 14:11:01.975638 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:11:01.975583 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4brfq7h"] May 27 14:11:01.978645 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:11:01.978615 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf26726ec_db76_4bda_b71c_f6e916e9e898.slice/crio-dd8a630d9964f53a80e828867a1216e382cf1838ea95488b123ff7174d17a242 WatchSource:0}: Error finding container dd8a630d9964f53a80e828867a1216e382cf1838ea95488b123ff7174d17a242: Status 404 returned error can't find the container with id dd8a630d9964f53a80e828867a1216e382cf1838ea95488b123ff7174d17a242 May 27 14:11:02.724472 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:11:02.724427 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4brfq7h" event={"ID":"f26726ec-db76-4bda-b71c-f6e916e9e898","Type":"ContainerStarted","Data":"dd8a630d9964f53a80e828867a1216e382cf1838ea95488b123ff7174d17a242"} May 27 14:11:04.854384 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:11:04.854333 2563 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 27 14:11:04.854643 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:11:04.854418 2563 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 27 14:11:04.854643 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:11:04.854448 2563 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 27 14:11:05.737740 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:11:05.737705 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4brfq7h" event={"ID":"f26726ec-db76-4bda-b71c-f6e916e9e898","Type":"ContainerStarted","Data":"7a269d824649bdb202b3951c88cdcd8d73c55cfcd317ac5a530fb830331f7286"} May 27 14:11:05.784584 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:11:05.784531 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4brfq7h" podStartSLOduration=1.910770276 podStartE2EDuration="4.784516225s" podCreationTimestamp="2026-05-27 14:11:01 +0000 UTC" firstStartedPulling="2026-05-27 14:11:01.980356462 +0000 UTC m=+347.080673405" lastFinishedPulling="2026-05-27 14:11:04.854102411 +0000 UTC m=+349.954419354" observedRunningTime="2026-05-27 14:11:05.783594638 +0000 UTC m=+350.883911603" watchObservedRunningTime="2026-05-27 14:11:05.784516225 +0000 UTC m=+350.884833168" May 27 14:11:05.842938 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:11:05.842877 2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4brfq7h" May 27 14:11:05.847466 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:11:05.847441 2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4brfq7h" May 27 14:11:06.741437 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:11:06.741404 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4brfq7h" May 27 14:11:06.742475 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:11:06.742456 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4brfq7h" May 27 14:11:38.799889 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:11:38.799847 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xd454"] May 27 14:11:38.809260 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:11:38.809236 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xd454" May 27 14:11:38.812050 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:11:38.812000 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xd454"] May 27 14:11:38.812193 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:11:38.812093 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 27 14:11:38.813300 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:11:38.813277 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 27 14:11:38.813412 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:11:38.813279 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-n67z4\"" May 27 14:11:38.928809 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:11:38.928767 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bclt\" (UniqueName: \"kubernetes.io/projected/90bcbb0d-5285-4ed0-b5f7-33dd3da509f2-kube-api-access-5bclt\") pod \"kuadrant-operator-catalog-xd454\" (UID: \"90bcbb0d-5285-4ed0-b5f7-33dd3da509f2\") " pod="kuadrant-system/kuadrant-operator-catalog-xd454" May 27 14:11:39.030118 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:11:39.030078 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5bclt\" (UniqueName: \"kubernetes.io/projected/90bcbb0d-5285-4ed0-b5f7-33dd3da509f2-kube-api-access-5bclt\") pod \"kuadrant-operator-catalog-xd454\" (UID: \"90bcbb0d-5285-4ed0-b5f7-33dd3da509f2\") " pod="kuadrant-system/kuadrant-operator-catalog-xd454" May 27 14:11:39.038763 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:11:39.038736 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bclt\" (UniqueName: \"kubernetes.io/projected/90bcbb0d-5285-4ed0-b5f7-33dd3da509f2-kube-api-access-5bclt\") pod \"kuadrant-operator-catalog-xd454\" (UID: \"90bcbb0d-5285-4ed0-b5f7-33dd3da509f2\") " pod="kuadrant-system/kuadrant-operator-catalog-xd454" May 27 14:11:39.119825 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:11:39.119726 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xd454" May 27 14:11:39.247978 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:11:39.247942 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xd454"] May 27 14:11:39.251992 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:11:39.251954 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90bcbb0d_5285_4ed0_b5f7_33dd3da509f2.slice/crio-f9740742bdfef6db7ba4dee9565ba9e45353f9673b8dfb48d28ed8b104a2eb99 WatchSource:0}: Error finding container f9740742bdfef6db7ba4dee9565ba9e45353f9673b8dfb48d28ed8b104a2eb99: Status 404 returned error can't find the container with id f9740742bdfef6db7ba4dee9565ba9e45353f9673b8dfb48d28ed8b104a2eb99 May 27 14:11:39.848744 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:11:39.848705 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xd454" event={"ID":"90bcbb0d-5285-4ed0-b5f7-33dd3da509f2","Type":"ContainerStarted","Data":"f9740742bdfef6db7ba4dee9565ba9e45353f9673b8dfb48d28ed8b104a2eb99"} May 27 14:11:41.856537 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:11:41.856492 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xd454" event={"ID":"90bcbb0d-5285-4ed0-b5f7-33dd3da509f2","Type":"ContainerStarted","Data":"0b1588c5e673e8bbec6c6a8c87a61b0ed855175fafb54407e7eab1cc7356b902"} May 27 14:11:41.874755 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:11:41.874622 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-xd454" podStartSLOduration=1.885019869 podStartE2EDuration="3.874604892s" podCreationTimestamp="2026-05-27 14:11:38 +0000 UTC" firstStartedPulling="2026-05-27 14:11:39.253217882 +0000 UTC m=+384.353534826" lastFinishedPulling="2026-05-27 14:11:41.242802905 +0000 UTC m=+386.343119849" observedRunningTime="2026-05-27 14:11:41.873154505 +0000 UTC m=+386.973471473" watchObservedRunningTime="2026-05-27 14:11:41.874604892 +0000 UTC m=+386.974921857" May 27 14:11:49.120082 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:11:49.120038 2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-xd454" May 27 14:11:49.120082 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:11:49.120089 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-xd454" May 27 14:11:49.141545 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:11:49.141509 2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-xd454" May 27 14:11:49.903154 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:11:49.903126 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-xd454" May 27 14:12:11.580344 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:11.580305 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2xlvg"] May 27 14:12:11.587030 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:11.587004 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2xlvg" May 27 14:12:11.590226 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:11.590206 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-dcm87\"" May 27 14:12:11.601481 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:11.601445 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2xlvg"] May 27 14:12:11.690670 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:11.690635 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6928fd17-7aba-46cf-9601-08765df630e2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-2xlvg\" (UID: \"6928fd17-7aba-46cf-9601-08765df630e2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2xlvg" May 27 14:12:11.690830 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:11.690741 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mtq8\" (UniqueName: \"kubernetes.io/projected/6928fd17-7aba-46cf-9601-08765df630e2-kube-api-access-8mtq8\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-2xlvg\" (UID: \"6928fd17-7aba-46cf-9601-08765df630e2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2xlvg" May 27 14:12:11.791317 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:11.791280 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6928fd17-7aba-46cf-9601-08765df630e2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-2xlvg\" (UID: \"6928fd17-7aba-46cf-9601-08765df630e2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2xlvg" May 27 14:12:11.791492 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:11.791345 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8mtq8\" (UniqueName: \"kubernetes.io/projected/6928fd17-7aba-46cf-9601-08765df630e2-kube-api-access-8mtq8\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-2xlvg\" (UID: \"6928fd17-7aba-46cf-9601-08765df630e2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2xlvg" May 27 14:12:11.791662 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:11.791642 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6928fd17-7aba-46cf-9601-08765df630e2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-2xlvg\" (UID: \"6928fd17-7aba-46cf-9601-08765df630e2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2xlvg" May 27 14:12:11.810749 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:11.810721 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mtq8\" (UniqueName: \"kubernetes.io/projected/6928fd17-7aba-46cf-9601-08765df630e2-kube-api-access-8mtq8\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-2xlvg\" (UID: \"6928fd17-7aba-46cf-9601-08765df630e2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2xlvg" May 27 14:12:11.897045 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:11.896955 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2xlvg" May 27 14:12:12.060651 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:12.060619 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2xlvg"] May 27 14:12:12.063491 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:12:12.063454 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6928fd17_7aba_46cf_9601_08765df630e2.slice/crio-e3ecf5f5decbce33aa3e24cbf25d93eba9c398bbb19d252464ce7d18b49b8ff5 WatchSource:0}: Error finding container e3ecf5f5decbce33aa3e24cbf25d93eba9c398bbb19d252464ce7d18b49b8ff5: Status 404 returned error can't find the container with id e3ecf5f5decbce33aa3e24cbf25d93eba9c398bbb19d252464ce7d18b49b8ff5 May 27 14:12:12.959460 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:12.959420 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2xlvg" event={"ID":"6928fd17-7aba-46cf-9601-08765df630e2","Type":"ContainerStarted","Data":"e3ecf5f5decbce33aa3e24cbf25d93eba9c398bbb19d252464ce7d18b49b8ff5"} May 27 14:12:18.980489 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:18.980449 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2xlvg" event={"ID":"6928fd17-7aba-46cf-9601-08765df630e2","Type":"ContainerStarted","Data":"af9ffa66becaff1ca770bdc1ee06c9acec17a49092503fc6cf916e06e714efef"} May 27 14:12:18.980865 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:18.980514 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2xlvg" May 27 14:12:19.007512 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:19.007460 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2xlvg" podStartSLOduration=2.084436835 podStartE2EDuration="8.007443612s" podCreationTimestamp="2026-05-27 14:12:11 +0000 UTC" firstStartedPulling="2026-05-27 14:12:12.06570678 +0000 UTC m=+417.166023723" lastFinishedPulling="2026-05-27 14:12:17.988713557 +0000 UTC m=+423.089030500" observedRunningTime="2026-05-27 14:12:19.005390164 +0000 UTC m=+424.105707131" watchObservedRunningTime="2026-05-27 14:12:19.007443612 +0000 UTC m=+424.107760578" May 27 14:12:19.917674 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:19.917641 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-sp7zj"] May 27 14:12:19.920739 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:19.920724 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-sp7zj" May 27 14:12:19.923380 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:19.923359 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-zm96j\"" May 27 14:12:19.932826 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:19.932802 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-sp7zj"] May 27 14:12:20.063346 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:20.063298 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9mbf\" (UniqueName: \"kubernetes.io/projected/9a2d8638-30de-4a8d-8017-899305eded1d-kube-api-access-j9mbf\") pod \"limitador-operator-controller-manager-85c4996f8c-sp7zj\" (UID: \"9a2d8638-30de-4a8d-8017-899305eded1d\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-sp7zj" May 27 14:12:20.164305 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:20.164260 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j9mbf\" (UniqueName: \"kubernetes.io/projected/9a2d8638-30de-4a8d-8017-899305eded1d-kube-api-access-j9mbf\") pod \"limitador-operator-controller-manager-85c4996f8c-sp7zj\" (UID: \"9a2d8638-30de-4a8d-8017-899305eded1d\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-sp7zj" May 27 14:12:20.178603 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:20.178504 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9mbf\" (UniqueName: \"kubernetes.io/projected/9a2d8638-30de-4a8d-8017-899305eded1d-kube-api-access-j9mbf\") pod \"limitador-operator-controller-manager-85c4996f8c-sp7zj\" (UID: \"9a2d8638-30de-4a8d-8017-899305eded1d\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-sp7zj" May 27 14:12:20.230471 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:20.230436 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-sp7zj" May 27 14:12:20.363815 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:20.363789 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-sp7zj"] May 27 14:12:20.366582 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:12:20.366547 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a2d8638_30de_4a8d_8017_899305eded1d.slice/crio-410d28f5bbb20281595c7f01cc114a15cb0cf3ce0498a008b37999cb71e28ddc WatchSource:0}: Error finding container 410d28f5bbb20281595c7f01cc114a15cb0cf3ce0498a008b37999cb71e28ddc: Status 404 returned error can't find the container with id 410d28f5bbb20281595c7f01cc114a15cb0cf3ce0498a008b37999cb71e28ddc May 27 14:12:20.987856 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:20.987808 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-sp7zj" event={"ID":"9a2d8638-30de-4a8d-8017-899305eded1d","Type":"ContainerStarted","Data":"410d28f5bbb20281595c7f01cc114a15cb0cf3ce0498a008b37999cb71e28ddc"} May 27 14:12:22.995172 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:22.995135 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-sp7zj" event={"ID":"9a2d8638-30de-4a8d-8017-899305eded1d","Type":"ContainerStarted","Data":"3d30bf92dfca2aad549d63513bcb7146a81e8948d91772c086571ea0b20a97df"} May 27 14:12:22.995723 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:22.995192 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-sp7zj" May 27 14:12:23.014983 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:23.014939 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-sp7zj" podStartSLOduration=1.660153897 podStartE2EDuration="4.01492434s" podCreationTimestamp="2026-05-27 14:12:19 +0000 UTC" firstStartedPulling="2026-05-27 14:12:20.368457165 +0000 UTC m=+425.468774112" lastFinishedPulling="2026-05-27 14:12:22.723227608 +0000 UTC m=+427.823544555" observedRunningTime="2026-05-27 14:12:23.013249616 +0000 UTC m=+428.113566598" watchObservedRunningTime="2026-05-27 14:12:23.01492434 +0000 UTC m=+428.115241306" May 27 14:12:29.986145 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:29.986107 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2xlvg" May 27 14:12:31.857748 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:31.857713 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2xlvg"] May 27 14:12:31.858192 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:31.857923 2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2xlvg" podUID="6928fd17-7aba-46cf-9601-08765df630e2" containerName="manager" containerID="cri-o://af9ffa66becaff1ca770bdc1ee06c9acec17a49092503fc6cf916e06e714efef" gracePeriod=2 May 27 14:12:31.861203 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:31.861153 2563 status_manager.go:895] "Failed to get status for pod" podUID="6928fd17-7aba-46cf-9601-08765df630e2" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2xlvg" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-2xlvg\" is forbidden: User \"system:node:ip-10-0-136-198.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-198.ec2.internal' and this object" May 27 14:12:31.861411 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:31.861375 2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2xlvg"] May 27 14:12:31.879970 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:31.879943 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-sp7zj"] May 27 14:12:31.880216 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:31.880192 2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-sp7zj" podUID="9a2d8638-30de-4a8d-8017-899305eded1d" containerName="manager" containerID="cri-o://3d30bf92dfca2aad549d63513bcb7146a81e8948d91772c086571ea0b20a97df" gracePeriod=2 May 27 14:12:31.882100 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:31.882074 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-sp7zj" May 27 14:12:31.887726 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:31.887702 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-gmwbj"] May 27 14:12:31.888143 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:31.888122 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6928fd17-7aba-46cf-9601-08765df630e2" containerName="manager" May 27 14:12:31.888143 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:31.888145 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6928fd17-7aba-46cf-9601-08765df630e2" containerName="manager" May 27 14:12:31.888283 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:31.888244 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="6928fd17-7aba-46cf-9601-08765df630e2" containerName="manager" May 27 14:12:31.890801 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:31.890773 2563 status_manager.go:895] "Failed to get status for pod" podUID="6928fd17-7aba-46cf-9601-08765df630e2" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2xlvg" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-2xlvg\" is forbidden: User \"system:node:ip-10-0-136-198.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-198.ec2.internal' and this object" May 27 14:12:31.891233 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:31.891216 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-gmwbj" May 27 14:12:31.895158 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:31.895135 2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-sp7zj"] May 27 14:12:31.910881 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:31.910846 2563 status_manager.go:895] "Failed to get status for pod" podUID="6928fd17-7aba-46cf-9601-08765df630e2" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2xlvg" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-2xlvg\" is forbidden: User \"system:node:ip-10-0-136-198.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-198.ec2.internal' and this object" May 27 14:12:31.913373 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:31.913210 2563 status_manager.go:895] "Failed to get status for pod" podUID="9a2d8638-30de-4a8d-8017-899305eded1d" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-sp7zj" err="pods \"limitador-operator-controller-manager-85c4996f8c-sp7zj\" is forbidden: User \"system:node:ip-10-0-136-198.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-198.ec2.internal' and this object" May 27 14:12:31.914742 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:31.914716 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-gmwbj"] May 27 14:12:31.915771 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:31.915734 2563 status_manager.go:895] "Failed to get status for pod" podUID="6928fd17-7aba-46cf-9601-08765df630e2" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2xlvg" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-2xlvg\" is forbidden: User \"system:node:ip-10-0-136-198.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-198.ec2.internal' and this object" May 27 14:12:31.966922 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:31.966866 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9zkc\" (UniqueName: \"kubernetes.io/projected/f52c176e-10aa-4ce5-be1c-2be36df4cbcb-kube-api-access-z9zkc\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-gmwbj\" (UID: \"f52c176e-10aa-4ce5-be1c-2be36df4cbcb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-gmwbj" May 27 14:12:31.967082 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:31.967001 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f52c176e-10aa-4ce5-be1c-2be36df4cbcb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-gmwbj\" (UID: \"f52c176e-10aa-4ce5-be1c-2be36df4cbcb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-gmwbj" May 27 14:12:32.026921 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:32.026867 2563 generic.go:358] "Generic (PLEG): container finished" podID="6928fd17-7aba-46cf-9601-08765df630e2" containerID="af9ffa66becaff1ca770bdc1ee06c9acec17a49092503fc6cf916e06e714efef" exitCode=0 May 27 14:12:32.028719 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:32.028691 2563 generic.go:358] "Generic (PLEG): container finished" podID="9a2d8638-30de-4a8d-8017-899305eded1d" containerID="3d30bf92dfca2aad549d63513bcb7146a81e8948d91772c086571ea0b20a97df" exitCode=0 May 27 14:12:32.068559 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:32.068517 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f52c176e-10aa-4ce5-be1c-2be36df4cbcb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-gmwbj\" (UID: \"f52c176e-10aa-4ce5-be1c-2be36df4cbcb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-gmwbj" May 27 14:12:32.068691 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:32.068601 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z9zkc\" (UniqueName: \"kubernetes.io/projected/f52c176e-10aa-4ce5-be1c-2be36df4cbcb-kube-api-access-z9zkc\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-gmwbj\" (UID: \"f52c176e-10aa-4ce5-be1c-2be36df4cbcb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-gmwbj" May 27 14:12:32.068867 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:32.068848 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f52c176e-10aa-4ce5-be1c-2be36df4cbcb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-gmwbj\" (UID: \"f52c176e-10aa-4ce5-be1c-2be36df4cbcb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-gmwbj" May 27 14:12:32.098918 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:32.098678 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9zkc\" (UniqueName: \"kubernetes.io/projected/f52c176e-10aa-4ce5-be1c-2be36df4cbcb-kube-api-access-z9zkc\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-gmwbj\" (UID: \"f52c176e-10aa-4ce5-be1c-2be36df4cbcb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-gmwbj" May 27 14:12:32.128067 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:32.128041 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2xlvg" May 27 14:12:32.130942 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:32.130922 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-sp7zj" May 27 14:12:32.140972 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:32.140950 2563 status_manager.go:895] "Failed to get status for pod" podUID="9a2d8638-30de-4a8d-8017-899305eded1d" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-sp7zj" err="pods \"limitador-operator-controller-manager-85c4996f8c-sp7zj\" is forbidden: User \"system:node:ip-10-0-136-198.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-198.ec2.internal' and this object" May 27 14:12:32.143726 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:32.143703 2563 status_manager.go:895] "Failed to get status for pod" podUID="6928fd17-7aba-46cf-9601-08765df630e2" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2xlvg" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-2xlvg\" is forbidden: User \"system:node:ip-10-0-136-198.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-198.ec2.internal' and this object" May 27 14:12:32.153051 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:32.153024 2563 status_manager.go:895] "Failed to get status for pod" podUID="9a2d8638-30de-4a8d-8017-899305eded1d" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-sp7zj" err="pods \"limitador-operator-controller-manager-85c4996f8c-sp7zj\" is forbidden: User \"system:node:ip-10-0-136-198.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-198.ec2.internal' and this object" May 27 14:12:32.155351 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:32.155326 2563 status_manager.go:895] "Failed to get status for pod" podUID="6928fd17-7aba-46cf-9601-08765df630e2" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2xlvg" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-2xlvg\" is forbidden: User \"system:node:ip-10-0-136-198.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-198.ec2.internal' and this object" May 27 14:12:32.270107 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:32.270068 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j9mbf\" (UniqueName: \"kubernetes.io/projected/9a2d8638-30de-4a8d-8017-899305eded1d-kube-api-access-j9mbf\") pod \"9a2d8638-30de-4a8d-8017-899305eded1d\" (UID: \"9a2d8638-30de-4a8d-8017-899305eded1d\") " May 27 14:12:32.270107 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:32.270115 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6928fd17-7aba-46cf-9601-08765df630e2-extensions-socket-volume\") pod \"6928fd17-7aba-46cf-9601-08765df630e2\" (UID: \"6928fd17-7aba-46cf-9601-08765df630e2\") " May 27 14:12:32.270354 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:32.270181 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8mtq8\" (UniqueName: \"kubernetes.io/projected/6928fd17-7aba-46cf-9601-08765df630e2-kube-api-access-8mtq8\") pod \"6928fd17-7aba-46cf-9601-08765df630e2\" (UID: \"6928fd17-7aba-46cf-9601-08765df630e2\") " May 27 14:12:32.270649 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:32.270616 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6928fd17-7aba-46cf-9601-08765df630e2-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6928fd17-7aba-46cf-9601-08765df630e2" (UID: "6928fd17-7aba-46cf-9601-08765df630e2"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 14:12:32.272434 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:32.272409 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a2d8638-30de-4a8d-8017-899305eded1d-kube-api-access-j9mbf" (OuterVolumeSpecName: "kube-api-access-j9mbf") pod "9a2d8638-30de-4a8d-8017-899305eded1d" (UID: "9a2d8638-30de-4a8d-8017-899305eded1d"). InnerVolumeSpecName "kube-api-access-j9mbf". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 14:12:32.272434 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:32.272426 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6928fd17-7aba-46cf-9601-08765df630e2-kube-api-access-8mtq8" (OuterVolumeSpecName: "kube-api-access-8mtq8") pod "6928fd17-7aba-46cf-9601-08765df630e2" (UID: "6928fd17-7aba-46cf-9601-08765df630e2"). InnerVolumeSpecName "kube-api-access-8mtq8". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 14:12:32.299765 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:32.299733 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-gmwbj" May 27 14:12:32.371375 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:32.371305 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8mtq8\" (UniqueName: \"kubernetes.io/projected/6928fd17-7aba-46cf-9601-08765df630e2-kube-api-access-8mtq8\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" May 27 14:12:32.371375 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:32.371335 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j9mbf\" (UniqueName: \"kubernetes.io/projected/9a2d8638-30de-4a8d-8017-899305eded1d-kube-api-access-j9mbf\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" May 27 14:12:32.371375 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:32.371344 2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6928fd17-7aba-46cf-9601-08765df630e2-extensions-socket-volume\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" May 27 14:12:32.464212 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:32.464169 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-gmwbj"] May 27 14:12:32.474235 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:12:32.474206 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf52c176e_10aa_4ce5_be1c_2be36df4cbcb.slice/crio-d931013a1c6f1410517d435459d333acd9251e2fcf4ae476f382528db44d897a WatchSource:0}: Error finding container d931013a1c6f1410517d435459d333acd9251e2fcf4ae476f382528db44d897a: Status 404 returned error can't find the container with id d931013a1c6f1410517d435459d333acd9251e2fcf4ae476f382528db44d897a May 27 14:12:33.033771 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:33.033738 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2xlvg" May 27 14:12:33.034272 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:33.033771 2563 scope.go:117] "RemoveContainer" containerID="af9ffa66becaff1ca770bdc1ee06c9acec17a49092503fc6cf916e06e714efef" May 27 14:12:33.035055 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:33.034962 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-sp7zj" May 27 14:12:33.036445 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:33.036408 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-gmwbj" event={"ID":"f52c176e-10aa-4ce5-be1c-2be36df4cbcb","Type":"ContainerStarted","Data":"8946f015a971b790367edf17b744a4efc21f893955e6e7898ca7a386e215f27c"} May 27 14:12:33.036445 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:33.036442 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-gmwbj" event={"ID":"f52c176e-10aa-4ce5-be1c-2be36df4cbcb","Type":"ContainerStarted","Data":"d931013a1c6f1410517d435459d333acd9251e2fcf4ae476f382528db44d897a"} May 27 14:12:33.036604 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:33.036563 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-gmwbj" May 27 14:12:33.036952 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:33.036925 2563 status_manager.go:895] "Failed to get status for pod" podUID="9a2d8638-30de-4a8d-8017-899305eded1d" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-sp7zj" err="pods \"limitador-operator-controller-manager-85c4996f8c-sp7zj\" is forbidden: User \"system:node:ip-10-0-136-198.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-198.ec2.internal' and this object" May 27 14:12:33.042726 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:33.042629 2563 scope.go:117] "RemoveContainer" containerID="3d30bf92dfca2aad549d63513bcb7146a81e8948d91772c086571ea0b20a97df" May 27 14:12:33.042726 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:33.042663 2563 status_manager.go:895] "Failed to get status for pod" podUID="6928fd17-7aba-46cf-9601-08765df630e2" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2xlvg" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-2xlvg\" is forbidden: User \"system:node:ip-10-0-136-198.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-198.ec2.internal' and this object" May 27 14:12:33.046466 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:33.046444 2563 status_manager.go:895] "Failed to get status for pod" podUID="9a2d8638-30de-4a8d-8017-899305eded1d" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-sp7zj" err="pods \"limitador-operator-controller-manager-85c4996f8c-sp7zj\" is forbidden: User \"system:node:ip-10-0-136-198.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-198.ec2.internal' and this object" May 27 14:12:33.048771 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:33.048746 2563 status_manager.go:895] "Failed to get status for pod" podUID="6928fd17-7aba-46cf-9601-08765df630e2" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2xlvg" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-2xlvg\" is forbidden: User \"system:node:ip-10-0-136-198.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-198.ec2.internal' and this object" May 27 14:12:33.098486 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:33.098433 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-gmwbj" podStartSLOduration=2.098417304 podStartE2EDuration="2.098417304s" podCreationTimestamp="2026-05-27 14:12:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 14:12:33.097612596 +0000 UTC m=+438.197929564" watchObservedRunningTime="2026-05-27 14:12:33.098417304 +0000 UTC m=+438.198734269" May 27 14:12:33.101023 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:33.100999 2563 status_manager.go:895] "Failed to get status for pod" podUID="9a2d8638-30de-4a8d-8017-899305eded1d" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-sp7zj" err="pods \"limitador-operator-controller-manager-85c4996f8c-sp7zj\" is forbidden: User \"system:node:ip-10-0-136-198.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-198.ec2.internal' and this object" May 27 14:12:33.129672 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:33.129591 2563 status_manager.go:895] "Failed to get status for pod" podUID="6928fd17-7aba-46cf-9601-08765df630e2" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2xlvg" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-2xlvg\" is forbidden: User \"system:node:ip-10-0-136-198.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-198.ec2.internal' and this object" May 27 14:12:33.423603 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:33.423517 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-mw6rg"] May 27 14:12:33.423861 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:33.423842 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a2d8638-30de-4a8d-8017-899305eded1d" containerName="manager" May 27 14:12:33.423926 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:33.423863 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a2d8638-30de-4a8d-8017-899305eded1d" containerName="manager" May 27 14:12:33.423966 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:33.423932 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="9a2d8638-30de-4a8d-8017-899305eded1d" containerName="manager" May 27 14:12:33.428142 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:33.428123 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-mw6rg" May 27 14:12:33.430684 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:33.430654 2563 status_manager.go:895] "Failed to get status for pod" podUID="9a2d8638-30de-4a8d-8017-899305eded1d" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-sp7zj" err="pods \"limitador-operator-controller-manager-85c4996f8c-sp7zj\" is forbidden: User \"system:node:ip-10-0-136-198.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-198.ec2.internal' and this object" May 27 14:12:33.434673 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:33.434642 2563 status_manager.go:895] "Failed to get status for pod" podUID="6928fd17-7aba-46cf-9601-08765df630e2" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2xlvg" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-2xlvg\" is forbidden: User \"system:node:ip-10-0-136-198.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-198.ec2.internal' and this object" May 27 14:12:33.444927 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:33.444902 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-mw6rg"] May 27 14:12:33.543320 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:33.543284 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6928fd17-7aba-46cf-9601-08765df630e2" path="/var/lib/kubelet/pods/6928fd17-7aba-46cf-9601-08765df630e2/volumes" May 27 14:12:33.543609 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:33.543597 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a2d8638-30de-4a8d-8017-899305eded1d" path="/var/lib/kubelet/pods/9a2d8638-30de-4a8d-8017-899305eded1d/volumes" May 27 14:12:33.582159 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:33.582121 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b81e77d7-3e83-4866-aeda-9f06a1093e1c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-mw6rg\" (UID: \"b81e77d7-3e83-4866-aeda-9f06a1093e1c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-mw6rg" May 27 14:12:33.582272 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:33.582178 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dw2rn\" (UniqueName: \"kubernetes.io/projected/b81e77d7-3e83-4866-aeda-9f06a1093e1c-kube-api-access-dw2rn\") pod \"kuadrant-operator-controller-manager-55c7f4c975-mw6rg\" (UID: \"b81e77d7-3e83-4866-aeda-9f06a1093e1c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-mw6rg" May 27 14:12:33.683474 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:33.683381 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b81e77d7-3e83-4866-aeda-9f06a1093e1c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-mw6rg\" (UID: \"b81e77d7-3e83-4866-aeda-9f06a1093e1c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-mw6rg" May 27 14:12:33.683474 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:33.683439 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dw2rn\" (UniqueName: \"kubernetes.io/projected/b81e77d7-3e83-4866-aeda-9f06a1093e1c-kube-api-access-dw2rn\") pod \"kuadrant-operator-controller-manager-55c7f4c975-mw6rg\" (UID: \"b81e77d7-3e83-4866-aeda-9f06a1093e1c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-mw6rg" May 27 14:12:33.683740 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:33.683716 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b81e77d7-3e83-4866-aeda-9f06a1093e1c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-mw6rg\" (UID: \"b81e77d7-3e83-4866-aeda-9f06a1093e1c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-mw6rg" May 27 14:12:33.692834 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:33.692807 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dw2rn\" (UniqueName: \"kubernetes.io/projected/b81e77d7-3e83-4866-aeda-9f06a1093e1c-kube-api-access-dw2rn\") pod \"kuadrant-operator-controller-manager-55c7f4c975-mw6rg\" (UID: \"b81e77d7-3e83-4866-aeda-9f06a1093e1c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-mw6rg" May 27 14:12:33.737577 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:33.737542 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-mw6rg" May 27 14:12:33.871416 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:33.871386 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-mw6rg"] May 27 14:12:33.875610 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:12:33.875581 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb81e77d7_3e83_4866_aeda_9f06a1093e1c.slice/crio-07468015b3e2dc0334d09488894825df21c065308a982778f98428a5283b8020 WatchSource:0}: Error finding container 07468015b3e2dc0334d09488894825df21c065308a982778f98428a5283b8020: Status 404 returned error can't find the container with id 07468015b3e2dc0334d09488894825df21c065308a982778f98428a5283b8020 May 27 14:12:34.042800 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:34.042768 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-mw6rg" event={"ID":"b81e77d7-3e83-4866-aeda-9f06a1093e1c","Type":"ContainerStarted","Data":"6bb3f6d90503b71f9883e79d51ba81e20b4fe977e9a50aec24d4eae40adfce3d"} May 27 14:12:34.042800 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:34.042806 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-mw6rg" event={"ID":"b81e77d7-3e83-4866-aeda-9f06a1093e1c","Type":"ContainerStarted","Data":"07468015b3e2dc0334d09488894825df21c065308a982778f98428a5283b8020"} May 27 14:12:34.067906 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:34.067837 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-mw6rg" podStartSLOduration=1.067817292 podStartE2EDuration="1.067817292s" podCreationTimestamp="2026-05-27 14:12:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 14:12:34.065649387 +0000 UTC m=+439.165966381" watchObservedRunningTime="2026-05-27 14:12:34.067817292 +0000 UTC m=+439.168134258" May 27 14:12:35.047286 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:35.047206 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-mw6rg" May 27 14:12:44.045786 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:44.045754 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-gmwbj" May 27 14:12:46.052007 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:46.051978 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-mw6rg" May 27 14:12:46.110460 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:46.110426 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-gmwbj"] May 27 14:12:46.110951 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:46.110920 2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-gmwbj" podUID="f52c176e-10aa-4ce5-be1c-2be36df4cbcb" containerName="manager" containerID="cri-o://8946f015a971b790367edf17b744a4efc21f893955e6e7898ca7a386e215f27c" gracePeriod=10 May 27 14:12:46.352546 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:46.352521 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-gmwbj" May 27 14:12:46.486276 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:46.486245 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z9zkc\" (UniqueName: \"kubernetes.io/projected/f52c176e-10aa-4ce5-be1c-2be36df4cbcb-kube-api-access-z9zkc\") pod \"f52c176e-10aa-4ce5-be1c-2be36df4cbcb\" (UID: \"f52c176e-10aa-4ce5-be1c-2be36df4cbcb\") " May 27 14:12:46.486448 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:46.486287 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f52c176e-10aa-4ce5-be1c-2be36df4cbcb-extensions-socket-volume\") pod \"f52c176e-10aa-4ce5-be1c-2be36df4cbcb\" (UID: \"f52c176e-10aa-4ce5-be1c-2be36df4cbcb\") " May 27 14:12:46.486677 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:46.486652 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f52c176e-10aa-4ce5-be1c-2be36df4cbcb-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f52c176e-10aa-4ce5-be1c-2be36df4cbcb" (UID: "f52c176e-10aa-4ce5-be1c-2be36df4cbcb"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 14:12:46.488371 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:46.488340 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f52c176e-10aa-4ce5-be1c-2be36df4cbcb-kube-api-access-z9zkc" (OuterVolumeSpecName: "kube-api-access-z9zkc") pod "f52c176e-10aa-4ce5-be1c-2be36df4cbcb" (UID: "f52c176e-10aa-4ce5-be1c-2be36df4cbcb"). InnerVolumeSpecName "kube-api-access-z9zkc". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 14:12:46.587461 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:46.587363 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z9zkc\" (UniqueName: \"kubernetes.io/projected/f52c176e-10aa-4ce5-be1c-2be36df4cbcb-kube-api-access-z9zkc\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" May 27 14:12:46.587461 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:46.587401 2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f52c176e-10aa-4ce5-be1c-2be36df4cbcb-extensions-socket-volume\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" May 27 14:12:47.091597 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:47.091564 2563 generic.go:358] "Generic (PLEG): container finished" podID="f52c176e-10aa-4ce5-be1c-2be36df4cbcb" containerID="8946f015a971b790367edf17b744a4efc21f893955e6e7898ca7a386e215f27c" exitCode=0 May 27 14:12:47.092011 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:47.091629 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-gmwbj" May 27 14:12:47.092011 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:47.091633 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-gmwbj" event={"ID":"f52c176e-10aa-4ce5-be1c-2be36df4cbcb","Type":"ContainerDied","Data":"8946f015a971b790367edf17b744a4efc21f893955e6e7898ca7a386e215f27c"} May 27 14:12:47.092011 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:47.091735 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-gmwbj" event={"ID":"f52c176e-10aa-4ce5-be1c-2be36df4cbcb","Type":"ContainerDied","Data":"d931013a1c6f1410517d435459d333acd9251e2fcf4ae476f382528db44d897a"} May 27 14:12:47.092011 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:47.091749 2563 scope.go:117] "RemoveContainer" containerID="8946f015a971b790367edf17b744a4efc21f893955e6e7898ca7a386e215f27c" May 27 14:12:47.099770 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:47.099678 2563 scope.go:117] "RemoveContainer" containerID="8946f015a971b790367edf17b744a4efc21f893955e6e7898ca7a386e215f27c" May 27 14:12:47.100014 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:12:47.099995 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8946f015a971b790367edf17b744a4efc21f893955e6e7898ca7a386e215f27c\": container with ID starting with 8946f015a971b790367edf17b744a4efc21f893955e6e7898ca7a386e215f27c not found: ID does not exist" containerID="8946f015a971b790367edf17b744a4efc21f893955e6e7898ca7a386e215f27c" May 27 14:12:47.100070 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:47.100022 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8946f015a971b790367edf17b744a4efc21f893955e6e7898ca7a386e215f27c"} err="failed to get container status \"8946f015a971b790367edf17b744a4efc21f893955e6e7898ca7a386e215f27c\": rpc error: code = NotFound desc = could not find container \"8946f015a971b790367edf17b744a4efc21f893955e6e7898ca7a386e215f27c\": container with ID starting with 8946f015a971b790367edf17b744a4efc21f893955e6e7898ca7a386e215f27c not found: ID does not exist" May 27 14:12:47.128667 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:47.128631 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-gmwbj"] May 27 14:12:47.139880 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:47.139844 2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-gmwbj"] May 27 14:12:47.542483 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:12:47.542451 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f52c176e-10aa-4ce5-be1c-2be36df4cbcb" path="/var/lib/kubelet/pods/f52c176e-10aa-4ce5-be1c-2be36df4cbcb/volumes" May 27 14:13:02.485339 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:02.485301 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-7blnx"] May 27 14:13:02.485768 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:02.485602 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f52c176e-10aa-4ce5-be1c-2be36df4cbcb" containerName="manager" May 27 14:13:02.485768 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:02.485613 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f52c176e-10aa-4ce5-be1c-2be36df4cbcb" containerName="manager" May 27 14:13:02.485768 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:02.485670 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="f52c176e-10aa-4ce5-be1c-2be36df4cbcb" containerName="manager" May 27 14:13:02.488143 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:02.488124 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-7blnx" May 27 14:13:02.490730 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:02.490711 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-xpwg6\"" May 27 14:13:02.505680 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:02.505652 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-7blnx"] May 27 14:13:02.510022 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:02.510000 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1653dacf-5ca5-4f80-8738-de6fbcb61514-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-7blnx\" (UID: \"1653dacf-5ca5-4f80-8738-de6fbcb61514\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-7blnx" May 27 14:13:02.510130 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:02.510055 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1653dacf-5ca5-4f80-8738-de6fbcb61514-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-7blnx\" (UID: \"1653dacf-5ca5-4f80-8738-de6fbcb61514\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-7blnx" May 27 14:13:02.510186 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:02.510145 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1653dacf-5ca5-4f80-8738-de6fbcb61514-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-7blnx\" (UID: \"1653dacf-5ca5-4f80-8738-de6fbcb61514\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-7blnx" May 27 14:13:02.510247 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:02.510208 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lfhr\" (UniqueName: \"kubernetes.io/projected/1653dacf-5ca5-4f80-8738-de6fbcb61514-kube-api-access-9lfhr\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-7blnx\" (UID: \"1653dacf-5ca5-4f80-8738-de6fbcb61514\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-7blnx" May 27 14:13:02.510302 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:02.510249 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1653dacf-5ca5-4f80-8738-de6fbcb61514-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-7blnx\" (UID: \"1653dacf-5ca5-4f80-8738-de6fbcb61514\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-7blnx" May 27 14:13:02.510302 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:02.510278 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1653dacf-5ca5-4f80-8738-de6fbcb61514-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-7blnx\" (UID: \"1653dacf-5ca5-4f80-8738-de6fbcb61514\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-7blnx" May 27 14:13:02.510404 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:02.510326 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1653dacf-5ca5-4f80-8738-de6fbcb61514-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-7blnx\" (UID: \"1653dacf-5ca5-4f80-8738-de6fbcb61514\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-7blnx" May 27 14:13:02.510404 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:02.510370 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1653dacf-5ca5-4f80-8738-de6fbcb61514-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-7blnx\" (UID: \"1653dacf-5ca5-4f80-8738-de6fbcb61514\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-7blnx" May 27 14:13:02.510404 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:02.510395 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1653dacf-5ca5-4f80-8738-de6fbcb61514-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-7blnx\" (UID: \"1653dacf-5ca5-4f80-8738-de6fbcb61514\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-7blnx" May 27 14:13:02.610979 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:02.610941 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1653dacf-5ca5-4f80-8738-de6fbcb61514-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-7blnx\" (UID: \"1653dacf-5ca5-4f80-8738-de6fbcb61514\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-7blnx" May 27 14:13:02.611200 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:02.610986 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1653dacf-5ca5-4f80-8738-de6fbcb61514-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-7blnx\" (UID: \"1653dacf-5ca5-4f80-8738-de6fbcb61514\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-7blnx" May 27 14:13:02.611200 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:02.611018 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9lfhr\" (UniqueName: \"kubernetes.io/projected/1653dacf-5ca5-4f80-8738-de6fbcb61514-kube-api-access-9lfhr\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-7blnx\" (UID: \"1653dacf-5ca5-4f80-8738-de6fbcb61514\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-7blnx" May 27 14:13:02.611200 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:02.611043 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1653dacf-5ca5-4f80-8738-de6fbcb61514-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-7blnx\" (UID: \"1653dacf-5ca5-4f80-8738-de6fbcb61514\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-7blnx" May 27 14:13:02.611200 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:02.611068 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1653dacf-5ca5-4f80-8738-de6fbcb61514-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-7blnx\" (UID: \"1653dacf-5ca5-4f80-8738-de6fbcb61514\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-7blnx" May 27 14:13:02.611200 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:02.611106 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1653dacf-5ca5-4f80-8738-de6fbcb61514-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-7blnx\" (UID: \"1653dacf-5ca5-4f80-8738-de6fbcb61514\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-7blnx" May 27 14:13:02.611200 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:02.611137 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1653dacf-5ca5-4f80-8738-de6fbcb61514-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-7blnx\" (UID: \"1653dacf-5ca5-4f80-8738-de6fbcb61514\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-7blnx" May 27 14:13:02.611200 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:02.611163 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1653dacf-5ca5-4f80-8738-de6fbcb61514-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-7blnx\" (UID: \"1653dacf-5ca5-4f80-8738-de6fbcb61514\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-7blnx" May 27 14:13:02.611200 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:02.611193 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1653dacf-5ca5-4f80-8738-de6fbcb61514-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-7blnx\" (UID: \"1653dacf-5ca5-4f80-8738-de6fbcb61514\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-7blnx" May 27 14:13:02.611607 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:02.611442 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1653dacf-5ca5-4f80-8738-de6fbcb61514-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-7blnx\" (UID: \"1653dacf-5ca5-4f80-8738-de6fbcb61514\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-7blnx" May 27 14:13:02.611607 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:02.611532 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1653dacf-5ca5-4f80-8738-de6fbcb61514-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-7blnx\" (UID: \"1653dacf-5ca5-4f80-8738-de6fbcb61514\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-7blnx" May 27 14:13:02.611700 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:02.611642 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1653dacf-5ca5-4f80-8738-de6fbcb61514-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-7blnx\" (UID: \"1653dacf-5ca5-4f80-8738-de6fbcb61514\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-7blnx" May 27 14:13:02.611700 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:02.611636 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1653dacf-5ca5-4f80-8738-de6fbcb61514-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-7blnx\" (UID: \"1653dacf-5ca5-4f80-8738-de6fbcb61514\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-7blnx" May 27 14:13:02.612033 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:02.612015 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1653dacf-5ca5-4f80-8738-de6fbcb61514-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-7blnx\" (UID: \"1653dacf-5ca5-4f80-8738-de6fbcb61514\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-7blnx" May 27 14:13:02.613267 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:02.613236 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1653dacf-5ca5-4f80-8738-de6fbcb61514-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-7blnx\" (UID: \"1653dacf-5ca5-4f80-8738-de6fbcb61514\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-7blnx" May 27 14:13:02.613685 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:02.613662 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1653dacf-5ca5-4f80-8738-de6fbcb61514-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-7blnx\" (UID: \"1653dacf-5ca5-4f80-8738-de6fbcb61514\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-7blnx" May 27 14:13:02.623155 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:02.623124 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1653dacf-5ca5-4f80-8738-de6fbcb61514-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-7blnx\" (UID: \"1653dacf-5ca5-4f80-8738-de6fbcb61514\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-7blnx" May 27 14:13:02.623585 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:02.623565 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lfhr\" (UniqueName: \"kubernetes.io/projected/1653dacf-5ca5-4f80-8738-de6fbcb61514-kube-api-access-9lfhr\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-7blnx\" (UID: \"1653dacf-5ca5-4f80-8738-de6fbcb61514\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-7blnx" May 27 14:13:02.798414 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:02.798325 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-7blnx" May 27 14:13:02.935979 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:02.935841 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-7blnx"] May 27 14:13:02.938302 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:13:02.938272 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1653dacf_5ca5_4f80_8738_de6fbcb61514.slice/crio-a36fd1ad75a93567af4cc9479ba9119f4b76c5a103d406bc9620ce21a57a2bea WatchSource:0}: Error finding container a36fd1ad75a93567af4cc9479ba9119f4b76c5a103d406bc9620ce21a57a2bea: Status 404 returned error can't find the container with id a36fd1ad75a93567af4cc9479ba9119f4b76c5a103d406bc9620ce21a57a2bea May 27 14:13:02.940389 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:02.940359 2563 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 27 14:13:02.940445 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:02.940424 2563 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 27 14:13:02.940488 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:02.940451 2563 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 27 14:13:03.145723 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:03.145634 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-7blnx" event={"ID":"1653dacf-5ca5-4f80-8738-de6fbcb61514","Type":"ContainerStarted","Data":"5413ed83b94f32c5f503975688f9ff713e41fc96e29a063c0da2e47cf913b9ee"} May 27 14:13:03.145723 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:03.145678 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-7blnx" event={"ID":"1653dacf-5ca5-4f80-8738-de6fbcb61514","Type":"ContainerStarted","Data":"a36fd1ad75a93567af4cc9479ba9119f4b76c5a103d406bc9620ce21a57a2bea"} May 27 14:13:03.167596 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:03.167543 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-7blnx" podStartSLOduration=1.167523339 podStartE2EDuration="1.167523339s" podCreationTimestamp="2026-05-27 14:13:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 14:13:03.166124384 +0000 UTC m=+468.266441352" watchObservedRunningTime="2026-05-27 14:13:03.167523339 +0000 UTC m=+468.267840307" May 27 14:13:03.799426 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:03.799382 2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-7blnx" May 27 14:13:04.803424 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:04.803394 2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-7blnx" May 27 14:13:05.152052 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:05.151965 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-7blnx" May 27 14:13:05.152971 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:05.152953 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-7blnx" May 27 14:13:07.356985 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:07.356946 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-jkkbk"] May 27 14:13:07.358835 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:07.358819 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-jkkbk" May 27 14:13:07.364333 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:07.364307 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" May 27 14:13:07.364477 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:07.364369 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-sm62j\"" May 27 14:13:07.373092 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:07.373065 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-jkkbk"] May 27 14:13:07.451154 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:07.451118 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-jkkbk"] May 27 14:13:07.452934 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:07.452911 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a3182f3e-3c12-49a0-82ef-c5bae3b35661-config-file\") pod \"limitador-limitador-7d549b5b-jkkbk\" (UID: \"a3182f3e-3c12-49a0-82ef-c5bae3b35661\") " pod="kuadrant-system/limitador-limitador-7d549b5b-jkkbk" May 27 14:13:07.453001 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:07.452966 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xm6d5\" (UniqueName: \"kubernetes.io/projected/a3182f3e-3c12-49a0-82ef-c5bae3b35661-kube-api-access-xm6d5\") pod \"limitador-limitador-7d549b5b-jkkbk\" (UID: \"a3182f3e-3c12-49a0-82ef-c5bae3b35661\") " pod="kuadrant-system/limitador-limitador-7d549b5b-jkkbk" May 27 14:13:07.554349 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:07.554309 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xm6d5\" (UniqueName: \"kubernetes.io/projected/a3182f3e-3c12-49a0-82ef-c5bae3b35661-kube-api-access-xm6d5\") pod \"limitador-limitador-7d549b5b-jkkbk\" (UID: \"a3182f3e-3c12-49a0-82ef-c5bae3b35661\") " pod="kuadrant-system/limitador-limitador-7d549b5b-jkkbk" May 27 14:13:07.554517 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:07.554410 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a3182f3e-3c12-49a0-82ef-c5bae3b35661-config-file\") pod \"limitador-limitador-7d549b5b-jkkbk\" (UID: \"a3182f3e-3c12-49a0-82ef-c5bae3b35661\") " pod="kuadrant-system/limitador-limitador-7d549b5b-jkkbk" May 27 14:13:07.555112 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:07.555088 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a3182f3e-3c12-49a0-82ef-c5bae3b35661-config-file\") pod \"limitador-limitador-7d549b5b-jkkbk\" (UID: \"a3182f3e-3c12-49a0-82ef-c5bae3b35661\") " pod="kuadrant-system/limitador-limitador-7d549b5b-jkkbk" May 27 14:13:07.563759 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:07.563725 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xm6d5\" (UniqueName: \"kubernetes.io/projected/a3182f3e-3c12-49a0-82ef-c5bae3b35661-kube-api-access-xm6d5\") pod \"limitador-limitador-7d549b5b-jkkbk\" (UID: \"a3182f3e-3c12-49a0-82ef-c5bae3b35661\") " pod="kuadrant-system/limitador-limitador-7d549b5b-jkkbk" May 27 14:13:07.669190 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:07.669088 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-jkkbk" May 27 14:13:07.827410 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:07.827384 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-jkkbk"] May 27 14:13:07.829555 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:13:07.829529 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3182f3e_3c12_49a0_82ef_c5bae3b35661.slice/crio-580026bd62a578122e2b38682b44359e4ecf9fa14345f3dbf5a3df2217c77290 WatchSource:0}: Error finding container 580026bd62a578122e2b38682b44359e4ecf9fa14345f3dbf5a3df2217c77290: Status 404 returned error can't find the container with id 580026bd62a578122e2b38682b44359e4ecf9fa14345f3dbf5a3df2217c77290 May 27 14:13:07.903973 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:07.903934 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-mf86t"] May 27 14:13:07.906867 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:07.906841 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-mf86t" May 27 14:13:07.910010 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:07.909985 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-ctqt8\"" May 27 14:13:07.920403 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:07.920338 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-mf86t"] May 27 14:13:07.958292 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:07.958256 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlz59\" (UniqueName: \"kubernetes.io/projected/c8f2381c-0859-48b4-a2df-711b29a767bc-kube-api-access-dlz59\") pod \"authorino-f99f4b5cd-mf86t\" (UID: \"c8f2381c-0859-48b4-a2df-711b29a767bc\") " pod="kuadrant-system/authorino-f99f4b5cd-mf86t" May 27 14:13:08.059142 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:08.059098 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dlz59\" (UniqueName: \"kubernetes.io/projected/c8f2381c-0859-48b4-a2df-711b29a767bc-kube-api-access-dlz59\") pod \"authorino-f99f4b5cd-mf86t\" (UID: \"c8f2381c-0859-48b4-a2df-711b29a767bc\") " pod="kuadrant-system/authorino-f99f4b5cd-mf86t" May 27 14:13:08.068834 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:08.068802 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlz59\" (UniqueName: \"kubernetes.io/projected/c8f2381c-0859-48b4-a2df-711b29a767bc-kube-api-access-dlz59\") pod \"authorino-f99f4b5cd-mf86t\" (UID: \"c8f2381c-0859-48b4-a2df-711b29a767bc\") " pod="kuadrant-system/authorino-f99f4b5cd-mf86t" May 27 14:13:08.162206 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:08.162171 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-jkkbk" event={"ID":"a3182f3e-3c12-49a0-82ef-c5bae3b35661","Type":"ContainerStarted","Data":"580026bd62a578122e2b38682b44359e4ecf9fa14345f3dbf5a3df2217c77290"} May 27 14:13:08.216505 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:08.216412 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-mf86t" May 27 14:13:08.359316 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:08.359276 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-mf86t"] May 27 14:13:08.362554 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:13:08.362522 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc8f2381c_0859_48b4_a2df_711b29a767bc.slice/crio-61d9bb36010f9da96eedad6cc56c72be9455c4297e8ffd960a665204903c4735 WatchSource:0}: Error finding container 61d9bb36010f9da96eedad6cc56c72be9455c4297e8ffd960a665204903c4735: Status 404 returned error can't find the container with id 61d9bb36010f9da96eedad6cc56c72be9455c4297e8ffd960a665204903c4735 May 27 14:13:09.167531 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:09.167492 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-mf86t" event={"ID":"c8f2381c-0859-48b4-a2df-711b29a767bc","Type":"ContainerStarted","Data":"61d9bb36010f9da96eedad6cc56c72be9455c4297e8ffd960a665204903c4735"} May 27 14:13:12.012205 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:12.012162 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-mf86t"] May 27 14:13:13.184090 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:13.184048 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-jkkbk" event={"ID":"a3182f3e-3c12-49a0-82ef-c5bae3b35661","Type":"ContainerStarted","Data":"f92c15e3d077e26a5f0bacfb884b1735064446c9717108ac0ea50730e01e8cf3"} May 27 14:13:13.184566 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:13.184176 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-jkkbk" May 27 14:13:13.185440 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:13.185416 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-mf86t" event={"ID":"c8f2381c-0859-48b4-a2df-711b29a767bc","Type":"ContainerStarted","Data":"a66a8b693c303450d1bce82959d8aefe8e23fe331d003b4c10d85a9cacf00b3c"} May 27 14:13:13.185508 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:13.185472 2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-f99f4b5cd-mf86t" podUID="c8f2381c-0859-48b4-a2df-711b29a767bc" containerName="authorino" containerID="cri-o://a66a8b693c303450d1bce82959d8aefe8e23fe331d003b4c10d85a9cacf00b3c" gracePeriod=30 May 27 14:13:13.202706 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:13.202661 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-jkkbk" podStartSLOduration=1.632446045 podStartE2EDuration="6.202646294s" podCreationTimestamp="2026-05-27 14:13:07 +0000 UTC" firstStartedPulling="2026-05-27 14:13:07.831331949 +0000 UTC m=+472.931648892" lastFinishedPulling="2026-05-27 14:13:12.401532197 +0000 UTC m=+477.501849141" observedRunningTime="2026-05-27 14:13:13.200926734 +0000 UTC m=+478.301243692" watchObservedRunningTime="2026-05-27 14:13:13.202646294 +0000 UTC m=+478.302963260" May 27 14:13:13.216013 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:13.215967 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-f99f4b5cd-mf86t" podStartSLOduration=2.167783301 podStartE2EDuration="6.215951615s" podCreationTimestamp="2026-05-27 14:13:07 +0000 UTC" firstStartedPulling="2026-05-27 14:13:08.364085817 +0000 UTC m=+473.464402768" lastFinishedPulling="2026-05-27 14:13:12.412254137 +0000 UTC m=+477.512571082" observedRunningTime="2026-05-27 14:13:13.215633896 +0000 UTC m=+478.315950861" watchObservedRunningTime="2026-05-27 14:13:13.215951615 +0000 UTC m=+478.316268582" May 27 14:13:13.433363 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:13.433335 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-mf86t" May 27 14:13:13.509711 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:13.509675 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dlz59\" (UniqueName: \"kubernetes.io/projected/c8f2381c-0859-48b4-a2df-711b29a767bc-kube-api-access-dlz59\") pod \"c8f2381c-0859-48b4-a2df-711b29a767bc\" (UID: \"c8f2381c-0859-48b4-a2df-711b29a767bc\") " May 27 14:13:13.511800 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:13.511765 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8f2381c-0859-48b4-a2df-711b29a767bc-kube-api-access-dlz59" (OuterVolumeSpecName: "kube-api-access-dlz59") pod "c8f2381c-0859-48b4-a2df-711b29a767bc" (UID: "c8f2381c-0859-48b4-a2df-711b29a767bc"). InnerVolumeSpecName "kube-api-access-dlz59". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 14:13:13.611400 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:13.611364 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dlz59\" (UniqueName: \"kubernetes.io/projected/c8f2381c-0859-48b4-a2df-711b29a767bc-kube-api-access-dlz59\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" May 27 14:13:14.190310 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:14.190274 2563 generic.go:358] "Generic (PLEG): container finished" podID="c8f2381c-0859-48b4-a2df-711b29a767bc" containerID="a66a8b693c303450d1bce82959d8aefe8e23fe331d003b4c10d85a9cacf00b3c" exitCode=0 May 27 14:13:14.190810 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:14.190324 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-mf86t" May 27 14:13:14.190810 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:14.190362 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-mf86t" event={"ID":"c8f2381c-0859-48b4-a2df-711b29a767bc","Type":"ContainerDied","Data":"a66a8b693c303450d1bce82959d8aefe8e23fe331d003b4c10d85a9cacf00b3c"} May 27 14:13:14.190810 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:14.190407 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-mf86t" event={"ID":"c8f2381c-0859-48b4-a2df-711b29a767bc","Type":"ContainerDied","Data":"61d9bb36010f9da96eedad6cc56c72be9455c4297e8ffd960a665204903c4735"} May 27 14:13:14.190810 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:14.190430 2563 scope.go:117] "RemoveContainer" containerID="a66a8b693c303450d1bce82959d8aefe8e23fe331d003b4c10d85a9cacf00b3c" May 27 14:13:14.198600 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:14.198583 2563 scope.go:117] "RemoveContainer" containerID="a66a8b693c303450d1bce82959d8aefe8e23fe331d003b4c10d85a9cacf00b3c" May 27 14:13:14.198858 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:13:14.198836 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a66a8b693c303450d1bce82959d8aefe8e23fe331d003b4c10d85a9cacf00b3c\": container with ID starting with a66a8b693c303450d1bce82959d8aefe8e23fe331d003b4c10d85a9cacf00b3c not found: ID does not exist" containerID="a66a8b693c303450d1bce82959d8aefe8e23fe331d003b4c10d85a9cacf00b3c" May 27 14:13:14.198928 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:14.198871 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a66a8b693c303450d1bce82959d8aefe8e23fe331d003b4c10d85a9cacf00b3c"} err="failed to get container status \"a66a8b693c303450d1bce82959d8aefe8e23fe331d003b4c10d85a9cacf00b3c\": rpc error: code = NotFound desc = could not find container \"a66a8b693c303450d1bce82959d8aefe8e23fe331d003b4c10d85a9cacf00b3c\": container with ID starting with a66a8b693c303450d1bce82959d8aefe8e23fe331d003b4c10d85a9cacf00b3c not found: ID does not exist" May 27 14:13:14.208234 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:14.208208 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-mf86t"] May 27 14:13:14.212535 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:14.212511 2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-mf86t"] May 27 14:13:15.542292 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:15.542260 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8f2381c-0859-48b4-a2df-711b29a767bc" path="/var/lib/kubelet/pods/c8f2381c-0859-48b4-a2df-711b29a767bc/volumes" May 27 14:13:22.639623 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:22.639586 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-jkkbk"] May 27 14:13:22.640045 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:22.639852 2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-jkkbk" podUID="a3182f3e-3c12-49a0-82ef-c5bae3b35661" containerName="limitador" containerID="cri-o://f92c15e3d077e26a5f0bacfb884b1735064446c9717108ac0ea50730e01e8cf3" gracePeriod=30 May 27 14:13:22.640638 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:22.640617 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-jkkbk" May 27 14:13:23.183703 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:23.183680 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-jkkbk" May 27 14:13:23.219661 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:23.219588 2563 generic.go:358] "Generic (PLEG): container finished" podID="a3182f3e-3c12-49a0-82ef-c5bae3b35661" containerID="f92c15e3d077e26a5f0bacfb884b1735064446c9717108ac0ea50730e01e8cf3" exitCode=0 May 27 14:13:23.219661 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:23.219650 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-jkkbk" event={"ID":"a3182f3e-3c12-49a0-82ef-c5bae3b35661","Type":"ContainerDied","Data":"f92c15e3d077e26a5f0bacfb884b1735064446c9717108ac0ea50730e01e8cf3"} May 27 14:13:23.219661 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:23.219654 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-jkkbk" May 27 14:13:23.219906 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:23.219674 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-jkkbk" event={"ID":"a3182f3e-3c12-49a0-82ef-c5bae3b35661","Type":"ContainerDied","Data":"580026bd62a578122e2b38682b44359e4ecf9fa14345f3dbf5a3df2217c77290"} May 27 14:13:23.219906 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:23.219691 2563 scope.go:117] "RemoveContainer" containerID="f92c15e3d077e26a5f0bacfb884b1735064446c9717108ac0ea50730e01e8cf3" May 27 14:13:23.229058 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:23.229037 2563 scope.go:117] "RemoveContainer" containerID="f92c15e3d077e26a5f0bacfb884b1735064446c9717108ac0ea50730e01e8cf3" May 27 14:13:23.229332 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:13:23.229313 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f92c15e3d077e26a5f0bacfb884b1735064446c9717108ac0ea50730e01e8cf3\": container with ID starting with f92c15e3d077e26a5f0bacfb884b1735064446c9717108ac0ea50730e01e8cf3 not found: ID does not exist" containerID="f92c15e3d077e26a5f0bacfb884b1735064446c9717108ac0ea50730e01e8cf3" May 27 14:13:23.229404 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:23.229344 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f92c15e3d077e26a5f0bacfb884b1735064446c9717108ac0ea50730e01e8cf3"} err="failed to get container status \"f92c15e3d077e26a5f0bacfb884b1735064446c9717108ac0ea50730e01e8cf3\": rpc error: code = NotFound desc = could not find container \"f92c15e3d077e26a5f0bacfb884b1735064446c9717108ac0ea50730e01e8cf3\": container with ID starting with f92c15e3d077e26a5f0bacfb884b1735064446c9717108ac0ea50730e01e8cf3 not found: ID does not exist" May 27 14:13:23.290180 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:23.290159 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xm6d5\" (UniqueName: \"kubernetes.io/projected/a3182f3e-3c12-49a0-82ef-c5bae3b35661-kube-api-access-xm6d5\") pod \"a3182f3e-3c12-49a0-82ef-c5bae3b35661\" (UID: \"a3182f3e-3c12-49a0-82ef-c5bae3b35661\") " May 27 14:13:23.290274 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:23.290190 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a3182f3e-3c12-49a0-82ef-c5bae3b35661-config-file\") pod \"a3182f3e-3c12-49a0-82ef-c5bae3b35661\" (UID: \"a3182f3e-3c12-49a0-82ef-c5bae3b35661\") " May 27 14:13:23.290557 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:23.290535 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3182f3e-3c12-49a0-82ef-c5bae3b35661-config-file" (OuterVolumeSpecName: "config-file") pod "a3182f3e-3c12-49a0-82ef-c5bae3b35661" (UID: "a3182f3e-3c12-49a0-82ef-c5bae3b35661"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 14:13:23.292156 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:23.292134 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3182f3e-3c12-49a0-82ef-c5bae3b35661-kube-api-access-xm6d5" (OuterVolumeSpecName: "kube-api-access-xm6d5") pod "a3182f3e-3c12-49a0-82ef-c5bae3b35661" (UID: "a3182f3e-3c12-49a0-82ef-c5bae3b35661"). InnerVolumeSpecName "kube-api-access-xm6d5". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 14:13:23.391001 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:23.390960 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xm6d5\" (UniqueName: \"kubernetes.io/projected/a3182f3e-3c12-49a0-82ef-c5bae3b35661-kube-api-access-xm6d5\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" May 27 14:13:23.391001 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:23.391001 2563 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a3182f3e-3c12-49a0-82ef-c5bae3b35661-config-file\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" May 27 14:13:23.544321 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:23.544292 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-jkkbk"] May 27 14:13:23.548692 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:23.548669 2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-jkkbk"] May 27 14:13:25.546765 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:25.546728 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3182f3e-3c12-49a0-82ef-c5bae3b35661" path="/var/lib/kubelet/pods/a3182f3e-3c12-49a0-82ef-c5bae3b35661/volumes" May 27 14:13:27.983553 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:27.983513 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-68c4fbbd6f-rnx44"] May 27 14:13:27.984093 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:27.983810 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8f2381c-0859-48b4-a2df-711b29a767bc" containerName="authorino" May 27 14:13:27.984093 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:27.983824 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8f2381c-0859-48b4-a2df-711b29a767bc" containerName="authorino" May 27 14:13:27.984093 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:27.983847 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3182f3e-3c12-49a0-82ef-c5bae3b35661" containerName="limitador" May 27 14:13:27.984093 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:27.983856 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3182f3e-3c12-49a0-82ef-c5bae3b35661" containerName="limitador" May 27 14:13:27.984093 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:27.984027 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="a3182f3e-3c12-49a0-82ef-c5bae3b35661" containerName="limitador" May 27 14:13:27.984093 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:27.984043 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="c8f2381c-0859-48b4-a2df-711b29a767bc" containerName="authorino" May 27 14:13:27.988617 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:27.988600 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-rnx44" May 27 14:13:27.992076 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:27.992054 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" May 27 14:13:27.992201 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:27.992056 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-fv4gf\"" May 27 14:13:27.997868 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:27.997842 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-rnx44"] May 27 14:13:28.136918 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:28.136868 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/d9166b2f-cdf9-4196-b89e-057a82c1a3c6-data\") pod \"postgres-68c4fbbd6f-rnx44\" (UID: \"d9166b2f-cdf9-4196-b89e-057a82c1a3c6\") " pod="opendatahub/postgres-68c4fbbd6f-rnx44" May 27 14:13:28.137086 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:28.136944 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghxqb\" (UniqueName: \"kubernetes.io/projected/d9166b2f-cdf9-4196-b89e-057a82c1a3c6-kube-api-access-ghxqb\") pod \"postgres-68c4fbbd6f-rnx44\" (UID: \"d9166b2f-cdf9-4196-b89e-057a82c1a3c6\") " pod="opendatahub/postgres-68c4fbbd6f-rnx44" May 27 14:13:28.238436 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:28.238358 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/d9166b2f-cdf9-4196-b89e-057a82c1a3c6-data\") pod \"postgres-68c4fbbd6f-rnx44\" (UID: \"d9166b2f-cdf9-4196-b89e-057a82c1a3c6\") " pod="opendatahub/postgres-68c4fbbd6f-rnx44" May 27 14:13:28.238436 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:28.238398 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ghxqb\" (UniqueName: \"kubernetes.io/projected/d9166b2f-cdf9-4196-b89e-057a82c1a3c6-kube-api-access-ghxqb\") pod \"postgres-68c4fbbd6f-rnx44\" (UID: \"d9166b2f-cdf9-4196-b89e-057a82c1a3c6\") " pod="opendatahub/postgres-68c4fbbd6f-rnx44" May 27 14:13:28.238764 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:28.238742 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/d9166b2f-cdf9-4196-b89e-057a82c1a3c6-data\") pod \"postgres-68c4fbbd6f-rnx44\" (UID: \"d9166b2f-cdf9-4196-b89e-057a82c1a3c6\") " pod="opendatahub/postgres-68c4fbbd6f-rnx44" May 27 14:13:28.247241 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:28.247211 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghxqb\" (UniqueName: \"kubernetes.io/projected/d9166b2f-cdf9-4196-b89e-057a82c1a3c6-kube-api-access-ghxqb\") pod \"postgres-68c4fbbd6f-rnx44\" (UID: \"d9166b2f-cdf9-4196-b89e-057a82c1a3c6\") " pod="opendatahub/postgres-68c4fbbd6f-rnx44" May 27 14:13:28.300136 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:28.300104 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-rnx44" May 27 14:13:28.429538 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:28.429469 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-rnx44"] May 27 14:13:28.431762 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:13:28.431735 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9166b2f_cdf9_4196_b89e_057a82c1a3c6.slice/crio-72f14708e1170f0e71b0835e55c8c0d13ca8ead9f5e74746dcba8afdf2930d40 WatchSource:0}: Error finding container 72f14708e1170f0e71b0835e55c8c0d13ca8ead9f5e74746dcba8afdf2930d40: Status 404 returned error can't find the container with id 72f14708e1170f0e71b0835e55c8c0d13ca8ead9f5e74746dcba8afdf2930d40 May 27 14:13:29.240340 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:29.240305 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-rnx44" event={"ID":"d9166b2f-cdf9-4196-b89e-057a82c1a3c6","Type":"ContainerStarted","Data":"72f14708e1170f0e71b0835e55c8c0d13ca8ead9f5e74746dcba8afdf2930d40"} May 27 14:13:34.262438 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:34.262401 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-rnx44" event={"ID":"d9166b2f-cdf9-4196-b89e-057a82c1a3c6","Type":"ContainerStarted","Data":"efe6a0704dc0838fcf0775650ad7843ff4105034c0eabd56d73691c046613d50"} May 27 14:13:34.262817 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:34.262526 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-68c4fbbd6f-rnx44" May 27 14:13:34.278874 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:34.278819 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/postgres-68c4fbbd6f-rnx44" podStartSLOduration=1.899363973 podStartE2EDuration="7.27880392s" podCreationTimestamp="2026-05-27 14:13:27 +0000 UTC" firstStartedPulling="2026-05-27 14:13:28.432965698 +0000 UTC m=+493.533282642" lastFinishedPulling="2026-05-27 14:13:33.812405641 +0000 UTC m=+498.912722589" observedRunningTime="2026-05-27 14:13:34.27782095 +0000 UTC m=+499.378137917" watchObservedRunningTime="2026-05-27 14:13:34.27880392 +0000 UTC m=+499.379120922" May 27 14:13:40.293505 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:40.293473 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-68c4fbbd6f-rnx44" May 27 14:13:40.826365 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:40.826329 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8b475cf9f-8wz8g"] May 27 14:13:40.829613 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:40.829597 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-8wz8g" May 27 14:13:40.832333 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:40.832311 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-ctqt8\"" May 27 14:13:40.835972 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:40.835947 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-8wz8g"] May 27 14:13:40.947552 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:40.947519 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ht8n5\" (UniqueName: \"kubernetes.io/projected/28275d59-dd58-4c45-9f83-8a70b7ecf4a9-kube-api-access-ht8n5\") pod \"authorino-8b475cf9f-8wz8g\" (UID: \"28275d59-dd58-4c45-9f83-8a70b7ecf4a9\") " pod="kuadrant-system/authorino-8b475cf9f-8wz8g" May 27 14:13:41.029284 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:41.029246 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-8wz8g"] May 27 14:13:41.029493 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:13:41.029474 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-ht8n5], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-8b475cf9f-8wz8g" podUID="28275d59-dd58-4c45-9f83-8a70b7ecf4a9" May 27 14:13:41.047935 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:41.047884 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ht8n5\" (UniqueName: \"kubernetes.io/projected/28275d59-dd58-4c45-9f83-8a70b7ecf4a9-kube-api-access-ht8n5\") pod \"authorino-8b475cf9f-8wz8g\" (UID: \"28275d59-dd58-4c45-9f83-8a70b7ecf4a9\") " pod="kuadrant-system/authorino-8b475cf9f-8wz8g" May 27 14:13:41.057811 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:41.057747 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6b64849f44-h84fx"] May 27 14:13:41.061095 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:41.061067 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6b64849f44-h84fx" May 27 14:13:41.061465 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:41.061442 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ht8n5\" (UniqueName: \"kubernetes.io/projected/28275d59-dd58-4c45-9f83-8a70b7ecf4a9-kube-api-access-ht8n5\") pod \"authorino-8b475cf9f-8wz8g\" (UID: \"28275d59-dd58-4c45-9f83-8a70b7ecf4a9\") " pod="kuadrant-system/authorino-8b475cf9f-8wz8g" May 27 14:13:41.063785 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:41.063766 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" May 27 14:13:41.071917 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:41.071874 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6b64849f44-h84fx"] May 27 14:13:41.149197 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:41.149134 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxm5n\" (UniqueName: \"kubernetes.io/projected/c4735d38-b77c-4864-9e9d-fd8ea5fe302e-kube-api-access-qxm5n\") pod \"authorino-6b64849f44-h84fx\" (UID: \"c4735d38-b77c-4864-9e9d-fd8ea5fe302e\") " pod="kuadrant-system/authorino-6b64849f44-h84fx" May 27 14:13:41.149197 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:41.149168 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c4735d38-b77c-4864-9e9d-fd8ea5fe302e-tls-cert\") pod \"authorino-6b64849f44-h84fx\" (UID: \"c4735d38-b77c-4864-9e9d-fd8ea5fe302e\") " pod="kuadrant-system/authorino-6b64849f44-h84fx" May 27 14:13:41.249911 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:41.249866 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qxm5n\" (UniqueName: \"kubernetes.io/projected/c4735d38-b77c-4864-9e9d-fd8ea5fe302e-kube-api-access-qxm5n\") pod \"authorino-6b64849f44-h84fx\" (UID: \"c4735d38-b77c-4864-9e9d-fd8ea5fe302e\") " pod="kuadrant-system/authorino-6b64849f44-h84fx" May 27 14:13:41.250061 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:41.249933 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c4735d38-b77c-4864-9e9d-fd8ea5fe302e-tls-cert\") pod \"authorino-6b64849f44-h84fx\" (UID: \"c4735d38-b77c-4864-9e9d-fd8ea5fe302e\") " pod="kuadrant-system/authorino-6b64849f44-h84fx" May 27 14:13:41.252384 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:41.252359 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c4735d38-b77c-4864-9e9d-fd8ea5fe302e-tls-cert\") pod \"authorino-6b64849f44-h84fx\" (UID: \"c4735d38-b77c-4864-9e9d-fd8ea5fe302e\") " pod="kuadrant-system/authorino-6b64849f44-h84fx" May 27 14:13:41.259038 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:41.259015 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxm5n\" (UniqueName: \"kubernetes.io/projected/c4735d38-b77c-4864-9e9d-fd8ea5fe302e-kube-api-access-qxm5n\") pod \"authorino-6b64849f44-h84fx\" (UID: \"c4735d38-b77c-4864-9e9d-fd8ea5fe302e\") " pod="kuadrant-system/authorino-6b64849f44-h84fx" May 27 14:13:41.286504 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:41.286479 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-8wz8g" May 27 14:13:41.291225 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:41.291205 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-8wz8g" May 27 14:13:41.377816 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:41.377784 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6b64849f44-h84fx" May 27 14:13:41.451496 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:41.451470 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ht8n5\" (UniqueName: \"kubernetes.io/projected/28275d59-dd58-4c45-9f83-8a70b7ecf4a9-kube-api-access-ht8n5\") pod \"28275d59-dd58-4c45-9f83-8a70b7ecf4a9\" (UID: \"28275d59-dd58-4c45-9f83-8a70b7ecf4a9\") " May 27 14:13:41.453446 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:41.453418 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28275d59-dd58-4c45-9f83-8a70b7ecf4a9-kube-api-access-ht8n5" (OuterVolumeSpecName: "kube-api-access-ht8n5") pod "28275d59-dd58-4c45-9f83-8a70b7ecf4a9" (UID: "28275d59-dd58-4c45-9f83-8a70b7ecf4a9"). InnerVolumeSpecName "kube-api-access-ht8n5". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 14:13:41.504329 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:41.504279 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6b64849f44-h84fx"] May 27 14:13:41.506829 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:13:41.506800 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc4735d38_b77c_4864_9e9d_fd8ea5fe302e.slice/crio-1633c5365ca76e39e1947cb1ac533eb3643fab377e6819f8fdea5e80e33179a5 WatchSource:0}: Error finding container 1633c5365ca76e39e1947cb1ac533eb3643fab377e6819f8fdea5e80e33179a5: Status 404 returned error can't find the container with id 1633c5365ca76e39e1947cb1ac533eb3643fab377e6819f8fdea5e80e33179a5 May 27 14:13:41.552227 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:41.552196 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ht8n5\" (UniqueName: \"kubernetes.io/projected/28275d59-dd58-4c45-9f83-8a70b7ecf4a9-kube-api-access-ht8n5\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" May 27 14:13:42.291449 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:42.291407 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6b64849f44-h84fx" event={"ID":"c4735d38-b77c-4864-9e9d-fd8ea5fe302e","Type":"ContainerStarted","Data":"0aa38b9e60e3b180114399064409e1e69e63f4030b50bed55f155f3cce282a12"} May 27 14:13:42.291449 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:42.291454 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6b64849f44-h84fx" event={"ID":"c4735d38-b77c-4864-9e9d-fd8ea5fe302e","Type":"ContainerStarted","Data":"1633c5365ca76e39e1947cb1ac533eb3643fab377e6819f8fdea5e80e33179a5"} May 27 14:13:42.291654 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:42.291424 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-8wz8g" May 27 14:13:42.307209 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:42.307158 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-6b64849f44-h84fx" podStartSLOduration=0.936846167 podStartE2EDuration="1.307144277s" podCreationTimestamp="2026-05-27 14:13:41 +0000 UTC" firstStartedPulling="2026-05-27 14:13:41.507956464 +0000 UTC m=+506.608273408" lastFinishedPulling="2026-05-27 14:13:41.878254573 +0000 UTC m=+506.978571518" observedRunningTime="2026-05-27 14:13:42.3062762 +0000 UTC m=+507.406593179" watchObservedRunningTime="2026-05-27 14:13:42.307144277 +0000 UTC m=+507.407461240" May 27 14:13:42.329786 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:42.329752 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-8wz8g"] May 27 14:13:42.336936 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:42.336880 2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-8wz8g"] May 27 14:13:43.543182 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:43.543150 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28275d59-dd58-4c45-9f83-8a70b7ecf4a9" path="/var/lib/kubelet/pods/28275d59-dd58-4c45-9f83-8a70b7ecf4a9/volumes" May 27 14:13:46.660802 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:46.660769 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-67598ddd74-kgxfk"] May 27 14:13:46.664388 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:46.664371 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-67598ddd74-kgxfk" May 27 14:13:46.667080 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:46.667057 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-vcm7m\"" May 27 14:13:46.667184 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:46.667060 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" May 27 14:13:46.675222 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:46.675197 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-67598ddd74-kgxfk"] May 27 14:13:46.796430 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:46.796393 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7mdd\" (UniqueName: \"kubernetes.io/projected/41d636d9-e57f-472c-99f2-9e51e3e4fe1c-kube-api-access-v7mdd\") pod \"maas-controller-67598ddd74-kgxfk\" (UID: \"41d636d9-e57f-472c-99f2-9e51e3e4fe1c\") " pod="opendatahub/maas-controller-67598ddd74-kgxfk" May 27 14:13:46.897249 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:46.897215 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v7mdd\" (UniqueName: \"kubernetes.io/projected/41d636d9-e57f-472c-99f2-9e51e3e4fe1c-kube-api-access-v7mdd\") pod \"maas-controller-67598ddd74-kgxfk\" (UID: \"41d636d9-e57f-472c-99f2-9e51e3e4fe1c\") " pod="opendatahub/maas-controller-67598ddd74-kgxfk" May 27 14:13:46.906458 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:46.906426 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7mdd\" (UniqueName: \"kubernetes.io/projected/41d636d9-e57f-472c-99f2-9e51e3e4fe1c-kube-api-access-v7mdd\") pod \"maas-controller-67598ddd74-kgxfk\" (UID: \"41d636d9-e57f-472c-99f2-9e51e3e4fe1c\") " pod="opendatahub/maas-controller-67598ddd74-kgxfk" May 27 14:13:46.975181 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:46.975106 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-67598ddd74-kgxfk" May 27 14:13:47.104406 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:47.104381 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-67598ddd74-kgxfk"] May 27 14:13:47.107099 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:13:47.107074 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41d636d9_e57f_472c_99f2_9e51e3e4fe1c.slice/crio-c1af477884cd3f5eb044a362535e5c681d2291852eae15dad647d6b0f95a9490 WatchSource:0}: Error finding container c1af477884cd3f5eb044a362535e5c681d2291852eae15dad647d6b0f95a9490: Status 404 returned error can't find the container with id c1af477884cd3f5eb044a362535e5c681d2291852eae15dad647d6b0f95a9490 May 27 14:13:47.310335 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:47.310300 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-67598ddd74-kgxfk" event={"ID":"41d636d9-e57f-472c-99f2-9e51e3e4fe1c","Type":"ContainerStarted","Data":"c1af477884cd3f5eb044a362535e5c681d2291852eae15dad647d6b0f95a9490"} May 27 14:13:50.320756 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:50.320721 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-67598ddd74-kgxfk" event={"ID":"41d636d9-e57f-472c-99f2-9e51e3e4fe1c","Type":"ContainerStarted","Data":"ae78d21ec0e140ad536d50041554349f797a5d0b4e3cbdd86aefffd2fab6ccef"} May 27 14:13:50.321160 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:50.320881 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-67598ddd74-kgxfk" May 27 14:13:50.336944 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:13:50.336880 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-67598ddd74-kgxfk" podStartSLOduration=2.11935513 podStartE2EDuration="4.336867094s" podCreationTimestamp="2026-05-27 14:13:46 +0000 UTC" firstStartedPulling="2026-05-27 14:13:47.108774929 +0000 UTC m=+512.209091874" lastFinishedPulling="2026-05-27 14:13:49.326286893 +0000 UTC m=+514.426603838" observedRunningTime="2026-05-27 14:13:50.336250673 +0000 UTC m=+515.436567642" watchObservedRunningTime="2026-05-27 14:13:50.336867094 +0000 UTC m=+515.437184059" May 27 14:14:01.330989 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:14:01.330954 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-67598ddd74-kgxfk" May 27 14:14:22.061517 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:14:22.061428 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-rdlhc"] May 27 14:14:22.066942 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:14:22.066920 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-rdlhc" May 27 14:14:22.070064 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:14:22.070046 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-9lpx4\"" May 27 14:14:22.070151 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:14:22.070048 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" May 27 14:14:22.077766 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:14:22.077744 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-rdlhc"] May 27 14:14:22.190725 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:14:22.190692 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvsk5\" (UniqueName: \"kubernetes.io/projected/8c25e3ac-d782-48de-87fc-6bb3aa254708-kube-api-access-lvsk5\") pod \"payload-processing-58b6c8fdc7-rdlhc\" (UID: \"8c25e3ac-d782-48de-87fc-6bb3aa254708\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-rdlhc" May 27 14:14:22.291330 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:14:22.291298 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lvsk5\" (UniqueName: \"kubernetes.io/projected/8c25e3ac-d782-48de-87fc-6bb3aa254708-kube-api-access-lvsk5\") pod \"payload-processing-58b6c8fdc7-rdlhc\" (UID: \"8c25e3ac-d782-48de-87fc-6bb3aa254708\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-rdlhc" May 27 14:14:22.299928 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:14:22.299882 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvsk5\" (UniqueName: \"kubernetes.io/projected/8c25e3ac-d782-48de-87fc-6bb3aa254708-kube-api-access-lvsk5\") pod \"payload-processing-58b6c8fdc7-rdlhc\" (UID: \"8c25e3ac-d782-48de-87fc-6bb3aa254708\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-rdlhc" May 27 14:14:22.378007 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:14:22.377931 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-rdlhc" May 27 14:14:22.515798 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:14:22.515776 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-rdlhc"] May 27 14:14:22.518336 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:14:22.518305 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c25e3ac_d782_48de_87fc_6bb3aa254708.slice/crio-067a6af4ec7e811e1293e7a925e29519e68ed070936bf1b2e8d9cd7bea8bbf41 WatchSource:0}: Error finding container 067a6af4ec7e811e1293e7a925e29519e68ed070936bf1b2e8d9cd7bea8bbf41: Status 404 returned error can't find the container with id 067a6af4ec7e811e1293e7a925e29519e68ed070936bf1b2e8d9cd7bea8bbf41 May 27 14:14:23.431253 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:14:23.431216 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-rdlhc" event={"ID":"8c25e3ac-d782-48de-87fc-6bb3aa254708","Type":"ContainerStarted","Data":"067a6af4ec7e811e1293e7a925e29519e68ed070936bf1b2e8d9cd7bea8bbf41"} May 27 14:14:26.444780 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:14:26.444738 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-rdlhc" event={"ID":"8c25e3ac-d782-48de-87fc-6bb3aa254708","Type":"ContainerStarted","Data":"825fbc7f521383919c2f53b1c20a9de6d0ecedbd7282bd2a1f9d661dfd9d820d"} May 27 14:14:26.445235 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:14:26.444828 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-rdlhc" May 27 14:14:26.463961 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:14:26.463912 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58b6c8fdc7-rdlhc" podStartSLOduration=1.4143721 podStartE2EDuration="4.463885776s" podCreationTimestamp="2026-05-27 14:14:22 +0000 UTC" firstStartedPulling="2026-05-27 14:14:22.520040208 +0000 UTC m=+547.620357153" lastFinishedPulling="2026-05-27 14:14:25.569553882 +0000 UTC m=+550.669870829" observedRunningTime="2026-05-27 14:14:26.46151803 +0000 UTC m=+551.561834996" watchObservedRunningTime="2026-05-27 14:14:26.463885776 +0000 UTC m=+551.564202741" May 27 14:14:37.450960 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:14:37.450928 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-rdlhc" May 27 14:15:00.140397 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:00.140354 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29664855-mmdrj"] May 27 14:15:00.148696 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:00.148671 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29664855-mmdrj" May 27 14:15:00.151348 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:00.151312 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29664855-mmdrj"] May 27 14:15:00.151530 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:00.151513 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-87shg\"" May 27 14:15:00.221413 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:00.221371 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpmx7\" (UniqueName: \"kubernetes.io/projected/6b6cea85-5a07-4c39-ab3e-4107f96a2bbc-kube-api-access-xpmx7\") pod \"maas-api-key-cleanup-29664855-mmdrj\" (UID: \"6b6cea85-5a07-4c39-ab3e-4107f96a2bbc\") " pod="opendatahub/maas-api-key-cleanup-29664855-mmdrj" May 27 14:15:00.322513 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:00.322479 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xpmx7\" (UniqueName: \"kubernetes.io/projected/6b6cea85-5a07-4c39-ab3e-4107f96a2bbc-kube-api-access-xpmx7\") pod \"maas-api-key-cleanup-29664855-mmdrj\" (UID: \"6b6cea85-5a07-4c39-ab3e-4107f96a2bbc\") " pod="opendatahub/maas-api-key-cleanup-29664855-mmdrj" May 27 14:15:00.331169 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:00.331140 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpmx7\" (UniqueName: \"kubernetes.io/projected/6b6cea85-5a07-4c39-ab3e-4107f96a2bbc-kube-api-access-xpmx7\") pod \"maas-api-key-cleanup-29664855-mmdrj\" (UID: \"6b6cea85-5a07-4c39-ab3e-4107f96a2bbc\") " pod="opendatahub/maas-api-key-cleanup-29664855-mmdrj" May 27 14:15:00.460374 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:00.460279 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29664855-mmdrj" May 27 14:15:00.602702 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:00.602674 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29664855-mmdrj"] May 27 14:15:00.605372 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:15:00.605343 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b6cea85_5a07_4c39_ab3e_4107f96a2bbc.slice/crio-baffba91bfca506497893babfe2d6625ca79e49adf48e594bcf23e037cbedb3d WatchSource:0}: Error finding container baffba91bfca506497893babfe2d6625ca79e49adf48e594bcf23e037cbedb3d: Status 404 returned error can't find the container with id baffba91bfca506497893babfe2d6625ca79e49adf48e594bcf23e037cbedb3d May 27 14:15:01.566167 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:01.566133 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29664855-mmdrj" event={"ID":"6b6cea85-5a07-4c39-ab3e-4107f96a2bbc","Type":"ContainerStarted","Data":"baffba91bfca506497893babfe2d6625ca79e49adf48e594bcf23e037cbedb3d"} May 27 14:15:04.577774 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:04.577684 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29664855-mmdrj" event={"ID":"6b6cea85-5a07-4c39-ab3e-4107f96a2bbc","Type":"ContainerStarted","Data":"469f462208d42c22df3917e903aa3964f321a72052bb00e0f25e091139f8a39e"} May 27 14:15:04.602741 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:04.602686 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29664855-mmdrj" podStartSLOduration=1.254312276 podStartE2EDuration="4.6026706s" podCreationTimestamp="2026-05-27 14:15:00 +0000 UTC" firstStartedPulling="2026-05-27 14:15:00.60705009 +0000 UTC m=+585.707367035" lastFinishedPulling="2026-05-27 14:15:03.955408415 +0000 UTC m=+589.055725359" observedRunningTime="2026-05-27 14:15:04.600948216 +0000 UTC m=+589.701265181" watchObservedRunningTime="2026-05-27 14:15:04.6026706 +0000 UTC m=+589.702987566" May 27 14:15:05.582641 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:05.582600 2563 generic.go:358] "Generic (PLEG): container finished" podID="6b6cea85-5a07-4c39-ab3e-4107f96a2bbc" containerID="469f462208d42c22df3917e903aa3964f321a72052bb00e0f25e091139f8a39e" exitCode=0 May 27 14:15:05.583111 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:05.582682 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29664855-mmdrj" event={"ID":"6b6cea85-5a07-4c39-ab3e-4107f96a2bbc","Type":"ContainerDied","Data":"469f462208d42c22df3917e903aa3964f321a72052bb00e0f25e091139f8a39e"} May 27 14:15:06.716210 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:06.716186 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29664855-mmdrj" May 27 14:15:06.779401 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:06.779362 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xpmx7\" (UniqueName: \"kubernetes.io/projected/6b6cea85-5a07-4c39-ab3e-4107f96a2bbc-kube-api-access-xpmx7\") pod \"6b6cea85-5a07-4c39-ab3e-4107f96a2bbc\" (UID: \"6b6cea85-5a07-4c39-ab3e-4107f96a2bbc\") " May 27 14:15:06.781577 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:06.781544 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b6cea85-5a07-4c39-ab3e-4107f96a2bbc-kube-api-access-xpmx7" (OuterVolumeSpecName: "kube-api-access-xpmx7") pod "6b6cea85-5a07-4c39-ab3e-4107f96a2bbc" (UID: "6b6cea85-5a07-4c39-ab3e-4107f96a2bbc"). InnerVolumeSpecName "kube-api-access-xpmx7". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 14:15:06.881212 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:06.881122 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xpmx7\" (UniqueName: \"kubernetes.io/projected/6b6cea85-5a07-4c39-ab3e-4107f96a2bbc-kube-api-access-xpmx7\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" May 27 14:15:07.590086 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:07.590048 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29664855-mmdrj" event={"ID":"6b6cea85-5a07-4c39-ab3e-4107f96a2bbc","Type":"ContainerDied","Data":"baffba91bfca506497893babfe2d6625ca79e49adf48e594bcf23e037cbedb3d"} May 27 14:15:07.590086 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:07.590085 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="baffba91bfca506497893babfe2d6625ca79e49adf48e594bcf23e037cbedb3d" May 27 14:15:07.590288 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:07.590095 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29664855-mmdrj" May 27 14:15:15.446137 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:15.446105 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-5g8bd_4589d4df-d2d2-43e2-af93-da49d130d20d/console-operator/1.log" May 27 14:15:15.446650 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:15.446477 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-5g8bd_4589d4df-d2d2-43e2-af93-da49d130d20d/console-operator/1.log" May 27 14:15:15.452833 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:15.452812 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fn9jd_3ebbf10f-4f07-403c-93b2-97261749308d/ovn-acl-logging/0.log" May 27 14:15:15.453106 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:15.453092 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fn9jd_3ebbf10f-4f07-403c-93b2-97261749308d/ovn-acl-logging/0.log" May 27 14:15:17.330040 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:17.330003 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvqwnx"] May 27 14:15:17.330426 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:17.330396 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b6cea85-5a07-4c39-ab3e-4107f96a2bbc" containerName="cleanup" May 27 14:15:17.330426 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:17.330410 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b6cea85-5a07-4c39-ab3e-4107f96a2bbc" containerName="cleanup" May 27 14:15:17.330513 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:17.330468 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="6b6cea85-5a07-4c39-ab3e-4107f96a2bbc" containerName="cleanup" May 27 14:15:17.333522 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:17.333507 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvqwnx" May 27 14:15:17.337568 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:17.337544 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" May 27 14:15:17.337705 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:17.337627 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" May 27 14:15:17.337705 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:17.337627 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" May 27 14:15:17.337803 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:17.337728 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-phs6z\"" May 27 14:15:17.345451 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:17.345423 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvqwnx"] May 27 14:15:17.480873 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:17.480839 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ea36817f-295c-494c-87ad-0d08136112fa-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvqwnx\" (UID: \"ea36817f-295c-494c-87ad-0d08136112fa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvqwnx" May 27 14:15:17.481097 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:17.480879 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ea36817f-295c-494c-87ad-0d08136112fa-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvqwnx\" (UID: \"ea36817f-295c-494c-87ad-0d08136112fa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvqwnx" May 27 14:15:17.481097 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:17.480954 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ea36817f-295c-494c-87ad-0d08136112fa-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvqwnx\" (UID: \"ea36817f-295c-494c-87ad-0d08136112fa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvqwnx" May 27 14:15:17.481217 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:17.481104 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ea36817f-295c-494c-87ad-0d08136112fa-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvqwnx\" (UID: \"ea36817f-295c-494c-87ad-0d08136112fa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvqwnx" May 27 14:15:17.481270 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:17.481218 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jg8sv\" (UniqueName: \"kubernetes.io/projected/ea36817f-295c-494c-87ad-0d08136112fa-kube-api-access-jg8sv\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvqwnx\" (UID: \"ea36817f-295c-494c-87ad-0d08136112fa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvqwnx" May 27 14:15:17.481318 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:17.481268 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ea36817f-295c-494c-87ad-0d08136112fa-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvqwnx\" (UID: \"ea36817f-295c-494c-87ad-0d08136112fa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvqwnx" May 27 14:15:17.582135 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:17.582045 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ea36817f-295c-494c-87ad-0d08136112fa-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvqwnx\" (UID: \"ea36817f-295c-494c-87ad-0d08136112fa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvqwnx" May 27 14:15:17.582305 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:17.582130 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jg8sv\" (UniqueName: \"kubernetes.io/projected/ea36817f-295c-494c-87ad-0d08136112fa-kube-api-access-jg8sv\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvqwnx\" (UID: \"ea36817f-295c-494c-87ad-0d08136112fa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvqwnx" May 27 14:15:17.582305 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:17.582173 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ea36817f-295c-494c-87ad-0d08136112fa-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvqwnx\" (UID: \"ea36817f-295c-494c-87ad-0d08136112fa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvqwnx" May 27 14:15:17.582305 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:17.582203 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ea36817f-295c-494c-87ad-0d08136112fa-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvqwnx\" (UID: \"ea36817f-295c-494c-87ad-0d08136112fa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvqwnx" May 27 14:15:17.582305 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:17.582229 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ea36817f-295c-494c-87ad-0d08136112fa-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvqwnx\" (UID: \"ea36817f-295c-494c-87ad-0d08136112fa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvqwnx" May 27 14:15:17.582305 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:17.582275 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ea36817f-295c-494c-87ad-0d08136112fa-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvqwnx\" (UID: \"ea36817f-295c-494c-87ad-0d08136112fa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvqwnx" May 27 14:15:17.582570 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:17.582466 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ea36817f-295c-494c-87ad-0d08136112fa-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvqwnx\" (UID: \"ea36817f-295c-494c-87ad-0d08136112fa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvqwnx" May 27 14:15:17.582629 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:17.582594 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ea36817f-295c-494c-87ad-0d08136112fa-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvqwnx\" (UID: \"ea36817f-295c-494c-87ad-0d08136112fa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvqwnx" May 27 14:15:17.582683 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:17.582631 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ea36817f-295c-494c-87ad-0d08136112fa-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvqwnx\" (UID: \"ea36817f-295c-494c-87ad-0d08136112fa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvqwnx" May 27 14:15:17.584502 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:17.584468 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ea36817f-295c-494c-87ad-0d08136112fa-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvqwnx\" (UID: \"ea36817f-295c-494c-87ad-0d08136112fa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvqwnx" May 27 14:15:17.584714 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:17.584696 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ea36817f-295c-494c-87ad-0d08136112fa-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvqwnx\" (UID: \"ea36817f-295c-494c-87ad-0d08136112fa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvqwnx" May 27 14:15:17.590720 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:17.590694 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jg8sv\" (UniqueName: \"kubernetes.io/projected/ea36817f-295c-494c-87ad-0d08136112fa-kube-api-access-jg8sv\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvqwnx\" (UID: \"ea36817f-295c-494c-87ad-0d08136112fa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvqwnx" May 27 14:15:17.643910 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:17.643848 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvqwnx" May 27 14:15:17.792435 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:17.792399 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvqwnx"] May 27 14:15:17.796221 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:15:17.796192 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea36817f_295c_494c_87ad_0d08136112fa.slice/crio-fc29a9f74aa7d55f38254dc7780ee4fc3bdd66259298e354bf722695c5b3b1ee WatchSource:0}: Error finding container fc29a9f74aa7d55f38254dc7780ee4fc3bdd66259298e354bf722695c5b3b1ee: Status 404 returned error can't find the container with id fc29a9f74aa7d55f38254dc7780ee4fc3bdd66259298e354bf722695c5b3b1ee May 27 14:15:18.626726 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:18.626683 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvqwnx" event={"ID":"ea36817f-295c-494c-87ad-0d08136112fa","Type":"ContainerStarted","Data":"fc29a9f74aa7d55f38254dc7780ee4fc3bdd66259298e354bf722695c5b3b1ee"} May 27 14:15:19.017529 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:19.017492 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-ktqbj"] May 27 14:15:19.021664 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:19.021634 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-ktqbj" May 27 14:15:19.024602 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:19.024575 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" May 27 14:15:19.034691 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:19.034661 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-ktqbj"] May 27 14:15:19.195065 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:19.195032 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c00c381-39be-4ac5-b1e1-57acb0f94a01-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-ktqbj\" (UID: \"4c00c381-39be-4ac5-b1e1-57acb0f94a01\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-ktqbj" May 27 14:15:19.195258 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:19.195101 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c00c381-39be-4ac5-b1e1-57acb0f94a01-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-ktqbj\" (UID: \"4c00c381-39be-4ac5-b1e1-57acb0f94a01\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-ktqbj" May 27 14:15:19.195258 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:19.195141 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2scxw\" (UniqueName: \"kubernetes.io/projected/4c00c381-39be-4ac5-b1e1-57acb0f94a01-kube-api-access-2scxw\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-ktqbj\" (UID: \"4c00c381-39be-4ac5-b1e1-57acb0f94a01\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-ktqbj" May 27 14:15:19.195258 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:19.195179 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4c00c381-39be-4ac5-b1e1-57acb0f94a01-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-ktqbj\" (UID: \"4c00c381-39be-4ac5-b1e1-57acb0f94a01\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-ktqbj" May 27 14:15:19.195258 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:19.195214 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c00c381-39be-4ac5-b1e1-57acb0f94a01-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-ktqbj\" (UID: \"4c00c381-39be-4ac5-b1e1-57acb0f94a01\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-ktqbj" May 27 14:15:19.195258 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:19.195244 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c00c381-39be-4ac5-b1e1-57acb0f94a01-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-ktqbj\" (UID: \"4c00c381-39be-4ac5-b1e1-57acb0f94a01\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-ktqbj" May 27 14:15:19.296359 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:19.296257 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c00c381-39be-4ac5-b1e1-57acb0f94a01-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-ktqbj\" (UID: \"4c00c381-39be-4ac5-b1e1-57acb0f94a01\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-ktqbj" May 27 14:15:19.296359 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:19.296344 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c00c381-39be-4ac5-b1e1-57acb0f94a01-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-ktqbj\" (UID: \"4c00c381-39be-4ac5-b1e1-57acb0f94a01\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-ktqbj" May 27 14:15:19.296586 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:19.296396 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c00c381-39be-4ac5-b1e1-57acb0f94a01-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-ktqbj\" (UID: \"4c00c381-39be-4ac5-b1e1-57acb0f94a01\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-ktqbj" May 27 14:15:19.296586 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:19.296433 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2scxw\" (UniqueName: \"kubernetes.io/projected/4c00c381-39be-4ac5-b1e1-57acb0f94a01-kube-api-access-2scxw\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-ktqbj\" (UID: \"4c00c381-39be-4ac5-b1e1-57acb0f94a01\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-ktqbj" May 27 14:15:19.296586 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:19.296456 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4c00c381-39be-4ac5-b1e1-57acb0f94a01-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-ktqbj\" (UID: \"4c00c381-39be-4ac5-b1e1-57acb0f94a01\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-ktqbj" May 27 14:15:19.296586 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:19.296488 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c00c381-39be-4ac5-b1e1-57acb0f94a01-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-ktqbj\" (UID: \"4c00c381-39be-4ac5-b1e1-57acb0f94a01\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-ktqbj" May 27 14:15:19.296867 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:19.296841 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c00c381-39be-4ac5-b1e1-57acb0f94a01-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-ktqbj\" (UID: \"4c00c381-39be-4ac5-b1e1-57acb0f94a01\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-ktqbj" May 27 14:15:19.296998 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:19.296981 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c00c381-39be-4ac5-b1e1-57acb0f94a01-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-ktqbj\" (UID: \"4c00c381-39be-4ac5-b1e1-57acb0f94a01\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-ktqbj" May 27 14:15:19.297077 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:19.297054 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4c00c381-39be-4ac5-b1e1-57acb0f94a01-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-ktqbj\" (UID: \"4c00c381-39be-4ac5-b1e1-57acb0f94a01\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-ktqbj" May 27 14:15:19.299072 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:19.299049 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c00c381-39be-4ac5-b1e1-57acb0f94a01-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-ktqbj\" (UID: \"4c00c381-39be-4ac5-b1e1-57acb0f94a01\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-ktqbj" May 27 14:15:19.299194 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:19.299173 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c00c381-39be-4ac5-b1e1-57acb0f94a01-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-ktqbj\" (UID: \"4c00c381-39be-4ac5-b1e1-57acb0f94a01\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-ktqbj" May 27 14:15:19.311104 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:19.311082 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2scxw\" (UniqueName: \"kubernetes.io/projected/4c00c381-39be-4ac5-b1e1-57acb0f94a01-kube-api-access-2scxw\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-ktqbj\" (UID: \"4c00c381-39be-4ac5-b1e1-57acb0f94a01\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-ktqbj" May 27 14:15:19.336157 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:19.336105 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-ktqbj" May 27 14:15:19.489089 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:19.489053 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-ktqbj"] May 27 14:15:19.491216 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:15:19.491187 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c00c381_39be_4ac5_b1e1_57acb0f94a01.slice/crio-95bbba228a71aee06b2797e7bcb82d6669623471faeaed6b08a6fee7db049078 WatchSource:0}: Error finding container 95bbba228a71aee06b2797e7bcb82d6669623471faeaed6b08a6fee7db049078: Status 404 returned error can't find the container with id 95bbba228a71aee06b2797e7bcb82d6669623471faeaed6b08a6fee7db049078 May 27 14:15:19.632633 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:19.632552 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-ktqbj" event={"ID":"4c00c381-39be-4ac5-b1e1-57acb0f94a01","Type":"ContainerStarted","Data":"95bbba228a71aee06b2797e7bcb82d6669623471faeaed6b08a6fee7db049078"} May 27 14:15:24.656310 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:24.656265 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvqwnx" event={"ID":"ea36817f-295c-494c-87ad-0d08136112fa","Type":"ContainerStarted","Data":"fe086e7258917b973efdc2e01e0e3ff1863f28c68d05edca97698af7f199c913"} May 27 14:15:24.658232 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:24.658196 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-ktqbj" event={"ID":"4c00c381-39be-4ac5-b1e1-57acb0f94a01","Type":"ContainerStarted","Data":"a57dd49ee56ca0cc263796a0fd7319c5b2a0cdcec7955503dda2b43a21383374"} May 27 14:15:29.687276 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:29.687188 2563 generic.go:358] "Generic (PLEG): container finished" podID="4c00c381-39be-4ac5-b1e1-57acb0f94a01" containerID="a57dd49ee56ca0cc263796a0fd7319c5b2a0cdcec7955503dda2b43a21383374" exitCode=0 May 27 14:15:29.687276 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:29.687255 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-ktqbj" event={"ID":"4c00c381-39be-4ac5-b1e1-57acb0f94a01","Type":"ContainerDied","Data":"a57dd49ee56ca0cc263796a0fd7319c5b2a0cdcec7955503dda2b43a21383374"} May 27 14:15:29.688005 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:29.687985 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 27 14:15:29.688748 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:29.688610 2563 generic.go:358] "Generic (PLEG): container finished" podID="ea36817f-295c-494c-87ad-0d08136112fa" containerID="fe086e7258917b973efdc2e01e0e3ff1863f28c68d05edca97698af7f199c913" exitCode=0 May 27 14:15:29.688748 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:29.688672 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvqwnx" event={"ID":"ea36817f-295c-494c-87ad-0d08136112fa","Type":"ContainerDied","Data":"fe086e7258917b973efdc2e01e0e3ff1863f28c68d05edca97698af7f199c913"} May 27 14:15:31.696975 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:31.696938 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvqwnx" event={"ID":"ea36817f-295c-494c-87ad-0d08136112fa","Type":"ContainerStarted","Data":"eaf8d39e35c1458105d0d28f547981c164db5767cffcfd7b4315ce19a7017c9d"} May 27 14:15:31.697353 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:31.697161 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvqwnx" May 27 14:15:31.717222 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:31.717172 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvqwnx" podStartSLOduration=1.286423571 podStartE2EDuration="14.717158187s" podCreationTimestamp="2026-05-27 14:15:17 +0000 UTC" firstStartedPulling="2026-05-27 14:15:17.798593073 +0000 UTC m=+602.898910017" lastFinishedPulling="2026-05-27 14:15:31.229327687 +0000 UTC m=+616.329644633" observedRunningTime="2026-05-27 14:15:31.715091214 +0000 UTC m=+616.815408205" watchObservedRunningTime="2026-05-27 14:15:31.717158187 +0000 UTC m=+616.817475152" May 27 14:15:37.717995 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:37.717960 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-ktqbj" event={"ID":"4c00c381-39be-4ac5-b1e1-57acb0f94a01","Type":"ContainerStarted","Data":"b6469ad15edc7cd36b69c46ab73a971b46ca479bbae8b0e418246d19786fb28b"} May 27 14:15:37.718421 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:37.718180 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-ktqbj" May 27 14:15:37.738455 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:37.738403 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-ktqbj" podStartSLOduration=2.517326286 podStartE2EDuration="19.738388193s" podCreationTimestamp="2026-05-27 14:15:18 +0000 UTC" firstStartedPulling="2026-05-27 14:15:19.493236413 +0000 UTC m=+604.593553357" lastFinishedPulling="2026-05-27 14:15:36.714298317 +0000 UTC m=+621.814615264" observedRunningTime="2026-05-27 14:15:37.737314745 +0000 UTC m=+622.837631723" watchObservedRunningTime="2026-05-27 14:15:37.738388193 +0000 UTC m=+622.838705160" May 27 14:15:42.713789 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:42.713755 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvqwnx" May 27 14:15:48.734294 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:15:48.734261 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-ktqbj" May 27 14:16:26.259272 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:16:26.259234 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-dbd548649-9plzw"] May 27 14:16:26.262750 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:16:26.262729 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-dbd548649-9plzw" May 27 14:16:26.271274 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:16:26.271246 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-dbd548649-9plzw"] May 27 14:16:26.304361 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:16:26.304321 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lwg4\" (UniqueName: \"kubernetes.io/projected/70185633-81fe-4652-96e3-07bc8470d3e4-kube-api-access-2lwg4\") pod \"authorino-dbd548649-9plzw\" (UID: \"70185633-81fe-4652-96e3-07bc8470d3e4\") " pod="kuadrant-system/authorino-dbd548649-9plzw" May 27 14:16:26.304540 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:16:26.304372 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/70185633-81fe-4652-96e3-07bc8470d3e4-tls-cert\") pod \"authorino-dbd548649-9plzw\" (UID: \"70185633-81fe-4652-96e3-07bc8470d3e4\") " pod="kuadrant-system/authorino-dbd548649-9plzw" May 27 14:16:26.405267 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:16:26.405230 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2lwg4\" (UniqueName: \"kubernetes.io/projected/70185633-81fe-4652-96e3-07bc8470d3e4-kube-api-access-2lwg4\") pod \"authorino-dbd548649-9plzw\" (UID: \"70185633-81fe-4652-96e3-07bc8470d3e4\") " pod="kuadrant-system/authorino-dbd548649-9plzw" May 27 14:16:26.405455 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:16:26.405287 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/70185633-81fe-4652-96e3-07bc8470d3e4-tls-cert\") pod \"authorino-dbd548649-9plzw\" (UID: \"70185633-81fe-4652-96e3-07bc8470d3e4\") " pod="kuadrant-system/authorino-dbd548649-9plzw" May 27 14:16:26.407778 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:16:26.407753 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/70185633-81fe-4652-96e3-07bc8470d3e4-tls-cert\") pod \"authorino-dbd548649-9plzw\" (UID: \"70185633-81fe-4652-96e3-07bc8470d3e4\") " pod="kuadrant-system/authorino-dbd548649-9plzw" May 27 14:16:26.417119 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:16:26.417091 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lwg4\" (UniqueName: \"kubernetes.io/projected/70185633-81fe-4652-96e3-07bc8470d3e4-kube-api-access-2lwg4\") pod \"authorino-dbd548649-9plzw\" (UID: \"70185633-81fe-4652-96e3-07bc8470d3e4\") " pod="kuadrant-system/authorino-dbd548649-9plzw" May 27 14:16:26.573586 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:16:26.573492 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-dbd548649-9plzw" May 27 14:16:26.704858 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:16:26.704834 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-dbd548649-9plzw"] May 27 14:16:26.707200 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:16:26.707169 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod70185633_81fe_4652_96e3_07bc8470d3e4.slice/crio-f1837572ffb557334c172eeab11ff242b2712eeaa40c945f3dd3c08ed1c38ff8 WatchSource:0}: Error finding container f1837572ffb557334c172eeab11ff242b2712eeaa40c945f3dd3c08ed1c38ff8: Status 404 returned error can't find the container with id f1837572ffb557334c172eeab11ff242b2712eeaa40c945f3dd3c08ed1c38ff8 May 27 14:16:26.892879 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:16:26.892783 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-dbd548649-9plzw" event={"ID":"70185633-81fe-4652-96e3-07bc8470d3e4","Type":"ContainerStarted","Data":"f1837572ffb557334c172eeab11ff242b2712eeaa40c945f3dd3c08ed1c38ff8"} May 27 14:16:27.898278 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:16:27.898241 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-dbd548649-9plzw" event={"ID":"70185633-81fe-4652-96e3-07bc8470d3e4","Type":"ContainerStarted","Data":"f4cbf292da35b01d2c5b9139a126a35b50188dc62f2a2b0fe2b606cf791b847a"} May 27 14:16:27.917755 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:16:27.917646 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-dbd548649-9plzw" podStartSLOduration=1.475593076 podStartE2EDuration="1.917624473s" podCreationTimestamp="2026-05-27 14:16:26 +0000 UTC" firstStartedPulling="2026-05-27 14:16:26.708618939 +0000 UTC m=+671.808935890" lastFinishedPulling="2026-05-27 14:16:27.150650341 +0000 UTC m=+672.250967287" observedRunningTime="2026-05-27 14:16:27.914187456 +0000 UTC m=+673.014504425" watchObservedRunningTime="2026-05-27 14:16:27.917624473 +0000 UTC m=+673.017941439" May 27 14:16:27.943952 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:16:27.943873 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6b64849f44-h84fx"] May 27 14:16:27.944159 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:16:27.944133 2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-6b64849f44-h84fx" podUID="c4735d38-b77c-4864-9e9d-fd8ea5fe302e" containerName="authorino" containerID="cri-o://0aa38b9e60e3b180114399064409e1e69e63f4030b50bed55f155f3cce282a12" gracePeriod=30 May 27 14:16:28.213425 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:16:28.213399 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6b64849f44-h84fx" May 27 14:16:28.323328 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:16:28.323289 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qxm5n\" (UniqueName: \"kubernetes.io/projected/c4735d38-b77c-4864-9e9d-fd8ea5fe302e-kube-api-access-qxm5n\") pod \"c4735d38-b77c-4864-9e9d-fd8ea5fe302e\" (UID: \"c4735d38-b77c-4864-9e9d-fd8ea5fe302e\") " May 27 14:16:28.323500 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:16:28.323399 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c4735d38-b77c-4864-9e9d-fd8ea5fe302e-tls-cert\") pod \"c4735d38-b77c-4864-9e9d-fd8ea5fe302e\" (UID: \"c4735d38-b77c-4864-9e9d-fd8ea5fe302e\") " May 27 14:16:28.325482 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:16:28.325444 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4735d38-b77c-4864-9e9d-fd8ea5fe302e-kube-api-access-qxm5n" (OuterVolumeSpecName: "kube-api-access-qxm5n") pod "c4735d38-b77c-4864-9e9d-fd8ea5fe302e" (UID: "c4735d38-b77c-4864-9e9d-fd8ea5fe302e"). InnerVolumeSpecName "kube-api-access-qxm5n". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 14:16:28.334014 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:16:28.333986 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4735d38-b77c-4864-9e9d-fd8ea5fe302e-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "c4735d38-b77c-4864-9e9d-fd8ea5fe302e" (UID: "c4735d38-b77c-4864-9e9d-fd8ea5fe302e"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 14:16:28.424219 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:16:28.424185 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qxm5n\" (UniqueName: \"kubernetes.io/projected/c4735d38-b77c-4864-9e9d-fd8ea5fe302e-kube-api-access-qxm5n\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" May 27 14:16:28.424219 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:16:28.424218 2563 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c4735d38-b77c-4864-9e9d-fd8ea5fe302e-tls-cert\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" May 27 14:16:28.902734 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:16:28.902694 2563 generic.go:358] "Generic (PLEG): container finished" podID="c4735d38-b77c-4864-9e9d-fd8ea5fe302e" containerID="0aa38b9e60e3b180114399064409e1e69e63f4030b50bed55f155f3cce282a12" exitCode=0 May 27 14:16:28.903239 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:16:28.902747 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6b64849f44-h84fx" May 27 14:16:28.903239 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:16:28.902770 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6b64849f44-h84fx" event={"ID":"c4735d38-b77c-4864-9e9d-fd8ea5fe302e","Type":"ContainerDied","Data":"0aa38b9e60e3b180114399064409e1e69e63f4030b50bed55f155f3cce282a12"} May 27 14:16:28.903239 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:16:28.902810 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6b64849f44-h84fx" event={"ID":"c4735d38-b77c-4864-9e9d-fd8ea5fe302e","Type":"ContainerDied","Data":"1633c5365ca76e39e1947cb1ac533eb3643fab377e6819f8fdea5e80e33179a5"} May 27 14:16:28.903239 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:16:28.902828 2563 scope.go:117] "RemoveContainer" containerID="0aa38b9e60e3b180114399064409e1e69e63f4030b50bed55f155f3cce282a12" May 27 14:16:28.911878 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:16:28.911855 2563 scope.go:117] "RemoveContainer" containerID="0aa38b9e60e3b180114399064409e1e69e63f4030b50bed55f155f3cce282a12" May 27 14:16:28.912178 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:16:28.912157 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0aa38b9e60e3b180114399064409e1e69e63f4030b50bed55f155f3cce282a12\": container with ID starting with 0aa38b9e60e3b180114399064409e1e69e63f4030b50bed55f155f3cce282a12 not found: ID does not exist" containerID="0aa38b9e60e3b180114399064409e1e69e63f4030b50bed55f155f3cce282a12" May 27 14:16:28.912249 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:16:28.912185 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0aa38b9e60e3b180114399064409e1e69e63f4030b50bed55f155f3cce282a12"} err="failed to get container status \"0aa38b9e60e3b180114399064409e1e69e63f4030b50bed55f155f3cce282a12\": rpc error: code = NotFound desc = could not find container \"0aa38b9e60e3b180114399064409e1e69e63f4030b50bed55f155f3cce282a12\": container with ID starting with 0aa38b9e60e3b180114399064409e1e69e63f4030b50bed55f155f3cce282a12 not found: ID does not exist" May 27 14:16:28.926008 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:16:28.925980 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6b64849f44-h84fx"] May 27 14:16:28.930639 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:16:28.930616 2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6b64849f44-h84fx"] May 27 14:16:29.543133 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:16:29.543097 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4735d38-b77c-4864-9e9d-fd8ea5fe302e" path="/var/lib/kubelet/pods/c4735d38-b77c-4864-9e9d-fd8ea5fe302e/volumes" May 27 14:17:52.369795 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:17:52.369760 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-67598ddd74-kgxfk"] May 27 14:17:52.370360 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:17:52.370008 2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-67598ddd74-kgxfk" podUID="41d636d9-e57f-472c-99f2-9e51e3e4fe1c" containerName="manager" containerID="cri-o://ae78d21ec0e140ad536d50041554349f797a5d0b4e3cbdd86aefffd2fab6ccef" gracePeriod=30 May 27 14:17:52.615175 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:17:52.615152 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-67598ddd74-kgxfk" May 27 14:17:52.779719 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:17:52.779682 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v7mdd\" (UniqueName: \"kubernetes.io/projected/41d636d9-e57f-472c-99f2-9e51e3e4fe1c-kube-api-access-v7mdd\") pod \"41d636d9-e57f-472c-99f2-9e51e3e4fe1c\" (UID: \"41d636d9-e57f-472c-99f2-9e51e3e4fe1c\") " May 27 14:17:52.781837 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:17:52.781805 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41d636d9-e57f-472c-99f2-9e51e3e4fe1c-kube-api-access-v7mdd" (OuterVolumeSpecName: "kube-api-access-v7mdd") pod "41d636d9-e57f-472c-99f2-9e51e3e4fe1c" (UID: "41d636d9-e57f-472c-99f2-9e51e3e4fe1c"). InnerVolumeSpecName "kube-api-access-v7mdd". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 14:17:52.880553 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:17:52.880515 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v7mdd\" (UniqueName: \"kubernetes.io/projected/41d636d9-e57f-472c-99f2-9e51e3e4fe1c-kube-api-access-v7mdd\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" May 27 14:17:53.219316 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:17:53.219277 2563 generic.go:358] "Generic (PLEG): container finished" podID="41d636d9-e57f-472c-99f2-9e51e3e4fe1c" containerID="ae78d21ec0e140ad536d50041554349f797a5d0b4e3cbdd86aefffd2fab6ccef" exitCode=0 May 27 14:17:53.219493 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:17:53.219349 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-67598ddd74-kgxfk" May 27 14:17:53.219493 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:17:53.219359 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-67598ddd74-kgxfk" event={"ID":"41d636d9-e57f-472c-99f2-9e51e3e4fe1c","Type":"ContainerDied","Data":"ae78d21ec0e140ad536d50041554349f797a5d0b4e3cbdd86aefffd2fab6ccef"} May 27 14:17:53.219493 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:17:53.219400 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-67598ddd74-kgxfk" event={"ID":"41d636d9-e57f-472c-99f2-9e51e3e4fe1c","Type":"ContainerDied","Data":"c1af477884cd3f5eb044a362535e5c681d2291852eae15dad647d6b0f95a9490"} May 27 14:17:53.219493 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:17:53.219416 2563 scope.go:117] "RemoveContainer" containerID="ae78d21ec0e140ad536d50041554349f797a5d0b4e3cbdd86aefffd2fab6ccef" May 27 14:17:53.228287 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:17:53.228265 2563 scope.go:117] "RemoveContainer" containerID="ae78d21ec0e140ad536d50041554349f797a5d0b4e3cbdd86aefffd2fab6ccef" May 27 14:17:53.228526 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:17:53.228507 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae78d21ec0e140ad536d50041554349f797a5d0b4e3cbdd86aefffd2fab6ccef\": container with ID starting with ae78d21ec0e140ad536d50041554349f797a5d0b4e3cbdd86aefffd2fab6ccef not found: ID does not exist" containerID="ae78d21ec0e140ad536d50041554349f797a5d0b4e3cbdd86aefffd2fab6ccef" May 27 14:17:53.228589 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:17:53.228532 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae78d21ec0e140ad536d50041554349f797a5d0b4e3cbdd86aefffd2fab6ccef"} err="failed to get container status \"ae78d21ec0e140ad536d50041554349f797a5d0b4e3cbdd86aefffd2fab6ccef\": rpc error: code = NotFound desc = could not find container \"ae78d21ec0e140ad536d50041554349f797a5d0b4e3cbdd86aefffd2fab6ccef\": container with ID starting with ae78d21ec0e140ad536d50041554349f797a5d0b4e3cbdd86aefffd2fab6ccef not found: ID does not exist" May 27 14:17:53.241712 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:17:53.241688 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-67598ddd74-kgxfk"] May 27 14:17:53.248343 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:17:53.248321 2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-67598ddd74-kgxfk"] May 27 14:17:53.542729 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:17:53.542692 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41d636d9-e57f-472c-99f2-9e51e3e4fe1c" path="/var/lib/kubelet/pods/41d636d9-e57f-472c-99f2-9e51e3e4fe1c/volumes" May 27 14:20:15.480805 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:20:15.480720 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-5g8bd_4589d4df-d2d2-43e2-af93-da49d130d20d/console-operator/1.log" May 27 14:20:15.481419 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:20:15.481231 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-5g8bd_4589d4df-d2d2-43e2-af93-da49d130d20d/console-operator/1.log" May 27 14:20:15.489636 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:20:15.489610 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fn9jd_3ebbf10f-4f07-403c-93b2-97261749308d/ovn-acl-logging/0.log" May 27 14:20:15.489828 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:20:15.489809 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fn9jd_3ebbf10f-4f07-403c-93b2-97261749308d/ovn-acl-logging/0.log" May 27 14:25:15.508984 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:25:15.508951 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-5g8bd_4589d4df-d2d2-43e2-af93-da49d130d20d/console-operator/1.log" May 27 14:25:15.511134 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:25:15.511110 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-5g8bd_4589d4df-d2d2-43e2-af93-da49d130d20d/console-operator/1.log" May 27 14:25:15.515365 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:25:15.515338 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fn9jd_3ebbf10f-4f07-403c-93b2-97261749308d/ovn-acl-logging/0.log" May 27 14:25:15.517305 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:25:15.517281 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fn9jd_3ebbf10f-4f07-403c-93b2-97261749308d/ovn-acl-logging/0.log" May 27 14:28:16.893780 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:28:16.893740 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-mw6rg"] May 27 14:28:16.896155 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:28:16.893992 2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-mw6rg" podUID="b81e77d7-3e83-4866-aeda-9f06a1093e1c" containerName="manager" containerID="cri-o://6bb3f6d90503b71f9883e79d51ba81e20b4fe977e9a50aec24d4eae40adfce3d" gracePeriod=10 May 27 14:28:17.651067 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:28:17.651039 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-mw6rg" May 27 14:28:17.758727 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:28:17.758693 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b81e77d7-3e83-4866-aeda-9f06a1093e1c-extensions-socket-volume\") pod \"b81e77d7-3e83-4866-aeda-9f06a1093e1c\" (UID: \"b81e77d7-3e83-4866-aeda-9f06a1093e1c\") " May 27 14:28:17.758883 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:28:17.758739 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dw2rn\" (UniqueName: \"kubernetes.io/projected/b81e77d7-3e83-4866-aeda-9f06a1093e1c-kube-api-access-dw2rn\") pod \"b81e77d7-3e83-4866-aeda-9f06a1093e1c\" (UID: \"b81e77d7-3e83-4866-aeda-9f06a1093e1c\") " May 27 14:28:17.759075 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:28:17.759049 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b81e77d7-3e83-4866-aeda-9f06a1093e1c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b81e77d7-3e83-4866-aeda-9f06a1093e1c" (UID: "b81e77d7-3e83-4866-aeda-9f06a1093e1c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 14:28:17.760880 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:28:17.760852 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b81e77d7-3e83-4866-aeda-9f06a1093e1c-kube-api-access-dw2rn" (OuterVolumeSpecName: "kube-api-access-dw2rn") pod "b81e77d7-3e83-4866-aeda-9f06a1093e1c" (UID: "b81e77d7-3e83-4866-aeda-9f06a1093e1c"). InnerVolumeSpecName "kube-api-access-dw2rn". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 14:28:17.859442 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:28:17.859402 2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b81e77d7-3e83-4866-aeda-9f06a1093e1c-extensions-socket-volume\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" May 27 14:28:17.859442 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:28:17.859435 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dw2rn\" (UniqueName: \"kubernetes.io/projected/b81e77d7-3e83-4866-aeda-9f06a1093e1c-kube-api-access-dw2rn\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" May 27 14:28:18.388289 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:28:18.388249 2563 generic.go:358] "Generic (PLEG): container finished" podID="b81e77d7-3e83-4866-aeda-9f06a1093e1c" containerID="6bb3f6d90503b71f9883e79d51ba81e20b4fe977e9a50aec24d4eae40adfce3d" exitCode=0 May 27 14:28:18.388695 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:28:18.388322 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-mw6rg" May 27 14:28:18.388695 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:28:18.388331 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-mw6rg" event={"ID":"b81e77d7-3e83-4866-aeda-9f06a1093e1c","Type":"ContainerDied","Data":"6bb3f6d90503b71f9883e79d51ba81e20b4fe977e9a50aec24d4eae40adfce3d"} May 27 14:28:18.388695 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:28:18.388361 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-mw6rg" event={"ID":"b81e77d7-3e83-4866-aeda-9f06a1093e1c","Type":"ContainerDied","Data":"07468015b3e2dc0334d09488894825df21c065308a982778f98428a5283b8020"} May 27 14:28:18.388695 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:28:18.388376 2563 scope.go:117] "RemoveContainer" containerID="6bb3f6d90503b71f9883e79d51ba81e20b4fe977e9a50aec24d4eae40adfce3d" May 27 14:28:18.397464 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:28:18.397446 2563 scope.go:117] "RemoveContainer" containerID="6bb3f6d90503b71f9883e79d51ba81e20b4fe977e9a50aec24d4eae40adfce3d" May 27 14:28:18.397736 ip-10-0-136-198 kubenswrapper[2563]: E0527 14:28:18.397717 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6bb3f6d90503b71f9883e79d51ba81e20b4fe977e9a50aec24d4eae40adfce3d\": container with ID starting with 6bb3f6d90503b71f9883e79d51ba81e20b4fe977e9a50aec24d4eae40adfce3d not found: ID does not exist" containerID="6bb3f6d90503b71f9883e79d51ba81e20b4fe977e9a50aec24d4eae40adfce3d" May 27 14:28:18.397785 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:28:18.397744 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bb3f6d90503b71f9883e79d51ba81e20b4fe977e9a50aec24d4eae40adfce3d"} err="failed to get container status \"6bb3f6d90503b71f9883e79d51ba81e20b4fe977e9a50aec24d4eae40adfce3d\": rpc error: code = NotFound desc = could not find container \"6bb3f6d90503b71f9883e79d51ba81e20b4fe977e9a50aec24d4eae40adfce3d\": container with ID starting with 6bb3f6d90503b71f9883e79d51ba81e20b4fe977e9a50aec24d4eae40adfce3d not found: ID does not exist" May 27 14:28:18.411431 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:28:18.411408 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-mw6rg"] May 27 14:28:18.419762 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:28:18.419733 2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-mw6rg"] May 27 14:28:19.542710 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:28:19.542673 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b81e77d7-3e83-4866-aeda-9f06a1093e1c" path="/var/lib/kubelet/pods/b81e77d7-3e83-4866-aeda-9f06a1093e1c/volumes" May 27 14:29:23.029653 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:29:23.029612 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7ftrs"] May 27 14:29:23.030051 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:29:23.029951 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b81e77d7-3e83-4866-aeda-9f06a1093e1c" containerName="manager" May 27 14:29:23.030051 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:29:23.029962 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b81e77d7-3e83-4866-aeda-9f06a1093e1c" containerName="manager" May 27 14:29:23.030051 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:29:23.029976 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4735d38-b77c-4864-9e9d-fd8ea5fe302e" containerName="authorino" May 27 14:29:23.030051 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:29:23.029981 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4735d38-b77c-4864-9e9d-fd8ea5fe302e" containerName="authorino" May 27 14:29:23.030051 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:29:23.029996 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41d636d9-e57f-472c-99f2-9e51e3e4fe1c" containerName="manager" May 27 14:29:23.030051 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:29:23.030002 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="41d636d9-e57f-472c-99f2-9e51e3e4fe1c" containerName="manager" May 27 14:29:23.030229 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:29:23.030071 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="c4735d38-b77c-4864-9e9d-fd8ea5fe302e" containerName="authorino" May 27 14:29:23.030229 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:29:23.030081 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="b81e77d7-3e83-4866-aeda-9f06a1093e1c" containerName="manager" May 27 14:29:23.030229 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:29:23.030087 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="41d636d9-e57f-472c-99f2-9e51e3e4fe1c" containerName="manager" May 27 14:29:23.033161 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:29:23.033144 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7ftrs" May 27 14:29:23.038399 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:29:23.038368 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-dcm87\"" May 27 14:29:23.062839 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:29:23.062810 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7ftrs"] May 27 14:29:23.122590 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:29:23.122557 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6l8w\" (UniqueName: \"kubernetes.io/projected/0d06c7f9-e6e4-4c62-8080-ad3072f19daf-kube-api-access-d6l8w\") pod \"kuadrant-operator-controller-manager-55c7f4c975-7ftrs\" (UID: \"0d06c7f9-e6e4-4c62-8080-ad3072f19daf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7ftrs" May 27 14:29:23.122756 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:29:23.122615 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0d06c7f9-e6e4-4c62-8080-ad3072f19daf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-7ftrs\" (UID: \"0d06c7f9-e6e4-4c62-8080-ad3072f19daf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7ftrs" May 27 14:29:23.224088 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:29:23.224050 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0d06c7f9-e6e4-4c62-8080-ad3072f19daf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-7ftrs\" (UID: \"0d06c7f9-e6e4-4c62-8080-ad3072f19daf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7ftrs" May 27 14:29:23.224279 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:29:23.224149 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d6l8w\" (UniqueName: \"kubernetes.io/projected/0d06c7f9-e6e4-4c62-8080-ad3072f19daf-kube-api-access-d6l8w\") pod \"kuadrant-operator-controller-manager-55c7f4c975-7ftrs\" (UID: \"0d06c7f9-e6e4-4c62-8080-ad3072f19daf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7ftrs" May 27 14:29:23.224490 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:29:23.224464 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0d06c7f9-e6e4-4c62-8080-ad3072f19daf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-7ftrs\" (UID: \"0d06c7f9-e6e4-4c62-8080-ad3072f19daf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7ftrs" May 27 14:29:23.233648 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:29:23.233621 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6l8w\" (UniqueName: \"kubernetes.io/projected/0d06c7f9-e6e4-4c62-8080-ad3072f19daf-kube-api-access-d6l8w\") pod \"kuadrant-operator-controller-manager-55c7f4c975-7ftrs\" (UID: \"0d06c7f9-e6e4-4c62-8080-ad3072f19daf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7ftrs" May 27 14:29:23.343436 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:29:23.343330 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7ftrs" May 27 14:29:23.490091 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:29:23.490046 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7ftrs"] May 27 14:29:23.493329 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:29:23.493300 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d06c7f9_e6e4_4c62_8080_ad3072f19daf.slice/crio-805387495c8e3e2d10974c4db411019cd468297d49e423335ff471418d011990 WatchSource:0}: Error finding container 805387495c8e3e2d10974c4db411019cd468297d49e423335ff471418d011990: Status 404 returned error can't find the container with id 805387495c8e3e2d10974c4db411019cd468297d49e423335ff471418d011990 May 27 14:29:23.495603 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:29:23.495582 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 27 14:29:23.615387 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:29:23.615290 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7ftrs" event={"ID":"0d06c7f9-e6e4-4c62-8080-ad3072f19daf","Type":"ContainerStarted","Data":"dbe86a258a548ccd5b8584ffaa874a9200b2d991f9d5007efd33b5f9c6da0a28"} May 27 14:29:23.615387 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:29:23.615333 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7ftrs" event={"ID":"0d06c7f9-e6e4-4c62-8080-ad3072f19daf","Type":"ContainerStarted","Data":"805387495c8e3e2d10974c4db411019cd468297d49e423335ff471418d011990"} May 27 14:29:23.615570 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:29:23.615404 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7ftrs" May 27 14:29:23.679104 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:29:23.679052 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7ftrs" podStartSLOduration=0.679037288 podStartE2EDuration="679.037288ms" podCreationTimestamp="2026-05-27 14:29:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 14:29:23.677436225 +0000 UTC m=+1448.777753191" watchObservedRunningTime="2026-05-27 14:29:23.679037288 +0000 UTC m=+1448.779354253" May 27 14:29:34.623734 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:29:34.623700 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7ftrs" May 27 14:30:00.139454 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:30:00.139416 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29664870-69l56"] May 27 14:30:00.143054 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:30:00.143037 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29664870-69l56" May 27 14:30:00.146076 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:30:00.146058 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-87shg\"" May 27 14:30:00.151682 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:30:00.151659 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29664870-69l56"] May 27 14:30:00.260953 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:30:00.260913 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whpd9\" (UniqueName: \"kubernetes.io/projected/d36ab7ba-8ce6-4850-adb9-a8ed97808095-kube-api-access-whpd9\") pod \"maas-api-key-cleanup-29664870-69l56\" (UID: \"d36ab7ba-8ce6-4850-adb9-a8ed97808095\") " pod="opendatahub/maas-api-key-cleanup-29664870-69l56" May 27 14:30:00.362512 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:30:00.362453 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-whpd9\" (UniqueName: \"kubernetes.io/projected/d36ab7ba-8ce6-4850-adb9-a8ed97808095-kube-api-access-whpd9\") pod \"maas-api-key-cleanup-29664870-69l56\" (UID: \"d36ab7ba-8ce6-4850-adb9-a8ed97808095\") " pod="opendatahub/maas-api-key-cleanup-29664870-69l56" May 27 14:30:00.372422 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:30:00.372389 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-whpd9\" (UniqueName: \"kubernetes.io/projected/d36ab7ba-8ce6-4850-adb9-a8ed97808095-kube-api-access-whpd9\") pod \"maas-api-key-cleanup-29664870-69l56\" (UID: \"d36ab7ba-8ce6-4850-adb9-a8ed97808095\") " pod="opendatahub/maas-api-key-cleanup-29664870-69l56" May 27 14:30:00.453939 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:30:00.453812 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29664870-69l56" May 27 14:30:00.589982 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:30:00.589957 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29664870-69l56"] May 27 14:30:00.592208 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:30:00.592185 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd36ab7ba_8ce6_4850_adb9_a8ed97808095.slice/crio-e6305cbc7b587d6f3559be1c5ab27fa67633a7c2d921764f07b99d29bf813e2d WatchSource:0}: Error finding container e6305cbc7b587d6f3559be1c5ab27fa67633a7c2d921764f07b99d29bf813e2d: Status 404 returned error can't find the container with id e6305cbc7b587d6f3559be1c5ab27fa67633a7c2d921764f07b99d29bf813e2d May 27 14:30:00.742654 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:30:00.742615 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29664870-69l56" event={"ID":"d36ab7ba-8ce6-4850-adb9-a8ed97808095","Type":"ContainerStarted","Data":"e6305cbc7b587d6f3559be1c5ab27fa67633a7c2d921764f07b99d29bf813e2d"} May 27 14:30:01.747770 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:30:01.747735 2563 generic.go:358] "Generic (PLEG): container finished" podID="d36ab7ba-8ce6-4850-adb9-a8ed97808095" containerID="3256722d10495761d58f981b16926692228dd8ede2e65b7ed627914bf80e2dbe" exitCode=0 May 27 14:30:01.748149 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:30:01.747822 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29664870-69l56" event={"ID":"d36ab7ba-8ce6-4850-adb9-a8ed97808095","Type":"ContainerDied","Data":"3256722d10495761d58f981b16926692228dd8ede2e65b7ed627914bf80e2dbe"} May 27 14:30:02.903010 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:30:02.902987 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29664870-69l56" May 27 14:30:02.984256 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:30:02.984225 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-whpd9\" (UniqueName: \"kubernetes.io/projected/d36ab7ba-8ce6-4850-adb9-a8ed97808095-kube-api-access-whpd9\") pod \"d36ab7ba-8ce6-4850-adb9-a8ed97808095\" (UID: \"d36ab7ba-8ce6-4850-adb9-a8ed97808095\") " May 27 14:30:02.986206 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:30:02.986172 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d36ab7ba-8ce6-4850-adb9-a8ed97808095-kube-api-access-whpd9" (OuterVolumeSpecName: "kube-api-access-whpd9") pod "d36ab7ba-8ce6-4850-adb9-a8ed97808095" (UID: "d36ab7ba-8ce6-4850-adb9-a8ed97808095"). InnerVolumeSpecName "kube-api-access-whpd9". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 14:30:03.085633 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:30:03.085558 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-whpd9\" (UniqueName: \"kubernetes.io/projected/d36ab7ba-8ce6-4850-adb9-a8ed97808095-kube-api-access-whpd9\") on node \"ip-10-0-136-198.ec2.internal\" DevicePath \"\"" May 27 14:30:03.770696 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:30:03.770659 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29664870-69l56" event={"ID":"d36ab7ba-8ce6-4850-adb9-a8ed97808095","Type":"ContainerDied","Data":"e6305cbc7b587d6f3559be1c5ab27fa67633a7c2d921764f07b99d29bf813e2d"} May 27 14:30:03.770696 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:30:03.770678 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29664870-69l56" May 27 14:30:03.770696 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:30:03.770691 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e6305cbc7b587d6f3559be1c5ab27fa67633a7c2d921764f07b99d29bf813e2d" May 27 14:30:15.533245 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:30:15.533217 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-5g8bd_4589d4df-d2d2-43e2-af93-da49d130d20d/console-operator/1.log" May 27 14:30:15.535643 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:30:15.535607 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-5g8bd_4589d4df-d2d2-43e2-af93-da49d130d20d/console-operator/1.log" May 27 14:30:15.539781 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:30:15.539758 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fn9jd_3ebbf10f-4f07-403c-93b2-97261749308d/ovn-acl-logging/0.log" May 27 14:30:15.550553 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:30:15.550532 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fn9jd_3ebbf10f-4f07-403c-93b2-97261749308d/ovn-acl-logging/0.log" May 27 14:35:15.555985 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:35:15.555949 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-5g8bd_4589d4df-d2d2-43e2-af93-da49d130d20d/console-operator/1.log" May 27 14:35:15.562625 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:35:15.562598 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fn9jd_3ebbf10f-4f07-403c-93b2-97261749308d/ovn-acl-logging/0.log" May 27 14:35:15.569056 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:35:15.569034 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-5g8bd_4589d4df-d2d2-43e2-af93-da49d130d20d/console-operator/1.log" May 27 14:35:15.575770 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:35:15.575749 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fn9jd_3ebbf10f-4f07-403c-93b2-97261749308d/ovn-acl-logging/0.log" May 27 14:39:07.072672 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:07.072630 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-dbd548649-9plzw_70185633-81fe-4652-96e3-07bc8470d3e4/authorino/0.log" May 27 14:39:11.921958 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:11.921927 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29664855-mmdrj_6b6cea85-5a07-4c39-ab3e-4107f96a2bbc/cleanup/0.log" May 27 14:39:12.027972 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:12.027937 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29664870-69l56_d36ab7ba-8ce6-4850-adb9-a8ed97808095/cleanup/0.log" May 27 14:39:12.637948 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:12.637841 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f4c796d7c-xrrb6_85444e95-12c4-4b7c-9925-b6cc4e4b365f/manager/0.log" May 27 14:39:12.748289 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:12.748260 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-rnx44_d9166b2f-cdf9-4196-b89e-057a82c1a3c6/postgres/0.log" May 27 14:39:14.024598 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:14.024564 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-dbd548649-9plzw_70185633-81fe-4652-96e3-07bc8470d3e4/authorino/0.log" May 27 14:39:14.502663 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:14.502630 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-xd454_90bcbb0d-5285-4ed0-b5f7-33dd3da509f2/registry-server/0.log" May 27 14:39:14.621678 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:14.621649 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-7ftrs_0d06c7f9-e6e4-4c62-8080-ad3072f19daf/manager/0.log" May 27 14:39:15.209091 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:15.209060 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4brfq7h_f26726ec-db76-4bda-b71c-f6e916e9e898/istio-proxy/0.log" May 27 14:39:15.662794 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:15.662768 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-7blnx_1653dacf-5ca5-4f80-8738-de6fbcb61514/istio-proxy/0.log" May 27 14:39:15.777335 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:15.777303 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-rdlhc_8c25e3ac-d782-48de-87fc-6bb3aa254708/payload-processing/0.log" May 27 14:39:15.889650 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:15.889618 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-799b5db656-96kw4_1bd3304d-9bda-4253-ac96-0dfca56dd2e1/router/0.log" May 27 14:39:16.449968 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:16.449941 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-ktqbj_4c00c381-39be-4ac5-b1e1-57acb0f94a01/storage-initializer/0.log" May 27 14:39:16.460412 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:16.460384 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-ktqbj_4c00c381-39be-4ac5-b1e1-57acb0f94a01/main/0.log" May 27 14:39:16.569794 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:16.569758 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvqwnx_ea36817f-295c-494c-87ad-0d08136112fa/main/0.log" May 27 14:39:16.577928 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:16.577906 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvqwnx_ea36817f-295c-494c-87ad-0d08136112fa/storage-initializer/0.log" May 27 14:39:24.308232 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:24.308198 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-px2cq_5a97ff24-1b84-4127-87cf-f53d545ce361/global-pull-secret-syncer/0.log" May 27 14:39:24.430758 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:24.430729 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-lkbl5_e0c55f03-86a3-4759-9e7c-5cf53d4ea59d/konnectivity-agent/0.log" May 27 14:39:24.486829 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:24.486801 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-198.ec2.internal_bdac52c688e8c8ccf183c0f228872be3/haproxy/0.log" May 27 14:39:28.424195 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:28.424163 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-dbd548649-9plzw_70185633-81fe-4652-96e3-07bc8470d3e4/authorino/0.log" May 27 14:39:28.574401 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:28.574370 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-xd454_90bcbb0d-5285-4ed0-b5f7-33dd3da509f2/registry-server/0.log" May 27 14:39:28.634245 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:28.634213 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-7ftrs_0d06c7f9-e6e4-4c62-8080-ad3072f19daf/manager/0.log" May 27 14:39:30.458949 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:30.458867 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-g2b6v_4ab50ff1-44f8-4599-9e35-5998ed988cfd/cluster-monitoring-operator/0.log" May 27 14:39:30.695301 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:30.695275 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6cv6p_a65514ec-c8e3-4420-8a77-710b934c35c1/node-exporter/0.log" May 27 14:39:30.736486 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:30.736459 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6cv6p_a65514ec-c8e3-4420-8a77-710b934c35c1/kube-rbac-proxy/0.log" May 27 14:39:30.776428 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:30.776398 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6cv6p_a65514ec-c8e3-4420-8a77-710b934c35c1/init-textfile/0.log" May 27 14:39:32.546147 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:32.546113 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9cxcf/perf-node-gather-daemonset-npthl"] May 27 14:39:32.546667 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:32.546647 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d36ab7ba-8ce6-4850-adb9-a8ed97808095" containerName="cleanup" May 27 14:39:32.546752 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:32.546670 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d36ab7ba-8ce6-4850-adb9-a8ed97808095" containerName="cleanup" May 27 14:39:32.546808 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:32.546755 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="d36ab7ba-8ce6-4850-adb9-a8ed97808095" containerName="cleanup" May 27 14:39:32.548888 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:32.548865 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9cxcf/perf-node-gather-daemonset-npthl" May 27 14:39:32.551557 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:32.551535 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9cxcf\"/\"openshift-service-ca.crt\"" May 27 14:39:32.551660 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:32.551586 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9cxcf\"/\"kube-root-ca.crt\"" May 27 14:39:32.552777 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:32.552757 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9cxcf\"/\"default-dockercfg-wfl27\"" May 27 14:39:32.561641 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:32.561619 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9cxcf/perf-node-gather-daemonset-npthl"] May 27 14:39:32.656034 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:32.656004 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d4d8f94f9-26d7g_e2bc8d1f-4404-42a0-ae30-056843788536/networking-console-plugin/0.log" May 27 14:39:32.688332 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:32.688294 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/70b1d1d9-5a97-4b32-9d5d-a3abe4423cca-proc\") pod \"perf-node-gather-daemonset-npthl\" (UID: \"70b1d1d9-5a97-4b32-9d5d-a3abe4423cca\") " pod="openshift-must-gather-9cxcf/perf-node-gather-daemonset-npthl" May 27 14:39:32.688497 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:32.688339 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4t9h\" (UniqueName: \"kubernetes.io/projected/70b1d1d9-5a97-4b32-9d5d-a3abe4423cca-kube-api-access-b4t9h\") pod \"perf-node-gather-daemonset-npthl\" (UID: \"70b1d1d9-5a97-4b32-9d5d-a3abe4423cca\") " pod="openshift-must-gather-9cxcf/perf-node-gather-daemonset-npthl" May 27 14:39:32.688497 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:32.688416 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/70b1d1d9-5a97-4b32-9d5d-a3abe4423cca-podres\") pod \"perf-node-gather-daemonset-npthl\" (UID: \"70b1d1d9-5a97-4b32-9d5d-a3abe4423cca\") " pod="openshift-must-gather-9cxcf/perf-node-gather-daemonset-npthl" May 27 14:39:32.688628 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:32.688489 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/70b1d1d9-5a97-4b32-9d5d-a3abe4423cca-sys\") pod \"perf-node-gather-daemonset-npthl\" (UID: \"70b1d1d9-5a97-4b32-9d5d-a3abe4423cca\") " pod="openshift-must-gather-9cxcf/perf-node-gather-daemonset-npthl" May 27 14:39:32.688628 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:32.688549 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/70b1d1d9-5a97-4b32-9d5d-a3abe4423cca-lib-modules\") pod \"perf-node-gather-daemonset-npthl\" (UID: \"70b1d1d9-5a97-4b32-9d5d-a3abe4423cca\") " pod="openshift-must-gather-9cxcf/perf-node-gather-daemonset-npthl" May 27 14:39:32.789023 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:32.788985 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/70b1d1d9-5a97-4b32-9d5d-a3abe4423cca-podres\") pod \"perf-node-gather-daemonset-npthl\" (UID: \"70b1d1d9-5a97-4b32-9d5d-a3abe4423cca\") " pod="openshift-must-gather-9cxcf/perf-node-gather-daemonset-npthl" May 27 14:39:32.789212 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:32.789048 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/70b1d1d9-5a97-4b32-9d5d-a3abe4423cca-sys\") pod \"perf-node-gather-daemonset-npthl\" (UID: \"70b1d1d9-5a97-4b32-9d5d-a3abe4423cca\") " pod="openshift-must-gather-9cxcf/perf-node-gather-daemonset-npthl" May 27 14:39:32.789212 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:32.789085 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/70b1d1d9-5a97-4b32-9d5d-a3abe4423cca-lib-modules\") pod \"perf-node-gather-daemonset-npthl\" (UID: \"70b1d1d9-5a97-4b32-9d5d-a3abe4423cca\") " pod="openshift-must-gather-9cxcf/perf-node-gather-daemonset-npthl" May 27 14:39:32.789212 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:32.789116 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/70b1d1d9-5a97-4b32-9d5d-a3abe4423cca-proc\") pod \"perf-node-gather-daemonset-npthl\" (UID: \"70b1d1d9-5a97-4b32-9d5d-a3abe4423cca\") " pod="openshift-must-gather-9cxcf/perf-node-gather-daemonset-npthl" May 27 14:39:32.789212 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:32.789147 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b4t9h\" (UniqueName: \"kubernetes.io/projected/70b1d1d9-5a97-4b32-9d5d-a3abe4423cca-kube-api-access-b4t9h\") pod \"perf-node-gather-daemonset-npthl\" (UID: \"70b1d1d9-5a97-4b32-9d5d-a3abe4423cca\") " pod="openshift-must-gather-9cxcf/perf-node-gather-daemonset-npthl" May 27 14:39:32.789212 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:32.789174 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/70b1d1d9-5a97-4b32-9d5d-a3abe4423cca-podres\") pod \"perf-node-gather-daemonset-npthl\" (UID: \"70b1d1d9-5a97-4b32-9d5d-a3abe4423cca\") " pod="openshift-must-gather-9cxcf/perf-node-gather-daemonset-npthl" May 27 14:39:32.789212 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:32.789174 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/70b1d1d9-5a97-4b32-9d5d-a3abe4423cca-sys\") pod \"perf-node-gather-daemonset-npthl\" (UID: \"70b1d1d9-5a97-4b32-9d5d-a3abe4423cca\") " pod="openshift-must-gather-9cxcf/perf-node-gather-daemonset-npthl" May 27 14:39:32.789495 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:32.789215 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/70b1d1d9-5a97-4b32-9d5d-a3abe4423cca-proc\") pod \"perf-node-gather-daemonset-npthl\" (UID: \"70b1d1d9-5a97-4b32-9d5d-a3abe4423cca\") " pod="openshift-must-gather-9cxcf/perf-node-gather-daemonset-npthl" May 27 14:39:32.789495 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:32.789252 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/70b1d1d9-5a97-4b32-9d5d-a3abe4423cca-lib-modules\") pod \"perf-node-gather-daemonset-npthl\" (UID: \"70b1d1d9-5a97-4b32-9d5d-a3abe4423cca\") " pod="openshift-must-gather-9cxcf/perf-node-gather-daemonset-npthl" May 27 14:39:32.798526 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:32.798462 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4t9h\" (UniqueName: \"kubernetes.io/projected/70b1d1d9-5a97-4b32-9d5d-a3abe4423cca-kube-api-access-b4t9h\") pod \"perf-node-gather-daemonset-npthl\" (UID: \"70b1d1d9-5a97-4b32-9d5d-a3abe4423cca\") " pod="openshift-must-gather-9cxcf/perf-node-gather-daemonset-npthl" May 27 14:39:32.858834 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:32.858799 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9cxcf/perf-node-gather-daemonset-npthl" May 27 14:39:32.992433 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:32.992405 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9cxcf/perf-node-gather-daemonset-npthl"] May 27 14:39:32.994361 ip-10-0-136-198 kubenswrapper[2563]: W0527 14:39:32.994331 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod70b1d1d9_5a97_4b32_9d5d_a3abe4423cca.slice/crio-91a18ea29898c7936aab9f600cbd4723e040668898e7ca46f2dffb4c056190ab WatchSource:0}: Error finding container 91a18ea29898c7936aab9f600cbd4723e040668898e7ca46f2dffb4c056190ab: Status 404 returned error can't find the container with id 91a18ea29898c7936aab9f600cbd4723e040668898e7ca46f2dffb4c056190ab May 27 14:39:32.995887 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:32.995868 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 27 14:39:33.259051 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:33.259018 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-5g8bd_4589d4df-d2d2-43e2-af93-da49d130d20d/console-operator/1.log" May 27 14:39:33.264946 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:33.264873 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-5g8bd_4589d4df-d2d2-43e2-af93-da49d130d20d/console-operator/2.log" May 27 14:39:33.780313 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:33.780276 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9cxcf/perf-node-gather-daemonset-npthl" event={"ID":"70b1d1d9-5a97-4b32-9d5d-a3abe4423cca","Type":"ContainerStarted","Data":"9cea6f60a318e946f2abd6270e79d1b3b482edbcde45063a49e7b35b17ee9c0f"} May 27 14:39:33.780313 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:33.780312 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9cxcf/perf-node-gather-daemonset-npthl" event={"ID":"70b1d1d9-5a97-4b32-9d5d-a3abe4423cca","Type":"ContainerStarted","Data":"91a18ea29898c7936aab9f600cbd4723e040668898e7ca46f2dffb4c056190ab"} May 27 14:39:33.780767 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:33.780398 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9cxcf/perf-node-gather-daemonset-npthl" May 27 14:39:33.803358 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:33.803303 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-9cxcf/perf-node-gather-daemonset-npthl" podStartSLOduration=1.803286942 podStartE2EDuration="1.803286942s" podCreationTimestamp="2026-05-27 14:39:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 14:39:33.80136126 +0000 UTC m=+2058.901678260" watchObservedRunningTime="2026-05-27 14:39:33.803286942 +0000 UTC m=+2058.903603907" May 27 14:39:34.324911 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:34.324867 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5cf8c89d64-t6kzq_97247087-636a-4f55-9a2a-47cc162238d2/volume-data-source-validator/0.log" May 27 14:39:35.163969 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:35.163874 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-f8t8t_11cf11df-4ac4-41ac-9294-bd472eb60b20/dns/0.log" May 27 14:39:35.187855 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:35.187827 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-f8t8t_11cf11df-4ac4-41ac-9294-bd472eb60b20/kube-rbac-proxy/0.log" May 27 14:39:35.334549 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:35.334522 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-j85ns_f5e2da5b-e345-4b11-ac5e-19f844c185e8/dns-node-resolver/0.log" May 27 14:39:35.977342 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:35.977301 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jg92x_1eeeff09-f3c8-453d-b9ca-d074d2cb10c8/node-ca/0.log" May 27 14:39:36.854246 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:36.854214 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4brfq7h_f26726ec-db76-4bda-b71c-f6e916e9e898/istio-proxy/0.log" May 27 14:39:37.138957 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:37.138854 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-7blnx_1653dacf-5ca5-4f80-8738-de6fbcb61514/istio-proxy/0.log" May 27 14:39:37.205724 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:37.205687 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-rdlhc_8c25e3ac-d782-48de-87fc-6bb3aa254708/payload-processing/0.log" May 27 14:39:37.246261 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:37.246231 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-799b5db656-96kw4_1bd3304d-9bda-4253-ac96-0dfca56dd2e1/router/0.log" May 27 14:39:37.828760 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:37.828731 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lx84l_1f3d65a9-4971-4574-94a4-84534b8c8e6b/serve-healthcheck-canary/0.log" May 27 14:39:38.385400 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:38.385371 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-7lb8j_69c8ab79-2afc-44ae-ba1f-7bbd76642023/insights-operator/0.log" May 27 14:39:38.385853 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:38.385788 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-7lb8j_69c8ab79-2afc-44ae-ba1f-7bbd76642023/insights-operator/1.log" May 27 14:39:38.538764 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:38.538731 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wllmb_09689767-b9d7-467f-a864-b35738fd6d49/kube-rbac-proxy/0.log" May 27 14:39:38.561697 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:38.561670 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wllmb_09689767-b9d7-467f-a864-b35738fd6d49/exporter/0.log" May 27 14:39:38.587612 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:38.587583 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wllmb_09689767-b9d7-467f-a864-b35738fd6d49/extractor/0.log" May 27 14:39:39.794104 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:39.794077 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9cxcf/perf-node-gather-daemonset-npthl" May 27 14:39:40.693926 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:40.693871 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29664855-mmdrj_6b6cea85-5a07-4c39-ab3e-4107f96a2bbc/cleanup/0.log" May 27 14:39:40.718511 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:40.718482 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29664870-69l56_d36ab7ba-8ce6-4850-adb9-a8ed97808095/cleanup/0.log" May 27 14:39:40.981284 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:40.981212 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f4c796d7c-xrrb6_85444e95-12c4-4b7c-9925-b6cc4e4b365f/manager/0.log" May 27 14:39:41.011915 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:41.011877 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-rnx44_d9166b2f-cdf9-4196-b89e-057a82c1a3c6/postgres/0.log" May 27 14:39:42.383572 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:42.383497 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5b46f7f598-prm68_6d70f6e1-8e48-46fa-8715-194fe32c6bca/manager/0.log" May 27 14:39:47.771396 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:47.771362 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-qwh27_6dfeff02-a96c-4202-bac6-7346398337d3/kube-storage-version-migrator-operator/1.log" May 27 14:39:47.772301 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:47.772283 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-qwh27_6dfeff02-a96c-4202-bac6-7346398337d3/kube-storage-version-migrator-operator/0.log" May 27 14:39:48.972603 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:48.972576 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tfnv8_0b4d0670-6986-4085-a211-e22549067d90/kube-multus-additional-cni-plugins/0.log" May 27 14:39:48.993133 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:48.993101 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tfnv8_0b4d0670-6986-4085-a211-e22549067d90/egress-router-binary-copy/0.log" May 27 14:39:49.016867 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:49.016831 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tfnv8_0b4d0670-6986-4085-a211-e22549067d90/cni-plugins/0.log" May 27 14:39:49.037203 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:49.037173 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tfnv8_0b4d0670-6986-4085-a211-e22549067d90/bond-cni-plugin/0.log" May 27 14:39:49.060871 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:49.060842 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tfnv8_0b4d0670-6986-4085-a211-e22549067d90/routeoverride-cni/0.log" May 27 14:39:49.084331 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:49.084303 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tfnv8_0b4d0670-6986-4085-a211-e22549067d90/whereabouts-cni-bincopy/0.log" May 27 14:39:49.107344 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:49.107313 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tfnv8_0b4d0670-6986-4085-a211-e22549067d90/whereabouts-cni/0.log" May 27 14:39:49.279670 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:49.279636 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-b8xln_bf9dc0c7-ad34-420e-bb88-13ce42450ed0/kube-multus/0.log" May 27 14:39:49.444675 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:49.444643 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-txmmd_3798bdf6-d616-43ed-b727-35b9407c33e7/network-metrics-daemon/0.log" May 27 14:39:49.466782 ip-10-0-136-198 kubenswrapper[2563]: I0527 14:39:49.466753 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-txmmd_3798bdf6-d616-43ed-b727-35b9407c33e7/kube-rbac-proxy/0.log"