May 21 14:41:27.128325 ip-10-0-134-244 systemd[1]: Starting Kubernetes Kubelet... May 21 14:41:27.574049 ip-10-0-134-244 kubenswrapper[2573]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 14:41:27.574049 ip-10-0-134-244 kubenswrapper[2573]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 21 14:41:27.574049 ip-10-0-134-244 kubenswrapper[2573]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 14:41:27.574049 ip-10-0-134-244 kubenswrapper[2573]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 21 14:41:27.574049 ip-10-0-134-244 kubenswrapper[2573]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 14:41:27.575764 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.575620 2573 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 21 14:41:27.579595 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579575 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 14:41:27.579595 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579592 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 14:41:27.579595 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579597 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 14:41:27.579595 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579601 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 14:41:27.579847 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579607 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 14:41:27.579847 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579613 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 14:41:27.579847 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579617 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 14:41:27.579847 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579621 2573 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 14:41:27.579847 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579625 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 14:41:27.579847 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579636 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 14:41:27.579847 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579640 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 14:41:27.579847 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579644 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 14:41:27.579847 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579648 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 14:41:27.579847 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579653 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 14:41:27.579847 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579656 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 14:41:27.579847 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579661 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 14:41:27.579847 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579664 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 14:41:27.579847 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579668 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 14:41:27.579847 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579672 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 14:41:27.579847 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579677 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 14:41:27.579847 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579680 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 14:41:27.579847 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579684 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 14:41:27.579847 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579688 2573 feature_gate.go:328] unrecognized feature gate: Example2 May 21 14:41:27.579847 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579692 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 14:41:27.580671 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579696 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 14:41:27.580671 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579700 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 14:41:27.580671 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579704 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 14:41:27.580671 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579707 2573 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 14:41:27.580671 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579711 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 14:41:27.580671 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579715 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 14:41:27.580671 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579719 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 14:41:27.580671 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579723 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 14:41:27.580671 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579726 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 14:41:27.580671 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579731 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 14:41:27.580671 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579735 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 14:41:27.580671 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579739 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 14:41:27.580671 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579744 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 14:41:27.580671 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579749 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 14:41:27.580671 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579764 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 14:41:27.580671 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579771 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 14:41:27.580671 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579777 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 14:41:27.580671 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579781 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 14:41:27.580671 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579788 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 14:41:27.580671 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579792 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 14:41:27.581530 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579796 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 14:41:27.581530 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579801 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 14:41:27.581530 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579805 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 14:41:27.581530 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579809 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 14:41:27.581530 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579813 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 14:41:27.581530 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579817 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 14:41:27.581530 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579822 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 14:41:27.581530 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579826 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 14:41:27.581530 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579830 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 14:41:27.581530 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579834 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 14:41:27.581530 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579838 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 14:41:27.581530 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579842 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 14:41:27.581530 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579845 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 14:41:27.581530 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579849 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 14:41:27.581530 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579855 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 14:41:27.581530 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579861 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 14:41:27.581530 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579866 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 14:41:27.581530 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579871 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 14:41:27.581530 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579874 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 14:41:27.582360 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579879 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 14:41:27.582360 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579883 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 14:41:27.582360 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579887 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 14:41:27.582360 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579891 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 14:41:27.582360 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579895 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 14:41:27.582360 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579899 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 14:41:27.582360 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579905 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 14:41:27.582360 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579909 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 14:41:27.582360 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579913 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 14:41:27.582360 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579917 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 14:41:27.582360 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579922 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 14:41:27.582360 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579926 2573 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 14:41:27.582360 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579932 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 14:41:27.582360 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579937 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 14:41:27.582360 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579944 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 14:41:27.582360 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579948 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 14:41:27.582360 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579952 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 14:41:27.582360 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579957 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 14:41:27.582360 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579961 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 14:41:27.582360 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579965 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 14:41:27.583122 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579970 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 14:41:27.583122 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579974 2573 feature_gate.go:328] unrecognized feature gate: Example May 21 14:41:27.583122 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.579979 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 14:41:27.583122 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.580666 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 14:41:27.583122 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.580675 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 14:41:27.583122 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.580680 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 14:41:27.583122 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.580684 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 14:41:27.583122 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.580688 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 14:41:27.583122 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.580693 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 14:41:27.583122 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.580697 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 14:41:27.583122 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.580702 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 14:41:27.583122 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.580706 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 14:41:27.583122 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.580710 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 14:41:27.583122 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.580715 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 14:41:27.583122 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.580719 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 14:41:27.583122 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.580724 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 14:41:27.583122 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.580728 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 14:41:27.583122 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.580732 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 14:41:27.583122 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.580737 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 14:41:27.583122 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.580741 2573 feature_gate.go:328] unrecognized feature gate: Example May 21 14:41:27.583664 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.580746 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 14:41:27.583664 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.580750 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 14:41:27.583664 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.580754 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 14:41:27.583664 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.580758 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 14:41:27.583664 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.580763 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 14:41:27.583664 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.580768 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 14:41:27.583664 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.580772 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 14:41:27.583664 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.580777 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 14:41:27.583664 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.580781 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 14:41:27.583664 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.580786 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 14:41:27.583664 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.580790 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 14:41:27.583664 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.580795 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 14:41:27.583664 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.580799 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 14:41:27.583664 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.580803 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 14:41:27.583664 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.580807 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 14:41:27.583664 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.580811 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 14:41:27.583664 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.580815 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 14:41:27.583664 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.580819 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 14:41:27.583664 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.580823 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 14:41:27.583664 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.580827 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 14:41:27.584196 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.580831 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 14:41:27.584196 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.580835 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 14:41:27.584196 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.580840 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 14:41:27.584196 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.580844 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 14:41:27.584196 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.580848 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 14:41:27.584196 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.580852 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 14:41:27.584196 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.580857 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 14:41:27.584196 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.580861 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 14:41:27.584196 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.580866 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 14:41:27.584196 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.580870 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 14:41:27.584196 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.580876 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 14:41:27.584196 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.580880 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 14:41:27.584196 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.580884 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 14:41:27.584196 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.580888 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 14:41:27.584196 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.580892 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 14:41:27.584196 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.580896 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 14:41:27.584196 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.580900 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 14:41:27.584196 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.580905 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 14:41:27.584196 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.580909 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 14:41:27.584196 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.580913 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 14:41:27.584685 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.580917 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 14:41:27.584685 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.580922 2573 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 14:41:27.584685 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.580928 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 14:41:27.584685 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.580934 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 14:41:27.584685 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.580940 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 14:41:27.584685 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.580946 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 14:41:27.584685 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.580952 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 14:41:27.584685 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.580956 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 14:41:27.584685 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.580960 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 14:41:27.584685 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.580964 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 14:41:27.584685 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.580968 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 14:41:27.584685 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.580972 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 14:41:27.584685 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.580978 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 14:41:27.584685 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.580982 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 14:41:27.584685 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.580986 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 14:41:27.584685 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.581007 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 14:41:27.584685 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.581012 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 14:41:27.584685 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.581016 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 14:41:27.584685 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.581021 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 14:41:27.585261 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.581025 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 14:41:27.585261 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.581029 2573 feature_gate.go:328] unrecognized feature gate: Example2 May 21 14:41:27.585261 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.581033 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 14:41:27.585261 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.581038 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 14:41:27.585261 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.581042 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 14:41:27.585261 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.581046 2573 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 14:41:27.585261 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.581050 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 14:41:27.585261 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.581054 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 14:41:27.585261 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.581058 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 14:41:27.585261 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.581062 2573 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 14:41:27.585261 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581171 2573 flags.go:64] FLAG: --address="0.0.0.0" May 21 14:41:27.585261 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581184 2573 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 21 14:41:27.585261 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581193 2573 flags.go:64] FLAG: --anonymous-auth="true" May 21 14:41:27.585261 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581200 2573 flags.go:64] FLAG: --application-metrics-count-limit="100" May 21 14:41:27.585261 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581207 2573 flags.go:64] FLAG: --authentication-token-webhook="false" May 21 14:41:27.585261 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581212 2573 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 21 14:41:27.585261 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581219 2573 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 21 14:41:27.585261 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581226 2573 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 21 14:41:27.585261 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581231 2573 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 21 14:41:27.585261 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581237 2573 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 21 14:41:27.585261 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581243 2573 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 21 14:41:27.585783 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581249 2573 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 21 14:41:27.585783 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581254 2573 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 21 14:41:27.585783 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581259 2573 flags.go:64] FLAG: --cgroup-root="" May 21 14:41:27.585783 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581264 2573 flags.go:64] FLAG: --cgroups-per-qos="true" May 21 14:41:27.585783 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581270 2573 flags.go:64] FLAG: --client-ca-file="" May 21 14:41:27.585783 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581274 2573 flags.go:64] FLAG: --cloud-config="" May 21 14:41:27.585783 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581279 2573 flags.go:64] FLAG: --cloud-provider="external" May 21 14:41:27.585783 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581284 2573 flags.go:64] FLAG: --cluster-dns="[]" May 21 14:41:27.585783 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581291 2573 flags.go:64] FLAG: --cluster-domain="" May 21 14:41:27.585783 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581297 2573 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 21 14:41:27.585783 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581302 2573 flags.go:64] FLAG: --config-dir="" May 21 14:41:27.585783 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581307 2573 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 21 14:41:27.585783 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581313 2573 flags.go:64] FLAG: --container-log-max-files="5" May 21 14:41:27.585783 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581319 2573 flags.go:64] FLAG: --container-log-max-size="10Mi" May 21 14:41:27.585783 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581325 2573 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 21 14:41:27.585783 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581331 2573 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 21 14:41:27.585783 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581337 2573 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 21 14:41:27.585783 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581342 2573 flags.go:64] FLAG: --contention-profiling="false" May 21 14:41:27.585783 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581347 2573 flags.go:64] FLAG: --cpu-cfs-quota="true" May 21 14:41:27.585783 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581352 2573 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 21 14:41:27.585783 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581357 2573 flags.go:64] FLAG: --cpu-manager-policy="none" May 21 14:41:27.585783 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581362 2573 flags.go:64] FLAG: --cpu-manager-policy-options="" May 21 14:41:27.585783 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581368 2573 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 21 14:41:27.585783 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581374 2573 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 21 14:41:27.585783 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581380 2573 flags.go:64] FLAG: --enable-debugging-handlers="true" May 21 14:41:27.586410 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581385 2573 flags.go:64] FLAG: --enable-load-reader="false" May 21 14:41:27.586410 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581389 2573 flags.go:64] FLAG: --enable-server="true" May 21 14:41:27.586410 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581394 2573 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 21 14:41:27.586410 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581400 2573 flags.go:64] FLAG: --event-burst="100" May 21 14:41:27.586410 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581406 2573 flags.go:64] FLAG: --event-qps="50" May 21 14:41:27.586410 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581410 2573 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 21 14:41:27.586410 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581416 2573 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 21 14:41:27.586410 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581421 2573 flags.go:64] FLAG: --eviction-hard="" May 21 14:41:27.586410 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581427 2573 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 21 14:41:27.586410 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581433 2573 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 21 14:41:27.586410 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581437 2573 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 21 14:41:27.586410 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581443 2573 flags.go:64] FLAG: --eviction-soft="" May 21 14:41:27.586410 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581447 2573 flags.go:64] FLAG: --eviction-soft-grace-period="" May 21 14:41:27.586410 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581453 2573 flags.go:64] FLAG: --exit-on-lock-contention="false" May 21 14:41:27.586410 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581458 2573 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 21 14:41:27.586410 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581464 2573 flags.go:64] FLAG: --experimental-mounter-path="" May 21 14:41:27.586410 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581468 2573 flags.go:64] FLAG: --fail-cgroupv1="false" May 21 14:41:27.586410 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581473 2573 flags.go:64] FLAG: --fail-swap-on="true" May 21 14:41:27.586410 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581478 2573 flags.go:64] FLAG: --feature-gates="" May 21 14:41:27.586410 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581485 2573 flags.go:64] FLAG: --file-check-frequency="20s" May 21 14:41:27.586410 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581490 2573 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 21 14:41:27.586410 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581495 2573 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 21 14:41:27.586410 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581501 2573 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 21 14:41:27.586410 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581506 2573 flags.go:64] FLAG: --healthz-port="10248" May 21 14:41:27.586410 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581511 2573 flags.go:64] FLAG: --help="false" May 21 14:41:27.587043 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581516 2573 flags.go:64] FLAG: --hostname-override="ip-10-0-134-244.ec2.internal" May 21 14:41:27.587043 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581522 2573 flags.go:64] FLAG: --housekeeping-interval="10s" May 21 14:41:27.587043 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581527 2573 flags.go:64] FLAG: --http-check-frequency="20s" May 21 14:41:27.587043 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581531 2573 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 21 14:41:27.587043 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581537 2573 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 21 14:41:27.587043 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581543 2573 flags.go:64] FLAG: --image-gc-high-threshold="85" May 21 14:41:27.587043 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581557 2573 flags.go:64] FLAG: --image-gc-low-threshold="80" May 21 14:41:27.587043 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581562 2573 flags.go:64] FLAG: --image-service-endpoint="" May 21 14:41:27.587043 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581567 2573 flags.go:64] FLAG: --kernel-memcg-notification="false" May 21 14:41:27.587043 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581572 2573 flags.go:64] FLAG: --kube-api-burst="100" May 21 14:41:27.587043 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581577 2573 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 21 14:41:27.587043 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581583 2573 flags.go:64] FLAG: --kube-api-qps="50" May 21 14:41:27.587043 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581588 2573 flags.go:64] FLAG: --kube-reserved="" May 21 14:41:27.587043 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581593 2573 flags.go:64] FLAG: --kube-reserved-cgroup="" May 21 14:41:27.587043 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581597 2573 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 21 14:41:27.587043 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581602 2573 flags.go:64] FLAG: --kubelet-cgroups="" May 21 14:41:27.587043 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581607 2573 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 21 14:41:27.587043 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581612 2573 flags.go:64] FLAG: --lock-file="" May 21 14:41:27.587043 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581620 2573 flags.go:64] FLAG: --log-cadvisor-usage="false" May 21 14:41:27.587043 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581625 2573 flags.go:64] FLAG: --log-flush-frequency="5s" May 21 14:41:27.587043 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581630 2573 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 21 14:41:27.587043 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581645 2573 flags.go:64] FLAG: --log-json-split-stream="false" May 21 14:41:27.587043 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581651 2573 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 21 14:41:27.587634 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581656 2573 flags.go:64] FLAG: --log-text-split-stream="false" May 21 14:41:27.587634 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581661 2573 flags.go:64] FLAG: --logging-format="text" May 21 14:41:27.587634 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581666 2573 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 21 14:41:27.587634 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581672 2573 flags.go:64] FLAG: --make-iptables-util-chains="true" May 21 14:41:27.587634 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581677 2573 flags.go:64] FLAG: --manifest-url="" May 21 14:41:27.587634 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581681 2573 flags.go:64] FLAG: --manifest-url-header="" May 21 14:41:27.587634 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581688 2573 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 21 14:41:27.587634 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581694 2573 flags.go:64] FLAG: --max-open-files="1000000" May 21 14:41:27.587634 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581701 2573 flags.go:64] FLAG: --max-pods="110" May 21 14:41:27.587634 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581706 2573 flags.go:64] FLAG: --maximum-dead-containers="-1" May 21 14:41:27.587634 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581711 2573 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 21 14:41:27.587634 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581716 2573 flags.go:64] FLAG: --memory-manager-policy="None" May 21 14:41:27.587634 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581721 2573 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 21 14:41:27.587634 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581726 2573 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 21 14:41:27.587634 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581730 2573 flags.go:64] FLAG: --node-ip="0.0.0.0" May 21 14:41:27.587634 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581735 2573 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 21 14:41:27.587634 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581748 2573 flags.go:64] FLAG: --node-status-max-images="50" May 21 14:41:27.587634 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581753 2573 flags.go:64] FLAG: --node-status-update-frequency="10s" May 21 14:41:27.587634 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581758 2573 flags.go:64] FLAG: --oom-score-adj="-999" May 21 14:41:27.587634 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581763 2573 flags.go:64] FLAG: --pod-cidr="" May 21 14:41:27.587634 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581768 2573 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 21 14:41:27.587634 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581777 2573 flags.go:64] FLAG: --pod-manifest-path="" May 21 14:41:27.587634 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581782 2573 flags.go:64] FLAG: --pod-max-pids="-1" May 21 14:41:27.587634 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581787 2573 flags.go:64] FLAG: --pods-per-core="0" May 21 14:41:27.588252 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581792 2573 flags.go:64] FLAG: --port="10250" May 21 14:41:27.588252 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581797 2573 flags.go:64] FLAG: --protect-kernel-defaults="false" May 21 14:41:27.588252 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581802 2573 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-01dd53ac11ae3620b" May 21 14:41:27.588252 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581810 2573 flags.go:64] FLAG: --qos-reserved="" May 21 14:41:27.588252 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581815 2573 flags.go:64] FLAG: --read-only-port="10255" May 21 14:41:27.588252 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581820 2573 flags.go:64] FLAG: --register-node="true" May 21 14:41:27.588252 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581825 2573 flags.go:64] FLAG: --register-schedulable="true" May 21 14:41:27.588252 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581830 2573 flags.go:64] FLAG: --register-with-taints="" May 21 14:41:27.588252 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581836 2573 flags.go:64] FLAG: --registry-burst="10" May 21 14:41:27.588252 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581841 2573 flags.go:64] FLAG: --registry-qps="5" May 21 14:41:27.588252 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581846 2573 flags.go:64] FLAG: --reserved-cpus="" May 21 14:41:27.588252 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581851 2573 flags.go:64] FLAG: --reserved-memory="" May 21 14:41:27.588252 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581857 2573 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 21 14:41:27.588252 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581863 2573 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 21 14:41:27.588252 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581868 2573 flags.go:64] FLAG: --rotate-certificates="false" May 21 14:41:27.588252 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581873 2573 flags.go:64] FLAG: --rotate-server-certificates="false" May 21 14:41:27.588252 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581878 2573 flags.go:64] FLAG: --runonce="false" May 21 14:41:27.588252 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581882 2573 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 21 14:41:27.588252 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581887 2573 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 21 14:41:27.588252 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581892 2573 flags.go:64] FLAG: --seccomp-default="false" May 21 14:41:27.588252 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581898 2573 flags.go:64] FLAG: --serialize-image-pulls="true" May 21 14:41:27.588252 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581902 2573 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 21 14:41:27.588252 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581908 2573 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 21 14:41:27.588252 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581913 2573 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 21 14:41:27.588252 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581918 2573 flags.go:64] FLAG: --storage-driver-password="root" May 21 14:41:27.588252 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581925 2573 flags.go:64] FLAG: --storage-driver-secure="false" May 21 14:41:27.588881 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581930 2573 flags.go:64] FLAG: --storage-driver-table="stats" May 21 14:41:27.588881 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581935 2573 flags.go:64] FLAG: --storage-driver-user="root" May 21 14:41:27.588881 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581940 2573 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 21 14:41:27.588881 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581945 2573 flags.go:64] FLAG: --sync-frequency="1m0s" May 21 14:41:27.588881 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581951 2573 flags.go:64] FLAG: --system-cgroups="" May 21 14:41:27.588881 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581955 2573 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 21 14:41:27.588881 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581964 2573 flags.go:64] FLAG: --system-reserved-cgroup="" May 21 14:41:27.588881 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581968 2573 flags.go:64] FLAG: --tls-cert-file="" May 21 14:41:27.588881 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581973 2573 flags.go:64] FLAG: --tls-cipher-suites="[]" May 21 14:41:27.588881 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581982 2573 flags.go:64] FLAG: --tls-min-version="" May 21 14:41:27.588881 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.581987 2573 flags.go:64] FLAG: --tls-private-key-file="" May 21 14:41:27.588881 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.582009 2573 flags.go:64] FLAG: --topology-manager-policy="none" May 21 14:41:27.588881 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.582015 2573 flags.go:64] FLAG: --topology-manager-policy-options="" May 21 14:41:27.588881 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.582019 2573 flags.go:64] FLAG: --topology-manager-scope="container" May 21 14:41:27.588881 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.582024 2573 flags.go:64] FLAG: --v="2" May 21 14:41:27.588881 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.582031 2573 flags.go:64] FLAG: --version="false" May 21 14:41:27.588881 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.582042 2573 flags.go:64] FLAG: --vmodule="" May 21 14:41:27.588881 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.582048 2573 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 21 14:41:27.588881 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.582054 2573 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 21 14:41:27.588881 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583325 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 14:41:27.588881 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583479 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 14:41:27.588881 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583487 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 14:41:27.588881 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583491 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 14:41:27.588881 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583498 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 14:41:27.589482 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583504 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 14:41:27.589482 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583508 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 14:41:27.589482 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583512 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 14:41:27.589482 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583516 2573 feature_gate.go:328] unrecognized feature gate: Example2 May 21 14:41:27.589482 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583520 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 14:41:27.589482 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583524 2573 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 14:41:27.589482 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583528 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 14:41:27.589482 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583532 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 14:41:27.589482 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583536 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 14:41:27.589482 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583540 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 14:41:27.589482 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583544 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 14:41:27.589482 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583548 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 14:41:27.589482 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583552 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 14:41:27.589482 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583555 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 14:41:27.589482 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583560 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 14:41:27.589482 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583564 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 14:41:27.589482 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583568 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 14:41:27.589482 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583572 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 14:41:27.589482 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583577 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 14:41:27.589482 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583581 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 14:41:27.589986 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583584 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 14:41:27.589986 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583589 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 14:41:27.589986 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583592 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 14:41:27.589986 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583596 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 14:41:27.589986 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583600 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 14:41:27.589986 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583603 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 14:41:27.589986 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583607 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 14:41:27.589986 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583611 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 14:41:27.589986 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583621 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 14:41:27.589986 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583625 2573 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 14:41:27.589986 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583629 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 14:41:27.589986 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583633 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 14:41:27.589986 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583637 2573 feature_gate.go:328] unrecognized feature gate: Example May 21 14:41:27.589986 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583641 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 14:41:27.589986 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583646 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 14:41:27.589986 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583650 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 14:41:27.589986 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583656 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 14:41:27.589986 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583662 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 14:41:27.589986 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583667 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 14:41:27.589986 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583672 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 14:41:27.590513 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583675 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 14:41:27.590513 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583678 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 14:41:27.590513 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583680 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 14:41:27.590513 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583683 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 14:41:27.590513 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583686 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 14:41:27.590513 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583688 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 14:41:27.590513 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583691 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 14:41:27.590513 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583694 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 14:41:27.590513 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583696 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 14:41:27.590513 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583699 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 14:41:27.590513 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583702 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 14:41:27.590513 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583704 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 14:41:27.590513 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583707 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 14:41:27.590513 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583710 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 14:41:27.590513 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583713 2573 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 14:41:27.590513 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583716 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 14:41:27.590513 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583718 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 14:41:27.590513 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583721 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 14:41:27.590513 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583723 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 14:41:27.590986 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583727 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 14:41:27.590986 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583730 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 14:41:27.590986 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583733 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 14:41:27.590986 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583736 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 14:41:27.590986 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583738 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 14:41:27.590986 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583741 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 14:41:27.590986 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583743 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 14:41:27.590986 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583746 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 14:41:27.590986 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583749 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 14:41:27.590986 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583751 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 14:41:27.590986 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583754 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 14:41:27.590986 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583757 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 14:41:27.590986 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583759 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 14:41:27.590986 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583762 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 14:41:27.590986 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583764 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 14:41:27.590986 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583766 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 14:41:27.590986 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583769 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 14:41:27.590986 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583772 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 14:41:27.590986 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583774 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 14:41:27.590986 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583781 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 14:41:27.591543 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583783 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 14:41:27.591543 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.583786 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 14:41:27.591543 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.584527 2573 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 14:41:27.591659 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.591637 2573 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 21 14:41:27.591688 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.591660 2573 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 21 14:41:27.591718 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591707 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 14:41:27.591718 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591712 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 14:41:27.591718 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591716 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 14:41:27.591718 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591719 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 14:41:27.591816 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591722 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 14:41:27.591816 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591725 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 14:41:27.591816 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591728 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 14:41:27.591816 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591730 2573 feature_gate.go:328] unrecognized feature gate: Example2 May 21 14:41:27.591816 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591733 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 14:41:27.591816 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591736 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 14:41:27.591816 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591738 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 14:41:27.591816 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591741 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 14:41:27.591816 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591743 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 14:41:27.591816 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591747 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 14:41:27.591816 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591750 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 14:41:27.591816 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591753 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 14:41:27.591816 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591756 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 14:41:27.591816 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591759 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 14:41:27.591816 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591762 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 14:41:27.591816 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591765 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 14:41:27.591816 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591768 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 14:41:27.591816 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591770 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 14:41:27.591816 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591773 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 14:41:27.591816 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591776 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 14:41:27.592338 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591778 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 14:41:27.592338 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591781 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 14:41:27.592338 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591784 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 14:41:27.592338 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591786 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 14:41:27.592338 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591789 2573 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 14:41:27.592338 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591792 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 14:41:27.592338 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591795 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 14:41:27.592338 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591797 2573 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 14:41:27.592338 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591800 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 14:41:27.592338 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591802 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 14:41:27.592338 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591806 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 14:41:27.592338 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591808 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 14:41:27.592338 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591811 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 14:41:27.592338 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591815 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 14:41:27.592338 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591818 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 14:41:27.592338 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591822 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 14:41:27.592338 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591826 2573 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 14:41:27.592338 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591829 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 14:41:27.592338 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591833 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 14:41:27.592817 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591836 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 14:41:27.592817 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591838 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 14:41:27.592817 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591841 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 14:41:27.592817 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591843 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 14:41:27.592817 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591847 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 14:41:27.592817 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591849 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 14:41:27.592817 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591852 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 14:41:27.592817 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591855 2573 feature_gate.go:328] unrecognized feature gate: Example May 21 14:41:27.592817 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591857 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 14:41:27.592817 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591860 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 14:41:27.592817 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591863 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 14:41:27.592817 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591866 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 14:41:27.592817 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591869 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 14:41:27.592817 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591872 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 14:41:27.592817 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591874 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 14:41:27.592817 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591877 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 14:41:27.592817 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591879 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 14:41:27.592817 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591882 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 14:41:27.592817 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591885 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 14:41:27.592817 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591888 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 14:41:27.593403 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591891 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 14:41:27.593403 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591893 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 14:41:27.593403 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591896 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 14:41:27.593403 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591899 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 14:41:27.593403 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591902 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 14:41:27.593403 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591904 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 14:41:27.593403 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591907 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 14:41:27.593403 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591909 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 14:41:27.593403 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591912 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 14:41:27.593403 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591914 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 14:41:27.593403 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591917 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 14:41:27.593403 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591920 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 14:41:27.593403 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591923 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 14:41:27.593403 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591927 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 14:41:27.593403 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591930 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 14:41:27.593403 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591933 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 14:41:27.593403 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591935 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 14:41:27.593403 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591938 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 14:41:27.593403 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591941 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 14:41:27.593403 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591943 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 14:41:27.593886 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591945 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 14:41:27.593886 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591948 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 14:41:27.593886 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.591951 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 14:41:27.593886 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.591956 2573 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 14:41:27.593886 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592078 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 14:41:27.593886 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592083 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 14:41:27.593886 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592087 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 14:41:27.593886 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592090 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 14:41:27.593886 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592093 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 14:41:27.593886 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592096 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 14:41:27.593886 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592099 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 14:41:27.593886 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592102 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 14:41:27.593886 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592105 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 14:41:27.593886 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592109 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 14:41:27.593886 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592112 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 14:41:27.594277 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592114 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 14:41:27.594277 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592117 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 14:41:27.594277 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592120 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 14:41:27.594277 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592123 2573 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 14:41:27.594277 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592127 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 14:41:27.594277 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592130 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 14:41:27.594277 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592133 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 14:41:27.594277 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592135 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 14:41:27.594277 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592138 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 14:41:27.594277 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592141 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 14:41:27.594277 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592143 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 14:41:27.594277 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592146 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 14:41:27.594277 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592148 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 14:41:27.594277 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592151 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 14:41:27.594277 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592154 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 14:41:27.594277 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592156 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 14:41:27.594277 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592159 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 14:41:27.594277 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592161 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 14:41:27.594277 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592164 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 14:41:27.594778 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592166 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 14:41:27.594778 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592170 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 14:41:27.594778 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592183 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 14:41:27.594778 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592186 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 14:41:27.594778 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592189 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 14:41:27.594778 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592192 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 14:41:27.594778 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592195 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 14:41:27.594778 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592197 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 14:41:27.594778 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592200 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 14:41:27.594778 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592202 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 14:41:27.594778 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592205 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 14:41:27.594778 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592208 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 14:41:27.594778 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592210 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 14:41:27.594778 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592213 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 14:41:27.594778 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592216 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 14:41:27.594778 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592219 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 14:41:27.594778 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592221 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 14:41:27.594778 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592224 2573 feature_gate.go:328] unrecognized feature gate: Example May 21 14:41:27.594778 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592226 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 14:41:27.594778 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592230 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 14:41:27.595274 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592234 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 14:41:27.595274 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592237 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 14:41:27.595274 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592240 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 14:41:27.595274 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592242 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 14:41:27.595274 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592245 2573 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 14:41:27.595274 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592247 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 14:41:27.595274 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592250 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 14:41:27.595274 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592253 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 14:41:27.595274 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592255 2573 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 14:41:27.595274 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592258 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 14:41:27.595274 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592260 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 14:41:27.595274 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592263 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 14:41:27.595274 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592265 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 14:41:27.595274 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592268 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 14:41:27.595274 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592278 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 14:41:27.595274 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592281 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 14:41:27.595274 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592283 2573 feature_gate.go:328] unrecognized feature gate: Example2 May 21 14:41:27.595274 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592286 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 14:41:27.595274 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592289 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 14:41:27.595274 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592291 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 14:41:27.595757 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592294 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 14:41:27.595757 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592296 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 14:41:27.595757 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592300 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 14:41:27.595757 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592302 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 14:41:27.595757 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592305 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 14:41:27.595757 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592308 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 14:41:27.595757 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592311 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 14:41:27.595757 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592313 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 14:41:27.595757 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592316 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 14:41:27.595757 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592318 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 14:41:27.595757 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592321 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 14:41:27.595757 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592324 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 14:41:27.595757 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592326 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 14:41:27.595757 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592329 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 14:41:27.595757 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592331 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 14:41:27.595757 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:27.592334 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 14:41:27.596163 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.592339 2573 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 14:41:27.596163 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.593154 2573 server.go:962] "Client rotation is on, will bootstrap in background" May 21 14:41:27.597737 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.597722 2573 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 21 14:41:27.598581 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.598569 2573 server.go:1019] "Starting client certificate rotation" May 21 14:41:27.598687 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.598670 2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 21 14:41:27.598736 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.598715 2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 21 14:41:27.622262 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.622232 2573 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 21 14:41:27.624181 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.624150 2573 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 21 14:41:27.640084 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.640059 2573 log.go:25] "Validated CRI v1 runtime API" May 21 14:41:27.645287 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.645268 2573 log.go:25] "Validated CRI v1 image API" May 21 14:41:27.647504 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.647478 2573 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 21 14:41:27.649400 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.649378 2573 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 21 14:41:27.656548 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.656521 2573 fs.go:135] Filesystem UUIDs: map[3112b79f-d377-4a92-8f3d-eb7b6bf9487f:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 d39ecc46-d1d9-4088-85f8-24e2898e6a9b:/dev/nvme0n1p4] May 21 14:41:27.656660 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.656545 2573 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 21 14:41:27.660869 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.660743 2573 manager.go:217] Machine: {Timestamp:2026-05-21 14:41:27.66025957 +0000 UTC m=+0.398515092 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101542 MemoryCapacity:33164505088 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec21f41788afd9c06180c6d28ea40bdd SystemUUID:ec21f417-88af-d9c0-6180-c6d28ea40bdd BootID:6e3a96e4-b9fd-472a-8266-d3eefabfcac7 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582254592 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:e4:42:d2:d4:e7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:e4:42:d2:d4:e7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:f2:92:a2:38:7d:ce Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164505088 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 21 14:41:27.661594 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.661579 2573 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 21 14:41:27.661711 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.661694 2573 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 21 14:41:27.662698 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.662673 2573 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 21 14:41:27.662835 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.662700 2573 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-244.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 21 14:41:27.662885 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.662847 2573 topology_manager.go:138] "Creating topology manager with none policy" May 21 14:41:27.662885 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.662855 2573 container_manager_linux.go:306] "Creating device plugin manager" May 21 14:41:27.662885 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.662863 2573 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 21 14:41:27.662885 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.662883 2573 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 21 14:41:27.664116 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.664106 2573 state_mem.go:36] "Initialized new in-memory state store" May 21 14:41:27.664228 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.664219 2573 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 21 14:41:27.666636 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.666626 2573 kubelet.go:491] "Attempting to sync node with API server" May 21 14:41:27.666672 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.666640 2573 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 21 14:41:27.666672 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.666657 2573 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 21 14:41:27.666672 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.666666 2573 kubelet.go:397] "Adding apiserver pod source" May 21 14:41:27.666781 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.666674 2573 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 21 14:41:27.667712 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.667697 2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 21 14:41:27.667812 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.667720 2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 21 14:41:27.670850 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.670835 2573 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 21 14:41:27.672703 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.672682 2573 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 21 14:41:27.674919 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.674902 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 21 14:41:27.675036 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.674924 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 21 14:41:27.675036 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.674939 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 21 14:41:27.675036 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.674948 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 21 14:41:27.675036 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.674962 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 21 14:41:27.675036 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.674970 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 21 14:41:27.675036 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.674979 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 21 14:41:27.675036 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.674986 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 21 14:41:27.675036 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.675012 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 21 14:41:27.675036 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.675021 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 21 14:41:27.675036 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.675033 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 21 14:41:27.675036 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.675041 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 21 14:41:27.675924 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.675911 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 21 14:41:27.676016 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.675929 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 21 14:41:27.678956 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.678937 2573 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-244.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 21 14:41:27.679231 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.679217 2573 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 21 14:41:27.679313 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.679264 2573 server.go:1295] "Started kubelet" May 21 14:41:27.679357 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.679332 2573 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 21 14:41:27.679733 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.679693 2573 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 21 14:41:27.679804 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.679749 2573 server_v1.go:47] "podresources" method="list" useActivePods=true May 21 14:41:27.679972 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:27.679934 2573 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-244.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 21 14:41:27.679972 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:27.679937 2573 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 21 14:41:27.680090 ip-10-0-134-244 systemd[1]: Started Kubernetes Kubelet. May 21 14:41:27.680873 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.680855 2573 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 21 14:41:27.681674 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.681658 2573 server.go:317] "Adding debug handlers to kubelet server" May 21 14:41:27.686650 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.686635 2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 21 14:41:27.687167 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.687151 2573 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 21 14:41:27.687333 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.687322 2573 volume_manager.go:295] "The desired_state_of_world populator starts" May 21 14:41:27.687425 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.687409 2573 volume_manager.go:297] "Starting Kubelet Volume Manager" May 21 14:41:27.687551 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.687537 2573 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 21 14:41:27.687551 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:27.687321 2573 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 21 14:41:27.687652 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.687598 2573 reconstruct.go:97] "Volume reconstruction finished" May 21 14:41:27.687652 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.687607 2573 reconciler.go:26] "Reconciler: start to sync state" May 21 14:41:27.688022 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:27.687985 2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-244.ec2.internal\" not found" May 21 14:41:27.688136 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.688079 2573 factory.go:55] Registering systemd factory May 21 14:41:27.688223 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.688141 2573 factory.go:223] Registration of the systemd container factory successfully May 21 14:41:27.688377 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.688364 2573 factory.go:153] Registering CRI-O factory May 21 14:41:27.688452 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.688381 2573 factory.go:223] Registration of the crio container factory successfully May 21 14:41:27.688452 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.688429 2573 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 21 14:41:27.688452 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.688447 2573 factory.go:103] Registering Raw factory May 21 14:41:27.688571 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.688462 2573 manager.go:1196] Started watching for new ooms in manager May 21 14:41:27.689129 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.689113 2573 manager.go:319] Starting recovery of all containers May 21 14:41:27.692322 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.692298 2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-sswzf" May 21 14:41:27.697319 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.697302 2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-sswzf" May 21 14:41:27.698169 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:27.694699 2573 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" May 21 14:41:27.698326 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:27.694564 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-244.ec2.internal.18b19bab4483666c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-244.ec2.internal,UID:ip-10-0-134-244.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-244.ec2.internal,},FirstTimestamp:2026-05-21 14:41:27.679231596 +0000 UTC m=+0.417487121,LastTimestamp:2026-05-21 14:41:27.679231596 +0000 UTC m=+0.417487121,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-244.ec2.internal,}" May 21 14:41:27.698448 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:27.698421 2573 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-244.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" May 21 14:41:27.704502 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.704488 2573 manager.go:324] Recovery completed May 21 14:41:27.708528 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.708516 2573 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 14:41:27.710250 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.710232 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-244.ec2.internal" event="NodeHasSufficientMemory" May 21 14:41:27.710320 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.710266 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-244.ec2.internal" event="NodeHasNoDiskPressure" May 21 14:41:27.710320 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.710279 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-244.ec2.internal" event="NodeHasSufficientPID" May 21 14:41:27.710765 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.710752 2573 cpu_manager.go:222] "Starting CPU manager" policy="none" May 21 14:41:27.710765 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.710764 2573 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 21 14:41:27.710871 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.710781 2573 state_mem.go:36] "Initialized new in-memory state store" May 21 14:41:27.712353 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:27.712286 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-244.ec2.internal.18b19bab465cb766 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-244.ec2.internal,UID:ip-10-0-134-244.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-244.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-244.ec2.internal,},FirstTimestamp:2026-05-21 14:41:27.710250854 +0000 UTC m=+0.448506376,LastTimestamp:2026-05-21 14:41:27.710250854 +0000 UTC m=+0.448506376,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-244.ec2.internal,}" May 21 14:41:27.713049 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.713018 2573 policy_none.go:49] "None policy: Start" May 21 14:41:27.713049 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.713034 2573 memory_manager.go:186] "Starting memorymanager" policy="None" May 21 14:41:27.713049 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.713045 2573 state_mem.go:35] "Initializing new in-memory state store" May 21 14:41:27.745586 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.745568 2573 manager.go:341] "Starting Device Plugin manager" May 21 14:41:27.760661 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:27.745610 2573 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 21 14:41:27.760661 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.745621 2573 server.go:85] "Starting device plugin registration server" May 21 14:41:27.760661 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.745891 2573 eviction_manager.go:189] "Eviction manager: starting control loop" May 21 14:41:27.760661 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.745902 2573 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 21 14:41:27.760661 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.746056 2573 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 21 14:41:27.760661 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.746132 2573 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 21 14:41:27.760661 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.746140 2573 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 21 14:41:27.760661 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:27.746740 2573 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 21 14:41:27.760661 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:27.746780 2573 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-244.ec2.internal\" not found" May 21 14:41:27.811126 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.811094 2573 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 21 14:41:27.812253 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.812227 2573 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 21 14:41:27.812253 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.812251 2573 status_manager.go:230] "Starting to sync pod status with apiserver" May 21 14:41:27.812421 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.812274 2573 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 21 14:41:27.812421 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.812282 2573 kubelet.go:2451] "Starting kubelet main sync loop" May 21 14:41:27.812421 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:27.812329 2573 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 21 14:41:27.814702 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.814681 2573 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 21 14:41:27.846487 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.846427 2573 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 14:41:27.847435 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.847419 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-244.ec2.internal" event="NodeHasSufficientMemory" May 21 14:41:27.847512 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.847450 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-244.ec2.internal" event="NodeHasNoDiskPressure" May 21 14:41:27.847512 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.847460 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-244.ec2.internal" event="NodeHasSufficientPID" May 21 14:41:27.847512 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.847484 2573 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-244.ec2.internal" May 21 14:41:27.855516 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.855499 2573 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-244.ec2.internal" May 21 14:41:27.855570 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:27.855524 2573 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-244.ec2.internal\": node \"ip-10-0-134-244.ec2.internal\" not found" May 21 14:41:27.874547 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:27.874518 2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-244.ec2.internal\" not found" May 21 14:41:27.912675 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.912643 2573 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-244.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-244.ec2.internal"] May 21 14:41:27.912819 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.912725 2573 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 14:41:27.914603 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.914586 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-244.ec2.internal" event="NodeHasSufficientMemory" May 21 14:41:27.914703 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.914622 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-244.ec2.internal" event="NodeHasNoDiskPressure" May 21 14:41:27.914703 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.914635 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-244.ec2.internal" event="NodeHasSufficientPID" May 21 14:41:27.915903 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.915886 2573 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 14:41:27.916091 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.916076 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-244.ec2.internal" May 21 14:41:27.916145 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.916106 2573 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 14:41:27.916705 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.916688 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-244.ec2.internal" event="NodeHasSufficientMemory" May 21 14:41:27.916705 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.916700 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-244.ec2.internal" event="NodeHasSufficientMemory" May 21 14:41:27.916831 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.916716 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-244.ec2.internal" event="NodeHasNoDiskPressure" May 21 14:41:27.916831 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.916725 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-244.ec2.internal" event="NodeHasSufficientPID" May 21 14:41:27.916831 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.916726 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-244.ec2.internal" event="NodeHasNoDiskPressure" May 21 14:41:27.916831 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.916822 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-244.ec2.internal" event="NodeHasSufficientPID" May 21 14:41:27.917971 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.917959 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-244.ec2.internal" May 21 14:41:27.918052 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.917983 2573 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 14:41:27.918684 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.918670 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-244.ec2.internal" event="NodeHasSufficientMemory" May 21 14:41:27.918759 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.918696 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-244.ec2.internal" event="NodeHasNoDiskPressure" May 21 14:41:27.918759 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.918711 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-244.ec2.internal" event="NodeHasSufficientPID" May 21 14:41:27.952795 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:27.952774 2573 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-244.ec2.internal\" not found" node="ip-10-0-134-244.ec2.internal" May 21 14:41:27.957066 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:27.957048 2573 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-244.ec2.internal\" not found" node="ip-10-0-134-244.ec2.internal" May 21 14:41:27.975191 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:27.975169 2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-244.ec2.internal\" not found" May 21 14:41:27.988894 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.988865 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1ee1cfe3f6bdf88984f096881704d77b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-244.ec2.internal\" (UID: \"1ee1cfe3f6bdf88984f096881704d77b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-244.ec2.internal" May 21 14:41:27.988894 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.988894 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1ee1cfe3f6bdf88984f096881704d77b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-244.ec2.internal\" (UID: \"1ee1cfe3f6bdf88984f096881704d77b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-244.ec2.internal" May 21 14:41:27.989064 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:27.988912 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f76149253834985fa6424385c0e68027-config\") pod \"kube-apiserver-proxy-ip-10-0-134-244.ec2.internal\" (UID: \"f76149253834985fa6424385c0e68027\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-244.ec2.internal" May 21 14:41:28.075716 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:28.075684 2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-244.ec2.internal\" not found" May 21 14:41:28.089053 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:28.089020 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f76149253834985fa6424385c0e68027-config\") pod \"kube-apiserver-proxy-ip-10-0-134-244.ec2.internal\" (UID: \"f76149253834985fa6424385c0e68027\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-244.ec2.internal" May 21 14:41:28.089117 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:28.089069 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1ee1cfe3f6bdf88984f096881704d77b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-244.ec2.internal\" (UID: \"1ee1cfe3f6bdf88984f096881704d77b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-244.ec2.internal" May 21 14:41:28.089117 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:28.089095 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1ee1cfe3f6bdf88984f096881704d77b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-244.ec2.internal\" (UID: \"1ee1cfe3f6bdf88984f096881704d77b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-244.ec2.internal" May 21 14:41:28.089189 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:28.089119 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1ee1cfe3f6bdf88984f096881704d77b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-244.ec2.internal\" (UID: \"1ee1cfe3f6bdf88984f096881704d77b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-244.ec2.internal" May 21 14:41:28.089189 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:28.089035 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f76149253834985fa6424385c0e68027-config\") pod \"kube-apiserver-proxy-ip-10-0-134-244.ec2.internal\" (UID: \"f76149253834985fa6424385c0e68027\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-244.ec2.internal" May 21 14:41:28.089189 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:28.089173 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1ee1cfe3f6bdf88984f096881704d77b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-244.ec2.internal\" (UID: \"1ee1cfe3f6bdf88984f096881704d77b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-244.ec2.internal" May 21 14:41:28.176438 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:28.176364 2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-244.ec2.internal\" not found" May 21 14:41:28.255865 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:28.255832 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-244.ec2.internal" May 21 14:41:28.259551 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:28.259530 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-244.ec2.internal" May 21 14:41:28.277246 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:28.277159 2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-244.ec2.internal\" not found" May 21 14:41:28.377705 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:28.377659 2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-244.ec2.internal\" not found" May 21 14:41:28.478197 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:28.478133 2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-244.ec2.internal\" not found" May 21 14:41:28.575220 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:28.575191 2573 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 21 14:41:28.578838 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:28.578814 2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-244.ec2.internal\" not found" May 21 14:41:28.598310 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:28.598270 2573 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 21 14:41:28.598464 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:28.598442 2573 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 21 14:41:28.598508 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:28.598465 2573 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 21 14:41:28.678942 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:28.678890 2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-244.ec2.internal\" not found" May 21 14:41:28.687747 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:28.687719 2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 21 14:41:28.698120 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:28.698090 2573 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 21 14:41:28.700423 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:28.700394 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-20 14:36:27 +0000 UTC" deadline="2028-01-05 04:42:27.860135779 +0000 UTC" May 21 14:41:28.700492 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:28.700424 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14246h0m59.159714996s" May 21 14:41:28.723808 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:28.723783 2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-8mw8n" May 21 14:41:28.731099 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:28.731043 2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-8mw8n" May 21 14:41:28.747467 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:28.747435 2573 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 21 14:41:28.788154 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:28.788122 2573 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-244.ec2.internal" May 21 14:41:28.801716 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:28.801690 2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 21 14:41:28.804029 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:28.803978 2573 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-244.ec2.internal" May 21 14:41:28.812757 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:28.812732 2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 21 14:41:28.880123 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:28.880096 2573 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 21 14:41:28.914706 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:28.914663 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf76149253834985fa6424385c0e68027.slice/crio-8c277b0fd4b2679abd26920781562741bc6392b348b79d9dd2e6dc027d14f56b WatchSource:0}: Error finding container 8c277b0fd4b2679abd26920781562741bc6392b348b79d9dd2e6dc027d14f56b: Status 404 returned error can't find the container with id 8c277b0fd4b2679abd26920781562741bc6392b348b79d9dd2e6dc027d14f56b May 21 14:41:28.915056 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:28.915028 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ee1cfe3f6bdf88984f096881704d77b.slice/crio-d41d1e93d39d80c962f0af228b0dd6991c514c6749c2d1739e4c81b523ce7533 WatchSource:0}: Error finding container d41d1e93d39d80c962f0af228b0dd6991c514c6749c2d1739e4c81b523ce7533: Status 404 returned error can't find the container with id d41d1e93d39d80c962f0af228b0dd6991c514c6749c2d1739e4c81b523ce7533 May 21 14:41:28.918853 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:28.918835 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 14:41:29.668479 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.668429 2573 apiserver.go:52] "Watching apiserver" May 21 14:41:29.676880 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.676821 2573 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 21 14:41:29.678597 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.678561 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-6fb9w","openshift-network-operator/iptables-alerter-qmdnb","kube-system/konnectivity-agent-kbq62","kube-system/kube-apiserver-proxy-ip-10-0-134-244.ec2.internal","openshift-cluster-node-tuning-operator/tuned-r9dpx","openshift-dns/node-resolver-k2p4j","openshift-image-registry/node-ca-nfd4x","openshift-ovn-kubernetes/ovnkube-node-5t966","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9ql9","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-244.ec2.internal","openshift-multus/multus-additional-cni-plugins-2cg2c","openshift-multus/multus-r6dl7","openshift-multus/network-metrics-daemon-tft6b"] May 21 14:41:29.680248 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.680215 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-k2p4j" May 21 14:41:29.682948 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.682408 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 21 14:41:29.682948 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.682604 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 21 14:41:29.682948 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.682732 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-xdg7s\"" May 21 14:41:29.683225 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.683202 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tft6b" May 21 14:41:29.683335 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:29.683277 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tft6b" podUID="646e1e59-0917-4626-8e22-158fec29f33f" May 21 14:41:29.684584 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.684558 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6fb9w" May 21 14:41:29.684680 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:29.684631 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6fb9w" podUID="2dc7761a-d68f-4f1f-ad3c-71fb26dad676" May 21 14:41:29.686922 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.686033 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2cg2c" May 21 14:41:29.688828 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.687150 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-r9dpx" May 21 14:41:29.691236 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.691209 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9ql9" May 21 14:41:29.691317 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.691297 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-v87jz\"" May 21 14:41:29.691550 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.691531 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 21 14:41:29.692111 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.691611 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nfd4x" May 21 14:41:29.692111 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.691768 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 21 14:41:29.692111 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.692063 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 21 14:41:29.696055 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.692895 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 21 14:41:29.696055 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.693132 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 21 14:41:29.696055 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.693335 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 21 14:41:29.696055 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.694090 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kbq62" May 21 14:41:29.696055 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.694789 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 21 14:41:29.696055 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.694891 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vrsn6\"" May 21 14:41:29.696055 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.695015 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-lz2z6\"" May 21 14:41:29.696055 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.695152 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 21 14:41:29.696055 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.695562 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 21 14:41:29.696055 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.695793 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 21 14:41:29.696055 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.696051 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-2jxgb\"" May 21 14:41:29.696597 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.696225 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 21 14:41:29.696597 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.696357 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 21 14:41:29.696597 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.696456 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 21 14:41:29.696729 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.696691 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3ad537a1-469b-485f-8391-60e2e8db2bf4-etc-tuned\") pod \"tuned-r9dpx\" (UID: \"3ad537a1-469b-485f-8391-60e2e8db2bf4\") " pod="openshift-cluster-node-tuning-operator/tuned-r9dpx" May 21 14:41:29.696780 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.696733 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/43f110a5-d9cb-4410-91e4-c3da71193c3c-run-systemd\") pod \"ovnkube-node-5t966\" (UID: \"43f110a5-d9cb-4410-91e4-c3da71193c3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5t966" May 21 14:41:29.696780 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.696767 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/43f110a5-d9cb-4410-91e4-c3da71193c3c-var-lib-openvswitch\") pod \"ovnkube-node-5t966\" (UID: \"43f110a5-d9cb-4410-91e4-c3da71193c3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5t966" May 21 14:41:29.696879 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.696797 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/43f110a5-d9cb-4410-91e4-c3da71193c3c-run-openvswitch\") pod \"ovnkube-node-5t966\" (UID: \"43f110a5-d9cb-4410-91e4-c3da71193c3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5t966" May 21 14:41:29.696879 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.696837 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/43f110a5-d9cb-4410-91e4-c3da71193c3c-run-ovn\") pod \"ovnkube-node-5t966\" (UID: \"43f110a5-d9cb-4410-91e4-c3da71193c3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5t966" May 21 14:41:29.696879 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.696869 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfvls\" (UniqueName: \"kubernetes.io/projected/591d522c-4c95-4b9c-852b-f84095cc2525-kube-api-access-nfvls\") pod \"node-resolver-k2p4j\" (UID: \"591d522c-4c95-4b9c-852b-f84095cc2525\") " pod="openshift-dns/node-resolver-k2p4j" May 21 14:41:29.697041 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.696900 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/34972f99-075d-486d-8b03-5efb08d79649-system-cni-dir\") pod \"multus-additional-cni-plugins-2cg2c\" (UID: \"34972f99-075d-486d-8b03-5efb08d79649\") " pod="openshift-multus/multus-additional-cni-plugins-2cg2c" May 21 14:41:29.697041 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.696928 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3ad537a1-469b-485f-8391-60e2e8db2bf4-tmp\") pod \"tuned-r9dpx\" (UID: \"3ad537a1-469b-485f-8391-60e2e8db2bf4\") " pod="openshift-cluster-node-tuning-operator/tuned-r9dpx" May 21 14:41:29.697041 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.696956 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/19eadc83-10b5-48f6-ad02-e8540668c1cc-serviceca\") pod \"node-ca-nfd4x\" (UID: \"19eadc83-10b5-48f6-ad02-e8540668c1cc\") " pod="openshift-image-registry/node-ca-nfd4x" May 21 14:41:29.697041 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.696988 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/43f110a5-d9cb-4410-91e4-c3da71193c3c-ovn-node-metrics-cert\") pod \"ovnkube-node-5t966\" (UID: \"43f110a5-d9cb-4410-91e4-c3da71193c3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5t966" May 21 14:41:29.697231 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.697045 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdqzd\" (UniqueName: \"kubernetes.io/projected/43f110a5-d9cb-4410-91e4-c3da71193c3c-kube-api-access-zdqzd\") pod \"ovnkube-node-5t966\" (UID: \"43f110a5-d9cb-4410-91e4-c3da71193c3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5t966" May 21 14:41:29.697231 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.697076 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/34972f99-075d-486d-8b03-5efb08d79649-cni-binary-copy\") pod \"multus-additional-cni-plugins-2cg2c\" (UID: \"34972f99-075d-486d-8b03-5efb08d79649\") " pod="openshift-multus/multus-additional-cni-plugins-2cg2c" May 21 14:41:29.697231 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.697108 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ad537a1-469b-485f-8391-60e2e8db2bf4-etc-kubernetes\") pod \"tuned-r9dpx\" (UID: \"3ad537a1-469b-485f-8391-60e2e8db2bf4\") " pod="openshift-cluster-node-tuning-operator/tuned-r9dpx" May 21 14:41:29.697231 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.697134 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3ad537a1-469b-485f-8391-60e2e8db2bf4-etc-sysctl-conf\") pod \"tuned-r9dpx\" (UID: \"3ad537a1-469b-485f-8391-60e2e8db2bf4\") " pod="openshift-cluster-node-tuning-operator/tuned-r9dpx" May 21 14:41:29.697231 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.697164 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ad537a1-469b-485f-8391-60e2e8db2bf4-var-lib-kubelet\") pod \"tuned-r9dpx\" (UID: \"3ad537a1-469b-485f-8391-60e2e8db2bf4\") " pod="openshift-cluster-node-tuning-operator/tuned-r9dpx" May 21 14:41:29.697231 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.697200 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/19eadc83-10b5-48f6-ad02-e8540668c1cc-host\") pod \"node-ca-nfd4x\" (UID: \"19eadc83-10b5-48f6-ad02-e8540668c1cc\") " pod="openshift-image-registry/node-ca-nfd4x" May 21 14:41:29.697498 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.697231 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/43f110a5-d9cb-4410-91e4-c3da71193c3c-host-kubelet\") pod \"ovnkube-node-5t966\" (UID: \"43f110a5-d9cb-4410-91e4-c3da71193c3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5t966" May 21 14:41:29.697498 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.697267 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/43f110a5-d9cb-4410-91e4-c3da71193c3c-host-slash\") pod \"ovnkube-node-5t966\" (UID: \"43f110a5-d9cb-4410-91e4-c3da71193c3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5t966" May 21 14:41:29.697498 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.697298 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/43f110a5-d9cb-4410-91e4-c3da71193c3c-host-run-netns\") pod \"ovnkube-node-5t966\" (UID: \"43f110a5-d9cb-4410-91e4-c3da71193c3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5t966" May 21 14:41:29.697498 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.697327 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m99lc\" (UniqueName: \"kubernetes.io/projected/34972f99-075d-486d-8b03-5efb08d79649-kube-api-access-m99lc\") pod \"multus-additional-cni-plugins-2cg2c\" (UID: \"34972f99-075d-486d-8b03-5efb08d79649\") " pod="openshift-multus/multus-additional-cni-plugins-2cg2c" May 21 14:41:29.697498 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.697359 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3ad537a1-469b-485f-8391-60e2e8db2bf4-etc-systemd\") pod \"tuned-r9dpx\" (UID: \"3ad537a1-469b-485f-8391-60e2e8db2bf4\") " pod="openshift-cluster-node-tuning-operator/tuned-r9dpx" May 21 14:41:29.697498 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.697388 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3ad537a1-469b-485f-8391-60e2e8db2bf4-run\") pod \"tuned-r9dpx\" (UID: \"3ad537a1-469b-485f-8391-60e2e8db2bf4\") " pod="openshift-cluster-node-tuning-operator/tuned-r9dpx" May 21 14:41:29.697498 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.697432 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5pt2\" (UniqueName: \"kubernetes.io/projected/3ad537a1-469b-485f-8391-60e2e8db2bf4-kube-api-access-q5pt2\") pod \"tuned-r9dpx\" (UID: \"3ad537a1-469b-485f-8391-60e2e8db2bf4\") " pod="openshift-cluster-node-tuning-operator/tuned-r9dpx" May 21 14:41:29.697824 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.697609 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 21 14:41:29.698247 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.698033 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 21 14:41:29.700039 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.700017 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lldct\" (UniqueName: \"kubernetes.io/projected/646e1e59-0917-4626-8e22-158fec29f33f-kube-api-access-lldct\") pod \"network-metrics-daemon-tft6b\" (UID: \"646e1e59-0917-4626-8e22-158fec29f33f\") " pod="openshift-multus/network-metrics-daemon-tft6b" May 21 14:41:29.700134 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.700060 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/43f110a5-d9cb-4410-91e4-c3da71193c3c-node-log\") pod \"ovnkube-node-5t966\" (UID: \"43f110a5-d9cb-4410-91e4-c3da71193c3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5t966" May 21 14:41:29.700134 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.700088 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/43f110a5-d9cb-4410-91e4-c3da71193c3c-host-cni-bin\") pod \"ovnkube-node-5t966\" (UID: \"43f110a5-d9cb-4410-91e4-c3da71193c3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5t966" May 21 14:41:29.700134 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.700115 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/43f110a5-d9cb-4410-91e4-c3da71193c3c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5t966\" (UID: \"43f110a5-d9cb-4410-91e4-c3da71193c3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5t966" May 21 14:41:29.700303 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.700144 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/34972f99-075d-486d-8b03-5efb08d79649-os-release\") pod \"multus-additional-cni-plugins-2cg2c\" (UID: \"34972f99-075d-486d-8b03-5efb08d79649\") " pod="openshift-multus/multus-additional-cni-plugins-2cg2c" May 21 14:41:29.700303 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.700169 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/34972f99-075d-486d-8b03-5efb08d79649-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2cg2c\" (UID: \"34972f99-075d-486d-8b03-5efb08d79649\") " pod="openshift-multus/multus-additional-cni-plugins-2cg2c" May 21 14:41:29.700303 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.700200 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/34972f99-075d-486d-8b03-5efb08d79649-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2cg2c\" (UID: \"34972f99-075d-486d-8b03-5efb08d79649\") " pod="openshift-multus/multus-additional-cni-plugins-2cg2c" May 21 14:41:29.700303 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.700223 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3ad537a1-469b-485f-8391-60e2e8db2bf4-etc-sysctl-d\") pod \"tuned-r9dpx\" (UID: \"3ad537a1-469b-485f-8391-60e2e8db2bf4\") " pod="openshift-cluster-node-tuning-operator/tuned-r9dpx" May 21 14:41:29.700303 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.700245 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3ad537a1-469b-485f-8391-60e2e8db2bf4-host\") pod \"tuned-r9dpx\" (UID: \"3ad537a1-469b-485f-8391-60e2e8db2bf4\") " pod="openshift-cluster-node-tuning-operator/tuned-r9dpx" May 21 14:41:29.700303 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.700266 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/43f110a5-d9cb-4410-91e4-c3da71193c3c-systemd-units\") pod \"ovnkube-node-5t966\" (UID: \"43f110a5-d9cb-4410-91e4-c3da71193c3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5t966" May 21 14:41:29.700303 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.700288 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/43f110a5-d9cb-4410-91e4-c3da71193c3c-host-run-ovn-kubernetes\") pod \"ovnkube-node-5t966\" (UID: \"43f110a5-d9cb-4410-91e4-c3da71193c3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5t966" May 21 14:41:29.700619 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.700308 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-jc2b2\"" May 21 14:41:29.700619 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.700454 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-r6dl7" May 21 14:41:29.700701 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.700310 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/34972f99-075d-486d-8b03-5efb08d79649-cnibin\") pod \"multus-additional-cni-plugins-2cg2c\" (UID: \"34972f99-075d-486d-8b03-5efb08d79649\") " pod="openshift-multus/multus-additional-cni-plugins-2cg2c" May 21 14:41:29.700748 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.700725 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gnsv\" (UniqueName: \"kubernetes.io/projected/2dc7761a-d68f-4f1f-ad3c-71fb26dad676-kube-api-access-2gnsv\") pod \"network-check-target-6fb9w\" (UID: \"2dc7761a-d68f-4f1f-ad3c-71fb26dad676\") " pod="openshift-network-diagnostics/network-check-target-6fb9w" May 21 14:41:29.700794 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.700751 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3ad537a1-469b-485f-8391-60e2e8db2bf4-etc-modprobe-d\") pod \"tuned-r9dpx\" (UID: \"3ad537a1-469b-485f-8391-60e2e8db2bf4\") " pod="openshift-cluster-node-tuning-operator/tuned-r9dpx" May 21 14:41:29.700839 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.700829 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vv97g\" (UniqueName: \"kubernetes.io/projected/19eadc83-10b5-48f6-ad02-e8540668c1cc-kube-api-access-vv97g\") pod \"node-ca-nfd4x\" (UID: \"19eadc83-10b5-48f6-ad02-e8540668c1cc\") " pod="openshift-image-registry/node-ca-nfd4x" May 21 14:41:29.700895 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.700878 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/43f110a5-d9cb-4410-91e4-c3da71193c3c-etc-openvswitch\") pod \"ovnkube-node-5t966\" (UID: \"43f110a5-d9cb-4410-91e4-c3da71193c3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5t966" May 21 14:41:29.700947 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.700904 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/43f110a5-d9cb-4410-91e4-c3da71193c3c-host-cni-netd\") pod \"ovnkube-node-5t966\" (UID: \"43f110a5-d9cb-4410-91e4-c3da71193c3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5t966" May 21 14:41:29.700947 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.700927 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/43f110a5-d9cb-4410-91e4-c3da71193c3c-env-overrides\") pod \"ovnkube-node-5t966\" (UID: \"43f110a5-d9cb-4410-91e4-c3da71193c3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5t966" May 21 14:41:29.701059 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.700965 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5t966" May 21 14:41:29.701059 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.700974 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/43f110a5-d9cb-4410-91e4-c3da71193c3c-ovnkube-script-lib\") pod \"ovnkube-node-5t966\" (UID: \"43f110a5-d9cb-4410-91e4-c3da71193c3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5t966" May 21 14:41:29.701059 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.701019 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/34972f99-075d-486d-8b03-5efb08d79649-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2cg2c\" (UID: \"34972f99-075d-486d-8b03-5efb08d79649\") " pod="openshift-multus/multus-additional-cni-plugins-2cg2c" May 21 14:41:29.701059 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.701044 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3ad537a1-469b-485f-8391-60e2e8db2bf4-etc-sysconfig\") pod \"tuned-r9dpx\" (UID: \"3ad537a1-469b-485f-8391-60e2e8db2bf4\") " pod="openshift-cluster-node-tuning-operator/tuned-r9dpx" May 21 14:41:29.701248 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.701098 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/646e1e59-0917-4626-8e22-158fec29f33f-metrics-certs\") pod \"network-metrics-daemon-tft6b\" (UID: \"646e1e59-0917-4626-8e22-158fec29f33f\") " pod="openshift-multus/network-metrics-daemon-tft6b" May 21 14:41:29.701248 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.701125 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/43f110a5-d9cb-4410-91e4-c3da71193c3c-ovnkube-config\") pod \"ovnkube-node-5t966\" (UID: \"43f110a5-d9cb-4410-91e4-c3da71193c3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5t966" May 21 14:41:29.701248 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.701153 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3ad537a1-469b-485f-8391-60e2e8db2bf4-sys\") pod \"tuned-r9dpx\" (UID: \"3ad537a1-469b-485f-8391-60e2e8db2bf4\") " pod="openshift-cluster-node-tuning-operator/tuned-r9dpx" May 21 14:41:29.701248 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.701177 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3ad537a1-469b-485f-8391-60e2e8db2bf4-lib-modules\") pod \"tuned-r9dpx\" (UID: \"3ad537a1-469b-485f-8391-60e2e8db2bf4\") " pod="openshift-cluster-node-tuning-operator/tuned-r9dpx" May 21 14:41:29.701248 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.701226 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/43f110a5-d9cb-4410-91e4-c3da71193c3c-log-socket\") pod \"ovnkube-node-5t966\" (UID: \"43f110a5-d9cb-4410-91e4-c3da71193c3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5t966" May 21 14:41:29.701475 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.701270 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/591d522c-4c95-4b9c-852b-f84095cc2525-hosts-file\") pod \"node-resolver-k2p4j\" (UID: \"591d522c-4c95-4b9c-852b-f84095cc2525\") " pod="openshift-dns/node-resolver-k2p4j" May 21 14:41:29.701475 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.701328 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/591d522c-4c95-4b9c-852b-f84095cc2525-tmp-dir\") pod \"node-resolver-k2p4j\" (UID: \"591d522c-4c95-4b9c-852b-f84095cc2525\") " pod="openshift-dns/node-resolver-k2p4j" May 21 14:41:29.702700 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.702679 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 21 14:41:29.702967 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.702947 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qmdnb" May 21 14:41:29.703083 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.703053 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 21 14:41:29.703156 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.703139 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 21 14:41:29.703298 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.703282 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-wk22h\"" May 21 14:41:29.703376 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.703355 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-9n8mg\"" May 21 14:41:29.703854 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.703509 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 21 14:41:29.703854 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.703587 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 21 14:41:29.703854 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.703707 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 21 14:41:29.704196 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.704077 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 21 14:41:29.705181 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.705153 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-8vltv\"" May 21 14:41:29.705774 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.705755 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 21 14:41:29.706113 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.706095 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 21 14:41:29.706252 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.706164 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 21 14:41:29.733387 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.733355 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 14:36:28 +0000 UTC" deadline="2028-01-02 14:17:21.728030844 +0000 UTC" May 21 14:41:29.733387 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.733388 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14183h35m51.994647608s" May 21 14:41:29.788970 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.788940 2573 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 21 14:41:29.802364 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.802333 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3ad537a1-469b-485f-8391-60e2e8db2bf4-sys\") pod \"tuned-r9dpx\" (UID: \"3ad537a1-469b-485f-8391-60e2e8db2bf4\") " pod="openshift-cluster-node-tuning-operator/tuned-r9dpx" May 21 14:41:29.802535 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.802376 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3ad537a1-469b-485f-8391-60e2e8db2bf4-lib-modules\") pod \"tuned-r9dpx\" (UID: \"3ad537a1-469b-485f-8391-60e2e8db2bf4\") " pod="openshift-cluster-node-tuning-operator/tuned-r9dpx" May 21 14:41:29.802535 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.802402 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/43f110a5-d9cb-4410-91e4-c3da71193c3c-log-socket\") pod \"ovnkube-node-5t966\" (UID: \"43f110a5-d9cb-4410-91e4-c3da71193c3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5t966" May 21 14:41:29.802535 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.802420 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3ad537a1-469b-485f-8391-60e2e8db2bf4-sys\") pod \"tuned-r9dpx\" (UID: \"3ad537a1-469b-485f-8391-60e2e8db2bf4\") " pod="openshift-cluster-node-tuning-operator/tuned-r9dpx" May 21 14:41:29.802535 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.802429 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f52ca37e-9f75-437f-b884-3ac7c7a74f4c-etc-selinux\") pod \"aws-ebs-csi-driver-node-m9ql9\" (UID: \"f52ca37e-9f75-437f-b884-3ac7c7a74f4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9ql9" May 21 14:41:29.802535 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.802451 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a65a2fdc-9089-4fb7-a01e-908858343c61-cnibin\") pod \"multus-r6dl7\" (UID: \"a65a2fdc-9089-4fb7-a01e-908858343c61\") " pod="openshift-multus/multus-r6dl7" May 21 14:41:29.802535 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.802474 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/43f110a5-d9cb-4410-91e4-c3da71193c3c-log-socket\") pod \"ovnkube-node-5t966\" (UID: \"43f110a5-d9cb-4410-91e4-c3da71193c3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5t966" May 21 14:41:29.802535 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.802490 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ce1c0d34-ad36-4566-ab88-6af8e7d619ed-host-slash\") pod \"iptables-alerter-qmdnb\" (UID: \"ce1c0d34-ad36-4566-ab88-6af8e7d619ed\") " pod="openshift-network-operator/iptables-alerter-qmdnb" May 21 14:41:29.802535 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.802521 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3ad537a1-469b-485f-8391-60e2e8db2bf4-lib-modules\") pod \"tuned-r9dpx\" (UID: \"3ad537a1-469b-485f-8391-60e2e8db2bf4\") " pod="openshift-cluster-node-tuning-operator/tuned-r9dpx" May 21 14:41:29.802535 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.802528 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3ad537a1-469b-485f-8391-60e2e8db2bf4-etc-tuned\") pod \"tuned-r9dpx\" (UID: \"3ad537a1-469b-485f-8391-60e2e8db2bf4\") " pod="openshift-cluster-node-tuning-operator/tuned-r9dpx" May 21 14:41:29.802982 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.802610 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/43f110a5-d9cb-4410-91e4-c3da71193c3c-run-systemd\") pod \"ovnkube-node-5t966\" (UID: \"43f110a5-d9cb-4410-91e4-c3da71193c3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5t966" May 21 14:41:29.802982 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.802681 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/43f110a5-d9cb-4410-91e4-c3da71193c3c-run-systemd\") pod \"ovnkube-node-5t966\" (UID: \"43f110a5-d9cb-4410-91e4-c3da71193c3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5t966" May 21 14:41:29.802982 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.802655 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nfvls\" (UniqueName: \"kubernetes.io/projected/591d522c-4c95-4b9c-852b-f84095cc2525-kube-api-access-nfvls\") pod \"node-resolver-k2p4j\" (UID: \"591d522c-4c95-4b9c-852b-f84095cc2525\") " pod="openshift-dns/node-resolver-k2p4j" May 21 14:41:29.802982 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.802726 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/34972f99-075d-486d-8b03-5efb08d79649-system-cni-dir\") pod \"multus-additional-cni-plugins-2cg2c\" (UID: \"34972f99-075d-486d-8b03-5efb08d79649\") " pod="openshift-multus/multus-additional-cni-plugins-2cg2c" May 21 14:41:29.802982 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.802797 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3ad537a1-469b-485f-8391-60e2e8db2bf4-tmp\") pod \"tuned-r9dpx\" (UID: \"3ad537a1-469b-485f-8391-60e2e8db2bf4\") " pod="openshift-cluster-node-tuning-operator/tuned-r9dpx" May 21 14:41:29.802982 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.802824 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/34972f99-075d-486d-8b03-5efb08d79649-system-cni-dir\") pod \"multus-additional-cni-plugins-2cg2c\" (UID: \"34972f99-075d-486d-8b03-5efb08d79649\") " pod="openshift-multus/multus-additional-cni-plugins-2cg2c" May 21 14:41:29.802982 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.802864 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f52ca37e-9f75-437f-b884-3ac7c7a74f4c-sys-fs\") pod \"aws-ebs-csi-driver-node-m9ql9\" (UID: \"f52ca37e-9f75-437f-b884-3ac7c7a74f4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9ql9" May 21 14:41:29.802982 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.802900 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a65a2fdc-9089-4fb7-a01e-908858343c61-multus-cni-dir\") pod \"multus-r6dl7\" (UID: \"a65a2fdc-9089-4fb7-a01e-908858343c61\") " pod="openshift-multus/multus-r6dl7" May 21 14:41:29.802982 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.802897 2573 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 21 14:41:29.802982 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.802943 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltv8d\" (UniqueName: \"kubernetes.io/projected/a65a2fdc-9089-4fb7-a01e-908858343c61-kube-api-access-ltv8d\") pod \"multus-r6dl7\" (UID: \"a65a2fdc-9089-4fb7-a01e-908858343c61\") " pod="openshift-multus/multus-r6dl7" May 21 14:41:29.802982 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.802977 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2s89\" (UniqueName: \"kubernetes.io/projected/ce1c0d34-ad36-4566-ab88-6af8e7d619ed-kube-api-access-w2s89\") pod \"iptables-alerter-qmdnb\" (UID: \"ce1c0d34-ad36-4566-ab88-6af8e7d619ed\") " pod="openshift-network-operator/iptables-alerter-qmdnb" May 21 14:41:29.803534 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.803028 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ad537a1-469b-485f-8391-60e2e8db2bf4-etc-kubernetes\") pod \"tuned-r9dpx\" (UID: \"3ad537a1-469b-485f-8391-60e2e8db2bf4\") " pod="openshift-cluster-node-tuning-operator/tuned-r9dpx" May 21 14:41:29.803534 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.803053 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/19eadc83-10b5-48f6-ad02-e8540668c1cc-host\") pod \"node-ca-nfd4x\" (UID: \"19eadc83-10b5-48f6-ad02-e8540668c1cc\") " pod="openshift-image-registry/node-ca-nfd4x" May 21 14:41:29.803534 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.803079 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/43f110a5-d9cb-4410-91e4-c3da71193c3c-host-kubelet\") pod \"ovnkube-node-5t966\" (UID: \"43f110a5-d9cb-4410-91e4-c3da71193c3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5t966" May 21 14:41:29.803534 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.803100 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a65a2fdc-9089-4fb7-a01e-908858343c61-host-var-lib-kubelet\") pod \"multus-r6dl7\" (UID: \"a65a2fdc-9089-4fb7-a01e-908858343c61\") " pod="openshift-multus/multus-r6dl7" May 21 14:41:29.803534 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.803124 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q5pt2\" (UniqueName: \"kubernetes.io/projected/3ad537a1-469b-485f-8391-60e2e8db2bf4-kube-api-access-q5pt2\") pod \"tuned-r9dpx\" (UID: \"3ad537a1-469b-485f-8391-60e2e8db2bf4\") " pod="openshift-cluster-node-tuning-operator/tuned-r9dpx" May 21 14:41:29.803534 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.803133 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/19eadc83-10b5-48f6-ad02-e8540668c1cc-host\") pod \"node-ca-nfd4x\" (UID: \"19eadc83-10b5-48f6-ad02-e8540668c1cc\") " pod="openshift-image-registry/node-ca-nfd4x" May 21 14:41:29.803534 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.803148 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lldct\" (UniqueName: \"kubernetes.io/projected/646e1e59-0917-4626-8e22-158fec29f33f-kube-api-access-lldct\") pod \"network-metrics-daemon-tft6b\" (UID: \"646e1e59-0917-4626-8e22-158fec29f33f\") " pod="openshift-multus/network-metrics-daemon-tft6b" May 21 14:41:29.803534 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.803174 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f52ca37e-9f75-437f-b884-3ac7c7a74f4c-device-dir\") pod \"aws-ebs-csi-driver-node-m9ql9\" (UID: \"f52ca37e-9f75-437f-b884-3ac7c7a74f4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9ql9" May 21 14:41:29.803534 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.803190 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ad537a1-469b-485f-8391-60e2e8db2bf4-etc-kubernetes\") pod \"tuned-r9dpx\" (UID: \"3ad537a1-469b-485f-8391-60e2e8db2bf4\") " pod="openshift-cluster-node-tuning-operator/tuned-r9dpx" May 21 14:41:29.803534 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.803201 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/43f110a5-d9cb-4410-91e4-c3da71193c3c-host-cni-netd\") pod \"ovnkube-node-5t966\" (UID: \"43f110a5-d9cb-4410-91e4-c3da71193c3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5t966" May 21 14:41:29.803534 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.803240 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/43f110a5-d9cb-4410-91e4-c3da71193c3c-host-kubelet\") pod \"ovnkube-node-5t966\" (UID: \"43f110a5-d9cb-4410-91e4-c3da71193c3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5t966" May 21 14:41:29.803534 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.803252 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/43f110a5-d9cb-4410-91e4-c3da71193c3c-ovnkube-script-lib\") pod \"ovnkube-node-5t966\" (UID: \"43f110a5-d9cb-4410-91e4-c3da71193c3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5t966" May 21 14:41:29.804478 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.804367 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/43f110a5-d9cb-4410-91e4-c3da71193c3c-host-cni-netd\") pod \"ovnkube-node-5t966\" (UID: \"43f110a5-d9cb-4410-91e4-c3da71193c3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5t966" May 21 14:41:29.804661 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.804635 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f52ca37e-9f75-437f-b884-3ac7c7a74f4c-socket-dir\") pod \"aws-ebs-csi-driver-node-m9ql9\" (UID: \"f52ca37e-9f75-437f-b884-3ac7c7a74f4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9ql9" May 21 14:41:29.804735 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.804698 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/34972f99-075d-486d-8b03-5efb08d79649-os-release\") pod \"multus-additional-cni-plugins-2cg2c\" (UID: \"34972f99-075d-486d-8b03-5efb08d79649\") " pod="openshift-multus/multus-additional-cni-plugins-2cg2c" May 21 14:41:29.804791 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.804741 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/34972f99-075d-486d-8b03-5efb08d79649-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2cg2c\" (UID: \"34972f99-075d-486d-8b03-5efb08d79649\") " pod="openshift-multus/multus-additional-cni-plugins-2cg2c" May 21 14:41:29.804844 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.804797 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3ad537a1-469b-485f-8391-60e2e8db2bf4-host\") pod \"tuned-r9dpx\" (UID: \"3ad537a1-469b-485f-8391-60e2e8db2bf4\") " pod="openshift-cluster-node-tuning-operator/tuned-r9dpx" May 21 14:41:29.804844 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.804831 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/43f110a5-d9cb-4410-91e4-c3da71193c3c-systemd-units\") pod \"ovnkube-node-5t966\" (UID: \"43f110a5-d9cb-4410-91e4-c3da71193c3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5t966" May 21 14:41:29.804944 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.804864 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2gnsv\" (UniqueName: \"kubernetes.io/projected/2dc7761a-d68f-4f1f-ad3c-71fb26dad676-kube-api-access-2gnsv\") pod \"network-check-target-6fb9w\" (UID: \"2dc7761a-d68f-4f1f-ad3c-71fb26dad676\") " pod="openshift-network-diagnostics/network-check-target-6fb9w" May 21 14:41:29.804944 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.804898 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3ad537a1-469b-485f-8391-60e2e8db2bf4-etc-modprobe-d\") pod \"tuned-r9dpx\" (UID: \"3ad537a1-469b-485f-8391-60e2e8db2bf4\") " pod="openshift-cluster-node-tuning-operator/tuned-r9dpx" May 21 14:41:29.804944 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.804931 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/43f110a5-d9cb-4410-91e4-c3da71193c3c-host-run-ovn-kubernetes\") pod \"ovnkube-node-5t966\" (UID: \"43f110a5-d9cb-4410-91e4-c3da71193c3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5t966" May 21 14:41:29.805117 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.804960 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a65a2fdc-9089-4fb7-a01e-908858343c61-hostroot\") pod \"multus-r6dl7\" (UID: \"a65a2fdc-9089-4fb7-a01e-908858343c61\") " pod="openshift-multus/multus-r6dl7" May 21 14:41:29.805117 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.805011 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/34972f99-075d-486d-8b03-5efb08d79649-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2cg2c\" (UID: \"34972f99-075d-486d-8b03-5efb08d79649\") " pod="openshift-multus/multus-additional-cni-plugins-2cg2c" May 21 14:41:29.805117 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.805043 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3ad537a1-469b-485f-8391-60e2e8db2bf4-etc-sysconfig\") pod \"tuned-r9dpx\" (UID: \"3ad537a1-469b-485f-8391-60e2e8db2bf4\") " pod="openshift-cluster-node-tuning-operator/tuned-r9dpx" May 21 14:41:29.805117 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.805079 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a65a2fdc-9089-4fb7-a01e-908858343c61-multus-socket-dir-parent\") pod \"multus-r6dl7\" (UID: \"a65a2fdc-9089-4fb7-a01e-908858343c61\") " pod="openshift-multus/multus-r6dl7" May 21 14:41:29.805303 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.805106 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/43f110a5-d9cb-4410-91e4-c3da71193c3c-ovnkube-script-lib\") pod \"ovnkube-node-5t966\" (UID: \"43f110a5-d9cb-4410-91e4-c3da71193c3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5t966" May 21 14:41:29.805303 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.805128 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a65a2fdc-9089-4fb7-a01e-908858343c61-host-var-lib-cni-multus\") pod \"multus-r6dl7\" (UID: \"a65a2fdc-9089-4fb7-a01e-908858343c61\") " pod="openshift-multus/multus-r6dl7" May 21 14:41:29.805303 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.805215 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/34972f99-075d-486d-8b03-5efb08d79649-os-release\") pod \"multus-additional-cni-plugins-2cg2c\" (UID: \"34972f99-075d-486d-8b03-5efb08d79649\") " pod="openshift-multus/multus-additional-cni-plugins-2cg2c" May 21 14:41:29.805303 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.805246 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/591d522c-4c95-4b9c-852b-f84095cc2525-tmp-dir\") pod \"node-resolver-k2p4j\" (UID: \"591d522c-4c95-4b9c-852b-f84095cc2525\") " pod="openshift-dns/node-resolver-k2p4j" May 21 14:41:29.805303 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.805259 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/43f110a5-d9cb-4410-91e4-c3da71193c3c-systemd-units\") pod \"ovnkube-node-5t966\" (UID: \"43f110a5-d9cb-4410-91e4-c3da71193c3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5t966" May 21 14:41:29.805303 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.805302 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a65a2fdc-9089-4fb7-a01e-908858343c61-system-cni-dir\") pod \"multus-r6dl7\" (UID: \"a65a2fdc-9089-4fb7-a01e-908858343c61\") " pod="openshift-multus/multus-r6dl7" May 21 14:41:29.805584 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.805330 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a65a2fdc-9089-4fb7-a01e-908858343c61-host-var-lib-cni-bin\") pod \"multus-r6dl7\" (UID: \"a65a2fdc-9089-4fb7-a01e-908858343c61\") " pod="openshift-multus/multus-r6dl7" May 21 14:41:29.805584 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.805363 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a65a2fdc-9089-4fb7-a01e-908858343c61-host-run-multus-certs\") pod \"multus-r6dl7\" (UID: \"a65a2fdc-9089-4fb7-a01e-908858343c61\") " pod="openshift-multus/multus-r6dl7" May 21 14:41:29.805584 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.805342 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3ad537a1-469b-485f-8391-60e2e8db2bf4-host\") pod \"tuned-r9dpx\" (UID: \"3ad537a1-469b-485f-8391-60e2e8db2bf4\") " pod="openshift-cluster-node-tuning-operator/tuned-r9dpx" May 21 14:41:29.805584 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.805401 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/43f110a5-d9cb-4410-91e4-c3da71193c3c-var-lib-openvswitch\") pod \"ovnkube-node-5t966\" (UID: \"43f110a5-d9cb-4410-91e4-c3da71193c3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5t966" May 21 14:41:29.805584 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.805430 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/43f110a5-d9cb-4410-91e4-c3da71193c3c-run-openvswitch\") pod \"ovnkube-node-5t966\" (UID: \"43f110a5-d9cb-4410-91e4-c3da71193c3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5t966" May 21 14:41:29.805584 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.805460 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/43f110a5-d9cb-4410-91e4-c3da71193c3c-run-ovn\") pod \"ovnkube-node-5t966\" (UID: \"43f110a5-d9cb-4410-91e4-c3da71193c3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5t966" May 21 14:41:29.805584 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.805498 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f52ca37e-9f75-437f-b884-3ac7c7a74f4c-registration-dir\") pod \"aws-ebs-csi-driver-node-m9ql9\" (UID: \"f52ca37e-9f75-437f-b884-3ac7c7a74f4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9ql9" May 21 14:41:29.805584 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.805533 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/97c0df6c-a20d-40ac-b07b-4337c1e00cff-konnectivity-ca\") pod \"konnectivity-agent-kbq62\" (UID: \"97c0df6c-a20d-40ac-b07b-4337c1e00cff\") " pod="kube-system/konnectivity-agent-kbq62" May 21 14:41:29.805584 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.805571 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a65a2fdc-9089-4fb7-a01e-908858343c61-host-run-netns\") pod \"multus-r6dl7\" (UID: \"a65a2fdc-9089-4fb7-a01e-908858343c61\") " pod="openshift-multus/multus-r6dl7" May 21 14:41:29.806090 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.805600 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a65a2fdc-9089-4fb7-a01e-908858343c61-etc-kubernetes\") pod \"multus-r6dl7\" (UID: \"a65a2fdc-9089-4fb7-a01e-908858343c61\") " pod="openshift-multus/multus-r6dl7" May 21 14:41:29.806090 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.805638 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/19eadc83-10b5-48f6-ad02-e8540668c1cc-serviceca\") pod \"node-ca-nfd4x\" (UID: \"19eadc83-10b5-48f6-ad02-e8540668c1cc\") " pod="openshift-image-registry/node-ca-nfd4x" May 21 14:41:29.806090 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.805672 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/591d522c-4c95-4b9c-852b-f84095cc2525-tmp-dir\") pod \"node-resolver-k2p4j\" (UID: \"591d522c-4c95-4b9c-852b-f84095cc2525\") " pod="openshift-dns/node-resolver-k2p4j" May 21 14:41:29.806090 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.805981 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3ad537a1-469b-485f-8391-60e2e8db2bf4-etc-modprobe-d\") pod \"tuned-r9dpx\" (UID: \"3ad537a1-469b-485f-8391-60e2e8db2bf4\") " pod="openshift-cluster-node-tuning-operator/tuned-r9dpx" May 21 14:41:29.806090 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.806061 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/43f110a5-d9cb-4410-91e4-c3da71193c3c-host-run-ovn-kubernetes\") pod \"ovnkube-node-5t966\" (UID: \"43f110a5-d9cb-4410-91e4-c3da71193c3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5t966" May 21 14:41:29.806320 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.806209 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/34972f99-075d-486d-8b03-5efb08d79649-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2cg2c\" (UID: \"34972f99-075d-486d-8b03-5efb08d79649\") " pod="openshift-multus/multus-additional-cni-plugins-2cg2c" May 21 14:41:29.806320 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.806272 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3ad537a1-469b-485f-8391-60e2e8db2bf4-etc-sysconfig\") pod \"tuned-r9dpx\" (UID: \"3ad537a1-469b-485f-8391-60e2e8db2bf4\") " pod="openshift-cluster-node-tuning-operator/tuned-r9dpx" May 21 14:41:29.806650 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.806625 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3ad537a1-469b-485f-8391-60e2e8db2bf4-etc-tuned\") pod \"tuned-r9dpx\" (UID: \"3ad537a1-469b-485f-8391-60e2e8db2bf4\") " pod="openshift-cluster-node-tuning-operator/tuned-r9dpx" May 21 14:41:29.806836 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.806809 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/34972f99-075d-486d-8b03-5efb08d79649-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2cg2c\" (UID: \"34972f99-075d-486d-8b03-5efb08d79649\") " pod="openshift-multus/multus-additional-cni-plugins-2cg2c" May 21 14:41:29.806976 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.806942 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/43f110a5-d9cb-4410-91e4-c3da71193c3c-var-lib-openvswitch\") pod \"ovnkube-node-5t966\" (UID: \"43f110a5-d9cb-4410-91e4-c3da71193c3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5t966" May 21 14:41:29.807066 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.807024 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/43f110a5-d9cb-4410-91e4-c3da71193c3c-run-openvswitch\") pod \"ovnkube-node-5t966\" (UID: \"43f110a5-d9cb-4410-91e4-c3da71193c3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5t966" May 21 14:41:29.807126 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.807080 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/43f110a5-d9cb-4410-91e4-c3da71193c3c-run-ovn\") pod \"ovnkube-node-5t966\" (UID: \"43f110a5-d9cb-4410-91e4-c3da71193c3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5t966" May 21 14:41:29.807713 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.807546 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/19eadc83-10b5-48f6-ad02-e8540668c1cc-serviceca\") pod \"node-ca-nfd4x\" (UID: \"19eadc83-10b5-48f6-ad02-e8540668c1cc\") " pod="openshift-image-registry/node-ca-nfd4x" May 21 14:41:29.807713 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.805673 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/43f110a5-d9cb-4410-91e4-c3da71193c3c-ovn-node-metrics-cert\") pod \"ovnkube-node-5t966\" (UID: \"43f110a5-d9cb-4410-91e4-c3da71193c3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5t966" May 21 14:41:29.807713 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.807661 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zdqzd\" (UniqueName: \"kubernetes.io/projected/43f110a5-d9cb-4410-91e4-c3da71193c3c-kube-api-access-zdqzd\") pod \"ovnkube-node-5t966\" (UID: \"43f110a5-d9cb-4410-91e4-c3da71193c3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5t966" May 21 14:41:29.807713 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.807698 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/34972f99-075d-486d-8b03-5efb08d79649-cni-binary-copy\") pod \"multus-additional-cni-plugins-2cg2c\" (UID: \"34972f99-075d-486d-8b03-5efb08d79649\") " pod="openshift-multus/multus-additional-cni-plugins-2cg2c" May 21 14:41:29.807955 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.807734 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3ad537a1-469b-485f-8391-60e2e8db2bf4-etc-sysctl-conf\") pod \"tuned-r9dpx\" (UID: \"3ad537a1-469b-485f-8391-60e2e8db2bf4\") " pod="openshift-cluster-node-tuning-operator/tuned-r9dpx" May 21 14:41:29.807955 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.807763 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ad537a1-469b-485f-8391-60e2e8db2bf4-var-lib-kubelet\") pod \"tuned-r9dpx\" (UID: \"3ad537a1-469b-485f-8391-60e2e8db2bf4\") " pod="openshift-cluster-node-tuning-operator/tuned-r9dpx" May 21 14:41:29.807955 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.807794 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/43f110a5-d9cb-4410-91e4-c3da71193c3c-host-slash\") pod \"ovnkube-node-5t966\" (UID: \"43f110a5-d9cb-4410-91e4-c3da71193c3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5t966" May 21 14:41:29.807955 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.807825 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/43f110a5-d9cb-4410-91e4-c3da71193c3c-host-run-netns\") pod \"ovnkube-node-5t966\" (UID: \"43f110a5-d9cb-4410-91e4-c3da71193c3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5t966" May 21 14:41:29.807955 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.807863 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmtpw\" (UniqueName: \"kubernetes.io/projected/f52ca37e-9f75-437f-b884-3ac7c7a74f4c-kube-api-access-tmtpw\") pod \"aws-ebs-csi-driver-node-m9ql9\" (UID: \"f52ca37e-9f75-437f-b884-3ac7c7a74f4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9ql9" May 21 14:41:29.807955 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.807897 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a65a2fdc-9089-4fb7-a01e-908858343c61-multus-conf-dir\") pod \"multus-r6dl7\" (UID: \"a65a2fdc-9089-4fb7-a01e-908858343c61\") " pod="openshift-multus/multus-r6dl7" May 21 14:41:29.807955 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.807930 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m99lc\" (UniqueName: \"kubernetes.io/projected/34972f99-075d-486d-8b03-5efb08d79649-kube-api-access-m99lc\") pod \"multus-additional-cni-plugins-2cg2c\" (UID: \"34972f99-075d-486d-8b03-5efb08d79649\") " pod="openshift-multus/multus-additional-cni-plugins-2cg2c" May 21 14:41:29.808295 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.807962 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3ad537a1-469b-485f-8391-60e2e8db2bf4-etc-systemd\") pod \"tuned-r9dpx\" (UID: \"3ad537a1-469b-485f-8391-60e2e8db2bf4\") " pod="openshift-cluster-node-tuning-operator/tuned-r9dpx" May 21 14:41:29.808295 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.808006 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3ad537a1-469b-485f-8391-60e2e8db2bf4-run\") pod \"tuned-r9dpx\" (UID: \"3ad537a1-469b-485f-8391-60e2e8db2bf4\") " pod="openshift-cluster-node-tuning-operator/tuned-r9dpx" May 21 14:41:29.808295 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.808039 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/43f110a5-d9cb-4410-91e4-c3da71193c3c-node-log\") pod \"ovnkube-node-5t966\" (UID: \"43f110a5-d9cb-4410-91e4-c3da71193c3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5t966" May 21 14:41:29.808295 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.808070 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/43f110a5-d9cb-4410-91e4-c3da71193c3c-host-cni-bin\") pod \"ovnkube-node-5t966\" (UID: \"43f110a5-d9cb-4410-91e4-c3da71193c3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5t966" May 21 14:41:29.808295 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.808123 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/43f110a5-d9cb-4410-91e4-c3da71193c3c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5t966\" (UID: \"43f110a5-d9cb-4410-91e4-c3da71193c3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5t966" May 21 14:41:29.808295 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.808164 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a65a2fdc-9089-4fb7-a01e-908858343c61-host-run-k8s-cni-cncf-io\") pod \"multus-r6dl7\" (UID: \"a65a2fdc-9089-4fb7-a01e-908858343c61\") " pod="openshift-multus/multus-r6dl7" May 21 14:41:29.808295 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.808206 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/43f110a5-d9cb-4410-91e4-c3da71193c3c-env-overrides\") pod \"ovnkube-node-5t966\" (UID: \"43f110a5-d9cb-4410-91e4-c3da71193c3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5t966" May 21 14:41:29.808295 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.808242 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/591d522c-4c95-4b9c-852b-f84095cc2525-hosts-file\") pod \"node-resolver-k2p4j\" (UID: \"591d522c-4c95-4b9c-852b-f84095cc2525\") " pod="openshift-dns/node-resolver-k2p4j" May 21 14:41:29.808295 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.808278 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f52ca37e-9f75-437f-b884-3ac7c7a74f4c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m9ql9\" (UID: \"f52ca37e-9f75-437f-b884-3ac7c7a74f4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9ql9" May 21 14:41:29.808295 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.808289 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/43f110a5-d9cb-4410-91e4-c3da71193c3c-ovn-node-metrics-cert\") pod \"ovnkube-node-5t966\" (UID: \"43f110a5-d9cb-4410-91e4-c3da71193c3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5t966" May 21 14:41:29.808782 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.808314 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/34972f99-075d-486d-8b03-5efb08d79649-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2cg2c\" (UID: \"34972f99-075d-486d-8b03-5efb08d79649\") " pod="openshift-multus/multus-additional-cni-plugins-2cg2c" May 21 14:41:29.808782 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.808344 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3ad537a1-469b-485f-8391-60e2e8db2bf4-etc-sysctl-d\") pod \"tuned-r9dpx\" (UID: \"3ad537a1-469b-485f-8391-60e2e8db2bf4\") " pod="openshift-cluster-node-tuning-operator/tuned-r9dpx" May 21 14:41:29.808782 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.808384 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/97c0df6c-a20d-40ac-b07b-4337c1e00cff-agent-certs\") pod \"konnectivity-agent-kbq62\" (UID: \"97c0df6c-a20d-40ac-b07b-4337c1e00cff\") " pod="kube-system/konnectivity-agent-kbq62" May 21 14:41:29.808782 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.808418 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a65a2fdc-9089-4fb7-a01e-908858343c61-os-release\") pod \"multus-r6dl7\" (UID: \"a65a2fdc-9089-4fb7-a01e-908858343c61\") " pod="openshift-multus/multus-r6dl7" May 21 14:41:29.808782 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.808453 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a65a2fdc-9089-4fb7-a01e-908858343c61-multus-daemon-config\") pod \"multus-r6dl7\" (UID: \"a65a2fdc-9089-4fb7-a01e-908858343c61\") " pod="openshift-multus/multus-r6dl7" May 21 14:41:29.808782 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.808489 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/34972f99-075d-486d-8b03-5efb08d79649-cnibin\") pod \"multus-additional-cni-plugins-2cg2c\" (UID: \"34972f99-075d-486d-8b03-5efb08d79649\") " pod="openshift-multus/multus-additional-cni-plugins-2cg2c" May 21 14:41:29.808782 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.808517 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vv97g\" (UniqueName: \"kubernetes.io/projected/19eadc83-10b5-48f6-ad02-e8540668c1cc-kube-api-access-vv97g\") pod \"node-ca-nfd4x\" (UID: \"19eadc83-10b5-48f6-ad02-e8540668c1cc\") " pod="openshift-image-registry/node-ca-nfd4x" May 21 14:41:29.808782 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.808551 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/43f110a5-d9cb-4410-91e4-c3da71193c3c-etc-openvswitch\") pod \"ovnkube-node-5t966\" (UID: \"43f110a5-d9cb-4410-91e4-c3da71193c3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5t966" May 21 14:41:29.808782 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.808570 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/34972f99-075d-486d-8b03-5efb08d79649-cni-binary-copy\") pod \"multus-additional-cni-plugins-2cg2c\" (UID: \"34972f99-075d-486d-8b03-5efb08d79649\") " pod="openshift-multus/multus-additional-cni-plugins-2cg2c" May 21 14:41:29.808782 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.808586 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ce1c0d34-ad36-4566-ab88-6af8e7d619ed-iptables-alerter-script\") pod \"iptables-alerter-qmdnb\" (UID: \"ce1c0d34-ad36-4566-ab88-6af8e7d619ed\") " pod="openshift-network-operator/iptables-alerter-qmdnb" May 21 14:41:29.808782 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.808622 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/646e1e59-0917-4626-8e22-158fec29f33f-metrics-certs\") pod \"network-metrics-daemon-tft6b\" (UID: \"646e1e59-0917-4626-8e22-158fec29f33f\") " pod="openshift-multus/network-metrics-daemon-tft6b" May 21 14:41:29.808782 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.808647 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/43f110a5-d9cb-4410-91e4-c3da71193c3c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5t966\" (UID: \"43f110a5-d9cb-4410-91e4-c3da71193c3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5t966" May 21 14:41:29.808782 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.808659 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/43f110a5-d9cb-4410-91e4-c3da71193c3c-ovnkube-config\") pod \"ovnkube-node-5t966\" (UID: \"43f110a5-d9cb-4410-91e4-c3da71193c3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5t966" May 21 14:41:29.808782 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.808705 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ad537a1-469b-485f-8391-60e2e8db2bf4-var-lib-kubelet\") pod \"tuned-r9dpx\" (UID: \"3ad537a1-469b-485f-8391-60e2e8db2bf4\") " pod="openshift-cluster-node-tuning-operator/tuned-r9dpx" May 21 14:41:29.808782 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.808740 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a65a2fdc-9089-4fb7-a01e-908858343c61-cni-binary-copy\") pod \"multus-r6dl7\" (UID: \"a65a2fdc-9089-4fb7-a01e-908858343c61\") " pod="openshift-multus/multus-r6dl7" May 21 14:41:29.809505 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.808843 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/43f110a5-d9cb-4410-91e4-c3da71193c3c-host-slash\") pod \"ovnkube-node-5t966\" (UID: \"43f110a5-d9cb-4410-91e4-c3da71193c3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5t966" May 21 14:41:29.809505 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.808891 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/43f110a5-d9cb-4410-91e4-c3da71193c3c-host-run-netns\") pod \"ovnkube-node-5t966\" (UID: \"43f110a5-d9cb-4410-91e4-c3da71193c3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5t966" May 21 14:41:29.809505 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.809010 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3ad537a1-469b-485f-8391-60e2e8db2bf4-etc-sysctl-conf\") pod \"tuned-r9dpx\" (UID: \"3ad537a1-469b-485f-8391-60e2e8db2bf4\") " pod="openshift-cluster-node-tuning-operator/tuned-r9dpx" May 21 14:41:29.809505 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.809178 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/43f110a5-d9cb-4410-91e4-c3da71193c3c-ovnkube-config\") pod \"ovnkube-node-5t966\" (UID: \"43f110a5-d9cb-4410-91e4-c3da71193c3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5t966" May 21 14:41:29.809505 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.809307 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3ad537a1-469b-485f-8391-60e2e8db2bf4-run\") pod \"tuned-r9dpx\" (UID: \"3ad537a1-469b-485f-8391-60e2e8db2bf4\") " pod="openshift-cluster-node-tuning-operator/tuned-r9dpx" May 21 14:41:29.809505 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.809357 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3ad537a1-469b-485f-8391-60e2e8db2bf4-tmp\") pod \"tuned-r9dpx\" (UID: \"3ad537a1-469b-485f-8391-60e2e8db2bf4\") " pod="openshift-cluster-node-tuning-operator/tuned-r9dpx" May 21 14:41:29.809505 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.809360 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/43f110a5-d9cb-4410-91e4-c3da71193c3c-node-log\") pod \"ovnkube-node-5t966\" (UID: \"43f110a5-d9cb-4410-91e4-c3da71193c3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5t966" May 21 14:41:29.809505 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.809399 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/43f110a5-d9cb-4410-91e4-c3da71193c3c-host-cni-bin\") pod \"ovnkube-node-5t966\" (UID: \"43f110a5-d9cb-4410-91e4-c3da71193c3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5t966" May 21 14:41:29.810258 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.809690 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3ad537a1-469b-485f-8391-60e2e8db2bf4-etc-systemd\") pod \"tuned-r9dpx\" (UID: \"3ad537a1-469b-485f-8391-60e2e8db2bf4\") " pod="openshift-cluster-node-tuning-operator/tuned-r9dpx" May 21 14:41:29.810258 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.809724 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/34972f99-075d-486d-8b03-5efb08d79649-cnibin\") pod \"multus-additional-cni-plugins-2cg2c\" (UID: \"34972f99-075d-486d-8b03-5efb08d79649\") " pod="openshift-multus/multus-additional-cni-plugins-2cg2c" May 21 14:41:29.810258 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.809750 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/43f110a5-d9cb-4410-91e4-c3da71193c3c-etc-openvswitch\") pod \"ovnkube-node-5t966\" (UID: \"43f110a5-d9cb-4410-91e4-c3da71193c3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5t966" May 21 14:41:29.810258 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:29.809887 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:41:29.810258 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.809926 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/591d522c-4c95-4b9c-852b-f84095cc2525-hosts-file\") pod \"node-resolver-k2p4j\" (UID: \"591d522c-4c95-4b9c-852b-f84095cc2525\") " pod="openshift-dns/node-resolver-k2p4j" May 21 14:41:29.810258 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:29.809984 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/646e1e59-0917-4626-8e22-158fec29f33f-metrics-certs podName:646e1e59-0917-4626-8e22-158fec29f33f nodeName:}" failed. No retries permitted until 2026-05-21 14:41:30.309951608 +0000 UTC m=+3.048207119 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/646e1e59-0917-4626-8e22-158fec29f33f-metrics-certs") pod "network-metrics-daemon-tft6b" (UID: "646e1e59-0917-4626-8e22-158fec29f33f") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:41:29.810258 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.810051 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3ad537a1-469b-485f-8391-60e2e8db2bf4-etc-sysctl-d\") pod \"tuned-r9dpx\" (UID: \"3ad537a1-469b-485f-8391-60e2e8db2bf4\") " pod="openshift-cluster-node-tuning-operator/tuned-r9dpx" May 21 14:41:29.811447 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.810741 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/34972f99-075d-486d-8b03-5efb08d79649-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2cg2c\" (UID: \"34972f99-075d-486d-8b03-5efb08d79649\") " pod="openshift-multus/multus-additional-cni-plugins-2cg2c" May 21 14:41:29.811447 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:29.811063 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 14:41:29.811447 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:29.811093 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 14:41:29.811447 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:29.811107 2573 projected.go:194] Error preparing data for projected volume kube-api-access-2gnsv for pod openshift-network-diagnostics/network-check-target-6fb9w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:41:29.811447 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:29.811181 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2dc7761a-d68f-4f1f-ad3c-71fb26dad676-kube-api-access-2gnsv podName:2dc7761a-d68f-4f1f-ad3c-71fb26dad676 nodeName:}" failed. No retries permitted until 2026-05-21 14:41:30.311165758 +0000 UTC m=+3.049421285 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2gnsv" (UniqueName: "kubernetes.io/projected/2dc7761a-d68f-4f1f-ad3c-71fb26dad676-kube-api-access-2gnsv") pod "network-check-target-6fb9w" (UID: "2dc7761a-d68f-4f1f-ad3c-71fb26dad676") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:41:29.811447 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.811287 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfvls\" (UniqueName: \"kubernetes.io/projected/591d522c-4c95-4b9c-852b-f84095cc2525-kube-api-access-nfvls\") pod \"node-resolver-k2p4j\" (UID: \"591d522c-4c95-4b9c-852b-f84095cc2525\") " pod="openshift-dns/node-resolver-k2p4j" May 21 14:41:29.811447 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.811317 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/43f110a5-d9cb-4410-91e4-c3da71193c3c-env-overrides\") pod \"ovnkube-node-5t966\" (UID: \"43f110a5-d9cb-4410-91e4-c3da71193c3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5t966" May 21 14:41:29.815294 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.814931 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lldct\" (UniqueName: \"kubernetes.io/projected/646e1e59-0917-4626-8e22-158fec29f33f-kube-api-access-lldct\") pod \"network-metrics-daemon-tft6b\" (UID: \"646e1e59-0917-4626-8e22-158fec29f33f\") " pod="openshift-multus/network-metrics-daemon-tft6b" May 21 14:41:29.816356 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.816332 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5pt2\" (UniqueName: \"kubernetes.io/projected/3ad537a1-469b-485f-8391-60e2e8db2bf4-kube-api-access-q5pt2\") pod \"tuned-r9dpx\" (UID: \"3ad537a1-469b-485f-8391-60e2e8db2bf4\") " pod="openshift-cluster-node-tuning-operator/tuned-r9dpx" May 21 14:41:29.817867 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.817807 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vv97g\" (UniqueName: \"kubernetes.io/projected/19eadc83-10b5-48f6-ad02-e8540668c1cc-kube-api-access-vv97g\") pod \"node-ca-nfd4x\" (UID: \"19eadc83-10b5-48f6-ad02-e8540668c1cc\") " pod="openshift-image-registry/node-ca-nfd4x" May 21 14:41:29.818465 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.818441 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdqzd\" (UniqueName: \"kubernetes.io/projected/43f110a5-d9cb-4410-91e4-c3da71193c3c-kube-api-access-zdqzd\") pod \"ovnkube-node-5t966\" (UID: \"43f110a5-d9cb-4410-91e4-c3da71193c3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5t966" May 21 14:41:29.819390 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.819337 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-244.ec2.internal" event={"ID":"1ee1cfe3f6bdf88984f096881704d77b","Type":"ContainerStarted","Data":"d41d1e93d39d80c962f0af228b0dd6991c514c6749c2d1739e4c81b523ce7533"} May 21 14:41:29.820936 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.820912 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m99lc\" (UniqueName: \"kubernetes.io/projected/34972f99-075d-486d-8b03-5efb08d79649-kube-api-access-m99lc\") pod \"multus-additional-cni-plugins-2cg2c\" (UID: \"34972f99-075d-486d-8b03-5efb08d79649\") " pod="openshift-multus/multus-additional-cni-plugins-2cg2c" May 21 14:41:29.821946 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.821917 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-244.ec2.internal" event={"ID":"f76149253834985fa6424385c0e68027","Type":"ContainerStarted","Data":"8c277b0fd4b2679abd26920781562741bc6392b348b79d9dd2e6dc027d14f56b"} May 21 14:41:29.897795 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.897741 2573 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 21 14:41:29.909156 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.909127 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a65a2fdc-9089-4fb7-a01e-908858343c61-system-cni-dir\") pod \"multus-r6dl7\" (UID: \"a65a2fdc-9089-4fb7-a01e-908858343c61\") " pod="openshift-multus/multus-r6dl7" May 21 14:41:29.909156 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.909168 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a65a2fdc-9089-4fb7-a01e-908858343c61-host-var-lib-cni-bin\") pod \"multus-r6dl7\" (UID: \"a65a2fdc-9089-4fb7-a01e-908858343c61\") " pod="openshift-multus/multus-r6dl7" May 21 14:41:29.909382 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.909194 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a65a2fdc-9089-4fb7-a01e-908858343c61-host-run-multus-certs\") pod \"multus-r6dl7\" (UID: \"a65a2fdc-9089-4fb7-a01e-908858343c61\") " pod="openshift-multus/multus-r6dl7" May 21 14:41:29.909382 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.909219 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f52ca37e-9f75-437f-b884-3ac7c7a74f4c-registration-dir\") pod \"aws-ebs-csi-driver-node-m9ql9\" (UID: \"f52ca37e-9f75-437f-b884-3ac7c7a74f4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9ql9" May 21 14:41:29.909382 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.909230 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a65a2fdc-9089-4fb7-a01e-908858343c61-system-cni-dir\") pod \"multus-r6dl7\" (UID: \"a65a2fdc-9089-4fb7-a01e-908858343c61\") " pod="openshift-multus/multus-r6dl7" May 21 14:41:29.909382 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.909242 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/97c0df6c-a20d-40ac-b07b-4337c1e00cff-konnectivity-ca\") pod \"konnectivity-agent-kbq62\" (UID: \"97c0df6c-a20d-40ac-b07b-4337c1e00cff\") " pod="kube-system/konnectivity-agent-kbq62" May 21 14:41:29.909382 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.909265 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a65a2fdc-9089-4fb7-a01e-908858343c61-host-run-netns\") pod \"multus-r6dl7\" (UID: \"a65a2fdc-9089-4fb7-a01e-908858343c61\") " pod="openshift-multus/multus-r6dl7" May 21 14:41:29.909382 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.909287 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a65a2fdc-9089-4fb7-a01e-908858343c61-etc-kubernetes\") pod \"multus-r6dl7\" (UID: \"a65a2fdc-9089-4fb7-a01e-908858343c61\") " pod="openshift-multus/multus-r6dl7" May 21 14:41:29.909382 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.909322 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tmtpw\" (UniqueName: \"kubernetes.io/projected/f52ca37e-9f75-437f-b884-3ac7c7a74f4c-kube-api-access-tmtpw\") pod \"aws-ebs-csi-driver-node-m9ql9\" (UID: \"f52ca37e-9f75-437f-b884-3ac7c7a74f4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9ql9" May 21 14:41:29.909382 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.909348 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a65a2fdc-9089-4fb7-a01e-908858343c61-multus-conf-dir\") pod \"multus-r6dl7\" (UID: \"a65a2fdc-9089-4fb7-a01e-908858343c61\") " pod="openshift-multus/multus-r6dl7" May 21 14:41:29.909382 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.909357 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f52ca37e-9f75-437f-b884-3ac7c7a74f4c-registration-dir\") pod \"aws-ebs-csi-driver-node-m9ql9\" (UID: \"f52ca37e-9f75-437f-b884-3ac7c7a74f4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9ql9" May 21 14:41:29.909382 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.909381 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a65a2fdc-9089-4fb7-a01e-908858343c61-host-run-k8s-cni-cncf-io\") pod \"multus-r6dl7\" (UID: \"a65a2fdc-9089-4fb7-a01e-908858343c61\") " pod="openshift-multus/multus-r6dl7" May 21 14:41:29.909822 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.909407 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f52ca37e-9f75-437f-b884-3ac7c7a74f4c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m9ql9\" (UID: \"f52ca37e-9f75-437f-b884-3ac7c7a74f4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9ql9" May 21 14:41:29.909822 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.909414 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a65a2fdc-9089-4fb7-a01e-908858343c61-host-run-netns\") pod \"multus-r6dl7\" (UID: \"a65a2fdc-9089-4fb7-a01e-908858343c61\") " pod="openshift-multus/multus-r6dl7" May 21 14:41:29.909822 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.909435 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/97c0df6c-a20d-40ac-b07b-4337c1e00cff-agent-certs\") pod \"konnectivity-agent-kbq62\" (UID: \"97c0df6c-a20d-40ac-b07b-4337c1e00cff\") " pod="kube-system/konnectivity-agent-kbq62" May 21 14:41:29.909822 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.909457 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a65a2fdc-9089-4fb7-a01e-908858343c61-etc-kubernetes\") pod \"multus-r6dl7\" (UID: \"a65a2fdc-9089-4fb7-a01e-908858343c61\") " pod="openshift-multus/multus-r6dl7" May 21 14:41:29.909822 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.909461 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a65a2fdc-9089-4fb7-a01e-908858343c61-os-release\") pod \"multus-r6dl7\" (UID: \"a65a2fdc-9089-4fb7-a01e-908858343c61\") " pod="openshift-multus/multus-r6dl7" May 21 14:41:29.909822 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.909488 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a65a2fdc-9089-4fb7-a01e-908858343c61-multus-daemon-config\") pod \"multus-r6dl7\" (UID: \"a65a2fdc-9089-4fb7-a01e-908858343c61\") " pod="openshift-multus/multus-r6dl7" May 21 14:41:29.909822 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.909501 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a65a2fdc-9089-4fb7-a01e-908858343c61-host-run-k8s-cni-cncf-io\") pod \"multus-r6dl7\" (UID: \"a65a2fdc-9089-4fb7-a01e-908858343c61\") " pod="openshift-multus/multus-r6dl7" May 21 14:41:29.909822 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.909520 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ce1c0d34-ad36-4566-ab88-6af8e7d619ed-iptables-alerter-script\") pod \"iptables-alerter-qmdnb\" (UID: \"ce1c0d34-ad36-4566-ab88-6af8e7d619ed\") " pod="openshift-network-operator/iptables-alerter-qmdnb" May 21 14:41:29.909822 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.909562 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a65a2fdc-9089-4fb7-a01e-908858343c61-cni-binary-copy\") pod \"multus-r6dl7\" (UID: \"a65a2fdc-9089-4fb7-a01e-908858343c61\") " pod="openshift-multus/multus-r6dl7" May 21 14:41:29.909822 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.909591 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f52ca37e-9f75-437f-b884-3ac7c7a74f4c-etc-selinux\") pod \"aws-ebs-csi-driver-node-m9ql9\" (UID: \"f52ca37e-9f75-437f-b884-3ac7c7a74f4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9ql9" May 21 14:41:29.909822 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.909617 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a65a2fdc-9089-4fb7-a01e-908858343c61-cnibin\") pod \"multus-r6dl7\" (UID: \"a65a2fdc-9089-4fb7-a01e-908858343c61\") " pod="openshift-multus/multus-r6dl7" May 21 14:41:29.909822 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.909642 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ce1c0d34-ad36-4566-ab88-6af8e7d619ed-host-slash\") pod \"iptables-alerter-qmdnb\" (UID: \"ce1c0d34-ad36-4566-ab88-6af8e7d619ed\") " pod="openshift-network-operator/iptables-alerter-qmdnb" May 21 14:41:29.909822 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.909671 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f52ca37e-9f75-437f-b884-3ac7c7a74f4c-sys-fs\") pod \"aws-ebs-csi-driver-node-m9ql9\" (UID: \"f52ca37e-9f75-437f-b884-3ac7c7a74f4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9ql9" May 21 14:41:29.909822 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.909698 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a65a2fdc-9089-4fb7-a01e-908858343c61-multus-cni-dir\") pod \"multus-r6dl7\" (UID: \"a65a2fdc-9089-4fb7-a01e-908858343c61\") " pod="openshift-multus/multus-r6dl7" May 21 14:41:29.909822 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.909289 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a65a2fdc-9089-4fb7-a01e-908858343c61-host-var-lib-cni-bin\") pod \"multus-r6dl7\" (UID: \"a65a2fdc-9089-4fb7-a01e-908858343c61\") " pod="openshift-multus/multus-r6dl7" May 21 14:41:29.909822 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.909788 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/97c0df6c-a20d-40ac-b07b-4337c1e00cff-konnectivity-ca\") pod \"konnectivity-agent-kbq62\" (UID: \"97c0df6c-a20d-40ac-b07b-4337c1e00cff\") " pod="kube-system/konnectivity-agent-kbq62" May 21 14:41:29.909822 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.909824 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a65a2fdc-9089-4fb7-a01e-908858343c61-multus-conf-dir\") pod \"multus-r6dl7\" (UID: \"a65a2fdc-9089-4fb7-a01e-908858343c61\") " pod="openshift-multus/multus-r6dl7" May 21 14:41:29.910605 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.909842 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a65a2fdc-9089-4fb7-a01e-908858343c61-multus-cni-dir\") pod \"multus-r6dl7\" (UID: \"a65a2fdc-9089-4fb7-a01e-908858343c61\") " pod="openshift-multus/multus-r6dl7" May 21 14:41:29.910605 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.909854 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f52ca37e-9f75-437f-b884-3ac7c7a74f4c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m9ql9\" (UID: \"f52ca37e-9f75-437f-b884-3ac7c7a74f4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9ql9" May 21 14:41:29.910605 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.909289 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a65a2fdc-9089-4fb7-a01e-908858343c61-host-run-multus-certs\") pod \"multus-r6dl7\" (UID: \"a65a2fdc-9089-4fb7-a01e-908858343c61\") " pod="openshift-multus/multus-r6dl7" May 21 14:41:29.910605 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.909908 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a65a2fdc-9089-4fb7-a01e-908858343c61-cnibin\") pod \"multus-r6dl7\" (UID: \"a65a2fdc-9089-4fb7-a01e-908858343c61\") " pod="openshift-multus/multus-r6dl7" May 21 14:41:29.910605 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.909923 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f52ca37e-9f75-437f-b884-3ac7c7a74f4c-sys-fs\") pod \"aws-ebs-csi-driver-node-m9ql9\" (UID: \"f52ca37e-9f75-437f-b884-3ac7c7a74f4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9ql9" May 21 14:41:29.910605 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.909925 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f52ca37e-9f75-437f-b884-3ac7c7a74f4c-etc-selinux\") pod \"aws-ebs-csi-driver-node-m9ql9\" (UID: \"f52ca37e-9f75-437f-b884-3ac7c7a74f4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9ql9" May 21 14:41:29.910605 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.909944 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ce1c0d34-ad36-4566-ab88-6af8e7d619ed-host-slash\") pod \"iptables-alerter-qmdnb\" (UID: \"ce1c0d34-ad36-4566-ab88-6af8e7d619ed\") " pod="openshift-network-operator/iptables-alerter-qmdnb" May 21 14:41:29.910605 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.910082 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a65a2fdc-9089-4fb7-a01e-908858343c61-os-release\") pod \"multus-r6dl7\" (UID: \"a65a2fdc-9089-4fb7-a01e-908858343c61\") " pod="openshift-multus/multus-r6dl7" May 21 14:41:29.910605 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.910148 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ltv8d\" (UniqueName: \"kubernetes.io/projected/a65a2fdc-9089-4fb7-a01e-908858343c61-kube-api-access-ltv8d\") pod \"multus-r6dl7\" (UID: \"a65a2fdc-9089-4fb7-a01e-908858343c61\") " pod="openshift-multus/multus-r6dl7" May 21 14:41:29.910605 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.910183 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w2s89\" (UniqueName: \"kubernetes.io/projected/ce1c0d34-ad36-4566-ab88-6af8e7d619ed-kube-api-access-w2s89\") pod \"iptables-alerter-qmdnb\" (UID: \"ce1c0d34-ad36-4566-ab88-6af8e7d619ed\") " pod="openshift-network-operator/iptables-alerter-qmdnb" May 21 14:41:29.910605 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.910215 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a65a2fdc-9089-4fb7-a01e-908858343c61-host-var-lib-kubelet\") pod \"multus-r6dl7\" (UID: \"a65a2fdc-9089-4fb7-a01e-908858343c61\") " pod="openshift-multus/multus-r6dl7" May 21 14:41:29.910605 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.910247 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f52ca37e-9f75-437f-b884-3ac7c7a74f4c-device-dir\") pod \"aws-ebs-csi-driver-node-m9ql9\" (UID: \"f52ca37e-9f75-437f-b884-3ac7c7a74f4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9ql9" May 21 14:41:29.910605 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.910276 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f52ca37e-9f75-437f-b884-3ac7c7a74f4c-socket-dir\") pod \"aws-ebs-csi-driver-node-m9ql9\" (UID: \"f52ca37e-9f75-437f-b884-3ac7c7a74f4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9ql9" May 21 14:41:29.910605 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.910333 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a65a2fdc-9089-4fb7-a01e-908858343c61-hostroot\") pod \"multus-r6dl7\" (UID: \"a65a2fdc-9089-4fb7-a01e-908858343c61\") " pod="openshift-multus/multus-r6dl7" May 21 14:41:29.910605 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.910364 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a65a2fdc-9089-4fb7-a01e-908858343c61-multus-socket-dir-parent\") pod \"multus-r6dl7\" (UID: \"a65a2fdc-9089-4fb7-a01e-908858343c61\") " pod="openshift-multus/multus-r6dl7" May 21 14:41:29.910605 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.910392 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a65a2fdc-9089-4fb7-a01e-908858343c61-host-var-lib-cni-multus\") pod \"multus-r6dl7\" (UID: \"a65a2fdc-9089-4fb7-a01e-908858343c61\") " pod="openshift-multus/multus-r6dl7" May 21 14:41:29.910605 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.910468 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a65a2fdc-9089-4fb7-a01e-908858343c61-host-var-lib-cni-multus\") pod \"multus-r6dl7\" (UID: \"a65a2fdc-9089-4fb7-a01e-908858343c61\") " pod="openshift-multus/multus-r6dl7" May 21 14:41:29.910605 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.910493 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a65a2fdc-9089-4fb7-a01e-908858343c61-cni-binary-copy\") pod \"multus-r6dl7\" (UID: \"a65a2fdc-9089-4fb7-a01e-908858343c61\") " pod="openshift-multus/multus-r6dl7" May 21 14:41:29.911365 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.910511 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ce1c0d34-ad36-4566-ab88-6af8e7d619ed-iptables-alerter-script\") pod \"iptables-alerter-qmdnb\" (UID: \"ce1c0d34-ad36-4566-ab88-6af8e7d619ed\") " pod="openshift-network-operator/iptables-alerter-qmdnb" May 21 14:41:29.911365 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.910515 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a65a2fdc-9089-4fb7-a01e-908858343c61-multus-daemon-config\") pod \"multus-r6dl7\" (UID: \"a65a2fdc-9089-4fb7-a01e-908858343c61\") " pod="openshift-multus/multus-r6dl7" May 21 14:41:29.911365 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.910578 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f52ca37e-9f75-437f-b884-3ac7c7a74f4c-device-dir\") pod \"aws-ebs-csi-driver-node-m9ql9\" (UID: \"f52ca37e-9f75-437f-b884-3ac7c7a74f4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9ql9" May 21 14:41:29.911365 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.910621 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a65a2fdc-9089-4fb7-a01e-908858343c61-host-var-lib-kubelet\") pod \"multus-r6dl7\" (UID: \"a65a2fdc-9089-4fb7-a01e-908858343c61\") " pod="openshift-multus/multus-r6dl7" May 21 14:41:29.911365 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.910673 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a65a2fdc-9089-4fb7-a01e-908858343c61-hostroot\") pod \"multus-r6dl7\" (UID: \"a65a2fdc-9089-4fb7-a01e-908858343c61\") " pod="openshift-multus/multus-r6dl7" May 21 14:41:29.911365 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.910742 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a65a2fdc-9089-4fb7-a01e-908858343c61-multus-socket-dir-parent\") pod \"multus-r6dl7\" (UID: \"a65a2fdc-9089-4fb7-a01e-908858343c61\") " pod="openshift-multus/multus-r6dl7" May 21 14:41:29.911365 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.910799 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f52ca37e-9f75-437f-b884-3ac7c7a74f4c-socket-dir\") pod \"aws-ebs-csi-driver-node-m9ql9\" (UID: \"f52ca37e-9f75-437f-b884-3ac7c7a74f4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9ql9" May 21 14:41:29.912615 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.912596 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/97c0df6c-a20d-40ac-b07b-4337c1e00cff-agent-certs\") pod \"konnectivity-agent-kbq62\" (UID: \"97c0df6c-a20d-40ac-b07b-4337c1e00cff\") " pod="kube-system/konnectivity-agent-kbq62" May 21 14:41:29.917232 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.917207 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmtpw\" (UniqueName: \"kubernetes.io/projected/f52ca37e-9f75-437f-b884-3ac7c7a74f4c-kube-api-access-tmtpw\") pod \"aws-ebs-csi-driver-node-m9ql9\" (UID: \"f52ca37e-9f75-437f-b884-3ac7c7a74f4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9ql9" May 21 14:41:29.922145 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.922081 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2s89\" (UniqueName: \"kubernetes.io/projected/ce1c0d34-ad36-4566-ab88-6af8e7d619ed-kube-api-access-w2s89\") pod \"iptables-alerter-qmdnb\" (UID: \"ce1c0d34-ad36-4566-ab88-6af8e7d619ed\") " pod="openshift-network-operator/iptables-alerter-qmdnb" May 21 14:41:29.922145 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.922081 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltv8d\" (UniqueName: \"kubernetes.io/projected/a65a2fdc-9089-4fb7-a01e-908858343c61-kube-api-access-ltv8d\") pod \"multus-r6dl7\" (UID: \"a65a2fdc-9089-4fb7-a01e-908858343c61\") " pod="openshift-multus/multus-r6dl7" May 21 14:41:29.998102 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:29.998066 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-k2p4j" May 21 14:41:30.008869 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:30.008838 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2cg2c" May 21 14:41:30.021049 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:30.021019 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-r9dpx" May 21 14:41:30.026768 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:30.026742 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9ql9" May 21 14:41:30.034396 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:30.034375 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nfd4x" May 21 14:41:30.041969 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:30.041948 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kbq62" May 21 14:41:30.050633 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:30.050602 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-r6dl7" May 21 14:41:30.058282 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:30.058263 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5t966" May 21 14:41:30.065778 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:30.065761 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qmdnb" May 21 14:41:30.313895 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:30.313800 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/646e1e59-0917-4626-8e22-158fec29f33f-metrics-certs\") pod \"network-metrics-daemon-tft6b\" (UID: \"646e1e59-0917-4626-8e22-158fec29f33f\") " pod="openshift-multus/network-metrics-daemon-tft6b" May 21 14:41:30.313895 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:30.313871 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2gnsv\" (UniqueName: \"kubernetes.io/projected/2dc7761a-d68f-4f1f-ad3c-71fb26dad676-kube-api-access-2gnsv\") pod \"network-check-target-6fb9w\" (UID: \"2dc7761a-d68f-4f1f-ad3c-71fb26dad676\") " pod="openshift-network-diagnostics/network-check-target-6fb9w" May 21 14:41:30.314124 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:30.313940 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:41:30.314124 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:30.314011 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 14:41:30.314124 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:30.314029 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 14:41:30.314124 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:30.314032 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/646e1e59-0917-4626-8e22-158fec29f33f-metrics-certs podName:646e1e59-0917-4626-8e22-158fec29f33f nodeName:}" failed. No retries permitted until 2026-05-21 14:41:31.31401239 +0000 UTC m=+4.052267911 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/646e1e59-0917-4626-8e22-158fec29f33f-metrics-certs") pod "network-metrics-daemon-tft6b" (UID: "646e1e59-0917-4626-8e22-158fec29f33f") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:41:30.314124 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:30.314043 2573 projected.go:194] Error preparing data for projected volume kube-api-access-2gnsv for pod openshift-network-diagnostics/network-check-target-6fb9w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:41:30.314124 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:30.314095 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2dc7761a-d68f-4f1f-ad3c-71fb26dad676-kube-api-access-2gnsv podName:2dc7761a-d68f-4f1f-ad3c-71fb26dad676 nodeName:}" failed. No retries permitted until 2026-05-21 14:41:31.314078674 +0000 UTC m=+4.052334202 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-2gnsv" (UniqueName: "kubernetes.io/projected/2dc7761a-d68f-4f1f-ad3c-71fb26dad676-kube-api-access-2gnsv") pod "network-check-target-6fb9w" (UID: "2dc7761a-d68f-4f1f-ad3c-71fb26dad676") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:41:30.697561 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:30.697532 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43f110a5_d9cb_4410_91e4_c3da71193c3c.slice/crio-888b4ebf9779bed372ac327a36fd746b6fa851e404c7b0a350ca87ab9a192f8c WatchSource:0}: Error finding container 888b4ebf9779bed372ac327a36fd746b6fa851e404c7b0a350ca87ab9a192f8c: Status 404 returned error can't find the container with id 888b4ebf9779bed372ac327a36fd746b6fa851e404c7b0a350ca87ab9a192f8c May 21 14:41:30.698832 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:30.698799 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda65a2fdc_9089_4fb7_a01e_908858343c61.slice/crio-5b66041eed9c307519544a51cfbf4e0a5200553cfd5125cc2312fd5011723d8c WatchSource:0}: Error finding container 5b66041eed9c307519544a51cfbf4e0a5200553cfd5125cc2312fd5011723d8c: Status 404 returned error can't find the container with id 5b66041eed9c307519544a51cfbf4e0a5200553cfd5125cc2312fd5011723d8c May 21 14:41:30.702668 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:30.702644 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97c0df6c_a20d_40ac_b07b_4337c1e00cff.slice/crio-0c271a91848b70cd3a8710528d7c5f3362ffa303ff6e08e3316b8ecb54d21b71 WatchSource:0}: Error finding container 0c271a91848b70cd3a8710528d7c5f3362ffa303ff6e08e3316b8ecb54d21b71: Status 404 returned error can't find the container with id 0c271a91848b70cd3a8710528d7c5f3362ffa303ff6e08e3316b8ecb54d21b71 May 21 14:41:30.704052 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:30.703987 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf52ca37e_9f75_437f_b884_3ac7c7a74f4c.slice/crio-b2cee69e3e07b1cf0f147d2feb29dd2fc2cb9570ee826027a6a6d609831a68d6 WatchSource:0}: Error finding container b2cee69e3e07b1cf0f147d2feb29dd2fc2cb9570ee826027a6a6d609831a68d6: Status 404 returned error can't find the container with id b2cee69e3e07b1cf0f147d2feb29dd2fc2cb9570ee826027a6a6d609831a68d6 May 21 14:41:30.704807 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:30.704784 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod591d522c_4c95_4b9c_852b_f84095cc2525.slice/crio-db9b07b05bda532a54e74682407ae1a04ddf0b71929181c42ede3bdd6e7907a7 WatchSource:0}: Error finding container db9b07b05bda532a54e74682407ae1a04ddf0b71929181c42ede3bdd6e7907a7: Status 404 returned error can't find the container with id db9b07b05bda532a54e74682407ae1a04ddf0b71929181c42ede3bdd6e7907a7 May 21 14:41:30.705667 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:30.705624 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce1c0d34_ad36_4566_ab88_6af8e7d619ed.slice/crio-5c807fbf746846f7b6c9e3384f793cb05a8a1d44cd29d6a597bf93104d9c0039 WatchSource:0}: Error finding container 5c807fbf746846f7b6c9e3384f793cb05a8a1d44cd29d6a597bf93104d9c0039: Status 404 returned error can't find the container with id 5c807fbf746846f7b6c9e3384f793cb05a8a1d44cd29d6a597bf93104d9c0039 May 21 14:41:30.706625 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:30.706463 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ad537a1_469b_485f_8391_60e2e8db2bf4.slice/crio-09bb617fccce7c741624d28c8037f7bf971122aa0d111a70331f721e17845101 WatchSource:0}: Error finding container 09bb617fccce7c741624d28c8037f7bf971122aa0d111a70331f721e17845101: Status 404 returned error can't find the container with id 09bb617fccce7c741624d28c8037f7bf971122aa0d111a70331f721e17845101 May 21 14:41:30.707618 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:41:30.707596 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19eadc83_10b5_48f6_ad02_e8540668c1cc.slice/crio-2f6d18ca716ab8a4129ddb7bfea157ec4bc1a95296f2c2a83e114ee11e3f5111 WatchSource:0}: Error finding container 2f6d18ca716ab8a4129ddb7bfea157ec4bc1a95296f2c2a83e114ee11e3f5111: Status 404 returned error can't find the container with id 2f6d18ca716ab8a4129ddb7bfea157ec4bc1a95296f2c2a83e114ee11e3f5111 May 21 14:41:30.733979 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:30.733933 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 14:36:28 +0000 UTC" deadline="2027-11-11 02:37:18.23735302 +0000 UTC" May 21 14:41:30.733979 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:30.733978 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12923h55m47.50337871s" May 21 14:41:30.824219 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:30.823974 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kbq62" event={"ID":"97c0df6c-a20d-40ac-b07b-4337c1e00cff","Type":"ContainerStarted","Data":"0c271a91848b70cd3a8710528d7c5f3362ffa303ff6e08e3316b8ecb54d21b71"} May 21 14:41:30.825058 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:30.825024 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5t966" event={"ID":"43f110a5-d9cb-4410-91e4-c3da71193c3c","Type":"ContainerStarted","Data":"888b4ebf9779bed372ac327a36fd746b6fa851e404c7b0a350ca87ab9a192f8c"} May 21 14:41:30.826438 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:30.826411 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-244.ec2.internal" event={"ID":"f76149253834985fa6424385c0e68027","Type":"ContainerStarted","Data":"64a58966205b75fea28c8c38f1f0d71ca2ff83274e527abfe1e85574d5d1e9a0"} May 21 14:41:30.827450 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:30.827425 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2cg2c" event={"ID":"34972f99-075d-486d-8b03-5efb08d79649","Type":"ContainerStarted","Data":"3cae34f9f0c8ee9fce43348f07e2f0c031452108b994c16db05d509028c8e977"} May 21 14:41:30.828499 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:30.828474 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-r9dpx" event={"ID":"3ad537a1-469b-485f-8391-60e2e8db2bf4","Type":"ContainerStarted","Data":"09bb617fccce7c741624d28c8037f7bf971122aa0d111a70331f721e17845101"} May 21 14:41:30.829429 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:30.829406 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-k2p4j" event={"ID":"591d522c-4c95-4b9c-852b-f84095cc2525","Type":"ContainerStarted","Data":"db9b07b05bda532a54e74682407ae1a04ddf0b71929181c42ede3bdd6e7907a7"} May 21 14:41:30.830433 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:30.830407 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9ql9" event={"ID":"f52ca37e-9f75-437f-b884-3ac7c7a74f4c","Type":"ContainerStarted","Data":"b2cee69e3e07b1cf0f147d2feb29dd2fc2cb9570ee826027a6a6d609831a68d6"} May 21 14:41:30.831307 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:30.831282 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-r6dl7" event={"ID":"a65a2fdc-9089-4fb7-a01e-908858343c61","Type":"ContainerStarted","Data":"5b66041eed9c307519544a51cfbf4e0a5200553cfd5125cc2312fd5011723d8c"} May 21 14:41:30.832355 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:30.832334 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nfd4x" event={"ID":"19eadc83-10b5-48f6-ad02-e8540668c1cc","Type":"ContainerStarted","Data":"2f6d18ca716ab8a4129ddb7bfea157ec4bc1a95296f2c2a83e114ee11e3f5111"} May 21 14:41:30.833425 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:30.833394 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qmdnb" event={"ID":"ce1c0d34-ad36-4566-ab88-6af8e7d619ed","Type":"ContainerStarted","Data":"5c807fbf746846f7b6c9e3384f793cb05a8a1d44cd29d6a597bf93104d9c0039"} May 21 14:41:30.840183 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:30.838346 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-244.ec2.internal" podStartSLOduration=2.838325841 podStartE2EDuration="2.838325841s" podCreationTimestamp="2026-05-21 14:41:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 14:41:30.837587596 +0000 UTC m=+3.575843117" watchObservedRunningTime="2026-05-21 14:41:30.838325841 +0000 UTC m=+3.576581376" May 21 14:41:31.322641 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:31.322499 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/646e1e59-0917-4626-8e22-158fec29f33f-metrics-certs\") pod \"network-metrics-daemon-tft6b\" (UID: \"646e1e59-0917-4626-8e22-158fec29f33f\") " pod="openshift-multus/network-metrics-daemon-tft6b" May 21 14:41:31.322812 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:31.322671 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:41:31.322812 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:31.322758 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/646e1e59-0917-4626-8e22-158fec29f33f-metrics-certs podName:646e1e59-0917-4626-8e22-158fec29f33f nodeName:}" failed. No retries permitted until 2026-05-21 14:41:33.322735025 +0000 UTC m=+6.060990551 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/646e1e59-0917-4626-8e22-158fec29f33f-metrics-certs") pod "network-metrics-daemon-tft6b" (UID: "646e1e59-0917-4626-8e22-158fec29f33f") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:41:31.323090 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:31.322981 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2gnsv\" (UniqueName: \"kubernetes.io/projected/2dc7761a-d68f-4f1f-ad3c-71fb26dad676-kube-api-access-2gnsv\") pod \"network-check-target-6fb9w\" (UID: \"2dc7761a-d68f-4f1f-ad3c-71fb26dad676\") " pod="openshift-network-diagnostics/network-check-target-6fb9w" May 21 14:41:31.323169 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:31.323117 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 14:41:31.323169 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:31.323141 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 14:41:31.323169 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:31.323157 2573 projected.go:194] Error preparing data for projected volume kube-api-access-2gnsv for pod openshift-network-diagnostics/network-check-target-6fb9w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:41:31.323321 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:31.323216 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2dc7761a-d68f-4f1f-ad3c-71fb26dad676-kube-api-access-2gnsv podName:2dc7761a-d68f-4f1f-ad3c-71fb26dad676 nodeName:}" failed. No retries permitted until 2026-05-21 14:41:33.323200552 +0000 UTC m=+6.061456070 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-2gnsv" (UniqueName: "kubernetes.io/projected/2dc7761a-d68f-4f1f-ad3c-71fb26dad676-kube-api-access-2gnsv") pod "network-check-target-6fb9w" (UID: "2dc7761a-d68f-4f1f-ad3c-71fb26dad676") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:41:31.786952 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:31.786686 2573 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 21 14:41:31.813602 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:31.812888 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6fb9w" May 21 14:41:31.813602 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:31.813039 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6fb9w" podUID="2dc7761a-d68f-4f1f-ad3c-71fb26dad676" May 21 14:41:31.813602 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:31.813411 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tft6b" May 21 14:41:31.813602 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:31.813522 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tft6b" podUID="646e1e59-0917-4626-8e22-158fec29f33f" May 21 14:41:31.851393 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:31.851359 2573 generic.go:358] "Generic (PLEG): container finished" podID="1ee1cfe3f6bdf88984f096881704d77b" containerID="6dbac9364d57aec87340848cf61cb3fa4417472c9054a9ad3c1edab1ace3d074" exitCode=0 May 21 14:41:31.851581 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:31.851480 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-244.ec2.internal" event={"ID":"1ee1cfe3f6bdf88984f096881704d77b","Type":"ContainerDied","Data":"6dbac9364d57aec87340848cf61cb3fa4417472c9054a9ad3c1edab1ace3d074"} May 21 14:41:32.859199 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:32.859158 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-244.ec2.internal" event={"ID":"1ee1cfe3f6bdf88984f096881704d77b","Type":"ContainerStarted","Data":"cd56df9c6a827eebacfd6e8ffcec7bffe3faeb9ec1d9aeed9ef2294cec736ad0"} May 21 14:41:32.872296 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:32.872229 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-244.ec2.internal" podStartSLOduration=4.87220748 podStartE2EDuration="4.87220748s" podCreationTimestamp="2026-05-21 14:41:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 14:41:32.871728734 +0000 UTC m=+5.609984266" watchObservedRunningTime="2026-05-21 14:41:32.87220748 +0000 UTC m=+5.610463012" May 21 14:41:33.342744 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:33.342605 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2gnsv\" (UniqueName: \"kubernetes.io/projected/2dc7761a-d68f-4f1f-ad3c-71fb26dad676-kube-api-access-2gnsv\") pod \"network-check-target-6fb9w\" (UID: \"2dc7761a-d68f-4f1f-ad3c-71fb26dad676\") " pod="openshift-network-diagnostics/network-check-target-6fb9w" May 21 14:41:33.342744 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:33.342685 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/646e1e59-0917-4626-8e22-158fec29f33f-metrics-certs\") pod \"network-metrics-daemon-tft6b\" (UID: \"646e1e59-0917-4626-8e22-158fec29f33f\") " pod="openshift-multus/network-metrics-daemon-tft6b" May 21 14:41:33.342987 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:33.342817 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:41:33.342987 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:33.342883 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/646e1e59-0917-4626-8e22-158fec29f33f-metrics-certs podName:646e1e59-0917-4626-8e22-158fec29f33f nodeName:}" failed. No retries permitted until 2026-05-21 14:41:37.342863239 +0000 UTC m=+10.081118764 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/646e1e59-0917-4626-8e22-158fec29f33f-metrics-certs") pod "network-metrics-daemon-tft6b" (UID: "646e1e59-0917-4626-8e22-158fec29f33f") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:41:33.343475 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:33.343314 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 14:41:33.343475 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:33.343338 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 14:41:33.343475 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:33.343352 2573 projected.go:194] Error preparing data for projected volume kube-api-access-2gnsv for pod openshift-network-diagnostics/network-check-target-6fb9w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:41:33.343475 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:33.343397 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2dc7761a-d68f-4f1f-ad3c-71fb26dad676-kube-api-access-2gnsv podName:2dc7761a-d68f-4f1f-ad3c-71fb26dad676 nodeName:}" failed. No retries permitted until 2026-05-21 14:41:37.343382105 +0000 UTC m=+10.081637628 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-2gnsv" (UniqueName: "kubernetes.io/projected/2dc7761a-d68f-4f1f-ad3c-71fb26dad676-kube-api-access-2gnsv") pod "network-check-target-6fb9w" (UID: "2dc7761a-d68f-4f1f-ad3c-71fb26dad676") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:41:33.813409 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:33.813147 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tft6b" May 21 14:41:33.813409 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:33.813192 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6fb9w" May 21 14:41:33.813409 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:33.813299 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tft6b" podUID="646e1e59-0917-4626-8e22-158fec29f33f" May 21 14:41:33.813688 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:33.813456 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6fb9w" podUID="2dc7761a-d68f-4f1f-ad3c-71fb26dad676" May 21 14:41:35.815453 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:35.815044 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6fb9w" May 21 14:41:35.815453 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:35.815180 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6fb9w" podUID="2dc7761a-d68f-4f1f-ad3c-71fb26dad676" May 21 14:41:35.816034 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:35.815626 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tft6b" May 21 14:41:35.816034 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:35.815736 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tft6b" podUID="646e1e59-0917-4626-8e22-158fec29f33f" May 21 14:41:37.374093 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:37.374054 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/646e1e59-0917-4626-8e22-158fec29f33f-metrics-certs\") pod \"network-metrics-daemon-tft6b\" (UID: \"646e1e59-0917-4626-8e22-158fec29f33f\") " pod="openshift-multus/network-metrics-daemon-tft6b" May 21 14:41:37.374520 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:37.374123 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2gnsv\" (UniqueName: \"kubernetes.io/projected/2dc7761a-d68f-4f1f-ad3c-71fb26dad676-kube-api-access-2gnsv\") pod \"network-check-target-6fb9w\" (UID: \"2dc7761a-d68f-4f1f-ad3c-71fb26dad676\") " pod="openshift-network-diagnostics/network-check-target-6fb9w" May 21 14:41:37.374520 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:37.374279 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 14:41:37.374520 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:37.374299 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 14:41:37.374520 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:37.374315 2573 projected.go:194] Error preparing data for projected volume kube-api-access-2gnsv for pod openshift-network-diagnostics/network-check-target-6fb9w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:41:37.374520 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:37.374375 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2dc7761a-d68f-4f1f-ad3c-71fb26dad676-kube-api-access-2gnsv podName:2dc7761a-d68f-4f1f-ad3c-71fb26dad676 nodeName:}" failed. No retries permitted until 2026-05-21 14:41:45.374357241 +0000 UTC m=+18.112612756 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-2gnsv" (UniqueName: "kubernetes.io/projected/2dc7761a-d68f-4f1f-ad3c-71fb26dad676-kube-api-access-2gnsv") pod "network-check-target-6fb9w" (UID: "2dc7761a-d68f-4f1f-ad3c-71fb26dad676") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:41:37.374520 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:37.374443 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:41:37.374520 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:37.374476 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/646e1e59-0917-4626-8e22-158fec29f33f-metrics-certs podName:646e1e59-0917-4626-8e22-158fec29f33f nodeName:}" failed. No retries permitted until 2026-05-21 14:41:45.374464257 +0000 UTC m=+18.112719768 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/646e1e59-0917-4626-8e22-158fec29f33f-metrics-certs") pod "network-metrics-daemon-tft6b" (UID: "646e1e59-0917-4626-8e22-158fec29f33f") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:41:37.814855 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:37.814290 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6fb9w" May 21 14:41:37.814855 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:37.814348 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tft6b" May 21 14:41:37.814855 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:37.814418 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6fb9w" podUID="2dc7761a-d68f-4f1f-ad3c-71fb26dad676" May 21 14:41:37.814855 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:37.814467 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tft6b" podUID="646e1e59-0917-4626-8e22-158fec29f33f" May 21 14:41:39.812648 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:39.812582 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tft6b" May 21 14:41:39.813140 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:39.812765 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tft6b" podUID="646e1e59-0917-4626-8e22-158fec29f33f" May 21 14:41:39.813140 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:39.812582 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6fb9w" May 21 14:41:39.813140 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:39.812864 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6fb9w" podUID="2dc7761a-d68f-4f1f-ad3c-71fb26dad676" May 21 14:41:41.813263 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:41.813211 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6fb9w" May 21 14:41:41.813263 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:41.813242 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tft6b" May 21 14:41:41.813758 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:41.813349 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6fb9w" podUID="2dc7761a-d68f-4f1f-ad3c-71fb26dad676" May 21 14:41:41.813758 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:41.813456 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tft6b" podUID="646e1e59-0917-4626-8e22-158fec29f33f" May 21 14:41:43.812744 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:43.812703 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6fb9w" May 21 14:41:43.813214 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:43.812762 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tft6b" May 21 14:41:43.813214 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:43.812844 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6fb9w" podUID="2dc7761a-d68f-4f1f-ad3c-71fb26dad676" May 21 14:41:43.813214 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:43.813014 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tft6b" podUID="646e1e59-0917-4626-8e22-158fec29f33f" May 21 14:41:45.433300 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:45.433249 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/646e1e59-0917-4626-8e22-158fec29f33f-metrics-certs\") pod \"network-metrics-daemon-tft6b\" (UID: \"646e1e59-0917-4626-8e22-158fec29f33f\") " pod="openshift-multus/network-metrics-daemon-tft6b" May 21 14:41:45.433770 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:45.433319 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2gnsv\" (UniqueName: \"kubernetes.io/projected/2dc7761a-d68f-4f1f-ad3c-71fb26dad676-kube-api-access-2gnsv\") pod \"network-check-target-6fb9w\" (UID: \"2dc7761a-d68f-4f1f-ad3c-71fb26dad676\") " pod="openshift-network-diagnostics/network-check-target-6fb9w" May 21 14:41:45.433770 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:45.433402 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:41:45.433770 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:45.433418 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 14:41:45.433770 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:45.433431 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 14:41:45.433770 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:45.433440 2573 projected.go:194] Error preparing data for projected volume kube-api-access-2gnsv for pod openshift-network-diagnostics/network-check-target-6fb9w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:41:45.433770 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:45.433475 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/646e1e59-0917-4626-8e22-158fec29f33f-metrics-certs podName:646e1e59-0917-4626-8e22-158fec29f33f nodeName:}" failed. No retries permitted until 2026-05-21 14:42:01.433451862 +0000 UTC m=+34.171707375 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/646e1e59-0917-4626-8e22-158fec29f33f-metrics-certs") pod "network-metrics-daemon-tft6b" (UID: "646e1e59-0917-4626-8e22-158fec29f33f") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:41:45.433770 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:45.433497 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2dc7761a-d68f-4f1f-ad3c-71fb26dad676-kube-api-access-2gnsv podName:2dc7761a-d68f-4f1f-ad3c-71fb26dad676 nodeName:}" failed. No retries permitted until 2026-05-21 14:42:01.433486456 +0000 UTC m=+34.171741966 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-2gnsv" (UniqueName: "kubernetes.io/projected/2dc7761a-d68f-4f1f-ad3c-71fb26dad676-kube-api-access-2gnsv") pod "network-check-target-6fb9w" (UID: "2dc7761a-d68f-4f1f-ad3c-71fb26dad676") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:41:45.812840 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:45.812743 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6fb9w" May 21 14:41:45.812840 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:45.812773 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tft6b" May 21 14:41:45.813077 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:45.812877 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6fb9w" podUID="2dc7761a-d68f-4f1f-ad3c-71fb26dad676" May 21 14:41:45.813077 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:45.812968 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tft6b" podUID="646e1e59-0917-4626-8e22-158fec29f33f" May 21 14:41:47.815350 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:47.815321 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tft6b" May 21 14:41:47.815840 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:47.815322 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6fb9w" May 21 14:41:47.815840 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:47.815433 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tft6b" podUID="646e1e59-0917-4626-8e22-158fec29f33f" May 21 14:41:47.815840 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:47.815503 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6fb9w" podUID="2dc7761a-d68f-4f1f-ad3c-71fb26dad676" May 21 14:41:49.813680 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:49.813202 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6fb9w" May 21 14:41:49.814524 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:49.813202 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tft6b" May 21 14:41:49.814524 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:49.813745 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6fb9w" podUID="2dc7761a-d68f-4f1f-ad3c-71fb26dad676" May 21 14:41:49.814524 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:49.813835 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tft6b" podUID="646e1e59-0917-4626-8e22-158fec29f33f" May 21 14:41:49.888190 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:49.888150 2573 generic.go:358] "Generic (PLEG): container finished" podID="34972f99-075d-486d-8b03-5efb08d79649" containerID="461d999b377f821806ae8f01956e385ad8afc71930dba6b44cf88c30f19c424a" exitCode=0 May 21 14:41:49.888383 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:49.888234 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2cg2c" event={"ID":"34972f99-075d-486d-8b03-5efb08d79649","Type":"ContainerDied","Data":"461d999b377f821806ae8f01956e385ad8afc71930dba6b44cf88c30f19c424a"} May 21 14:41:49.889611 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:49.889587 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-r9dpx" event={"ID":"3ad537a1-469b-485f-8391-60e2e8db2bf4","Type":"ContainerStarted","Data":"77915a4d0c8b10d7b47a5f7f9c95abbe03946afaa085e27b55028df86f4f4bd0"} May 21 14:41:49.890800 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:49.890779 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-k2p4j" event={"ID":"591d522c-4c95-4b9c-852b-f84095cc2525","Type":"ContainerStarted","Data":"7dd4d0ffc805b7192479e0fda94719c02e65683247970df0cd75a38950f445e8"} May 21 14:41:49.892133 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:49.892110 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9ql9" event={"ID":"f52ca37e-9f75-437f-b884-3ac7c7a74f4c","Type":"ContainerStarted","Data":"1fd0acb8442b55c1d4c63854ba4c611649eda6b70e6ed2c96a1a243c807145d7"} May 21 14:41:49.893404 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:49.893378 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-r6dl7" event={"ID":"a65a2fdc-9089-4fb7-a01e-908858343c61","Type":"ContainerStarted","Data":"587f6efa8f91ab9f767df9cbea1a6155acfc7ee4b214e13863b8f72c3dd140ab"} May 21 14:41:49.894617 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:49.894595 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nfd4x" event={"ID":"19eadc83-10b5-48f6-ad02-e8540668c1cc","Type":"ContainerStarted","Data":"a99f31bea22bce85e645b937aa88e2a18baacfa0685da84e2c88c0f8776cce1a"} May 21 14:41:49.895871 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:49.895841 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kbq62" event={"ID":"97c0df6c-a20d-40ac-b07b-4337c1e00cff","Type":"ContainerStarted","Data":"7d5c79f2d2f672341bf54bcac649937c27c1a06aa1b1fa53916f6c07eccbd6bd"} May 21 14:41:49.898244 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:49.898220 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5t966" event={"ID":"43f110a5-d9cb-4410-91e4-c3da71193c3c","Type":"ContainerStarted","Data":"a9377bc91bbe607a46ae865428189a6e5bcb573fbe7bab5f19c2408a8c316eb5"} May 21 14:41:49.898349 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:49.898250 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5t966" event={"ID":"43f110a5-d9cb-4410-91e4-c3da71193c3c","Type":"ContainerStarted","Data":"3ddbe2cee75753a77f18d99add2455060e13045206e3f8e184d70fe3aeed0f3b"} May 21 14:41:49.898349 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:49.898262 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5t966" event={"ID":"43f110a5-d9cb-4410-91e4-c3da71193c3c","Type":"ContainerStarted","Data":"ff8850136a90e3e1bc0a1a0b74ae1f437560618dc95955020429f5d97b468e5b"} May 21 14:41:49.898349 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:49.898271 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5t966" event={"ID":"43f110a5-d9cb-4410-91e4-c3da71193c3c","Type":"ContainerStarted","Data":"af64c68f3f736b775bde5eb29b6a761a11d3c9a00b6b267310e0d469b7c70bd5"} May 21 14:41:49.898349 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:49.898279 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5t966" event={"ID":"43f110a5-d9cb-4410-91e4-c3da71193c3c","Type":"ContainerStarted","Data":"e9c1b3ef5450917715555e3558660c1a44b0cc5f41dbe14b3529d2dce5336d3a"} May 21 14:41:49.898349 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:49.898292 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5t966" event={"ID":"43f110a5-d9cb-4410-91e4-c3da71193c3c","Type":"ContainerStarted","Data":"f282d7da754cf0ff830fa0c16a31d6f77cd89023466b3ac2c649539cb6afbf1a"} May 21 14:41:49.946707 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:49.946656 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-r6dl7" podStartSLOduration=3.751376352 podStartE2EDuration="21.946641459s" podCreationTimestamp="2026-05-21 14:41:28 +0000 UTC" firstStartedPulling="2026-05-21 14:41:30.701525763 +0000 UTC m=+3.439781273" lastFinishedPulling="2026-05-21 14:41:48.89679087 +0000 UTC m=+21.635046380" observedRunningTime="2026-05-21 14:41:49.946313817 +0000 UTC m=+22.684569348" watchObservedRunningTime="2026-05-21 14:41:49.946641459 +0000 UTC m=+22.684896990" May 21 14:41:49.946975 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:49.946947 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-r9dpx" podStartSLOduration=4.759474199 podStartE2EDuration="22.946939265s" podCreationTimestamp="2026-05-21 14:41:27 +0000 UTC" firstStartedPulling="2026-05-21 14:41:30.709441057 +0000 UTC m=+3.447696571" lastFinishedPulling="2026-05-21 14:41:48.896906124 +0000 UTC m=+21.635161637" observedRunningTime="2026-05-21 14:41:49.931598747 +0000 UTC m=+22.669854278" watchObservedRunningTime="2026-05-21 14:41:49.946939265 +0000 UTC m=+22.685194801" May 21 14:41:49.966071 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:49.965989 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-k2p4j" podStartSLOduration=4.959842742 podStartE2EDuration="22.965973237s" podCreationTimestamp="2026-05-21 14:41:27 +0000 UTC" firstStartedPulling="2026-05-21 14:41:30.706570524 +0000 UTC m=+3.444826040" lastFinishedPulling="2026-05-21 14:41:48.712701011 +0000 UTC m=+21.450956535" observedRunningTime="2026-05-21 14:41:49.965886418 +0000 UTC m=+22.704141950" watchObservedRunningTime="2026-05-21 14:41:49.965973237 +0000 UTC m=+22.704228769" May 21 14:41:49.984281 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:49.984229 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-nfd4x" podStartSLOduration=11.921404497 podStartE2EDuration="21.984215372s" podCreationTimestamp="2026-05-21 14:41:28 +0000 UTC" firstStartedPulling="2026-05-21 14:41:30.712699396 +0000 UTC m=+3.450954911" lastFinishedPulling="2026-05-21 14:41:40.775510271 +0000 UTC m=+13.513765786" observedRunningTime="2026-05-21 14:41:49.984105007 +0000 UTC m=+22.722360537" watchObservedRunningTime="2026-05-21 14:41:49.984215372 +0000 UTC m=+22.722470904" May 21 14:41:50.003879 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:50.003814 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-kbq62" podStartSLOduration=3.995180938 podStartE2EDuration="22.00379326s" podCreationTimestamp="2026-05-21 14:41:28 +0000 UTC" firstStartedPulling="2026-05-21 14:41:30.704087268 +0000 UTC m=+3.442342777" lastFinishedPulling="2026-05-21 14:41:48.712699578 +0000 UTC m=+21.450955099" observedRunningTime="2026-05-21 14:41:50.003080907 +0000 UTC m=+22.741336438" watchObservedRunningTime="2026-05-21 14:41:50.00379326 +0000 UTC m=+22.742048795" May 21 14:41:50.210318 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:50.210290 2573 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 21 14:41:50.758260 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:50.758073 2573 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-21T14:41:50.210315766Z","UUID":"c0f1d650-22ef-4f03-b47b-a5965d6759f7","Handler":null,"Name":"","Endpoint":""} May 21 14:41:50.760172 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:50.760150 2573 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 21 14:41:50.760385 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:50.760182 2573 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 21 14:41:50.902412 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:50.902360 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9ql9" event={"ID":"f52ca37e-9f75-437f-b884-3ac7c7a74f4c","Type":"ContainerStarted","Data":"9f6570224b5d51551789922a052cb0851c9abecd0db04fb021808b23b1a8b0e5"} May 21 14:41:50.903867 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:50.903804 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qmdnb" event={"ID":"ce1c0d34-ad36-4566-ab88-6af8e7d619ed","Type":"ContainerStarted","Data":"f3befd33f1897e7f1da165965323f6546657893f663d75b79c54b780336b4ce7"} May 21 14:41:50.917440 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:50.917387 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-qmdnb" podStartSLOduration=4.75944053 podStartE2EDuration="22.917365937s" podCreationTimestamp="2026-05-21 14:41:28 +0000 UTC" firstStartedPulling="2026-05-21 14:41:30.707852385 +0000 UTC m=+3.446107909" lastFinishedPulling="2026-05-21 14:41:48.865777799 +0000 UTC m=+21.604033316" observedRunningTime="2026-05-21 14:41:50.916682836 +0000 UTC m=+23.654938368" watchObservedRunningTime="2026-05-21 14:41:50.917365937 +0000 UTC m=+23.655621471" May 21 14:41:51.812778 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:51.812745 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6fb9w" May 21 14:41:51.812940 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:51.812881 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6fb9w" podUID="2dc7761a-d68f-4f1f-ad3c-71fb26dad676" May 21 14:41:51.813131 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:51.813094 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tft6b" May 21 14:41:51.813224 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:51.813207 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tft6b" podUID="646e1e59-0917-4626-8e22-158fec29f33f" May 21 14:41:51.907163 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:51.907073 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9ql9" event={"ID":"f52ca37e-9f75-437f-b884-3ac7c7a74f4c","Type":"ContainerStarted","Data":"7f617a4bf2599fd2a528dcd99af50f844042056a25849fd619eefe7278323832"} May 21 14:41:51.909786 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:51.909758 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5t966" event={"ID":"43f110a5-d9cb-4410-91e4-c3da71193c3c","Type":"ContainerStarted","Data":"b2cef60b7031b14a2810649ff30263004c51164ce708217c5c2ca2017e780d84"} May 21 14:41:51.923405 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:51.923355 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9ql9" podStartSLOduration=3.488256597 podStartE2EDuration="23.923339805s" podCreationTimestamp="2026-05-21 14:41:28 +0000 UTC" firstStartedPulling="2026-05-21 14:41:30.70613542 +0000 UTC m=+3.444390930" lastFinishedPulling="2026-05-21 14:41:51.141218618 +0000 UTC m=+23.879474138" observedRunningTime="2026-05-21 14:41:51.92330744 +0000 UTC m=+24.661562973" watchObservedRunningTime="2026-05-21 14:41:51.923339805 +0000 UTC m=+24.661595330" May 21 14:41:53.804674 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:53.804441 2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-kbq62" May 21 14:41:53.805258 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:53.805237 2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-kbq62" May 21 14:41:53.813295 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:53.813272 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tft6b" May 21 14:41:53.813454 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:53.813389 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tft6b" podUID="646e1e59-0917-4626-8e22-158fec29f33f" May 21 14:41:53.813518 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:53.813452 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6fb9w" May 21 14:41:53.813576 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:53.813547 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6fb9w" podUID="2dc7761a-d68f-4f1f-ad3c-71fb26dad676" May 21 14:41:53.914028 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:53.913986 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-kbq62" May 21 14:41:53.914524 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:53.914501 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-kbq62" May 21 14:41:55.813462 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:55.813229 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6fb9w" May 21 14:41:55.814285 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:55.813232 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tft6b" May 21 14:41:55.814285 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:55.813491 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6fb9w" podUID="2dc7761a-d68f-4f1f-ad3c-71fb26dad676" May 21 14:41:55.814285 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:55.813564 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tft6b" podUID="646e1e59-0917-4626-8e22-158fec29f33f" May 21 14:41:55.919239 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:55.919200 2573 generic.go:358] "Generic (PLEG): container finished" podID="34972f99-075d-486d-8b03-5efb08d79649" containerID="0bf5cc1db0fd0f10a2634fab0d0dee79845de924156691e9d195deab32e07bb0" exitCode=0 May 21 14:41:55.919420 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:55.919290 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2cg2c" event={"ID":"34972f99-075d-486d-8b03-5efb08d79649","Type":"ContainerDied","Data":"0bf5cc1db0fd0f10a2634fab0d0dee79845de924156691e9d195deab32e07bb0"} May 21 14:41:55.922474 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:55.922450 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5t966" event={"ID":"43f110a5-d9cb-4410-91e4-c3da71193c3c","Type":"ContainerStarted","Data":"3a20f11702e7a5aacd63ce951b2c46597031b5ddf9f662c74d37c5662be04719"} May 21 14:41:55.922965 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:55.922944 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5t966" May 21 14:41:55.923037 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:55.922977 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5t966" May 21 14:41:55.941660 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:55.939586 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5t966" May 21 14:41:55.963057 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:55.963012 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-5t966" podStartSLOduration=9.711917008 podStartE2EDuration="27.962976621s" podCreationTimestamp="2026-05-21 14:41:28 +0000 UTC" firstStartedPulling="2026-05-21 14:41:30.700119083 +0000 UTC m=+3.438374609" lastFinishedPulling="2026-05-21 14:41:48.951178714 +0000 UTC m=+21.689434222" observedRunningTime="2026-05-21 14:41:55.962182769 +0000 UTC m=+28.700438301" watchObservedRunningTime="2026-05-21 14:41:55.962976621 +0000 UTC m=+28.701232154" May 21 14:41:56.925870 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:56.925839 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5t966" May 21 14:41:56.946046 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:56.946017 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5t966" May 21 14:41:57.090646 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:57.090615 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6fb9w"] May 21 14:41:57.090801 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:57.090731 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6fb9w" May 21 14:41:57.090844 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:57.090809 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6fb9w" podUID="2dc7761a-d68f-4f1f-ad3c-71fb26dad676" May 21 14:41:57.093476 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:57.093441 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tft6b"] May 21 14:41:57.093595 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:57.093573 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tft6b" May 21 14:41:57.093723 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:57.093701 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tft6b" podUID="646e1e59-0917-4626-8e22-158fec29f33f" May 21 14:41:57.929080 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:57.929044 2573 generic.go:358] "Generic (PLEG): container finished" podID="34972f99-075d-486d-8b03-5efb08d79649" containerID="2ada3af4c6056bf83cfae66c6571e669039df50b7c0abbcf1ea3fd86f5774398" exitCode=0 May 21 14:41:57.929474 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:57.929124 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2cg2c" event={"ID":"34972f99-075d-486d-8b03-5efb08d79649","Type":"ContainerDied","Data":"2ada3af4c6056bf83cfae66c6571e669039df50b7c0abbcf1ea3fd86f5774398"} May 21 14:41:58.337886 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:58.337849 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-ttwzv"] May 21 14:41:58.350648 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:58.349239 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ttwzv" May 21 14:41:58.350783 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:58.350610 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ttwzv"] May 21 14:41:58.350783 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:58.350736 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ttwzv" podUID="5c6a4608-495d-4cdb-8b1f-2df7cfa2b0d3" May 21 14:41:58.434232 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:58.434197 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5c6a4608-495d-4cdb-8b1f-2df7cfa2b0d3-kubelet-config\") pod \"global-pull-secret-syncer-ttwzv\" (UID: \"5c6a4608-495d-4cdb-8b1f-2df7cfa2b0d3\") " pod="kube-system/global-pull-secret-syncer-ttwzv" May 21 14:41:58.434232 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:58.434249 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5c6a4608-495d-4cdb-8b1f-2df7cfa2b0d3-original-pull-secret\") pod \"global-pull-secret-syncer-ttwzv\" (UID: \"5c6a4608-495d-4cdb-8b1f-2df7cfa2b0d3\") " pod="kube-system/global-pull-secret-syncer-ttwzv" May 21 14:41:58.434447 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:58.434267 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5c6a4608-495d-4cdb-8b1f-2df7cfa2b0d3-dbus\") pod \"global-pull-secret-syncer-ttwzv\" (UID: \"5c6a4608-495d-4cdb-8b1f-2df7cfa2b0d3\") " pod="kube-system/global-pull-secret-syncer-ttwzv" May 21 14:41:58.534956 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:58.534915 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5c6a4608-495d-4cdb-8b1f-2df7cfa2b0d3-dbus\") pod \"global-pull-secret-syncer-ttwzv\" (UID: \"5c6a4608-495d-4cdb-8b1f-2df7cfa2b0d3\") " pod="kube-system/global-pull-secret-syncer-ttwzv" May 21 14:41:58.535126 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:58.534983 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5c6a4608-495d-4cdb-8b1f-2df7cfa2b0d3-kubelet-config\") pod \"global-pull-secret-syncer-ttwzv\" (UID: \"5c6a4608-495d-4cdb-8b1f-2df7cfa2b0d3\") " pod="kube-system/global-pull-secret-syncer-ttwzv" May 21 14:41:58.535126 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:58.535037 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5c6a4608-495d-4cdb-8b1f-2df7cfa2b0d3-original-pull-secret\") pod \"global-pull-secret-syncer-ttwzv\" (UID: \"5c6a4608-495d-4cdb-8b1f-2df7cfa2b0d3\") " pod="kube-system/global-pull-secret-syncer-ttwzv" May 21 14:41:58.535126 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:58.535121 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 14:41:58.535254 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:58.535116 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5c6a4608-495d-4cdb-8b1f-2df7cfa2b0d3-kubelet-config\") pod \"global-pull-secret-syncer-ttwzv\" (UID: \"5c6a4608-495d-4cdb-8b1f-2df7cfa2b0d3\") " pod="kube-system/global-pull-secret-syncer-ttwzv" May 21 14:41:58.535254 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:58.535172 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c6a4608-495d-4cdb-8b1f-2df7cfa2b0d3-original-pull-secret podName:5c6a4608-495d-4cdb-8b1f-2df7cfa2b0d3 nodeName:}" failed. No retries permitted until 2026-05-21 14:41:59.035159698 +0000 UTC m=+31.773415207 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5c6a4608-495d-4cdb-8b1f-2df7cfa2b0d3-original-pull-secret") pod "global-pull-secret-syncer-ttwzv" (UID: "5c6a4608-495d-4cdb-8b1f-2df7cfa2b0d3") : object "kube-system"/"original-pull-secret" not registered May 21 14:41:58.535254 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:58.535194 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5c6a4608-495d-4cdb-8b1f-2df7cfa2b0d3-dbus\") pod \"global-pull-secret-syncer-ttwzv\" (UID: \"5c6a4608-495d-4cdb-8b1f-2df7cfa2b0d3\") " pod="kube-system/global-pull-secret-syncer-ttwzv" May 21 14:41:58.812683 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:58.812654 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6fb9w" May 21 14:41:58.812683 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:58.812673 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tft6b" May 21 14:41:58.812876 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:58.812755 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6fb9w" podUID="2dc7761a-d68f-4f1f-ad3c-71fb26dad676" May 21 14:41:58.812952 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:58.812926 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tft6b" podUID="646e1e59-0917-4626-8e22-158fec29f33f" May 21 14:41:58.931429 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:58.931394 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ttwzv" May 21 14:41:58.931836 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:58.931509 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ttwzv" podUID="5c6a4608-495d-4cdb-8b1f-2df7cfa2b0d3" May 21 14:41:59.038879 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:59.038840 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5c6a4608-495d-4cdb-8b1f-2df7cfa2b0d3-original-pull-secret\") pod \"global-pull-secret-syncer-ttwzv\" (UID: \"5c6a4608-495d-4cdb-8b1f-2df7cfa2b0d3\") " pod="kube-system/global-pull-secret-syncer-ttwzv" May 21 14:41:59.039093 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:59.038973 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 14:41:59.039093 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:41:59.039064 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c6a4608-495d-4cdb-8b1f-2df7cfa2b0d3-original-pull-secret podName:5c6a4608-495d-4cdb-8b1f-2df7cfa2b0d3 nodeName:}" failed. No retries permitted until 2026-05-21 14:42:00.039043314 +0000 UTC m=+32.777298827 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5c6a4608-495d-4cdb-8b1f-2df7cfa2b0d3-original-pull-secret") pod "global-pull-secret-syncer-ttwzv" (UID: "5c6a4608-495d-4cdb-8b1f-2df7cfa2b0d3") : object "kube-system"/"original-pull-secret" not registered May 21 14:41:59.935377 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:59.935188 2573 generic.go:358] "Generic (PLEG): container finished" podID="34972f99-075d-486d-8b03-5efb08d79649" containerID="55025ac1895990c546215cbb4380b09e838d9dde3bdd8b578754154b3b51187c" exitCode=0 May 21 14:41:59.935865 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:41:59.935269 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2cg2c" event={"ID":"34972f99-075d-486d-8b03-5efb08d79649","Type":"ContainerDied","Data":"55025ac1895990c546215cbb4380b09e838d9dde3bdd8b578754154b3b51187c"} May 21 14:42:00.045273 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:00.045232 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5c6a4608-495d-4cdb-8b1f-2df7cfa2b0d3-original-pull-secret\") pod \"global-pull-secret-syncer-ttwzv\" (UID: \"5c6a4608-495d-4cdb-8b1f-2df7cfa2b0d3\") " pod="kube-system/global-pull-secret-syncer-ttwzv" May 21 14:42:00.045464 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:42:00.045346 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 14:42:00.045464 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:42:00.045394 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c6a4608-495d-4cdb-8b1f-2df7cfa2b0d3-original-pull-secret podName:5c6a4608-495d-4cdb-8b1f-2df7cfa2b0d3 nodeName:}" failed. No retries permitted until 2026-05-21 14:42:02.045381092 +0000 UTC m=+34.783636601 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5c6a4608-495d-4cdb-8b1f-2df7cfa2b0d3-original-pull-secret") pod "global-pull-secret-syncer-ttwzv" (UID: "5c6a4608-495d-4cdb-8b1f-2df7cfa2b0d3") : object "kube-system"/"original-pull-secret" not registered May 21 14:42:00.813452 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:00.813411 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ttwzv" May 21 14:42:00.813452 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:00.813435 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tft6b" May 21 14:42:00.813767 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:00.813411 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6fb9w" May 21 14:42:00.813767 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:42:00.813535 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ttwzv" podUID="5c6a4608-495d-4cdb-8b1f-2df7cfa2b0d3" May 21 14:42:00.813767 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:42:00.813591 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6fb9w" podUID="2dc7761a-d68f-4f1f-ad3c-71fb26dad676" May 21 14:42:00.813767 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:42:00.813674 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tft6b" podUID="646e1e59-0917-4626-8e22-158fec29f33f" May 21 14:42:01.454786 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.454752 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/646e1e59-0917-4626-8e22-158fec29f33f-metrics-certs\") pod \"network-metrics-daemon-tft6b\" (UID: \"646e1e59-0917-4626-8e22-158fec29f33f\") " pod="openshift-multus/network-metrics-daemon-tft6b" May 21 14:42:01.455266 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.454822 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2gnsv\" (UniqueName: \"kubernetes.io/projected/2dc7761a-d68f-4f1f-ad3c-71fb26dad676-kube-api-access-2gnsv\") pod \"network-check-target-6fb9w\" (UID: \"2dc7761a-d68f-4f1f-ad3c-71fb26dad676\") " pod="openshift-network-diagnostics/network-check-target-6fb9w" May 21 14:42:01.455266 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:42:01.454888 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:42:01.455266 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:42:01.454955 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/646e1e59-0917-4626-8e22-158fec29f33f-metrics-certs podName:646e1e59-0917-4626-8e22-158fec29f33f nodeName:}" failed. No retries permitted until 2026-05-21 14:42:33.454938264 +0000 UTC m=+66.193193777 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/646e1e59-0917-4626-8e22-158fec29f33f-metrics-certs") pod "network-metrics-daemon-tft6b" (UID: "646e1e59-0917-4626-8e22-158fec29f33f") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:42:01.455266 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:42:01.454963 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 14:42:01.455266 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:42:01.454979 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 14:42:01.455266 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:42:01.455009 2573 projected.go:194] Error preparing data for projected volume kube-api-access-2gnsv for pod openshift-network-diagnostics/network-check-target-6fb9w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:42:01.455266 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:42:01.455059 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2dc7761a-d68f-4f1f-ad3c-71fb26dad676-kube-api-access-2gnsv podName:2dc7761a-d68f-4f1f-ad3c-71fb26dad676 nodeName:}" failed. No retries permitted until 2026-05-21 14:42:33.455042509 +0000 UTC m=+66.193298041 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-2gnsv" (UniqueName: "kubernetes.io/projected/2dc7761a-d68f-4f1f-ad3c-71fb26dad676-kube-api-access-2gnsv") pod "network-check-target-6fb9w" (UID: "2dc7761a-d68f-4f1f-ad3c-71fb26dad676") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:42:01.553051 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.553020 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-244.ec2.internal" event="NodeReady" May 21 14:42:01.553219 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.553181 2573 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 21 14:42:01.586382 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.586324 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dc49c9966-6xkjm"] May 21 14:42:01.609707 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.609671 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b74954856-ff8np"] May 21 14:42:01.609903 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.609839 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dc49c9966-6xkjm" May 21 14:42:01.612777 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.612485 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" May 21 14:42:01.612777 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.612526 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-8fx6q\"" May 21 14:42:01.612777 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.612583 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" May 21 14:42:01.612777 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.612526 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" May 21 14:42:01.613075 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.612853 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" May 21 14:42:01.629410 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.629380 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c647f55bc-zsjds"] May 21 14:42:01.629586 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.629556 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b74954856-ff8np" May 21 14:42:01.633117 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.632599 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" May 21 14:42:01.653429 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.653402 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-67d64978d7-ttr7l"] May 21 14:42:01.653567 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.653555 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c647f55bc-zsjds" May 21 14:42:01.659204 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.656398 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" May 21 14:42:01.659204 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.656413 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" May 21 14:42:01.659204 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.656491 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" May 21 14:42:01.659204 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.656411 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" May 21 14:42:01.674908 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.674880 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-nhgp4"] May 21 14:42:01.675064 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.675029 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67d64978d7-ttr7l" May 21 14:42:01.677305 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.677272 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 21 14:42:01.677305 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.677300 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 21 14:42:01.677495 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.677320 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 21 14:42:01.677495 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.677444 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-nhhn2\"" May 21 14:42:01.682295 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.682277 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 21 14:42:01.695427 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.695404 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b74954856-ff8np"] May 21 14:42:01.695427 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.695430 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dc49c9966-6xkjm"] May 21 14:42:01.695558 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.695439 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c647f55bc-zsjds"] May 21 14:42:01.695558 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.695446 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-67d64978d7-ttr7l"] May 21 14:42:01.695558 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.695459 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-8kdcz"] May 21 14:42:01.695558 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.695540 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nhgp4" May 21 14:42:01.697806 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.697789 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 21 14:42:01.697910 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.697828 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 21 14:42:01.697910 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.697841 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qp2mh\"" May 21 14:42:01.721078 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.721051 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8kdcz"] May 21 14:42:01.721078 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.721076 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nhgp4"] May 21 14:42:01.721230 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.721186 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8kdcz" May 21 14:42:01.724418 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.724390 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 21 14:42:01.724556 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.724542 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 21 14:42:01.724644 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.724630 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-t9nbd\"" May 21 14:42:01.724897 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.724884 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 21 14:42:01.756817 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.756787 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/a3815ee1-81d0-453e-b028-0cf9ae6956c8-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7c647f55bc-zsjds\" (UID: \"a3815ee1-81d0-453e-b028-0cf9ae6956c8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c647f55bc-zsjds" May 21 14:42:01.756952 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.756832 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8nkv\" (UniqueName: \"kubernetes.io/projected/dcea2ff5-a4b1-4a44-89d3-3fbf7ec4e7ee-kube-api-access-p8nkv\") pod \"managed-serviceaccount-addon-agent-5dc49c9966-6xkjm\" (UID: \"dcea2ff5-a4b1-4a44-89d3-3fbf7ec4e7ee\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dc49c9966-6xkjm" May 21 14:42:01.756952 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.756864 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rpdm\" (UniqueName: \"kubernetes.io/projected/a3815ee1-81d0-453e-b028-0cf9ae6956c8-kube-api-access-6rpdm\") pod \"cluster-proxy-proxy-agent-7c647f55bc-zsjds\" (UID: \"a3815ee1-81d0-453e-b028-0cf9ae6956c8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c647f55bc-zsjds" May 21 14:42:01.756952 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.756883 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f95cadd8-4e74-4e10-b701-a471d17e2fea-registry-certificates\") pod \"image-registry-67d64978d7-ttr7l\" (UID: \"f95cadd8-4e74-4e10-b701-a471d17e2fea\") " pod="openshift-image-registry/image-registry-67d64978d7-ttr7l" May 21 14:42:01.756952 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.756906 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/a3815ee1-81d0-453e-b028-0cf9ae6956c8-ca\") pod \"cluster-proxy-proxy-agent-7c647f55bc-zsjds\" (UID: \"a3815ee1-81d0-453e-b028-0cf9ae6956c8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c647f55bc-zsjds" May 21 14:42:01.757125 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.756957 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a3815ee1-81d0-453e-b028-0cf9ae6956c8-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7c647f55bc-zsjds\" (UID: \"a3815ee1-81d0-453e-b028-0cf9ae6956c8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c647f55bc-zsjds" May 21 14:42:01.757125 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.756986 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/a3815ee1-81d0-453e-b028-0cf9ae6956c8-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-7c647f55bc-zsjds\" (UID: \"a3815ee1-81d0-453e-b028-0cf9ae6956c8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c647f55bc-zsjds" May 21 14:42:01.757125 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.757034 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f95cadd8-4e74-4e10-b701-a471d17e2fea-ca-trust-extracted\") pod \"image-registry-67d64978d7-ttr7l\" (UID: \"f95cadd8-4e74-4e10-b701-a471d17e2fea\") " pod="openshift-image-registry/image-registry-67d64978d7-ttr7l" May 21 14:42:01.757125 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.757061 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krsh8\" (UniqueName: \"kubernetes.io/projected/f95cadd8-4e74-4e10-b701-a471d17e2fea-kube-api-access-krsh8\") pod \"image-registry-67d64978d7-ttr7l\" (UID: \"f95cadd8-4e74-4e10-b701-a471d17e2fea\") " pod="openshift-image-registry/image-registry-67d64978d7-ttr7l" May 21 14:42:01.757125 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.757114 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lf4kz\" (UniqueName: \"kubernetes.io/projected/4577417b-aa71-48b7-ac09-24cfc930e297-kube-api-access-lf4kz\") pod \"klusterlet-addon-workmgr-5b74954856-ff8np\" (UID: \"4577417b-aa71-48b7-ac09-24cfc930e297\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b74954856-ff8np" May 21 14:42:01.757269 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.757144 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dcea2ff5-a4b1-4a44-89d3-3fbf7ec4e7ee-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5dc49c9966-6xkjm\" (UID: \"dcea2ff5-a4b1-4a44-89d3-3fbf7ec4e7ee\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dc49c9966-6xkjm" May 21 14:42:01.757269 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.757164 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f95cadd8-4e74-4e10-b701-a471d17e2fea-installation-pull-secrets\") pod \"image-registry-67d64978d7-ttr7l\" (UID: \"f95cadd8-4e74-4e10-b701-a471d17e2fea\") " pod="openshift-image-registry/image-registry-67d64978d7-ttr7l" May 21 14:42:01.757269 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.757186 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f95cadd8-4e74-4e10-b701-a471d17e2fea-registry-tls\") pod \"image-registry-67d64978d7-ttr7l\" (UID: \"f95cadd8-4e74-4e10-b701-a471d17e2fea\") " pod="openshift-image-registry/image-registry-67d64978d7-ttr7l" May 21 14:42:01.757269 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.757214 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/a3815ee1-81d0-453e-b028-0cf9ae6956c8-hub\") pod \"cluster-proxy-proxy-agent-7c647f55bc-zsjds\" (UID: \"a3815ee1-81d0-453e-b028-0cf9ae6956c8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c647f55bc-zsjds" May 21 14:42:01.757269 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.757230 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f95cadd8-4e74-4e10-b701-a471d17e2fea-image-registry-private-configuration\") pod \"image-registry-67d64978d7-ttr7l\" (UID: \"f95cadd8-4e74-4e10-b701-a471d17e2fea\") " pod="openshift-image-registry/image-registry-67d64978d7-ttr7l" May 21 14:42:01.757269 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.757246 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f95cadd8-4e74-4e10-b701-a471d17e2fea-bound-sa-token\") pod \"image-registry-67d64978d7-ttr7l\" (UID: \"f95cadd8-4e74-4e10-b701-a471d17e2fea\") " pod="openshift-image-registry/image-registry-67d64978d7-ttr7l" May 21 14:42:01.757440 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.757270 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/4577417b-aa71-48b7-ac09-24cfc930e297-klusterlet-config\") pod \"klusterlet-addon-workmgr-5b74954856-ff8np\" (UID: \"4577417b-aa71-48b7-ac09-24cfc930e297\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b74954856-ff8np" May 21 14:42:01.757440 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.757298 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f95cadd8-4e74-4e10-b701-a471d17e2fea-trusted-ca\") pod \"image-registry-67d64978d7-ttr7l\" (UID: \"f95cadd8-4e74-4e10-b701-a471d17e2fea\") " pod="openshift-image-registry/image-registry-67d64978d7-ttr7l" May 21 14:42:01.757440 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.757311 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4577417b-aa71-48b7-ac09-24cfc930e297-tmp\") pod \"klusterlet-addon-workmgr-5b74954856-ff8np\" (UID: \"4577417b-aa71-48b7-ac09-24cfc930e297\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b74954856-ff8np" May 21 14:42:01.858611 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.858576 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f95cadd8-4e74-4e10-b701-a471d17e2fea-registry-tls\") pod \"image-registry-67d64978d7-ttr7l\" (UID: \"f95cadd8-4e74-4e10-b701-a471d17e2fea\") " pod="openshift-image-registry/image-registry-67d64978d7-ttr7l" May 21 14:42:01.858800 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.858619 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/a3815ee1-81d0-453e-b028-0cf9ae6956c8-hub\") pod \"cluster-proxy-proxy-agent-7c647f55bc-zsjds\" (UID: \"a3815ee1-81d0-453e-b028-0cf9ae6956c8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c647f55bc-zsjds" May 21 14:42:01.858800 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.858646 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f95cadd8-4e74-4e10-b701-a471d17e2fea-image-registry-private-configuration\") pod \"image-registry-67d64978d7-ttr7l\" (UID: \"f95cadd8-4e74-4e10-b701-a471d17e2fea\") " pod="openshift-image-registry/image-registry-67d64978d7-ttr7l" May 21 14:42:01.858800 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.858672 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f95cadd8-4e74-4e10-b701-a471d17e2fea-bound-sa-token\") pod \"image-registry-67d64978d7-ttr7l\" (UID: \"f95cadd8-4e74-4e10-b701-a471d17e2fea\") " pod="openshift-image-registry/image-registry-67d64978d7-ttr7l" May 21 14:42:01.858800 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.858698 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/4577417b-aa71-48b7-ac09-24cfc930e297-klusterlet-config\") pod \"klusterlet-addon-workmgr-5b74954856-ff8np\" (UID: \"4577417b-aa71-48b7-ac09-24cfc930e297\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b74954856-ff8np" May 21 14:42:01.858800 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.858738 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f95cadd8-4e74-4e10-b701-a471d17e2fea-trusted-ca\") pod \"image-registry-67d64978d7-ttr7l\" (UID: \"f95cadd8-4e74-4e10-b701-a471d17e2fea\") " pod="openshift-image-registry/image-registry-67d64978d7-ttr7l" May 21 14:42:01.858800 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:42:01.858738 2573 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 14:42:01.858800 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:42:01.858766 2573 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67d64978d7-ttr7l: secret "image-registry-tls" not found May 21 14:42:01.859239 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:42:01.858830 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f95cadd8-4e74-4e10-b701-a471d17e2fea-registry-tls podName:f95cadd8-4e74-4e10-b701-a471d17e2fea nodeName:}" failed. No retries permitted until 2026-05-21 14:42:02.35880732 +0000 UTC m=+35.097062830 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f95cadd8-4e74-4e10-b701-a471d17e2fea-registry-tls") pod "image-registry-67d64978d7-ttr7l" (UID: "f95cadd8-4e74-4e10-b701-a471d17e2fea") : secret "image-registry-tls" not found May 21 14:42:01.859239 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.859063 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4577417b-aa71-48b7-ac09-24cfc930e297-tmp\") pod \"klusterlet-addon-workmgr-5b74954856-ff8np\" (UID: \"4577417b-aa71-48b7-ac09-24cfc930e297\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b74954856-ff8np" May 21 14:42:01.859239 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.859113 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6mpn\" (UniqueName: \"kubernetes.io/projected/cf5c512d-d3b8-4cf0-9b13-2e99eeac6432-kube-api-access-b6mpn\") pod \"ingress-canary-8kdcz\" (UID: \"cf5c512d-d3b8-4cf0-9b13-2e99eeac6432\") " pod="openshift-ingress-canary/ingress-canary-8kdcz" May 21 14:42:01.859239 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.859152 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/a3815ee1-81d0-453e-b028-0cf9ae6956c8-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7c647f55bc-zsjds\" (UID: \"a3815ee1-81d0-453e-b028-0cf9ae6956c8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c647f55bc-zsjds" May 21 14:42:01.859239 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.859181 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p8nkv\" (UniqueName: \"kubernetes.io/projected/dcea2ff5-a4b1-4a44-89d3-3fbf7ec4e7ee-kube-api-access-p8nkv\") pod \"managed-serviceaccount-addon-agent-5dc49c9966-6xkjm\" (UID: \"dcea2ff5-a4b1-4a44-89d3-3fbf7ec4e7ee\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dc49c9966-6xkjm" May 21 14:42:01.859239 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.859206 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e9d6b052-42ec-4661-b823-05dd64d61de4-config-volume\") pod \"dns-default-nhgp4\" (UID: \"e9d6b052-42ec-4661-b823-05dd64d61de4\") " pod="openshift-dns/dns-default-nhgp4" May 21 14:42:01.859239 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.859236 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jv7x7\" (UniqueName: \"kubernetes.io/projected/e9d6b052-42ec-4661-b823-05dd64d61de4-kube-api-access-jv7x7\") pod \"dns-default-nhgp4\" (UID: \"e9d6b052-42ec-4661-b823-05dd64d61de4\") " pod="openshift-dns/dns-default-nhgp4" May 21 14:42:01.859498 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.859266 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6rpdm\" (UniqueName: \"kubernetes.io/projected/a3815ee1-81d0-453e-b028-0cf9ae6956c8-kube-api-access-6rpdm\") pod \"cluster-proxy-proxy-agent-7c647f55bc-zsjds\" (UID: \"a3815ee1-81d0-453e-b028-0cf9ae6956c8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c647f55bc-zsjds" May 21 14:42:01.859498 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.859289 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f95cadd8-4e74-4e10-b701-a471d17e2fea-registry-certificates\") pod \"image-registry-67d64978d7-ttr7l\" (UID: \"f95cadd8-4e74-4e10-b701-a471d17e2fea\") " pod="openshift-image-registry/image-registry-67d64978d7-ttr7l" May 21 14:42:01.859498 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.859316 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/a3815ee1-81d0-453e-b028-0cf9ae6956c8-ca\") pod \"cluster-proxy-proxy-agent-7c647f55bc-zsjds\" (UID: \"a3815ee1-81d0-453e-b028-0cf9ae6956c8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c647f55bc-zsjds" May 21 14:42:01.859498 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.859339 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a3815ee1-81d0-453e-b028-0cf9ae6956c8-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7c647f55bc-zsjds\" (UID: \"a3815ee1-81d0-453e-b028-0cf9ae6956c8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c647f55bc-zsjds" May 21 14:42:01.859498 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.859368 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/a3815ee1-81d0-453e-b028-0cf9ae6956c8-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-7c647f55bc-zsjds\" (UID: \"a3815ee1-81d0-453e-b028-0cf9ae6956c8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c647f55bc-zsjds" May 21 14:42:01.859498 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.859392 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f95cadd8-4e74-4e10-b701-a471d17e2fea-ca-trust-extracted\") pod \"image-registry-67d64978d7-ttr7l\" (UID: \"f95cadd8-4e74-4e10-b701-a471d17e2fea\") " pod="openshift-image-registry/image-registry-67d64978d7-ttr7l" May 21 14:42:01.859498 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.859417 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-krsh8\" (UniqueName: \"kubernetes.io/projected/f95cadd8-4e74-4e10-b701-a471d17e2fea-kube-api-access-krsh8\") pod \"image-registry-67d64978d7-ttr7l\" (UID: \"f95cadd8-4e74-4e10-b701-a471d17e2fea\") " pod="openshift-image-registry/image-registry-67d64978d7-ttr7l" May 21 14:42:01.859498 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.859494 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lf4kz\" (UniqueName: \"kubernetes.io/projected/4577417b-aa71-48b7-ac09-24cfc930e297-kube-api-access-lf4kz\") pod \"klusterlet-addon-workmgr-5b74954856-ff8np\" (UID: \"4577417b-aa71-48b7-ac09-24cfc930e297\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b74954856-ff8np" May 21 14:42:01.859498 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.859493 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4577417b-aa71-48b7-ac09-24cfc930e297-tmp\") pod \"klusterlet-addon-workmgr-5b74954856-ff8np\" (UID: \"4577417b-aa71-48b7-ac09-24cfc930e297\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b74954856-ff8np" May 21 14:42:01.859930 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.859521 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e9d6b052-42ec-4661-b823-05dd64d61de4-metrics-tls\") pod \"dns-default-nhgp4\" (UID: \"e9d6b052-42ec-4661-b823-05dd64d61de4\") " pod="openshift-dns/dns-default-nhgp4" May 21 14:42:01.859930 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.859549 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cf5c512d-d3b8-4cf0-9b13-2e99eeac6432-cert\") pod \"ingress-canary-8kdcz\" (UID: \"cf5c512d-d3b8-4cf0-9b13-2e99eeac6432\") " pod="openshift-ingress-canary/ingress-canary-8kdcz" May 21 14:42:01.859930 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.859588 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dcea2ff5-a4b1-4a44-89d3-3fbf7ec4e7ee-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5dc49c9966-6xkjm\" (UID: \"dcea2ff5-a4b1-4a44-89d3-3fbf7ec4e7ee\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dc49c9966-6xkjm" May 21 14:42:01.859930 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.859608 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9d6b052-42ec-4661-b823-05dd64d61de4-tmp-dir\") pod \"dns-default-nhgp4\" (UID: \"e9d6b052-42ec-4661-b823-05dd64d61de4\") " pod="openshift-dns/dns-default-nhgp4" May 21 14:42:01.859930 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.859638 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f95cadd8-4e74-4e10-b701-a471d17e2fea-installation-pull-secrets\") pod \"image-registry-67d64978d7-ttr7l\" (UID: \"f95cadd8-4e74-4e10-b701-a471d17e2fea\") " pod="openshift-image-registry/image-registry-67d64978d7-ttr7l" May 21 14:42:01.859930 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.859748 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f95cadd8-4e74-4e10-b701-a471d17e2fea-trusted-ca\") pod \"image-registry-67d64978d7-ttr7l\" (UID: \"f95cadd8-4e74-4e10-b701-a471d17e2fea\") " pod="openshift-image-registry/image-registry-67d64978d7-ttr7l" May 21 14:42:01.860619 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.860330 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f95cadd8-4e74-4e10-b701-a471d17e2fea-registry-certificates\") pod \"image-registry-67d64978d7-ttr7l\" (UID: \"f95cadd8-4e74-4e10-b701-a471d17e2fea\") " pod="openshift-image-registry/image-registry-67d64978d7-ttr7l" May 21 14:42:01.860619 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.860397 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/a3815ee1-81d0-453e-b028-0cf9ae6956c8-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-7c647f55bc-zsjds\" (UID: \"a3815ee1-81d0-453e-b028-0cf9ae6956c8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c647f55bc-zsjds" May 21 14:42:01.864650 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.864361 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/a3815ee1-81d0-453e-b028-0cf9ae6956c8-ca\") pod \"cluster-proxy-proxy-agent-7c647f55bc-zsjds\" (UID: \"a3815ee1-81d0-453e-b028-0cf9ae6956c8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c647f55bc-zsjds" May 21 14:42:01.864650 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.864394 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f95cadd8-4e74-4e10-b701-a471d17e2fea-image-registry-private-configuration\") pod \"image-registry-67d64978d7-ttr7l\" (UID: \"f95cadd8-4e74-4e10-b701-a471d17e2fea\") " pod="openshift-image-registry/image-registry-67d64978d7-ttr7l" May 21 14:42:01.864650 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.864441 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/a3815ee1-81d0-453e-b028-0cf9ae6956c8-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7c647f55bc-zsjds\" (UID: \"a3815ee1-81d0-453e-b028-0cf9ae6956c8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c647f55bc-zsjds" May 21 14:42:01.864650 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.864455 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a3815ee1-81d0-453e-b028-0cf9ae6956c8-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7c647f55bc-zsjds\" (UID: \"a3815ee1-81d0-453e-b028-0cf9ae6956c8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c647f55bc-zsjds" May 21 14:42:01.864650 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.864513 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/a3815ee1-81d0-453e-b028-0cf9ae6956c8-hub\") pod \"cluster-proxy-proxy-agent-7c647f55bc-zsjds\" (UID: \"a3815ee1-81d0-453e-b028-0cf9ae6956c8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c647f55bc-zsjds" May 21 14:42:01.864650 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.864616 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/4577417b-aa71-48b7-ac09-24cfc930e297-klusterlet-config\") pod \"klusterlet-addon-workmgr-5b74954856-ff8np\" (UID: \"4577417b-aa71-48b7-ac09-24cfc930e297\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b74954856-ff8np" May 21 14:42:01.865061 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.864666 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f95cadd8-4e74-4e10-b701-a471d17e2fea-ca-trust-extracted\") pod \"image-registry-67d64978d7-ttr7l\" (UID: \"f95cadd8-4e74-4e10-b701-a471d17e2fea\") " pod="openshift-image-registry/image-registry-67d64978d7-ttr7l" May 21 14:42:01.865400 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.865374 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f95cadd8-4e74-4e10-b701-a471d17e2fea-installation-pull-secrets\") pod \"image-registry-67d64978d7-ttr7l\" (UID: \"f95cadd8-4e74-4e10-b701-a471d17e2fea\") " pod="openshift-image-registry/image-registry-67d64978d7-ttr7l" May 21 14:42:01.870805 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.870781 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lf4kz\" (UniqueName: \"kubernetes.io/projected/4577417b-aa71-48b7-ac09-24cfc930e297-kube-api-access-lf4kz\") pod \"klusterlet-addon-workmgr-5b74954856-ff8np\" (UID: \"4577417b-aa71-48b7-ac09-24cfc930e297\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b74954856-ff8np" May 21 14:42:01.870935 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.870877 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rpdm\" (UniqueName: \"kubernetes.io/projected/a3815ee1-81d0-453e-b028-0cf9ae6956c8-kube-api-access-6rpdm\") pod \"cluster-proxy-proxy-agent-7c647f55bc-zsjds\" (UID: \"a3815ee1-81d0-453e-b028-0cf9ae6956c8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c647f55bc-zsjds" May 21 14:42:01.871820 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.871794 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f95cadd8-4e74-4e10-b701-a471d17e2fea-bound-sa-token\") pod \"image-registry-67d64978d7-ttr7l\" (UID: \"f95cadd8-4e74-4e10-b701-a471d17e2fea\") " pod="openshift-image-registry/image-registry-67d64978d7-ttr7l" May 21 14:42:01.872207 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.872184 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-krsh8\" (UniqueName: \"kubernetes.io/projected/f95cadd8-4e74-4e10-b701-a471d17e2fea-kube-api-access-krsh8\") pod \"image-registry-67d64978d7-ttr7l\" (UID: \"f95cadd8-4e74-4e10-b701-a471d17e2fea\") " pod="openshift-image-registry/image-registry-67d64978d7-ttr7l" May 21 14:42:01.874855 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.874834 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8nkv\" (UniqueName: \"kubernetes.io/projected/dcea2ff5-a4b1-4a44-89d3-3fbf7ec4e7ee-kube-api-access-p8nkv\") pod \"managed-serviceaccount-addon-agent-5dc49c9966-6xkjm\" (UID: \"dcea2ff5-a4b1-4a44-89d3-3fbf7ec4e7ee\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dc49c9966-6xkjm" May 21 14:42:01.875195 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.875148 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dcea2ff5-a4b1-4a44-89d3-3fbf7ec4e7ee-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5dc49c9966-6xkjm\" (UID: \"dcea2ff5-a4b1-4a44-89d3-3fbf7ec4e7ee\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dc49c9966-6xkjm" May 21 14:42:01.932307 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.932265 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dc49c9966-6xkjm" May 21 14:42:01.943833 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.943768 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b74954856-ff8np" May 21 14:42:01.960951 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.960917 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e9d6b052-42ec-4661-b823-05dd64d61de4-config-volume\") pod \"dns-default-nhgp4\" (UID: \"e9d6b052-42ec-4661-b823-05dd64d61de4\") " pod="openshift-dns/dns-default-nhgp4" May 21 14:42:01.961104 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.960969 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jv7x7\" (UniqueName: \"kubernetes.io/projected/e9d6b052-42ec-4661-b823-05dd64d61de4-kube-api-access-jv7x7\") pod \"dns-default-nhgp4\" (UID: \"e9d6b052-42ec-4661-b823-05dd64d61de4\") " pod="openshift-dns/dns-default-nhgp4" May 21 14:42:01.961104 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.961049 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e9d6b052-42ec-4661-b823-05dd64d61de4-metrics-tls\") pod \"dns-default-nhgp4\" (UID: \"e9d6b052-42ec-4661-b823-05dd64d61de4\") " pod="openshift-dns/dns-default-nhgp4" May 21 14:42:01.961104 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.961069 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cf5c512d-d3b8-4cf0-9b13-2e99eeac6432-cert\") pod \"ingress-canary-8kdcz\" (UID: \"cf5c512d-d3b8-4cf0-9b13-2e99eeac6432\") " pod="openshift-ingress-canary/ingress-canary-8kdcz" May 21 14:42:01.961104 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.961102 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9d6b052-42ec-4661-b823-05dd64d61de4-tmp-dir\") pod \"dns-default-nhgp4\" (UID: \"e9d6b052-42ec-4661-b823-05dd64d61de4\") " pod="openshift-dns/dns-default-nhgp4" May 21 14:42:01.961314 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.961151 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b6mpn\" (UniqueName: \"kubernetes.io/projected/cf5c512d-d3b8-4cf0-9b13-2e99eeac6432-kube-api-access-b6mpn\") pod \"ingress-canary-8kdcz\" (UID: \"cf5c512d-d3b8-4cf0-9b13-2e99eeac6432\") " pod="openshift-ingress-canary/ingress-canary-8kdcz" May 21 14:42:01.961405 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:42:01.961381 2573 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 14:42:01.961510 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:42:01.961460 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf5c512d-d3b8-4cf0-9b13-2e99eeac6432-cert podName:cf5c512d-d3b8-4cf0-9b13-2e99eeac6432 nodeName:}" failed. No retries permitted until 2026-05-21 14:42:02.461440445 +0000 UTC m=+35.199695970 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/cf5c512d-d3b8-4cf0-9b13-2e99eeac6432-cert") pod "ingress-canary-8kdcz" (UID: "cf5c512d-d3b8-4cf0-9b13-2e99eeac6432") : secret "canary-serving-cert" not found May 21 14:42:01.961591 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:42:01.961389 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 14:42:01.961591 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:42:01.961589 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9d6b052-42ec-4661-b823-05dd64d61de4-metrics-tls podName:e9d6b052-42ec-4661-b823-05dd64d61de4 nodeName:}" failed. No retries permitted until 2026-05-21 14:42:02.461572261 +0000 UTC m=+35.199827772 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e9d6b052-42ec-4661-b823-05dd64d61de4-metrics-tls") pod "dns-default-nhgp4" (UID: "e9d6b052-42ec-4661-b823-05dd64d61de4") : secret "dns-default-metrics-tls" not found May 21 14:42:01.961950 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.961929 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e9d6b052-42ec-4661-b823-05dd64d61de4-config-volume\") pod \"dns-default-nhgp4\" (UID: \"e9d6b052-42ec-4661-b823-05dd64d61de4\") " pod="openshift-dns/dns-default-nhgp4" May 21 14:42:01.962056 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.962045 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9d6b052-42ec-4661-b823-05dd64d61de4-tmp-dir\") pod \"dns-default-nhgp4\" (UID: \"e9d6b052-42ec-4661-b823-05dd64d61de4\") " pod="openshift-dns/dns-default-nhgp4" May 21 14:42:01.963885 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.963865 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c647f55bc-zsjds" May 21 14:42:01.970903 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.970873 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6mpn\" (UniqueName: \"kubernetes.io/projected/cf5c512d-d3b8-4cf0-9b13-2e99eeac6432-kube-api-access-b6mpn\") pod \"ingress-canary-8kdcz\" (UID: \"cf5c512d-d3b8-4cf0-9b13-2e99eeac6432\") " pod="openshift-ingress-canary/ingress-canary-8kdcz" May 21 14:42:01.971339 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:01.971318 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jv7x7\" (UniqueName: \"kubernetes.io/projected/e9d6b052-42ec-4661-b823-05dd64d61de4-kube-api-access-jv7x7\") pod \"dns-default-nhgp4\" (UID: \"e9d6b052-42ec-4661-b823-05dd64d61de4\") " pod="openshift-dns/dns-default-nhgp4" May 21 14:42:02.062324 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:02.062224 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5c6a4608-495d-4cdb-8b1f-2df7cfa2b0d3-original-pull-secret\") pod \"global-pull-secret-syncer-ttwzv\" (UID: \"5c6a4608-495d-4cdb-8b1f-2df7cfa2b0d3\") " pod="kube-system/global-pull-secret-syncer-ttwzv" May 21 14:42:02.062488 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:42:02.062471 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 14:42:02.062550 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:42:02.062536 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c6a4608-495d-4cdb-8b1f-2df7cfa2b0d3-original-pull-secret podName:5c6a4608-495d-4cdb-8b1f-2df7cfa2b0d3 nodeName:}" failed. No retries permitted until 2026-05-21 14:42:06.062518878 +0000 UTC m=+38.800774389 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5c6a4608-495d-4cdb-8b1f-2df7cfa2b0d3-original-pull-secret") pod "global-pull-secret-syncer-ttwzv" (UID: "5c6a4608-495d-4cdb-8b1f-2df7cfa2b0d3") : object "kube-system"/"original-pull-secret" not registered May 21 14:42:02.119784 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:02.119749 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dc49c9966-6xkjm"] May 21 14:42:02.124705 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:02.124675 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b74954856-ff8np"] May 21 14:42:02.125266 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:42:02.125236 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddcea2ff5_a4b1_4a44_89d3_3fbf7ec4e7ee.slice/crio-5634cff60b425a4bf406b2652aefdeae5a3788f9e0e6dd31a68e4d574e4f8f3b WatchSource:0}: Error finding container 5634cff60b425a4bf406b2652aefdeae5a3788f9e0e6dd31a68e4d574e4f8f3b: Status 404 returned error can't find the container with id 5634cff60b425a4bf406b2652aefdeae5a3788f9e0e6dd31a68e4d574e4f8f3b May 21 14:42:02.127700 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:42:02.127674 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4577417b_aa71_48b7_ac09_24cfc930e297.slice/crio-8521b6419a2d0715febe9d5eba72902e73d5471389740586ec3738e60793e32a WatchSource:0}: Error finding container 8521b6419a2d0715febe9d5eba72902e73d5471389740586ec3738e60793e32a: Status 404 returned error can't find the container with id 8521b6419a2d0715febe9d5eba72902e73d5471389740586ec3738e60793e32a May 21 14:42:02.134366 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:02.134338 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c647f55bc-zsjds"] May 21 14:42:02.137430 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:42:02.137398 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda3815ee1_81d0_453e_b028_0cf9ae6956c8.slice/crio-4613de99c35a7a5e4e30d2d139477e060ca4ae4f7eb32b7ac92d5e07f5603e03 WatchSource:0}: Error finding container 4613de99c35a7a5e4e30d2d139477e060ca4ae4f7eb32b7ac92d5e07f5603e03: Status 404 returned error can't find the container with id 4613de99c35a7a5e4e30d2d139477e060ca4ae4f7eb32b7ac92d5e07f5603e03 May 21 14:42:02.364516 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:02.364417 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f95cadd8-4e74-4e10-b701-a471d17e2fea-registry-tls\") pod \"image-registry-67d64978d7-ttr7l\" (UID: \"f95cadd8-4e74-4e10-b701-a471d17e2fea\") " pod="openshift-image-registry/image-registry-67d64978d7-ttr7l" May 21 14:42:02.364690 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:42:02.364618 2573 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 14:42:02.364690 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:42:02.364643 2573 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67d64978d7-ttr7l: secret "image-registry-tls" not found May 21 14:42:02.364801 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:42:02.364720 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f95cadd8-4e74-4e10-b701-a471d17e2fea-registry-tls podName:f95cadd8-4e74-4e10-b701-a471d17e2fea nodeName:}" failed. No retries permitted until 2026-05-21 14:42:03.364697388 +0000 UTC m=+36.102952899 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f95cadd8-4e74-4e10-b701-a471d17e2fea-registry-tls") pod "image-registry-67d64978d7-ttr7l" (UID: "f95cadd8-4e74-4e10-b701-a471d17e2fea") : secret "image-registry-tls" not found May 21 14:42:02.465295 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:02.465242 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e9d6b052-42ec-4661-b823-05dd64d61de4-metrics-tls\") pod \"dns-default-nhgp4\" (UID: \"e9d6b052-42ec-4661-b823-05dd64d61de4\") " pod="openshift-dns/dns-default-nhgp4" May 21 14:42:02.465295 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:02.465296 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cf5c512d-d3b8-4cf0-9b13-2e99eeac6432-cert\") pod \"ingress-canary-8kdcz\" (UID: \"cf5c512d-d3b8-4cf0-9b13-2e99eeac6432\") " pod="openshift-ingress-canary/ingress-canary-8kdcz" May 21 14:42:02.466115 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:42:02.465424 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 14:42:02.466115 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:42:02.465504 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9d6b052-42ec-4661-b823-05dd64d61de4-metrics-tls podName:e9d6b052-42ec-4661-b823-05dd64d61de4 nodeName:}" failed. No retries permitted until 2026-05-21 14:42:03.465486615 +0000 UTC m=+36.203742126 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e9d6b052-42ec-4661-b823-05dd64d61de4-metrics-tls") pod "dns-default-nhgp4" (UID: "e9d6b052-42ec-4661-b823-05dd64d61de4") : secret "dns-default-metrics-tls" not found May 21 14:42:02.466115 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:42:02.465428 2573 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 14:42:02.466115 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:42:02.465580 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf5c512d-d3b8-4cf0-9b13-2e99eeac6432-cert podName:cf5c512d-d3b8-4cf0-9b13-2e99eeac6432 nodeName:}" failed. No retries permitted until 2026-05-21 14:42:03.465563633 +0000 UTC m=+36.203819144 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/cf5c512d-d3b8-4cf0-9b13-2e99eeac6432-cert") pod "ingress-canary-8kdcz" (UID: "cf5c512d-d3b8-4cf0-9b13-2e99eeac6432") : secret "canary-serving-cert" not found May 21 14:42:02.813310 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:02.813272 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6fb9w" May 21 14:42:02.813727 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:02.813593 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ttwzv" May 21 14:42:02.813727 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:02.813272 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tft6b" May 21 14:42:02.816383 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:02.816149 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 21 14:42:02.816383 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:02.816159 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 21 14:42:02.816383 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:02.816194 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-n8k7m\"" May 21 14:42:02.816383 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:02.816270 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 21 14:42:02.816383 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:02.816151 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 21 14:42:02.816709 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:02.816519 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-brsnp\"" May 21 14:42:02.944079 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:02.943804 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c647f55bc-zsjds" event={"ID":"a3815ee1-81d0-453e-b028-0cf9ae6956c8","Type":"ContainerStarted","Data":"4613de99c35a7a5e4e30d2d139477e060ca4ae4f7eb32b7ac92d5e07f5603e03"} May 21 14:42:02.946393 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:02.946361 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b74954856-ff8np" event={"ID":"4577417b-aa71-48b7-ac09-24cfc930e297","Type":"ContainerStarted","Data":"8521b6419a2d0715febe9d5eba72902e73d5471389740586ec3738e60793e32a"} May 21 14:42:02.947583 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:02.947552 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dc49c9966-6xkjm" event={"ID":"dcea2ff5-a4b1-4a44-89d3-3fbf7ec4e7ee","Type":"ContainerStarted","Data":"5634cff60b425a4bf406b2652aefdeae5a3788f9e0e6dd31a68e4d574e4f8f3b"} May 21 14:42:03.372403 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:03.372362 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f95cadd8-4e74-4e10-b701-a471d17e2fea-registry-tls\") pod \"image-registry-67d64978d7-ttr7l\" (UID: \"f95cadd8-4e74-4e10-b701-a471d17e2fea\") " pod="openshift-image-registry/image-registry-67d64978d7-ttr7l" May 21 14:42:03.372638 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:42:03.372557 2573 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 14:42:03.372638 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:42:03.372573 2573 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67d64978d7-ttr7l: secret "image-registry-tls" not found May 21 14:42:03.372638 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:42:03.372637 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f95cadd8-4e74-4e10-b701-a471d17e2fea-registry-tls podName:f95cadd8-4e74-4e10-b701-a471d17e2fea nodeName:}" failed. No retries permitted until 2026-05-21 14:42:05.372616981 +0000 UTC m=+38.110872509 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f95cadd8-4e74-4e10-b701-a471d17e2fea-registry-tls") pod "image-registry-67d64978d7-ttr7l" (UID: "f95cadd8-4e74-4e10-b701-a471d17e2fea") : secret "image-registry-tls" not found May 21 14:42:03.473259 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:03.473221 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e9d6b052-42ec-4661-b823-05dd64d61de4-metrics-tls\") pod \"dns-default-nhgp4\" (UID: \"e9d6b052-42ec-4661-b823-05dd64d61de4\") " pod="openshift-dns/dns-default-nhgp4" May 21 14:42:03.473723 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:03.473275 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cf5c512d-d3b8-4cf0-9b13-2e99eeac6432-cert\") pod \"ingress-canary-8kdcz\" (UID: \"cf5c512d-d3b8-4cf0-9b13-2e99eeac6432\") " pod="openshift-ingress-canary/ingress-canary-8kdcz" May 21 14:42:03.473723 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:42:03.473425 2573 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 14:42:03.473723 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:42:03.473497 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf5c512d-d3b8-4cf0-9b13-2e99eeac6432-cert podName:cf5c512d-d3b8-4cf0-9b13-2e99eeac6432 nodeName:}" failed. No retries permitted until 2026-05-21 14:42:05.47347795 +0000 UTC m=+38.211733473 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/cf5c512d-d3b8-4cf0-9b13-2e99eeac6432-cert") pod "ingress-canary-8kdcz" (UID: "cf5c512d-d3b8-4cf0-9b13-2e99eeac6432") : secret "canary-serving-cert" not found May 21 14:42:03.473932 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:42:03.473912 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 14:42:03.474026 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:42:03.473966 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9d6b052-42ec-4661-b823-05dd64d61de4-metrics-tls podName:e9d6b052-42ec-4661-b823-05dd64d61de4 nodeName:}" failed. No retries permitted until 2026-05-21 14:42:05.473951955 +0000 UTC m=+38.212207468 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e9d6b052-42ec-4661-b823-05dd64d61de4-metrics-tls") pod "dns-default-nhgp4" (UID: "e9d6b052-42ec-4661-b823-05dd64d61de4") : secret "dns-default-metrics-tls" not found May 21 14:42:05.393058 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:05.392940 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f95cadd8-4e74-4e10-b701-a471d17e2fea-registry-tls\") pod \"image-registry-67d64978d7-ttr7l\" (UID: \"f95cadd8-4e74-4e10-b701-a471d17e2fea\") " pod="openshift-image-registry/image-registry-67d64978d7-ttr7l" May 21 14:42:05.393592 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:42:05.393123 2573 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 14:42:05.393592 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:42:05.393147 2573 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67d64978d7-ttr7l: secret "image-registry-tls" not found May 21 14:42:05.393592 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:42:05.393223 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f95cadd8-4e74-4e10-b701-a471d17e2fea-registry-tls podName:f95cadd8-4e74-4e10-b701-a471d17e2fea nodeName:}" failed. No retries permitted until 2026-05-21 14:42:09.393201047 +0000 UTC m=+42.131456562 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f95cadd8-4e74-4e10-b701-a471d17e2fea-registry-tls") pod "image-registry-67d64978d7-ttr7l" (UID: "f95cadd8-4e74-4e10-b701-a471d17e2fea") : secret "image-registry-tls" not found May 21 14:42:05.494351 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:05.494064 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e9d6b052-42ec-4661-b823-05dd64d61de4-metrics-tls\") pod \"dns-default-nhgp4\" (UID: \"e9d6b052-42ec-4661-b823-05dd64d61de4\") " pod="openshift-dns/dns-default-nhgp4" May 21 14:42:05.494351 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:05.494122 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cf5c512d-d3b8-4cf0-9b13-2e99eeac6432-cert\") pod \"ingress-canary-8kdcz\" (UID: \"cf5c512d-d3b8-4cf0-9b13-2e99eeac6432\") " pod="openshift-ingress-canary/ingress-canary-8kdcz" May 21 14:42:05.494351 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:42:05.494214 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 14:42:05.494351 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:42:05.494264 2573 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 14:42:05.494351 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:42:05.494291 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9d6b052-42ec-4661-b823-05dd64d61de4-metrics-tls podName:e9d6b052-42ec-4661-b823-05dd64d61de4 nodeName:}" failed. No retries permitted until 2026-05-21 14:42:09.494270724 +0000 UTC m=+42.232526236 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e9d6b052-42ec-4661-b823-05dd64d61de4-metrics-tls") pod "dns-default-nhgp4" (UID: "e9d6b052-42ec-4661-b823-05dd64d61de4") : secret "dns-default-metrics-tls" not found May 21 14:42:05.494351 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:42:05.494319 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf5c512d-d3b8-4cf0-9b13-2e99eeac6432-cert podName:cf5c512d-d3b8-4cf0-9b13-2e99eeac6432 nodeName:}" failed. No retries permitted until 2026-05-21 14:42:09.494300853 +0000 UTC m=+42.232556377 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/cf5c512d-d3b8-4cf0-9b13-2e99eeac6432-cert") pod "ingress-canary-8kdcz" (UID: "cf5c512d-d3b8-4cf0-9b13-2e99eeac6432") : secret "canary-serving-cert" not found May 21 14:42:06.099465 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:06.099420 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5c6a4608-495d-4cdb-8b1f-2df7cfa2b0d3-original-pull-secret\") pod \"global-pull-secret-syncer-ttwzv\" (UID: \"5c6a4608-495d-4cdb-8b1f-2df7cfa2b0d3\") " pod="kube-system/global-pull-secret-syncer-ttwzv" May 21 14:42:06.103317 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:06.103280 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5c6a4608-495d-4cdb-8b1f-2df7cfa2b0d3-original-pull-secret\") pod \"global-pull-secret-syncer-ttwzv\" (UID: \"5c6a4608-495d-4cdb-8b1f-2df7cfa2b0d3\") " pod="kube-system/global-pull-secret-syncer-ttwzv" May 21 14:42:06.136499 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:06.136448 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ttwzv" May 21 14:42:09.429464 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:09.429414 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f95cadd8-4e74-4e10-b701-a471d17e2fea-registry-tls\") pod \"image-registry-67d64978d7-ttr7l\" (UID: \"f95cadd8-4e74-4e10-b701-a471d17e2fea\") " pod="openshift-image-registry/image-registry-67d64978d7-ttr7l" May 21 14:42:09.429905 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:42:09.429565 2573 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 14:42:09.429905 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:42:09.429586 2573 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67d64978d7-ttr7l: secret "image-registry-tls" not found May 21 14:42:09.429905 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:42:09.429647 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f95cadd8-4e74-4e10-b701-a471d17e2fea-registry-tls podName:f95cadd8-4e74-4e10-b701-a471d17e2fea nodeName:}" failed. No retries permitted until 2026-05-21 14:42:17.429630724 +0000 UTC m=+50.167886233 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f95cadd8-4e74-4e10-b701-a471d17e2fea-registry-tls") pod "image-registry-67d64978d7-ttr7l" (UID: "f95cadd8-4e74-4e10-b701-a471d17e2fea") : secret "image-registry-tls" not found May 21 14:42:09.530744 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:09.530700 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e9d6b052-42ec-4661-b823-05dd64d61de4-metrics-tls\") pod \"dns-default-nhgp4\" (UID: \"e9d6b052-42ec-4661-b823-05dd64d61de4\") " pod="openshift-dns/dns-default-nhgp4" May 21 14:42:09.530744 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:09.530745 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cf5c512d-d3b8-4cf0-9b13-2e99eeac6432-cert\") pod \"ingress-canary-8kdcz\" (UID: \"cf5c512d-d3b8-4cf0-9b13-2e99eeac6432\") " pod="openshift-ingress-canary/ingress-canary-8kdcz" May 21 14:42:09.531012 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:42:09.530870 2573 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 14:42:09.531012 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:42:09.530941 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf5c512d-d3b8-4cf0-9b13-2e99eeac6432-cert podName:cf5c512d-d3b8-4cf0-9b13-2e99eeac6432 nodeName:}" failed. No retries permitted until 2026-05-21 14:42:17.530925965 +0000 UTC m=+50.269181474 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/cf5c512d-d3b8-4cf0-9b13-2e99eeac6432-cert") pod "ingress-canary-8kdcz" (UID: "cf5c512d-d3b8-4cf0-9b13-2e99eeac6432") : secret "canary-serving-cert" not found May 21 14:42:09.531012 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:42:09.530867 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 14:42:09.531167 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:42:09.531015 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9d6b052-42ec-4661-b823-05dd64d61de4-metrics-tls podName:e9d6b052-42ec-4661-b823-05dd64d61de4 nodeName:}" failed. No retries permitted until 2026-05-21 14:42:17.530990269 +0000 UTC m=+50.269245791 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e9d6b052-42ec-4661-b823-05dd64d61de4-metrics-tls") pod "dns-default-nhgp4" (UID: "e9d6b052-42ec-4661-b823-05dd64d61de4") : secret "dns-default-metrics-tls" not found May 21 14:42:12.756458 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:12.756352 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ttwzv"] May 21 14:42:12.970305 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:12.970263 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b74954856-ff8np" event={"ID":"4577417b-aa71-48b7-ac09-24cfc930e297","Type":"ContainerStarted","Data":"ce47f914fb516c7e85cddfcb4481af048dcf3276a6be572959077c732b1efd12"} May 21 14:42:12.970518 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:12.970494 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b74954856-ff8np" May 21 14:42:12.971531 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:12.971494 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ttwzv" event={"ID":"5c6a4608-495d-4cdb-8b1f-2df7cfa2b0d3","Type":"ContainerStarted","Data":"f9e73886536b21c08b39ac5e88c8ff38b2652fde7c72e4fef7d145c09b06f14e"} May 21 14:42:12.972559 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:12.972536 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b74954856-ff8np" May 21 14:42:12.974215 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:12.974193 2573 generic.go:358] "Generic (PLEG): container finished" podID="34972f99-075d-486d-8b03-5efb08d79649" containerID="0d1f969b8fee4fa54f38af189a071eefd5e7daaa9f0b932e655f3722b8ccd711" exitCode=0 May 21 14:42:12.974319 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:12.974272 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2cg2c" event={"ID":"34972f99-075d-486d-8b03-5efb08d79649","Type":"ContainerDied","Data":"0d1f969b8fee4fa54f38af189a071eefd5e7daaa9f0b932e655f3722b8ccd711"} May 21 14:42:12.975513 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:12.975493 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c647f55bc-zsjds" event={"ID":"a3815ee1-81d0-453e-b028-0cf9ae6956c8","Type":"ContainerStarted","Data":"9d0f951caa92933451ead08fb2beb56f76146b6a17ae708622ced53854be5a63"} May 21 14:42:12.976693 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:12.976672 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dc49c9966-6xkjm" event={"ID":"dcea2ff5-a4b1-4a44-89d3-3fbf7ec4e7ee","Type":"ContainerStarted","Data":"fa3ee55ae8d514a32adcf70d11d3bfec399dd9ec979dbbede4e5e6cb1de4393d"} May 21 14:42:12.985714 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:12.985669 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b74954856-ff8np" podStartSLOduration=31.496864236 podStartE2EDuration="41.985655161s" podCreationTimestamp="2026-05-21 14:41:31 +0000 UTC" firstStartedPulling="2026-05-21 14:42:02.129288567 +0000 UTC m=+34.867544077" lastFinishedPulling="2026-05-21 14:42:12.618079494 +0000 UTC m=+45.356335002" observedRunningTime="2026-05-21 14:42:12.985302731 +0000 UTC m=+45.723558262" watchObservedRunningTime="2026-05-21 14:42:12.985655161 +0000 UTC m=+45.723910686" May 21 14:42:12.999554 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:12.999499 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dc49c9966-6xkjm" podStartSLOduration=31.520803334 podStartE2EDuration="41.999480632s" podCreationTimestamp="2026-05-21 14:41:31 +0000 UTC" firstStartedPulling="2026-05-21 14:42:02.12691281 +0000 UTC m=+34.865168332" lastFinishedPulling="2026-05-21 14:42:12.605590106 +0000 UTC m=+45.343845630" observedRunningTime="2026-05-21 14:42:12.998978224 +0000 UTC m=+45.737233758" watchObservedRunningTime="2026-05-21 14:42:12.999480632 +0000 UTC m=+45.737736166" May 21 14:42:13.983166 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:13.983127 2573 generic.go:358] "Generic (PLEG): container finished" podID="34972f99-075d-486d-8b03-5efb08d79649" containerID="f1f3c7e70fa97e39a4583aa6c48504e0b22c2f7def4ab1dc2a2fb38ed7fbe705" exitCode=0 May 21 14:42:13.983636 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:13.983284 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2cg2c" event={"ID":"34972f99-075d-486d-8b03-5efb08d79649","Type":"ContainerDied","Data":"f1f3c7e70fa97e39a4583aa6c48504e0b22c2f7def4ab1dc2a2fb38ed7fbe705"} May 21 14:42:14.990436 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:14.990384 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2cg2c" event={"ID":"34972f99-075d-486d-8b03-5efb08d79649","Type":"ContainerStarted","Data":"67c30fe07cbae5fc82fe0111d60a5fd2dbf07ad2412da5a19c93a29ecc0167b7"} May 21 14:42:14.993027 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:14.992978 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c647f55bc-zsjds" event={"ID":"a3815ee1-81d0-453e-b028-0cf9ae6956c8","Type":"ContainerStarted","Data":"046f7dbc9e00d6d1e1e32c1708fd5f936e5b2129e2b9513d8a5dfaa407aacd33"} May 21 14:42:14.993027 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:14.993028 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c647f55bc-zsjds" event={"ID":"a3815ee1-81d0-453e-b028-0cf9ae6956c8","Type":"ContainerStarted","Data":"a49958aedefef57ffae799e3a3ba6e556c6bf8cb5cf5e9f4269a8a9cbb099fd0"} May 21 14:42:15.012150 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:15.012098 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-2cg2c" podStartSLOduration=6.130628894 podStartE2EDuration="48.012079966s" podCreationTimestamp="2026-05-21 14:41:27 +0000 UTC" firstStartedPulling="2026-05-21 14:41:30.712199035 +0000 UTC m=+3.450454544" lastFinishedPulling="2026-05-21 14:42:12.593650093 +0000 UTC m=+45.331905616" observedRunningTime="2026-05-21 14:42:15.010498054 +0000 UTC m=+47.748753588" watchObservedRunningTime="2026-05-21 14:42:15.012079966 +0000 UTC m=+47.750335496" May 21 14:42:15.028383 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:15.028319 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c647f55bc-zsjds" podStartSLOduration=31.326912121 podStartE2EDuration="44.028297517s" podCreationTimestamp="2026-05-21 14:41:31 +0000 UTC" firstStartedPulling="2026-05-21 14:42:02.139428049 +0000 UTC m=+34.877683557" lastFinishedPulling="2026-05-21 14:42:14.840813444 +0000 UTC m=+47.579068953" observedRunningTime="2026-05-21 14:42:15.027236774 +0000 UTC m=+47.765492333" watchObservedRunningTime="2026-05-21 14:42:15.028297517 +0000 UTC m=+47.766553049" May 21 14:42:16.998170 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:16.998085 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ttwzv" event={"ID":"5c6a4608-495d-4cdb-8b1f-2df7cfa2b0d3","Type":"ContainerStarted","Data":"c104723fd39c472d4e09fe8b9653125d2b60ee422746b1bbb818c0de90cd3a1b"} May 21 14:42:17.507133 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:17.507076 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f95cadd8-4e74-4e10-b701-a471d17e2fea-registry-tls\") pod \"image-registry-67d64978d7-ttr7l\" (UID: \"f95cadd8-4e74-4e10-b701-a471d17e2fea\") " pod="openshift-image-registry/image-registry-67d64978d7-ttr7l" May 21 14:42:17.507306 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:42:17.507216 2573 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 14:42:17.507306 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:42:17.507237 2573 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67d64978d7-ttr7l: secret "image-registry-tls" not found May 21 14:42:17.507306 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:42:17.507294 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f95cadd8-4e74-4e10-b701-a471d17e2fea-registry-tls podName:f95cadd8-4e74-4e10-b701-a471d17e2fea nodeName:}" failed. No retries permitted until 2026-05-21 14:42:33.507278687 +0000 UTC m=+66.245534202 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f95cadd8-4e74-4e10-b701-a471d17e2fea-registry-tls") pod "image-registry-67d64978d7-ttr7l" (UID: "f95cadd8-4e74-4e10-b701-a471d17e2fea") : secret "image-registry-tls" not found May 21 14:42:17.607673 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:17.607629 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e9d6b052-42ec-4661-b823-05dd64d61de4-metrics-tls\") pod \"dns-default-nhgp4\" (UID: \"e9d6b052-42ec-4661-b823-05dd64d61de4\") " pod="openshift-dns/dns-default-nhgp4" May 21 14:42:17.607673 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:17.607678 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cf5c512d-d3b8-4cf0-9b13-2e99eeac6432-cert\") pod \"ingress-canary-8kdcz\" (UID: \"cf5c512d-d3b8-4cf0-9b13-2e99eeac6432\") " pod="openshift-ingress-canary/ingress-canary-8kdcz" May 21 14:42:17.607923 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:42:17.607802 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 14:42:17.607923 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:42:17.607815 2573 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 14:42:17.607923 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:42:17.607872 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf5c512d-d3b8-4cf0-9b13-2e99eeac6432-cert podName:cf5c512d-d3b8-4cf0-9b13-2e99eeac6432 nodeName:}" failed. No retries permitted until 2026-05-21 14:42:33.607853157 +0000 UTC m=+66.346108673 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/cf5c512d-d3b8-4cf0-9b13-2e99eeac6432-cert") pod "ingress-canary-8kdcz" (UID: "cf5c512d-d3b8-4cf0-9b13-2e99eeac6432") : secret "canary-serving-cert" not found May 21 14:42:17.607923 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:42:17.607890 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9d6b052-42ec-4661-b823-05dd64d61de4-metrics-tls podName:e9d6b052-42ec-4661-b823-05dd64d61de4 nodeName:}" failed. No retries permitted until 2026-05-21 14:42:33.607879867 +0000 UTC m=+66.346135376 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e9d6b052-42ec-4661-b823-05dd64d61de4-metrics-tls") pod "dns-default-nhgp4" (UID: "e9d6b052-42ec-4661-b823-05dd64d61de4") : secret "dns-default-metrics-tls" not found May 21 14:42:28.948757 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:28.948725 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5t966" May 21 14:42:28.973693 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:28.973642 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-ttwzv" podStartSLOduration=26.994786551 podStartE2EDuration="30.973628619s" podCreationTimestamp="2026-05-21 14:41:58 +0000 UTC" firstStartedPulling="2026-05-21 14:42:12.762920173 +0000 UTC m=+45.501175681" lastFinishedPulling="2026-05-21 14:42:16.74176224 +0000 UTC m=+49.480017749" observedRunningTime="2026-05-21 14:42:17.011111984 +0000 UTC m=+49.749367516" watchObservedRunningTime="2026-05-21 14:42:28.973628619 +0000 UTC m=+61.711884150" May 21 14:42:33.514046 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:33.513982 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f95cadd8-4e74-4e10-b701-a471d17e2fea-registry-tls\") pod \"image-registry-67d64978d7-ttr7l\" (UID: \"f95cadd8-4e74-4e10-b701-a471d17e2fea\") " pod="openshift-image-registry/image-registry-67d64978d7-ttr7l" May 21 14:42:33.514498 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:33.514080 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/646e1e59-0917-4626-8e22-158fec29f33f-metrics-certs\") pod \"network-metrics-daemon-tft6b\" (UID: \"646e1e59-0917-4626-8e22-158fec29f33f\") " pod="openshift-multus/network-metrics-daemon-tft6b" May 21 14:42:33.514498 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:33.514155 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2gnsv\" (UniqueName: \"kubernetes.io/projected/2dc7761a-d68f-4f1f-ad3c-71fb26dad676-kube-api-access-2gnsv\") pod \"network-check-target-6fb9w\" (UID: \"2dc7761a-d68f-4f1f-ad3c-71fb26dad676\") " pod="openshift-network-diagnostics/network-check-target-6fb9w" May 21 14:42:33.514498 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:42:33.514157 2573 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 14:42:33.514498 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:42:33.514234 2573 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67d64978d7-ttr7l: secret "image-registry-tls" not found May 21 14:42:33.514498 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:42:33.514330 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f95cadd8-4e74-4e10-b701-a471d17e2fea-registry-tls podName:f95cadd8-4e74-4e10-b701-a471d17e2fea nodeName:}" failed. No retries permitted until 2026-05-21 14:43:05.514311236 +0000 UTC m=+98.252566760 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f95cadd8-4e74-4e10-b701-a471d17e2fea-registry-tls") pod "image-registry-67d64978d7-ttr7l" (UID: "f95cadd8-4e74-4e10-b701-a471d17e2fea") : secret "image-registry-tls" not found May 21 14:42:33.516654 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:33.516636 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 21 14:42:33.516718 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:33.516662 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 21 14:42:33.525073 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:42:33.525053 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 21 14:42:33.525129 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:42:33.525116 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/646e1e59-0917-4626-8e22-158fec29f33f-metrics-certs podName:646e1e59-0917-4626-8e22-158fec29f33f nodeName:}" failed. No retries permitted until 2026-05-21 14:43:37.525096848 +0000 UTC m=+130.263352363 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/646e1e59-0917-4626-8e22-158fec29f33f-metrics-certs") pod "network-metrics-daemon-tft6b" (UID: "646e1e59-0917-4626-8e22-158fec29f33f") : secret "metrics-daemon-secret" not found May 21 14:42:33.526708 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:33.526693 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 21 14:42:33.538366 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:33.538341 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gnsv\" (UniqueName: \"kubernetes.io/projected/2dc7761a-d68f-4f1f-ad3c-71fb26dad676-kube-api-access-2gnsv\") pod \"network-check-target-6fb9w\" (UID: \"2dc7761a-d68f-4f1f-ad3c-71fb26dad676\") " pod="openshift-network-diagnostics/network-check-target-6fb9w" May 21 14:42:33.615372 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:33.615331 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e9d6b052-42ec-4661-b823-05dd64d61de4-metrics-tls\") pod \"dns-default-nhgp4\" (UID: \"e9d6b052-42ec-4661-b823-05dd64d61de4\") " pod="openshift-dns/dns-default-nhgp4" May 21 14:42:33.615372 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:33.615385 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cf5c512d-d3b8-4cf0-9b13-2e99eeac6432-cert\") pod \"ingress-canary-8kdcz\" (UID: \"cf5c512d-d3b8-4cf0-9b13-2e99eeac6432\") " pod="openshift-ingress-canary/ingress-canary-8kdcz" May 21 14:42:33.615613 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:42:33.615486 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 14:42:33.615613 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:42:33.615549 2573 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 14:42:33.615613 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:42:33.615555 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9d6b052-42ec-4661-b823-05dd64d61de4-metrics-tls podName:e9d6b052-42ec-4661-b823-05dd64d61de4 nodeName:}" failed. No retries permitted until 2026-05-21 14:43:05.615540007 +0000 UTC m=+98.353795516 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e9d6b052-42ec-4661-b823-05dd64d61de4-metrics-tls") pod "dns-default-nhgp4" (UID: "e9d6b052-42ec-4661-b823-05dd64d61de4") : secret "dns-default-metrics-tls" not found May 21 14:42:33.615613 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:42:33.615604 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf5c512d-d3b8-4cf0-9b13-2e99eeac6432-cert podName:cf5c512d-d3b8-4cf0-9b13-2e99eeac6432 nodeName:}" failed. No retries permitted until 2026-05-21 14:43:05.615591767 +0000 UTC m=+98.353847280 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/cf5c512d-d3b8-4cf0-9b13-2e99eeac6432-cert") pod "ingress-canary-8kdcz" (UID: "cf5c512d-d3b8-4cf0-9b13-2e99eeac6432") : secret "canary-serving-cert" not found May 21 14:42:33.730966 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:33.730933 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-n8k7m\"" May 21 14:42:33.738720 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:33.738702 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6fb9w" May 21 14:42:33.854672 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:33.854638 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6fb9w"] May 21 14:42:33.858158 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:42:33.858128 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dc7761a_d68f_4f1f_ad3c_71fb26dad676.slice/crio-52d697f295289e085cf367040cdcdb5d28f9194723f7679f921d4c9e35b26273 WatchSource:0}: Error finding container 52d697f295289e085cf367040cdcdb5d28f9194723f7679f921d4c9e35b26273: Status 404 returned error can't find the container with id 52d697f295289e085cf367040cdcdb5d28f9194723f7679f921d4c9e35b26273 May 21 14:42:34.039838 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:34.039751 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6fb9w" event={"ID":"2dc7761a-d68f-4f1f-ad3c-71fb26dad676","Type":"ContainerStarted","Data":"52d697f295289e085cf367040cdcdb5d28f9194723f7679f921d4c9e35b26273"} May 21 14:42:37.048169 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:37.048136 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6fb9w" event={"ID":"2dc7761a-d68f-4f1f-ad3c-71fb26dad676","Type":"ContainerStarted","Data":"7292e3c48b49f25841de8c3ff7bb97d624030f28ff6a96ef86aa5daadb01b8f2"} May 21 14:42:37.048528 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:37.048288 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-6fb9w" May 21 14:42:37.062377 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:42:37.062331 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-6fb9w" podStartSLOduration=67.538645156 podStartE2EDuration="1m10.062315813s" podCreationTimestamp="2026-05-21 14:41:27 +0000 UTC" firstStartedPulling="2026-05-21 14:42:33.859919065 +0000 UTC m=+66.598174574" lastFinishedPulling="2026-05-21 14:42:36.383589717 +0000 UTC m=+69.121845231" observedRunningTime="2026-05-21 14:42:37.06191836 +0000 UTC m=+69.800173892" watchObservedRunningTime="2026-05-21 14:42:37.062315813 +0000 UTC m=+69.800571345" May 21 14:43:05.562977 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:43:05.562929 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f95cadd8-4e74-4e10-b701-a471d17e2fea-registry-tls\") pod \"image-registry-67d64978d7-ttr7l\" (UID: \"f95cadd8-4e74-4e10-b701-a471d17e2fea\") " pod="openshift-image-registry/image-registry-67d64978d7-ttr7l" May 21 14:43:05.563468 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:43:05.563095 2573 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 14:43:05.563468 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:43:05.563117 2573 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67d64978d7-ttr7l: secret "image-registry-tls" not found May 21 14:43:05.563468 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:43:05.563177 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f95cadd8-4e74-4e10-b701-a471d17e2fea-registry-tls podName:f95cadd8-4e74-4e10-b701-a471d17e2fea nodeName:}" failed. No retries permitted until 2026-05-21 14:44:09.563160256 +0000 UTC m=+162.301415770 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f95cadd8-4e74-4e10-b701-a471d17e2fea-registry-tls") pod "image-registry-67d64978d7-ttr7l" (UID: "f95cadd8-4e74-4e10-b701-a471d17e2fea") : secret "image-registry-tls" not found May 21 14:43:05.663952 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:43:05.663902 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e9d6b052-42ec-4661-b823-05dd64d61de4-metrics-tls\") pod \"dns-default-nhgp4\" (UID: \"e9d6b052-42ec-4661-b823-05dd64d61de4\") " pod="openshift-dns/dns-default-nhgp4" May 21 14:43:05.663952 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:43:05.663957 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cf5c512d-d3b8-4cf0-9b13-2e99eeac6432-cert\") pod \"ingress-canary-8kdcz\" (UID: \"cf5c512d-d3b8-4cf0-9b13-2e99eeac6432\") " pod="openshift-ingress-canary/ingress-canary-8kdcz" May 21 14:43:05.664163 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:43:05.664063 2573 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 14:43:05.664163 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:43:05.664099 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 14:43:05.664163 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:43:05.664127 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf5c512d-d3b8-4cf0-9b13-2e99eeac6432-cert podName:cf5c512d-d3b8-4cf0-9b13-2e99eeac6432 nodeName:}" failed. No retries permitted until 2026-05-21 14:44:09.66411261 +0000 UTC m=+162.402368119 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/cf5c512d-d3b8-4cf0-9b13-2e99eeac6432-cert") pod "ingress-canary-8kdcz" (UID: "cf5c512d-d3b8-4cf0-9b13-2e99eeac6432") : secret "canary-serving-cert" not found May 21 14:43:05.664289 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:43:05.664180 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9d6b052-42ec-4661-b823-05dd64d61de4-metrics-tls podName:e9d6b052-42ec-4661-b823-05dd64d61de4 nodeName:}" failed. No retries permitted until 2026-05-21 14:44:09.664159882 +0000 UTC m=+162.402415411 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e9d6b052-42ec-4661-b823-05dd64d61de4-metrics-tls") pod "dns-default-nhgp4" (UID: "e9d6b052-42ec-4661-b823-05dd64d61de4") : secret "dns-default-metrics-tls" not found May 21 14:43:08.052590 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:43:08.052556 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-6fb9w" May 21 14:43:31.723349 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:43:31.723317 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-k2p4j_591d522c-4c95-4b9c-852b-f84095cc2525/dns-node-resolver/0.log" May 21 14:43:32.522683 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:43:32.522653 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nfd4x_19eadc83-10b5-48f6-ad02-e8540668c1cc/node-ca/0.log" May 21 14:43:37.606871 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:43:37.606825 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/646e1e59-0917-4626-8e22-158fec29f33f-metrics-certs\") pod \"network-metrics-daemon-tft6b\" (UID: \"646e1e59-0917-4626-8e22-158fec29f33f\") " pod="openshift-multus/network-metrics-daemon-tft6b" May 21 14:43:37.607307 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:43:37.606976 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 21 14:43:37.607307 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:43:37.607064 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/646e1e59-0917-4626-8e22-158fec29f33f-metrics-certs podName:646e1e59-0917-4626-8e22-158fec29f33f nodeName:}" failed. No retries permitted until 2026-05-21 14:45:39.607046595 +0000 UTC m=+252.345302104 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/646e1e59-0917-4626-8e22-158fec29f33f-metrics-certs") pod "network-metrics-daemon-tft6b" (UID: "646e1e59-0917-4626-8e22-158fec29f33f") : secret "metrics-daemon-secret" not found May 21 14:44:00.283503 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:00.283464 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-24hvv"] May 21 14:44:00.286632 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:00.286606 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-24hvv" May 21 14:44:00.289849 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:00.289824 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 21 14:44:00.290010 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:00.289853 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 21 14:44:00.290010 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:00.289868 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 21 14:44:00.290010 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:00.289824 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 21 14:44:00.290010 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:00.289824 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-z8tpz\"" May 21 14:44:00.298094 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:00.298072 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-24hvv"] May 21 14:44:00.380068 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:00.380027 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/57a7acb8-a711-41c2-be8f-c046a2d124cb-data-volume\") pod \"insights-runtime-extractor-24hvv\" (UID: \"57a7acb8-a711-41c2-be8f-c046a2d124cb\") " pod="openshift-insights/insights-runtime-extractor-24hvv" May 21 14:44:00.380247 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:00.380079 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/57a7acb8-a711-41c2-be8f-c046a2d124cb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-24hvv\" (UID: \"57a7acb8-a711-41c2-be8f-c046a2d124cb\") " pod="openshift-insights/insights-runtime-extractor-24hvv" May 21 14:44:00.380247 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:00.380208 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/57a7acb8-a711-41c2-be8f-c046a2d124cb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-24hvv\" (UID: \"57a7acb8-a711-41c2-be8f-c046a2d124cb\") " pod="openshift-insights/insights-runtime-extractor-24hvv" May 21 14:44:00.380344 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:00.380261 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/57a7acb8-a711-41c2-be8f-c046a2d124cb-crio-socket\") pod \"insights-runtime-extractor-24hvv\" (UID: \"57a7acb8-a711-41c2-be8f-c046a2d124cb\") " pod="openshift-insights/insights-runtime-extractor-24hvv" May 21 14:44:00.380344 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:00.380287 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57z7k\" (UniqueName: \"kubernetes.io/projected/57a7acb8-a711-41c2-be8f-c046a2d124cb-kube-api-access-57z7k\") pod \"insights-runtime-extractor-24hvv\" (UID: \"57a7acb8-a711-41c2-be8f-c046a2d124cb\") " pod="openshift-insights/insights-runtime-extractor-24hvv" May 21 14:44:00.480796 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:00.480763 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-57z7k\" (UniqueName: \"kubernetes.io/projected/57a7acb8-a711-41c2-be8f-c046a2d124cb-kube-api-access-57z7k\") pod \"insights-runtime-extractor-24hvv\" (UID: \"57a7acb8-a711-41c2-be8f-c046a2d124cb\") " pod="openshift-insights/insights-runtime-extractor-24hvv" May 21 14:44:00.480961 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:00.480809 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/57a7acb8-a711-41c2-be8f-c046a2d124cb-data-volume\") pod \"insights-runtime-extractor-24hvv\" (UID: \"57a7acb8-a711-41c2-be8f-c046a2d124cb\") " pod="openshift-insights/insights-runtime-extractor-24hvv" May 21 14:44:00.480961 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:00.480842 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/57a7acb8-a711-41c2-be8f-c046a2d124cb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-24hvv\" (UID: \"57a7acb8-a711-41c2-be8f-c046a2d124cb\") " pod="openshift-insights/insights-runtime-extractor-24hvv" May 21 14:44:00.480961 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:00.480911 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/57a7acb8-a711-41c2-be8f-c046a2d124cb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-24hvv\" (UID: \"57a7acb8-a711-41c2-be8f-c046a2d124cb\") " pod="openshift-insights/insights-runtime-extractor-24hvv" May 21 14:44:00.480961 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:00.480956 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/57a7acb8-a711-41c2-be8f-c046a2d124cb-crio-socket\") pod \"insights-runtime-extractor-24hvv\" (UID: \"57a7acb8-a711-41c2-be8f-c046a2d124cb\") " pod="openshift-insights/insights-runtime-extractor-24hvv" May 21 14:44:00.481165 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:00.481046 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/57a7acb8-a711-41c2-be8f-c046a2d124cb-crio-socket\") pod \"insights-runtime-extractor-24hvv\" (UID: \"57a7acb8-a711-41c2-be8f-c046a2d124cb\") " pod="openshift-insights/insights-runtime-extractor-24hvv" May 21 14:44:00.481283 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:00.481263 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/57a7acb8-a711-41c2-be8f-c046a2d124cb-data-volume\") pod \"insights-runtime-extractor-24hvv\" (UID: \"57a7acb8-a711-41c2-be8f-c046a2d124cb\") " pod="openshift-insights/insights-runtime-extractor-24hvv" May 21 14:44:00.481549 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:00.481510 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/57a7acb8-a711-41c2-be8f-c046a2d124cb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-24hvv\" (UID: \"57a7acb8-a711-41c2-be8f-c046a2d124cb\") " pod="openshift-insights/insights-runtime-extractor-24hvv" May 21 14:44:00.483725 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:00.483694 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/57a7acb8-a711-41c2-be8f-c046a2d124cb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-24hvv\" (UID: \"57a7acb8-a711-41c2-be8f-c046a2d124cb\") " pod="openshift-insights/insights-runtime-extractor-24hvv" May 21 14:44:00.493215 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:00.493192 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-57z7k\" (UniqueName: \"kubernetes.io/projected/57a7acb8-a711-41c2-be8f-c046a2d124cb-kube-api-access-57z7k\") pod \"insights-runtime-extractor-24hvv\" (UID: \"57a7acb8-a711-41c2-be8f-c046a2d124cb\") " pod="openshift-insights/insights-runtime-extractor-24hvv" May 21 14:44:00.595465 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:00.595380 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-24hvv" May 21 14:44:00.737192 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:00.737157 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-24hvv"] May 21 14:44:00.740752 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:44:00.740726 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57a7acb8_a711_41c2_be8f_c046a2d124cb.slice/crio-53426870b875f3eb5362c6cd2e0da8e43839deb4db58b1030bc12fbd1c1f9ac5 WatchSource:0}: Error finding container 53426870b875f3eb5362c6cd2e0da8e43839deb4db58b1030bc12fbd1c1f9ac5: Status 404 returned error can't find the container with id 53426870b875f3eb5362c6cd2e0da8e43839deb4db58b1030bc12fbd1c1f9ac5 May 21 14:44:01.245429 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:01.245382 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-24hvv" event={"ID":"57a7acb8-a711-41c2-be8f-c046a2d124cb","Type":"ContainerStarted","Data":"7b52b8dfe47c137efd3a850fc588331a2a980c5b1c0bc7cbb2f20295ffc07916"} May 21 14:44:01.245429 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:01.245432 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-24hvv" event={"ID":"57a7acb8-a711-41c2-be8f-c046a2d124cb","Type":"ContainerStarted","Data":"53426870b875f3eb5362c6cd2e0da8e43839deb4db58b1030bc12fbd1c1f9ac5"} May 21 14:44:02.250141 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:02.250090 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-24hvv" event={"ID":"57a7acb8-a711-41c2-be8f-c046a2d124cb","Type":"ContainerStarted","Data":"3bee773d376ff8ac6f8d0276bb20e2f8745401736760db75ed21fdec6c0c4b05"} May 21 14:44:03.254514 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:03.254472 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-24hvv" event={"ID":"57a7acb8-a711-41c2-be8f-c046a2d124cb","Type":"ContainerStarted","Data":"69d94a5447dd7c002280f10449d7408a64e3f43ef2a90b3dcd9d940b47e09180"} May 21 14:44:03.277643 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:03.277591 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-24hvv" podStartSLOduration=0.995281805 podStartE2EDuration="3.277573332s" podCreationTimestamp="2026-05-21 14:44:00 +0000 UTC" firstStartedPulling="2026-05-21 14:44:00.79291214 +0000 UTC m=+153.531167650" lastFinishedPulling="2026-05-21 14:44:03.075203665 +0000 UTC m=+155.813459177" observedRunningTime="2026-05-21 14:44:03.276423682 +0000 UTC m=+156.014679214" watchObservedRunningTime="2026-05-21 14:44:03.277573332 +0000 UTC m=+156.015828863" May 21 14:44:04.694339 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:44:04.694283 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-67d64978d7-ttr7l" podUID="f95cadd8-4e74-4e10-b701-a471d17e2fea" May 21 14:44:04.703471 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:44:04.703427 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-nhgp4" podUID="e9d6b052-42ec-4661-b823-05dd64d61de4" May 21 14:44:04.729777 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:44:04.729739 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-8kdcz" podUID="cf5c512d-d3b8-4cf0-9b13-2e99eeac6432" May 21 14:44:05.259335 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:05.259299 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67d64978d7-ttr7l" May 21 14:44:05.259541 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:05.259300 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nhgp4" May 21 14:44:05.843643 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:44:05.843584 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-tft6b" podUID="646e1e59-0917-4626-8e22-158fec29f33f" May 21 14:44:07.899493 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:07.899460 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-7lffp"] May 21 14:44:07.902773 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:07.902749 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7lffp" May 21 14:44:07.904927 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:07.904905 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 21 14:44:07.905061 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:07.904963 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-nwh7b\"" May 21 14:44:07.905061 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:07.905007 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 21 14:44:07.905774 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:07.905752 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 21 14:44:07.905774 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:07.905768 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 21 14:44:07.905943 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:07.905758 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 21 14:44:07.905943 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:07.905795 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 21 14:44:08.047668 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:08.047635 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a932471e-6ff7-4ce5-8085-f42b6d02acb9-root\") pod \"node-exporter-7lffp\" (UID: \"a932471e-6ff7-4ce5-8085-f42b6d02acb9\") " pod="openshift-monitoring/node-exporter-7lffp" May 21 14:44:08.047852 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:08.047674 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a932471e-6ff7-4ce5-8085-f42b6d02acb9-node-exporter-textfile\") pod \"node-exporter-7lffp\" (UID: \"a932471e-6ff7-4ce5-8085-f42b6d02acb9\") " pod="openshift-monitoring/node-exporter-7lffp" May 21 14:44:08.047852 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:08.047704 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a932471e-6ff7-4ce5-8085-f42b6d02acb9-node-exporter-accelerators-collector-config\") pod \"node-exporter-7lffp\" (UID: \"a932471e-6ff7-4ce5-8085-f42b6d02acb9\") " pod="openshift-monitoring/node-exporter-7lffp" May 21 14:44:08.047852 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:08.047791 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a932471e-6ff7-4ce5-8085-f42b6d02acb9-node-exporter-tls\") pod \"node-exporter-7lffp\" (UID: \"a932471e-6ff7-4ce5-8085-f42b6d02acb9\") " pod="openshift-monitoring/node-exporter-7lffp" May 21 14:44:08.047852 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:08.047829 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a932471e-6ff7-4ce5-8085-f42b6d02acb9-node-exporter-wtmp\") pod \"node-exporter-7lffp\" (UID: \"a932471e-6ff7-4ce5-8085-f42b6d02acb9\") " pod="openshift-monitoring/node-exporter-7lffp" May 21 14:44:08.048020 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:08.047883 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a932471e-6ff7-4ce5-8085-f42b6d02acb9-sys\") pod \"node-exporter-7lffp\" (UID: \"a932471e-6ff7-4ce5-8085-f42b6d02acb9\") " pod="openshift-monitoring/node-exporter-7lffp" May 21 14:44:08.048020 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:08.047899 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a932471e-6ff7-4ce5-8085-f42b6d02acb9-metrics-client-ca\") pod \"node-exporter-7lffp\" (UID: \"a932471e-6ff7-4ce5-8085-f42b6d02acb9\") " pod="openshift-monitoring/node-exporter-7lffp" May 21 14:44:08.048020 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:08.047915 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rw5wz\" (UniqueName: \"kubernetes.io/projected/a932471e-6ff7-4ce5-8085-f42b6d02acb9-kube-api-access-rw5wz\") pod \"node-exporter-7lffp\" (UID: \"a932471e-6ff7-4ce5-8085-f42b6d02acb9\") " pod="openshift-monitoring/node-exporter-7lffp" May 21 14:44:08.048020 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:08.047963 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a932471e-6ff7-4ce5-8085-f42b6d02acb9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7lffp\" (UID: \"a932471e-6ff7-4ce5-8085-f42b6d02acb9\") " pod="openshift-monitoring/node-exporter-7lffp" May 21 14:44:08.148749 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:08.148702 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a932471e-6ff7-4ce5-8085-f42b6d02acb9-root\") pod \"node-exporter-7lffp\" (UID: \"a932471e-6ff7-4ce5-8085-f42b6d02acb9\") " pod="openshift-monitoring/node-exporter-7lffp" May 21 14:44:08.148749 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:08.148748 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a932471e-6ff7-4ce5-8085-f42b6d02acb9-node-exporter-textfile\") pod \"node-exporter-7lffp\" (UID: \"a932471e-6ff7-4ce5-8085-f42b6d02acb9\") " pod="openshift-monitoring/node-exporter-7lffp" May 21 14:44:08.148986 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:08.148769 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a932471e-6ff7-4ce5-8085-f42b6d02acb9-node-exporter-accelerators-collector-config\") pod \"node-exporter-7lffp\" (UID: \"a932471e-6ff7-4ce5-8085-f42b6d02acb9\") " pod="openshift-monitoring/node-exporter-7lffp" May 21 14:44:08.148986 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:08.148810 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a932471e-6ff7-4ce5-8085-f42b6d02acb9-node-exporter-tls\") pod \"node-exporter-7lffp\" (UID: \"a932471e-6ff7-4ce5-8085-f42b6d02acb9\") " pod="openshift-monitoring/node-exporter-7lffp" May 21 14:44:08.148986 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:08.148815 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a932471e-6ff7-4ce5-8085-f42b6d02acb9-root\") pod \"node-exporter-7lffp\" (UID: \"a932471e-6ff7-4ce5-8085-f42b6d02acb9\") " pod="openshift-monitoring/node-exporter-7lffp" May 21 14:44:08.148986 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:08.148834 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a932471e-6ff7-4ce5-8085-f42b6d02acb9-node-exporter-wtmp\") pod \"node-exporter-7lffp\" (UID: \"a932471e-6ff7-4ce5-8085-f42b6d02acb9\") " pod="openshift-monitoring/node-exporter-7lffp" May 21 14:44:08.148986 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:08.148886 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a932471e-6ff7-4ce5-8085-f42b6d02acb9-sys\") pod \"node-exporter-7lffp\" (UID: \"a932471e-6ff7-4ce5-8085-f42b6d02acb9\") " pod="openshift-monitoring/node-exporter-7lffp" May 21 14:44:08.148986 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:08.148910 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a932471e-6ff7-4ce5-8085-f42b6d02acb9-metrics-client-ca\") pod \"node-exporter-7lffp\" (UID: \"a932471e-6ff7-4ce5-8085-f42b6d02acb9\") " pod="openshift-monitoring/node-exporter-7lffp" May 21 14:44:08.148986 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:08.148934 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rw5wz\" (UniqueName: \"kubernetes.io/projected/a932471e-6ff7-4ce5-8085-f42b6d02acb9-kube-api-access-rw5wz\") pod \"node-exporter-7lffp\" (UID: \"a932471e-6ff7-4ce5-8085-f42b6d02acb9\") " pod="openshift-monitoring/node-exporter-7lffp" May 21 14:44:08.148986 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:08.148966 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a932471e-6ff7-4ce5-8085-f42b6d02acb9-sys\") pod \"node-exporter-7lffp\" (UID: \"a932471e-6ff7-4ce5-8085-f42b6d02acb9\") " pod="openshift-monitoring/node-exporter-7lffp" May 21 14:44:08.149405 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:08.149037 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a932471e-6ff7-4ce5-8085-f42b6d02acb9-node-exporter-wtmp\") pod \"node-exporter-7lffp\" (UID: \"a932471e-6ff7-4ce5-8085-f42b6d02acb9\") " pod="openshift-monitoring/node-exporter-7lffp" May 21 14:44:08.149405 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:08.148969 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a932471e-6ff7-4ce5-8085-f42b6d02acb9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7lffp\" (UID: \"a932471e-6ff7-4ce5-8085-f42b6d02acb9\") " pod="openshift-monitoring/node-exporter-7lffp" May 21 14:44:08.149405 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:08.149170 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a932471e-6ff7-4ce5-8085-f42b6d02acb9-node-exporter-textfile\") pod \"node-exporter-7lffp\" (UID: \"a932471e-6ff7-4ce5-8085-f42b6d02acb9\") " pod="openshift-monitoring/node-exporter-7lffp" May 21 14:44:08.149542 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:08.149501 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a932471e-6ff7-4ce5-8085-f42b6d02acb9-metrics-client-ca\") pod \"node-exporter-7lffp\" (UID: \"a932471e-6ff7-4ce5-8085-f42b6d02acb9\") " pod="openshift-monitoring/node-exporter-7lffp" May 21 14:44:08.149584 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:08.149540 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a932471e-6ff7-4ce5-8085-f42b6d02acb9-node-exporter-accelerators-collector-config\") pod \"node-exporter-7lffp\" (UID: \"a932471e-6ff7-4ce5-8085-f42b6d02acb9\") " pod="openshift-monitoring/node-exporter-7lffp" May 21 14:44:08.151393 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:08.151370 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a932471e-6ff7-4ce5-8085-f42b6d02acb9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7lffp\" (UID: \"a932471e-6ff7-4ce5-8085-f42b6d02acb9\") " pod="openshift-monitoring/node-exporter-7lffp" May 21 14:44:08.151464 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:08.151374 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a932471e-6ff7-4ce5-8085-f42b6d02acb9-node-exporter-tls\") pod \"node-exporter-7lffp\" (UID: \"a932471e-6ff7-4ce5-8085-f42b6d02acb9\") " pod="openshift-monitoring/node-exporter-7lffp" May 21 14:44:08.156516 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:08.156491 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rw5wz\" (UniqueName: \"kubernetes.io/projected/a932471e-6ff7-4ce5-8085-f42b6d02acb9-kube-api-access-rw5wz\") pod \"node-exporter-7lffp\" (UID: \"a932471e-6ff7-4ce5-8085-f42b6d02acb9\") " pod="openshift-monitoring/node-exporter-7lffp" May 21 14:44:08.211744 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:08.211700 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7lffp" May 21 14:44:08.220006 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:44:08.219955 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda932471e_6ff7_4ce5_8085_f42b6d02acb9.slice/crio-473c7cc16e0aadf1e008f405d85171acd658087930eb004fb2bc192cb419a9e6 WatchSource:0}: Error finding container 473c7cc16e0aadf1e008f405d85171acd658087930eb004fb2bc192cb419a9e6: Status 404 returned error can't find the container with id 473c7cc16e0aadf1e008f405d85171acd658087930eb004fb2bc192cb419a9e6 May 21 14:44:08.267698 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:08.267655 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7lffp" event={"ID":"a932471e-6ff7-4ce5-8085-f42b6d02acb9","Type":"ContainerStarted","Data":"473c7cc16e0aadf1e008f405d85171acd658087930eb004fb2bc192cb419a9e6"} May 21 14:44:09.663281 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:09.663243 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f95cadd8-4e74-4e10-b701-a471d17e2fea-registry-tls\") pod \"image-registry-67d64978d7-ttr7l\" (UID: \"f95cadd8-4e74-4e10-b701-a471d17e2fea\") " pod="openshift-image-registry/image-registry-67d64978d7-ttr7l" May 21 14:44:09.665670 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:09.665644 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f95cadd8-4e74-4e10-b701-a471d17e2fea-registry-tls\") pod \"image-registry-67d64978d7-ttr7l\" (UID: \"f95cadd8-4e74-4e10-b701-a471d17e2fea\") " pod="openshift-image-registry/image-registry-67d64978d7-ttr7l" May 21 14:44:09.762415 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:09.762380 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-nhhn2\"" May 21 14:44:09.763579 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:09.763560 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cf5c512d-d3b8-4cf0-9b13-2e99eeac6432-cert\") pod \"ingress-canary-8kdcz\" (UID: \"cf5c512d-d3b8-4cf0-9b13-2e99eeac6432\") " pod="openshift-ingress-canary/ingress-canary-8kdcz" May 21 14:44:09.763659 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:09.763610 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e9d6b052-42ec-4661-b823-05dd64d61de4-metrics-tls\") pod \"dns-default-nhgp4\" (UID: \"e9d6b052-42ec-4661-b823-05dd64d61de4\") " pod="openshift-dns/dns-default-nhgp4" May 21 14:44:09.765827 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:09.765804 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e9d6b052-42ec-4661-b823-05dd64d61de4-metrics-tls\") pod \"dns-default-nhgp4\" (UID: \"e9d6b052-42ec-4661-b823-05dd64d61de4\") " pod="openshift-dns/dns-default-nhgp4" May 21 14:44:09.766085 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:09.766063 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cf5c512d-d3b8-4cf0-9b13-2e99eeac6432-cert\") pod \"ingress-canary-8kdcz\" (UID: \"cf5c512d-d3b8-4cf0-9b13-2e99eeac6432\") " pod="openshift-ingress-canary/ingress-canary-8kdcz" May 21 14:44:09.770819 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:09.770782 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67d64978d7-ttr7l" May 21 14:44:09.894146 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:09.894117 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-67d64978d7-ttr7l"] May 21 14:44:09.896854 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:44:09.896829 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf95cadd8_4e74_4e10_b701_a471d17e2fea.slice/crio-30642be0d6a9bb8d65bbfa2819dab624de28ec90d467149c120454b4353c50c4 WatchSource:0}: Error finding container 30642be0d6a9bb8d65bbfa2819dab624de28ec90d467149c120454b4353c50c4: Status 404 returned error can't find the container with id 30642be0d6a9bb8d65bbfa2819dab624de28ec90d467149c120454b4353c50c4 May 21 14:44:10.062079 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:10.062046 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qp2mh\"" May 21 14:44:10.070480 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:10.070452 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nhgp4" May 21 14:44:10.191196 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:10.191119 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nhgp4"] May 21 14:44:10.195151 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:44:10.195124 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9d6b052_42ec_4661_b823_05dd64d61de4.slice/crio-81cdf3a6bde7896358f301c1a0e5a75e2a62d9ecce473a2b5d7dd02435eada67 WatchSource:0}: Error finding container 81cdf3a6bde7896358f301c1a0e5a75e2a62d9ecce473a2b5d7dd02435eada67: Status 404 returned error can't find the container with id 81cdf3a6bde7896358f301c1a0e5a75e2a62d9ecce473a2b5d7dd02435eada67 May 21 14:44:10.273489 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:10.273450 2573 generic.go:358] "Generic (PLEG): container finished" podID="a932471e-6ff7-4ce5-8085-f42b6d02acb9" containerID="df92fd55d1dddc81feaecda3223c867df90141af19bcf5e60b7afa0f8d908a04" exitCode=0 May 21 14:44:10.273654 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:10.273527 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7lffp" event={"ID":"a932471e-6ff7-4ce5-8085-f42b6d02acb9","Type":"ContainerDied","Data":"df92fd55d1dddc81feaecda3223c867df90141af19bcf5e60b7afa0f8d908a04"} May 21 14:44:10.274682 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:10.274652 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nhgp4" event={"ID":"e9d6b052-42ec-4661-b823-05dd64d61de4","Type":"ContainerStarted","Data":"81cdf3a6bde7896358f301c1a0e5a75e2a62d9ecce473a2b5d7dd02435eada67"} May 21 14:44:10.276052 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:10.276023 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67d64978d7-ttr7l" event={"ID":"f95cadd8-4e74-4e10-b701-a471d17e2fea","Type":"ContainerStarted","Data":"43717c53d66c6901074eb7d3172fdd7746a6deabe9880ff0e0847943af0f4d3f"} May 21 14:44:10.276259 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:10.276061 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67d64978d7-ttr7l" event={"ID":"f95cadd8-4e74-4e10-b701-a471d17e2fea","Type":"ContainerStarted","Data":"30642be0d6a9bb8d65bbfa2819dab624de28ec90d467149c120454b4353c50c4"} May 21 14:44:10.276259 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:10.276179 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-67d64978d7-ttr7l" May 21 14:44:10.305574 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:10.305524 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-67d64978d7-ttr7l" podStartSLOduration=162.305509717 podStartE2EDuration="2m42.305509717s" podCreationTimestamp="2026-05-21 14:41:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 14:44:10.304565632 +0000 UTC m=+163.042821194" watchObservedRunningTime="2026-05-21 14:44:10.305509717 +0000 UTC m=+163.043765248" May 21 14:44:11.281544 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:11.281504 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7lffp" event={"ID":"a932471e-6ff7-4ce5-8085-f42b6d02acb9","Type":"ContainerStarted","Data":"3c4508fb0eb4022030e967e4fac7f1aca0a7412c8220e7d56468c29f5266c527"} May 21 14:44:11.282028 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:11.281552 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7lffp" event={"ID":"a932471e-6ff7-4ce5-8085-f42b6d02acb9","Type":"ContainerStarted","Data":"a9ee2e4a2dd99bf4d929dc370e327675ad3b8a3f9081636785a8e6154b3e42d2"} May 21 14:44:11.300915 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:11.300852 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-7lffp" podStartSLOduration=3.311621046 podStartE2EDuration="4.300835223s" podCreationTimestamp="2026-05-21 14:44:07 +0000 UTC" firstStartedPulling="2026-05-21 14:44:08.221929953 +0000 UTC m=+160.960185461" lastFinishedPulling="2026-05-21 14:44:09.211144129 +0000 UTC m=+161.949399638" observedRunningTime="2026-05-21 14:44:11.29906836 +0000 UTC m=+164.037323891" watchObservedRunningTime="2026-05-21 14:44:11.300835223 +0000 UTC m=+164.039090753" May 21 14:44:12.285545 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:12.285488 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nhgp4" event={"ID":"e9d6b052-42ec-4661-b823-05dd64d61de4","Type":"ContainerStarted","Data":"e8af18b28b36234cfe1471a2c8c3bbc919aa60bfdd918f08368189a70260da34"} May 21 14:44:12.285545 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:12.285545 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nhgp4" event={"ID":"e9d6b052-42ec-4661-b823-05dd64d61de4","Type":"ContainerStarted","Data":"a0082eafa792ed2d867024e03ed8dd00b0e4040751d6ea05e1f64dce67b57e3e"} May 21 14:44:12.303646 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:12.303591 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-nhgp4" podStartSLOduration=129.722750026 podStartE2EDuration="2m11.303577951s" podCreationTimestamp="2026-05-21 14:42:01 +0000 UTC" firstStartedPulling="2026-05-21 14:44:10.197093562 +0000 UTC m=+162.935349070" lastFinishedPulling="2026-05-21 14:44:11.777921484 +0000 UTC m=+164.516176995" observedRunningTime="2026-05-21 14:44:12.3021116 +0000 UTC m=+165.040367128" watchObservedRunningTime="2026-05-21 14:44:12.303577951 +0000 UTC m=+165.041833483" May 21 14:44:12.971760 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:12.971709 2573 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b74954856-ff8np" podUID="4577417b-aa71-48b7-ac09-24cfc930e297" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.7:8000/readyz\": dial tcp 10.132.0.7:8000: connect: connection refused" May 21 14:44:13.289543 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:13.289511 2573 generic.go:358] "Generic (PLEG): container finished" podID="dcea2ff5-a4b1-4a44-89d3-3fbf7ec4e7ee" containerID="fa3ee55ae8d514a32adcf70d11d3bfec399dd9ec979dbbede4e5e6cb1de4393d" exitCode=255 May 21 14:44:13.289947 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:13.289587 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dc49c9966-6xkjm" event={"ID":"dcea2ff5-a4b1-4a44-89d3-3fbf7ec4e7ee","Type":"ContainerDied","Data":"fa3ee55ae8d514a32adcf70d11d3bfec399dd9ec979dbbede4e5e6cb1de4393d"} May 21 14:44:13.289947 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:13.289925 2573 scope.go:117] "RemoveContainer" containerID="fa3ee55ae8d514a32adcf70d11d3bfec399dd9ec979dbbede4e5e6cb1de4393d" May 21 14:44:13.290874 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:13.290854 2573 generic.go:358] "Generic (PLEG): container finished" podID="4577417b-aa71-48b7-ac09-24cfc930e297" containerID="ce47f914fb516c7e85cddfcb4481af048dcf3276a6be572959077c732b1efd12" exitCode=1 May 21 14:44:13.290954 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:13.290918 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b74954856-ff8np" event={"ID":"4577417b-aa71-48b7-ac09-24cfc930e297","Type":"ContainerDied","Data":"ce47f914fb516c7e85cddfcb4481af048dcf3276a6be572959077c732b1efd12"} May 21 14:44:13.291121 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:13.291104 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-nhgp4" May 21 14:44:13.291309 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:13.291295 2573 scope.go:117] "RemoveContainer" containerID="ce47f914fb516c7e85cddfcb4481af048dcf3276a6be572959077c732b1efd12" May 21 14:44:14.295449 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:14.295416 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dc49c9966-6xkjm" event={"ID":"dcea2ff5-a4b1-4a44-89d3-3fbf7ec4e7ee","Type":"ContainerStarted","Data":"57ea5cc3525469a0cc171e4d5c8fadc172230a05a328e4d5d0b0741f4e136a96"} May 21 14:44:14.296869 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:14.296843 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b74954856-ff8np" event={"ID":"4577417b-aa71-48b7-ac09-24cfc930e297","Type":"ContainerStarted","Data":"2e7f11a6bc4a70082abbcae1562b46da48c4046baa64bf3d93efe0409f209836"} May 21 14:44:14.297165 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:14.297147 2573 status_manager.go:355] "Container readiness changed for unknown container" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b74954856-ff8np" containerID="cri-o://ce47f914fb516c7e85cddfcb4481af048dcf3276a6be572959077c732b1efd12" May 21 14:44:14.297231 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:14.297169 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b74954856-ff8np" May 21 14:44:15.299990 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:15.299907 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b74954856-ff8np" May 21 14:44:15.300590 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:15.300571 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b74954856-ff8np" May 21 14:44:16.812669 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:16.812633 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tft6b" May 21 14:44:17.814012 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:17.813961 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8kdcz" May 21 14:44:17.816578 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:17.816554 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-t9nbd\"" May 21 14:44:17.825272 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:17.825256 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8kdcz" May 21 14:44:17.946145 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:17.945973 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8kdcz"] May 21 14:44:17.948546 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:44:17.948519 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf5c512d_d3b8_4cf0_9b13_2e99eeac6432.slice/crio-fb6d7ddd733a2582658466a03632ebcd8b0780631f4285140429fe65befa42b8 WatchSource:0}: Error finding container fb6d7ddd733a2582658466a03632ebcd8b0780631f4285140429fe65befa42b8: Status 404 returned error can't find the container with id fb6d7ddd733a2582658466a03632ebcd8b0780631f4285140429fe65befa42b8 May 21 14:44:18.308421 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:18.308390 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8kdcz" event={"ID":"cf5c512d-d3b8-4cf0-9b13-2e99eeac6432","Type":"ContainerStarted","Data":"fb6d7ddd733a2582658466a03632ebcd8b0780631f4285140429fe65befa42b8"} May 21 14:44:20.316459 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:20.316422 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8kdcz" event={"ID":"cf5c512d-d3b8-4cf0-9b13-2e99eeac6432","Type":"ContainerStarted","Data":"957b6fec7cc41b7b46d7408eeb287c35748a7547bed22a0c4ae92574e969aeca"} May 21 14:44:20.331082 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:20.331021 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-8kdcz" podStartSLOduration=137.541377723 podStartE2EDuration="2m19.330978816s" podCreationTimestamp="2026-05-21 14:42:01 +0000 UTC" firstStartedPulling="2026-05-21 14:44:17.950432923 +0000 UTC m=+170.688688432" lastFinishedPulling="2026-05-21 14:44:19.740034011 +0000 UTC m=+172.478289525" observedRunningTime="2026-05-21 14:44:20.33083371 +0000 UTC m=+173.069089241" watchObservedRunningTime="2026-05-21 14:44:20.330978816 +0000 UTC m=+173.069234348" May 21 14:44:23.299633 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:23.299598 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-nhgp4" May 21 14:44:29.775392 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:29.775357 2573 patch_prober.go:28] interesting pod/image-registry-67d64978d7-ttr7l container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 21 14:44:29.775778 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:29.775408 2573 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-67d64978d7-ttr7l" podUID="f95cadd8-4e74-4e10-b701-a471d17e2fea" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 21 14:44:31.286008 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:31.285961 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-67d64978d7-ttr7l" May 21 14:44:32.341322 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:32.341285 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-67d64978d7-ttr7l"] May 21 14:44:42.088917 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:42.088890 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nhgp4_e9d6b052-42ec-4661-b823-05dd64d61de4/dns/0.log" May 21 14:44:42.289083 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:42.289051 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nhgp4_e9d6b052-42ec-4661-b823-05dd64d61de4/kube-rbac-proxy/0.log" May 21 14:44:42.687448 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:42.687417 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-k2p4j_591d522c-4c95-4b9c-852b-f84095cc2525/dns-node-resolver/0.log" May 21 14:44:43.289081 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:43.289049 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8kdcz_cf5c512d-d3b8-4cf0-9b13-2e99eeac6432/serve-healthcheck-canary/0.log" May 21 14:44:57.360511 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:57.360456 2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-67d64978d7-ttr7l" podUID="f95cadd8-4e74-4e10-b701-a471d17e2fea" containerName="registry" containerID="cri-o://43717c53d66c6901074eb7d3172fdd7746a6deabe9880ff0e0847943af0f4d3f" gracePeriod=30 May 21 14:44:57.602181 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:57.602153 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67d64978d7-ttr7l" May 21 14:44:57.727321 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:57.727278 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f95cadd8-4e74-4e10-b701-a471d17e2fea-ca-trust-extracted\") pod \"f95cadd8-4e74-4e10-b701-a471d17e2fea\" (UID: \"f95cadd8-4e74-4e10-b701-a471d17e2fea\") " May 21 14:44:57.727321 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:57.727322 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f95cadd8-4e74-4e10-b701-a471d17e2fea-trusted-ca\") pod \"f95cadd8-4e74-4e10-b701-a471d17e2fea\" (UID: \"f95cadd8-4e74-4e10-b701-a471d17e2fea\") " May 21 14:44:57.727546 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:57.727364 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f95cadd8-4e74-4e10-b701-a471d17e2fea-image-registry-private-configuration\") pod \"f95cadd8-4e74-4e10-b701-a471d17e2fea\" (UID: \"f95cadd8-4e74-4e10-b701-a471d17e2fea\") " May 21 14:44:57.727546 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:57.727391 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f95cadd8-4e74-4e10-b701-a471d17e2fea-registry-certificates\") pod \"f95cadd8-4e74-4e10-b701-a471d17e2fea\" (UID: \"f95cadd8-4e74-4e10-b701-a471d17e2fea\") " May 21 14:44:57.727546 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:57.727431 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-krsh8\" (UniqueName: \"kubernetes.io/projected/f95cadd8-4e74-4e10-b701-a471d17e2fea-kube-api-access-krsh8\") pod \"f95cadd8-4e74-4e10-b701-a471d17e2fea\" (UID: \"f95cadd8-4e74-4e10-b701-a471d17e2fea\") " May 21 14:44:57.727546 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:57.727526 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f95cadd8-4e74-4e10-b701-a471d17e2fea-registry-tls\") pod \"f95cadd8-4e74-4e10-b701-a471d17e2fea\" (UID: \"f95cadd8-4e74-4e10-b701-a471d17e2fea\") " May 21 14:44:57.727737 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:57.727578 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f95cadd8-4e74-4e10-b701-a471d17e2fea-installation-pull-secrets\") pod \"f95cadd8-4e74-4e10-b701-a471d17e2fea\" (UID: \"f95cadd8-4e74-4e10-b701-a471d17e2fea\") " May 21 14:44:57.727737 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:57.727625 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f95cadd8-4e74-4e10-b701-a471d17e2fea-bound-sa-token\") pod \"f95cadd8-4e74-4e10-b701-a471d17e2fea\" (UID: \"f95cadd8-4e74-4e10-b701-a471d17e2fea\") " May 21 14:44:57.727883 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:57.727859 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f95cadd8-4e74-4e10-b701-a471d17e2fea-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "f95cadd8-4e74-4e10-b701-a471d17e2fea" (UID: "f95cadd8-4e74-4e10-b701-a471d17e2fea"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 14:44:57.727960 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:57.727879 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f95cadd8-4e74-4e10-b701-a471d17e2fea-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "f95cadd8-4e74-4e10-b701-a471d17e2fea" (UID: "f95cadd8-4e74-4e10-b701-a471d17e2fea"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 14:44:57.730175 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:57.730139 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f95cadd8-4e74-4e10-b701-a471d17e2fea-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "f95cadd8-4e74-4e10-b701-a471d17e2fea" (UID: "f95cadd8-4e74-4e10-b701-a471d17e2fea"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 14:44:57.730328 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:57.730176 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f95cadd8-4e74-4e10-b701-a471d17e2fea-kube-api-access-krsh8" (OuterVolumeSpecName: "kube-api-access-krsh8") pod "f95cadd8-4e74-4e10-b701-a471d17e2fea" (UID: "f95cadd8-4e74-4e10-b701-a471d17e2fea"). InnerVolumeSpecName "kube-api-access-krsh8". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 14:44:57.730423 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:57.730395 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f95cadd8-4e74-4e10-b701-a471d17e2fea-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "f95cadd8-4e74-4e10-b701-a471d17e2fea" (UID: "f95cadd8-4e74-4e10-b701-a471d17e2fea"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 14:44:57.730498 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:57.730422 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f95cadd8-4e74-4e10-b701-a471d17e2fea-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "f95cadd8-4e74-4e10-b701-a471d17e2fea" (UID: "f95cadd8-4e74-4e10-b701-a471d17e2fea"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 14:44:57.730498 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:57.730463 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f95cadd8-4e74-4e10-b701-a471d17e2fea-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "f95cadd8-4e74-4e10-b701-a471d17e2fea" (UID: "f95cadd8-4e74-4e10-b701-a471d17e2fea"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 14:44:57.737205 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:57.737180 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f95cadd8-4e74-4e10-b701-a471d17e2fea-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "f95cadd8-4e74-4e10-b701-a471d17e2fea" (UID: "f95cadd8-4e74-4e10-b701-a471d17e2fea"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 14:44:57.828518 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:57.828493 2573 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f95cadd8-4e74-4e10-b701-a471d17e2fea-bound-sa-token\") on node \"ip-10-0-134-244.ec2.internal\" DevicePath \"\"" May 21 14:44:57.828518 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:57.828518 2573 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f95cadd8-4e74-4e10-b701-a471d17e2fea-ca-trust-extracted\") on node \"ip-10-0-134-244.ec2.internal\" DevicePath \"\"" May 21 14:44:57.828662 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:57.828528 2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f95cadd8-4e74-4e10-b701-a471d17e2fea-trusted-ca\") on node \"ip-10-0-134-244.ec2.internal\" DevicePath \"\"" May 21 14:44:57.828662 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:57.828539 2573 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f95cadd8-4e74-4e10-b701-a471d17e2fea-image-registry-private-configuration\") on node \"ip-10-0-134-244.ec2.internal\" DevicePath \"\"" May 21 14:44:57.828662 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:57.828548 2573 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f95cadd8-4e74-4e10-b701-a471d17e2fea-registry-certificates\") on node \"ip-10-0-134-244.ec2.internal\" DevicePath \"\"" May 21 14:44:57.828662 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:57.828557 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-krsh8\" (UniqueName: \"kubernetes.io/projected/f95cadd8-4e74-4e10-b701-a471d17e2fea-kube-api-access-krsh8\") on node \"ip-10-0-134-244.ec2.internal\" DevicePath \"\"" May 21 14:44:57.828662 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:57.828565 2573 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f95cadd8-4e74-4e10-b701-a471d17e2fea-registry-tls\") on node \"ip-10-0-134-244.ec2.internal\" DevicePath \"\"" May 21 14:44:57.828662 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:57.828574 2573 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f95cadd8-4e74-4e10-b701-a471d17e2fea-installation-pull-secrets\") on node \"ip-10-0-134-244.ec2.internal\" DevicePath \"\"" May 21 14:44:58.420414 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:58.420371 2573 generic.go:358] "Generic (PLEG): container finished" podID="f95cadd8-4e74-4e10-b701-a471d17e2fea" containerID="43717c53d66c6901074eb7d3172fdd7746a6deabe9880ff0e0847943af0f4d3f" exitCode=0 May 21 14:44:58.420841 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:58.420439 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67d64978d7-ttr7l" May 21 14:44:58.420841 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:58.420452 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67d64978d7-ttr7l" event={"ID":"f95cadd8-4e74-4e10-b701-a471d17e2fea","Type":"ContainerDied","Data":"43717c53d66c6901074eb7d3172fdd7746a6deabe9880ff0e0847943af0f4d3f"} May 21 14:44:58.420841 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:58.420489 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67d64978d7-ttr7l" event={"ID":"f95cadd8-4e74-4e10-b701-a471d17e2fea","Type":"ContainerDied","Data":"30642be0d6a9bb8d65bbfa2819dab624de28ec90d467149c120454b4353c50c4"} May 21 14:44:58.420841 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:58.420504 2573 scope.go:117] "RemoveContainer" containerID="43717c53d66c6901074eb7d3172fdd7746a6deabe9880ff0e0847943af0f4d3f" May 21 14:44:58.428889 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:58.428870 2573 scope.go:117] "RemoveContainer" containerID="43717c53d66c6901074eb7d3172fdd7746a6deabe9880ff0e0847943af0f4d3f" May 21 14:44:58.429171 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:44:58.429150 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43717c53d66c6901074eb7d3172fdd7746a6deabe9880ff0e0847943af0f4d3f\": container with ID starting with 43717c53d66c6901074eb7d3172fdd7746a6deabe9880ff0e0847943af0f4d3f not found: ID does not exist" containerID="43717c53d66c6901074eb7d3172fdd7746a6deabe9880ff0e0847943af0f4d3f" May 21 14:44:58.429249 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:58.429175 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43717c53d66c6901074eb7d3172fdd7746a6deabe9880ff0e0847943af0f4d3f"} err="failed to get container status \"43717c53d66c6901074eb7d3172fdd7746a6deabe9880ff0e0847943af0f4d3f\": rpc error: code = NotFound desc = could not find container \"43717c53d66c6901074eb7d3172fdd7746a6deabe9880ff0e0847943af0f4d3f\": container with ID starting with 43717c53d66c6901074eb7d3172fdd7746a6deabe9880ff0e0847943af0f4d3f not found: ID does not exist" May 21 14:44:58.435562 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:58.435540 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-67d64978d7-ttr7l"] May 21 14:44:58.440774 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:58.440753 2573 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-67d64978d7-ttr7l"] May 21 14:44:59.816726 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:44:59.816692 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f95cadd8-4e74-4e10-b701-a471d17e2fea" path="/var/lib/kubelet/pods/f95cadd8-4e74-4e10-b701-a471d17e2fea/volumes" May 21 14:45:01.965448 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:45:01.965394 2573 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c647f55bc-zsjds" podUID="a3815ee1-81d0-453e-b028-0cf9ae6956c8" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" May 21 14:45:11.965484 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:45:11.965431 2573 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c647f55bc-zsjds" podUID="a3815ee1-81d0-453e-b028-0cf9ae6956c8" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" May 21 14:45:21.965283 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:45:21.965235 2573 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c647f55bc-zsjds" podUID="a3815ee1-81d0-453e-b028-0cf9ae6956c8" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" May 21 14:45:21.965796 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:45:21.965317 2573 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c647f55bc-zsjds" May 21 14:45:21.965970 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:45:21.965947 2573 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"046f7dbc9e00d6d1e1e32c1708fd5f936e5b2129e2b9513d8a5dfaa407aacd33"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c647f55bc-zsjds" containerMessage="Container service-proxy failed liveness probe, will be restarted" May 21 14:45:21.966073 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:45:21.966017 2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c647f55bc-zsjds" podUID="a3815ee1-81d0-453e-b028-0cf9ae6956c8" containerName="service-proxy" containerID="cri-o://046f7dbc9e00d6d1e1e32c1708fd5f936e5b2129e2b9513d8a5dfaa407aacd33" gracePeriod=30 May 21 14:45:22.485076 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:45:22.485040 2573 generic.go:358] "Generic (PLEG): container finished" podID="a3815ee1-81d0-453e-b028-0cf9ae6956c8" containerID="046f7dbc9e00d6d1e1e32c1708fd5f936e5b2129e2b9513d8a5dfaa407aacd33" exitCode=2 May 21 14:45:22.485247 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:45:22.485110 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c647f55bc-zsjds" event={"ID":"a3815ee1-81d0-453e-b028-0cf9ae6956c8","Type":"ContainerDied","Data":"046f7dbc9e00d6d1e1e32c1708fd5f936e5b2129e2b9513d8a5dfaa407aacd33"} May 21 14:45:22.485247 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:45:22.485146 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c647f55bc-zsjds" event={"ID":"a3815ee1-81d0-453e-b028-0cf9ae6956c8","Type":"ContainerStarted","Data":"95df63fd71e7f41ace1520246aa4b569507e7987a91ee3b91cca9f0bcd596dcc"} May 21 14:45:39.642339 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:45:39.642294 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/646e1e59-0917-4626-8e22-158fec29f33f-metrics-certs\") pod \"network-metrics-daemon-tft6b\" (UID: \"646e1e59-0917-4626-8e22-158fec29f33f\") " pod="openshift-multus/network-metrics-daemon-tft6b" May 21 14:45:39.644655 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:45:39.644616 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/646e1e59-0917-4626-8e22-158fec29f33f-metrics-certs\") pod \"network-metrics-daemon-tft6b\" (UID: \"646e1e59-0917-4626-8e22-158fec29f33f\") " pod="openshift-multus/network-metrics-daemon-tft6b" May 21 14:45:39.915722 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:45:39.915624 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-brsnp\"" May 21 14:45:39.924543 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:45:39.924515 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tft6b" May 21 14:45:40.042349 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:45:40.042317 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tft6b"] May 21 14:45:40.045211 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:45:40.045185 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod646e1e59_0917_4626_8e22_158fec29f33f.slice/crio-3a35f77ab9ccb2215360e3e1def38d33c82e8855dd871a1ea89478898e534bfe WatchSource:0}: Error finding container 3a35f77ab9ccb2215360e3e1def38d33c82e8855dd871a1ea89478898e534bfe: Status 404 returned error can't find the container with id 3a35f77ab9ccb2215360e3e1def38d33c82e8855dd871a1ea89478898e534bfe May 21 14:45:40.532189 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:45:40.532155 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tft6b" event={"ID":"646e1e59-0917-4626-8e22-158fec29f33f","Type":"ContainerStarted","Data":"3a35f77ab9ccb2215360e3e1def38d33c82e8855dd871a1ea89478898e534bfe"} May 21 14:45:41.536360 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:45:41.536327 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tft6b" event={"ID":"646e1e59-0917-4626-8e22-158fec29f33f","Type":"ContainerStarted","Data":"be6b0df39539489296a0999b897fcf3c6d06b1a80d09e26e287a1b637b774032"} May 21 14:45:41.536360 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:45:41.536363 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tft6b" event={"ID":"646e1e59-0917-4626-8e22-158fec29f33f","Type":"ContainerStarted","Data":"be7abddedc602d85fd6cc5e2a6dea61e9cba17c5cde45d6288158fa6de815db9"} May 21 14:45:41.551404 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:45:41.551321 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-tft6b" podStartSLOduration=253.306034394 podStartE2EDuration="4m14.551307182s" podCreationTimestamp="2026-05-21 14:41:27 +0000 UTC" firstStartedPulling="2026-05-21 14:45:40.04709006 +0000 UTC m=+252.785345570" lastFinishedPulling="2026-05-21 14:45:41.292362848 +0000 UTC m=+254.030618358" observedRunningTime="2026-05-21 14:45:41.550172618 +0000 UTC m=+254.288428149" watchObservedRunningTime="2026-05-21 14:45:41.551307182 +0000 UTC m=+254.289562765" May 21 14:46:27.704121 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:46:27.704091 2573 kubelet.go:1628] "Image garbage collection succeeded" May 21 14:46:43.107106 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:46:43.107066 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-wp8v7"] May 21 14:46:43.109563 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:46:43.107412 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f95cadd8-4e74-4e10-b701-a471d17e2fea" containerName="registry" May 21 14:46:43.109563 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:46:43.107430 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="f95cadd8-4e74-4e10-b701-a471d17e2fea" containerName="registry" May 21 14:46:43.109563 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:46:43.107491 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="f95cadd8-4e74-4e10-b701-a471d17e2fea" containerName="registry" May 21 14:46:43.110308 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:46:43.110289 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-wp8v7" May 21 14:46:43.112457 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:46:43.112434 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" May 21 14:46:43.112567 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:46:43.112476 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-bf5pg\"" May 21 14:46:43.113233 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:46:43.113216 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" May 21 14:46:43.121487 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:46:43.121460 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-wp8v7"] May 21 14:46:43.169512 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:46:43.169468 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/df33f41a-11c1-4bcb-9dab-eb7d1429d983-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-wp8v7\" (UID: \"df33f41a-11c1-4bcb-9dab-eb7d1429d983\") " pod="cert-manager/cert-manager-webhook-587ccfb98-wp8v7" May 21 14:46:43.169687 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:46:43.169529 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2b5m9\" (UniqueName: \"kubernetes.io/projected/df33f41a-11c1-4bcb-9dab-eb7d1429d983-kube-api-access-2b5m9\") pod \"cert-manager-webhook-587ccfb98-wp8v7\" (UID: \"df33f41a-11c1-4bcb-9dab-eb7d1429d983\") " pod="cert-manager/cert-manager-webhook-587ccfb98-wp8v7" May 21 14:46:43.270498 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:46:43.270453 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/df33f41a-11c1-4bcb-9dab-eb7d1429d983-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-wp8v7\" (UID: \"df33f41a-11c1-4bcb-9dab-eb7d1429d983\") " pod="cert-manager/cert-manager-webhook-587ccfb98-wp8v7" May 21 14:46:43.270665 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:46:43.270531 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2b5m9\" (UniqueName: \"kubernetes.io/projected/df33f41a-11c1-4bcb-9dab-eb7d1429d983-kube-api-access-2b5m9\") pod \"cert-manager-webhook-587ccfb98-wp8v7\" (UID: \"df33f41a-11c1-4bcb-9dab-eb7d1429d983\") " pod="cert-manager/cert-manager-webhook-587ccfb98-wp8v7" May 21 14:46:43.279529 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:46:43.279490 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/df33f41a-11c1-4bcb-9dab-eb7d1429d983-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-wp8v7\" (UID: \"df33f41a-11c1-4bcb-9dab-eb7d1429d983\") " pod="cert-manager/cert-manager-webhook-587ccfb98-wp8v7" May 21 14:46:43.279658 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:46:43.279552 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2b5m9\" (UniqueName: \"kubernetes.io/projected/df33f41a-11c1-4bcb-9dab-eb7d1429d983-kube-api-access-2b5m9\") pod \"cert-manager-webhook-587ccfb98-wp8v7\" (UID: \"df33f41a-11c1-4bcb-9dab-eb7d1429d983\") " pod="cert-manager/cert-manager-webhook-587ccfb98-wp8v7" May 21 14:46:43.422138 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:46:43.422098 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-wp8v7" May 21 14:46:43.548253 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:46:43.548211 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-wp8v7"] May 21 14:46:43.551478 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:46:43.551440 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddf33f41a_11c1_4bcb_9dab_eb7d1429d983.slice/crio-19d82d054169ce7bd2166bd61f7eb30016a20c9ccce40d63b3e9df23e1d24648 WatchSource:0}: Error finding container 19d82d054169ce7bd2166bd61f7eb30016a20c9ccce40d63b3e9df23e1d24648: Status 404 returned error can't find the container with id 19d82d054169ce7bd2166bd61f7eb30016a20c9ccce40d63b3e9df23e1d24648 May 21 14:46:43.553325 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:46:43.553304 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 14:46:43.687639 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:46:43.687551 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-wp8v7" event={"ID":"df33f41a-11c1-4bcb-9dab-eb7d1429d983","Type":"ContainerStarted","Data":"19d82d054169ce7bd2166bd61f7eb30016a20c9ccce40d63b3e9df23e1d24648"} May 21 14:46:46.697859 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:46:46.697823 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-wp8v7" event={"ID":"df33f41a-11c1-4bcb-9dab-eb7d1429d983","Type":"ContainerStarted","Data":"b156e6d91dd78d9e76b5cc412e73452477f04e546862a5c5f421bbec629b2711"} May 21 14:46:46.698266 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:46:46.697942 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-587ccfb98-wp8v7" May 21 14:46:46.714832 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:46:46.714787 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-587ccfb98-wp8v7" podStartSLOduration=1.138288672 podStartE2EDuration="3.714772422s" podCreationTimestamp="2026-05-21 14:46:43 +0000 UTC" firstStartedPulling="2026-05-21 14:46:43.553442325 +0000 UTC m=+316.291697833" lastFinishedPulling="2026-05-21 14:46:46.129926063 +0000 UTC m=+318.868181583" observedRunningTime="2026-05-21 14:46:46.713525257 +0000 UTC m=+319.451780779" watchObservedRunningTime="2026-05-21 14:46:46.714772422 +0000 UTC m=+319.453027952" May 21 14:46:52.702342 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:46:52.702306 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-587ccfb98-wp8v7" May 21 14:46:59.059502 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:46:59.059468 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-f5249"] May 21 14:46:59.062516 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:46:59.062501 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-f5249" May 21 14:46:59.066093 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:46:59.066064 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" May 21 14:46:59.066889 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:46:59.066872 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" May 21 14:46:59.066889 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:46:59.066882 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-lnkbg\"" May 21 14:46:59.076893 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:46:59.076867 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-f5249"] May 21 14:46:59.185751 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:46:59.185712 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d352108a-a320-429f-bca2-f833fe652419-tmp\") pod \"openshift-lws-operator-bfc7f696d-f5249\" (UID: \"d352108a-a320-429f-bca2-f833fe652419\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-f5249" May 21 14:46:59.185751 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:46:59.185753 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n47pt\" (UniqueName: \"kubernetes.io/projected/d352108a-a320-429f-bca2-f833fe652419-kube-api-access-n47pt\") pod \"openshift-lws-operator-bfc7f696d-f5249\" (UID: \"d352108a-a320-429f-bca2-f833fe652419\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-f5249" May 21 14:46:59.286510 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:46:59.286471 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d352108a-a320-429f-bca2-f833fe652419-tmp\") pod \"openshift-lws-operator-bfc7f696d-f5249\" (UID: \"d352108a-a320-429f-bca2-f833fe652419\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-f5249" May 21 14:46:59.286510 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:46:59.286512 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n47pt\" (UniqueName: \"kubernetes.io/projected/d352108a-a320-429f-bca2-f833fe652419-kube-api-access-n47pt\") pod \"openshift-lws-operator-bfc7f696d-f5249\" (UID: \"d352108a-a320-429f-bca2-f833fe652419\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-f5249" May 21 14:46:59.286857 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:46:59.286836 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d352108a-a320-429f-bca2-f833fe652419-tmp\") pod \"openshift-lws-operator-bfc7f696d-f5249\" (UID: \"d352108a-a320-429f-bca2-f833fe652419\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-f5249" May 21 14:46:59.294478 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:46:59.294454 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n47pt\" (UniqueName: \"kubernetes.io/projected/d352108a-a320-429f-bca2-f833fe652419-kube-api-access-n47pt\") pod \"openshift-lws-operator-bfc7f696d-f5249\" (UID: \"d352108a-a320-429f-bca2-f833fe652419\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-f5249" May 21 14:46:59.371193 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:46:59.371078 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-f5249" May 21 14:46:59.497053 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:46:59.497019 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-f5249"] May 21 14:46:59.500151 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:46:59.500112 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd352108a_a320_429f_bca2_f833fe652419.slice/crio-a10df088e5bc273058b3903c2c14618d48854ad9ac588f02d24e326e95733d73 WatchSource:0}: Error finding container a10df088e5bc273058b3903c2c14618d48854ad9ac588f02d24e326e95733d73: Status 404 returned error can't find the container with id a10df088e5bc273058b3903c2c14618d48854ad9ac588f02d24e326e95733d73 May 21 14:46:59.731855 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:46:59.731817 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-f5249" event={"ID":"d352108a-a320-429f-bca2-f833fe652419","Type":"ContainerStarted","Data":"a10df088e5bc273058b3903c2c14618d48854ad9ac588f02d24e326e95733d73"} May 21 14:47:02.740769 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:02.740729 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-f5249" event={"ID":"d352108a-a320-429f-bca2-f833fe652419","Type":"ContainerStarted","Data":"77fc3047caae86c9bf56aa9ca9062190cd69a29463b828777987ea1baf6a7373"} May 21 14:47:02.755710 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:02.755615 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-f5249" podStartSLOduration=0.977968811 podStartE2EDuration="3.755597622s" podCreationTimestamp="2026-05-21 14:46:59 +0000 UTC" firstStartedPulling="2026-05-21 14:46:59.501849599 +0000 UTC m=+332.240105112" lastFinishedPulling="2026-05-21 14:47:02.279478411 +0000 UTC m=+335.017733923" observedRunningTime="2026-05-21 14:47:02.754841287 +0000 UTC m=+335.493096819" watchObservedRunningTime="2026-05-21 14:47:02.755597622 +0000 UTC m=+335.493853154" May 21 14:47:18.730228 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:18.730145 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f7cd99cbc-v4296"] May 21 14:47:18.733364 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:18.733344 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5f7cd99cbc-v4296" May 21 14:47:18.736182 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:18.736158 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 21 14:47:18.736502 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:18.736480 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 21 14:47:18.736583 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:18.736564 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 21 14:47:18.736644 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:18.736628 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-b79wj\"" May 21 14:47:18.736727 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:18.736712 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 21 14:47:18.763442 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:18.763408 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f7cd99cbc-v4296"] May 21 14:47:18.836665 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:18.836620 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7f729679-bcfb-4879-8c55-f9c9b1df85e1-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f7cd99cbc-v4296\" (UID: \"7f729679-bcfb-4879-8c55-f9c9b1df85e1\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7cd99cbc-v4296" May 21 14:47:18.836857 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:18.836697 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vp488\" (UniqueName: \"kubernetes.io/projected/7f729679-bcfb-4879-8c55-f9c9b1df85e1-kube-api-access-vp488\") pod \"opendatahub-operator-controller-manager-5f7cd99cbc-v4296\" (UID: \"7f729679-bcfb-4879-8c55-f9c9b1df85e1\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7cd99cbc-v4296" May 21 14:47:18.836857 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:18.836737 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7f729679-bcfb-4879-8c55-f9c9b1df85e1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f7cd99cbc-v4296\" (UID: \"7f729679-bcfb-4879-8c55-f9c9b1df85e1\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7cd99cbc-v4296" May 21 14:47:18.937417 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:18.937367 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vp488\" (UniqueName: \"kubernetes.io/projected/7f729679-bcfb-4879-8c55-f9c9b1df85e1-kube-api-access-vp488\") pod \"opendatahub-operator-controller-manager-5f7cd99cbc-v4296\" (UID: \"7f729679-bcfb-4879-8c55-f9c9b1df85e1\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7cd99cbc-v4296" May 21 14:47:18.937601 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:18.937447 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7f729679-bcfb-4879-8c55-f9c9b1df85e1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f7cd99cbc-v4296\" (UID: \"7f729679-bcfb-4879-8c55-f9c9b1df85e1\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7cd99cbc-v4296" May 21 14:47:18.937601 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:18.937497 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7f729679-bcfb-4879-8c55-f9c9b1df85e1-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f7cd99cbc-v4296\" (UID: \"7f729679-bcfb-4879-8c55-f9c9b1df85e1\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7cd99cbc-v4296" May 21 14:47:18.940055 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:18.940024 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7f729679-bcfb-4879-8c55-f9c9b1df85e1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f7cd99cbc-v4296\" (UID: \"7f729679-bcfb-4879-8c55-f9c9b1df85e1\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7cd99cbc-v4296" May 21 14:47:18.940180 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:18.940058 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7f729679-bcfb-4879-8c55-f9c9b1df85e1-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f7cd99cbc-v4296\" (UID: \"7f729679-bcfb-4879-8c55-f9c9b1df85e1\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7cd99cbc-v4296" May 21 14:47:18.945609 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:18.945583 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vp488\" (UniqueName: \"kubernetes.io/projected/7f729679-bcfb-4879-8c55-f9c9b1df85e1-kube-api-access-vp488\") pod \"opendatahub-operator-controller-manager-5f7cd99cbc-v4296\" (UID: \"7f729679-bcfb-4879-8c55-f9c9b1df85e1\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7cd99cbc-v4296" May 21 14:47:19.043898 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:19.043804 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5f7cd99cbc-v4296" May 21 14:47:19.172545 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:19.172492 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f7cd99cbc-v4296"] May 21 14:47:19.176910 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:47:19.176878 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f729679_bcfb_4879_8c55_f9c9b1df85e1.slice/crio-9d55eccf0b63be472f72da2738fb4aec0f2456295ff557da4848809ac17904cd WatchSource:0}: Error finding container 9d55eccf0b63be472f72da2738fb4aec0f2456295ff557da4848809ac17904cd: Status 404 returned error can't find the container with id 9d55eccf0b63be472f72da2738fb4aec0f2456295ff557da4848809ac17904cd May 21 14:47:19.790590 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:19.790534 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f7cd99cbc-v4296" event={"ID":"7f729679-bcfb-4879-8c55-f9c9b1df85e1","Type":"ContainerStarted","Data":"9d55eccf0b63be472f72da2738fb4aec0f2456295ff557da4848809ac17904cd"} May 21 14:47:21.797878 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:21.797838 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f7cd99cbc-v4296" event={"ID":"7f729679-bcfb-4879-8c55-f9c9b1df85e1","Type":"ContainerStarted","Data":"eaa6a4cf2c07744969e36063148a76c3835b684185205a8e26488c6fdfedc7ea"} May 21 14:47:21.798285 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:21.797976 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5f7cd99cbc-v4296" May 21 14:47:21.818934 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:21.818830 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5f7cd99cbc-v4296" podStartSLOduration=1.438450994 podStartE2EDuration="3.818814917s" podCreationTimestamp="2026-05-21 14:47:18 +0000 UTC" firstStartedPulling="2026-05-21 14:47:19.178941783 +0000 UTC m=+351.917197306" lastFinishedPulling="2026-05-21 14:47:21.559305705 +0000 UTC m=+354.297561229" observedRunningTime="2026-05-21 14:47:21.816889974 +0000 UTC m=+354.555145506" watchObservedRunningTime="2026-05-21 14:47:21.818814917 +0000 UTC m=+354.557070448" May 21 14:47:32.802642 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:32.802606 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5f7cd99cbc-v4296" May 21 14:47:36.232095 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:36.232059 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-74bcf6bb97-nx2js"] May 21 14:47:36.237707 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:36.237684 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-74bcf6bb97-nx2js" May 21 14:47:36.241083 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:36.241061 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 21 14:47:36.241219 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:36.241096 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" May 21 14:47:36.241219 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:36.241060 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-rpsjs\"" May 21 14:47:36.241219 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:36.241059 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" May 21 14:47:36.241426 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:36.241229 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 21 14:47:36.243681 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:36.243628 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-74bcf6bb97-nx2js"] May 21 14:47:36.368954 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:36.368921 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aedb1754-31e0-4198-8edc-e2a4764cfcf2-tmp\") pod \"kube-auth-proxy-74bcf6bb97-nx2js\" (UID: \"aedb1754-31e0-4198-8edc-e2a4764cfcf2\") " pod="openshift-ingress/kube-auth-proxy-74bcf6bb97-nx2js" May 21 14:47:36.368954 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:36.368957 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aedb1754-31e0-4198-8edc-e2a4764cfcf2-tls-certs\") pod \"kube-auth-proxy-74bcf6bb97-nx2js\" (UID: \"aedb1754-31e0-4198-8edc-e2a4764cfcf2\") " pod="openshift-ingress/kube-auth-proxy-74bcf6bb97-nx2js" May 21 14:47:36.369170 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:36.369051 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mn8lg\" (UniqueName: \"kubernetes.io/projected/aedb1754-31e0-4198-8edc-e2a4764cfcf2-kube-api-access-mn8lg\") pod \"kube-auth-proxy-74bcf6bb97-nx2js\" (UID: \"aedb1754-31e0-4198-8edc-e2a4764cfcf2\") " pod="openshift-ingress/kube-auth-proxy-74bcf6bb97-nx2js" May 21 14:47:36.469893 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:36.469856 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aedb1754-31e0-4198-8edc-e2a4764cfcf2-tmp\") pod \"kube-auth-proxy-74bcf6bb97-nx2js\" (UID: \"aedb1754-31e0-4198-8edc-e2a4764cfcf2\") " pod="openshift-ingress/kube-auth-proxy-74bcf6bb97-nx2js" May 21 14:47:36.469893 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:36.469901 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aedb1754-31e0-4198-8edc-e2a4764cfcf2-tls-certs\") pod \"kube-auth-proxy-74bcf6bb97-nx2js\" (UID: \"aedb1754-31e0-4198-8edc-e2a4764cfcf2\") " pod="openshift-ingress/kube-auth-proxy-74bcf6bb97-nx2js" May 21 14:47:36.470140 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:36.469930 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mn8lg\" (UniqueName: \"kubernetes.io/projected/aedb1754-31e0-4198-8edc-e2a4764cfcf2-kube-api-access-mn8lg\") pod \"kube-auth-proxy-74bcf6bb97-nx2js\" (UID: \"aedb1754-31e0-4198-8edc-e2a4764cfcf2\") " pod="openshift-ingress/kube-auth-proxy-74bcf6bb97-nx2js" May 21 14:47:36.472328 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:36.472293 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aedb1754-31e0-4198-8edc-e2a4764cfcf2-tmp\") pod \"kube-auth-proxy-74bcf6bb97-nx2js\" (UID: \"aedb1754-31e0-4198-8edc-e2a4764cfcf2\") " pod="openshift-ingress/kube-auth-proxy-74bcf6bb97-nx2js" May 21 14:47:36.472472 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:36.472454 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aedb1754-31e0-4198-8edc-e2a4764cfcf2-tls-certs\") pod \"kube-auth-proxy-74bcf6bb97-nx2js\" (UID: \"aedb1754-31e0-4198-8edc-e2a4764cfcf2\") " pod="openshift-ingress/kube-auth-proxy-74bcf6bb97-nx2js" May 21 14:47:36.478394 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:36.478368 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mn8lg\" (UniqueName: \"kubernetes.io/projected/aedb1754-31e0-4198-8edc-e2a4764cfcf2-kube-api-access-mn8lg\") pod \"kube-auth-proxy-74bcf6bb97-nx2js\" (UID: \"aedb1754-31e0-4198-8edc-e2a4764cfcf2\") " pod="openshift-ingress/kube-auth-proxy-74bcf6bb97-nx2js" May 21 14:47:36.547980 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:36.547887 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-74bcf6bb97-nx2js" May 21 14:47:36.700432 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:36.700398 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-74bcf6bb97-nx2js"] May 21 14:47:36.703625 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:47:36.703587 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaedb1754_31e0_4198_8edc_e2a4764cfcf2.slice/crio-1b5cf41a2b93e652618cc78e6ff3ed58fb785ceeec20f1410eab68e942594808 WatchSource:0}: Error finding container 1b5cf41a2b93e652618cc78e6ff3ed58fb785ceeec20f1410eab68e942594808: Status 404 returned error can't find the container with id 1b5cf41a2b93e652618cc78e6ff3ed58fb785ceeec20f1410eab68e942594808 May 21 14:47:36.839446 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:36.839338 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-74bcf6bb97-nx2js" event={"ID":"aedb1754-31e0-4198-8edc-e2a4764cfcf2","Type":"ContainerStarted","Data":"1b5cf41a2b93e652618cc78e6ff3ed58fb785ceeec20f1410eab68e942594808"} May 21 14:47:39.849114 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:39.849079 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-74bcf6bb97-nx2js" event={"ID":"aedb1754-31e0-4198-8edc-e2a4764cfcf2","Type":"ContainerStarted","Data":"08458c1072248612db059e81fcaaec5aa4d9cdccc9ca87cb6a013e8997509125"} May 21 14:47:39.865645 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:39.865592 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-74bcf6bb97-nx2js" podStartSLOduration=1.313681189 podStartE2EDuration="3.865573656s" podCreationTimestamp="2026-05-21 14:47:36 +0000 UTC" firstStartedPulling="2026-05-21 14:47:36.705471432 +0000 UTC m=+369.443726943" lastFinishedPulling="2026-05-21 14:47:39.25736389 +0000 UTC m=+371.995619410" observedRunningTime="2026-05-21 14:47:39.86541607 +0000 UTC m=+372.603671602" watchObservedRunningTime="2026-05-21 14:47:39.865573656 +0000 UTC m=+372.603829188" May 21 14:47:39.976645 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:39.976611 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-l9d5p"] May 21 14:47:39.979778 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:39.979760 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-l9d5p" May 21 14:47:39.982030 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:39.982010 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-tvnkh\"" May 21 14:47:39.982126 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:39.982016 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" May 21 14:47:39.988141 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:39.988114 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-l9d5p"] May 21 14:47:39.995781 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:39.995762 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ef58c87a-100a-4044-9bfe-1763cf75e42f-cert\") pod \"odh-model-controller-858dbf95b8-l9d5p\" (UID: \"ef58c87a-100a-4044-9bfe-1763cf75e42f\") " pod="opendatahub/odh-model-controller-858dbf95b8-l9d5p" May 21 14:47:39.995861 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:39.995802 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5w58\" (UniqueName: \"kubernetes.io/projected/ef58c87a-100a-4044-9bfe-1763cf75e42f-kube-api-access-f5w58\") pod \"odh-model-controller-858dbf95b8-l9d5p\" (UID: \"ef58c87a-100a-4044-9bfe-1763cf75e42f\") " pod="opendatahub/odh-model-controller-858dbf95b8-l9d5p" May 21 14:47:40.097037 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:40.096983 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ef58c87a-100a-4044-9bfe-1763cf75e42f-cert\") pod \"odh-model-controller-858dbf95b8-l9d5p\" (UID: \"ef58c87a-100a-4044-9bfe-1763cf75e42f\") " pod="opendatahub/odh-model-controller-858dbf95b8-l9d5p" May 21 14:47:40.097221 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:40.097058 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f5w58\" (UniqueName: \"kubernetes.io/projected/ef58c87a-100a-4044-9bfe-1763cf75e42f-kube-api-access-f5w58\") pod \"odh-model-controller-858dbf95b8-l9d5p\" (UID: \"ef58c87a-100a-4044-9bfe-1763cf75e42f\") " pod="opendatahub/odh-model-controller-858dbf95b8-l9d5p" May 21 14:47:40.097221 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:47:40.097135 2573 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found May 21 14:47:40.097221 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:47:40.097201 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef58c87a-100a-4044-9bfe-1763cf75e42f-cert podName:ef58c87a-100a-4044-9bfe-1763cf75e42f nodeName:}" failed. No retries permitted until 2026-05-21 14:47:40.597183417 +0000 UTC m=+373.335438936 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ef58c87a-100a-4044-9bfe-1763cf75e42f-cert") pod "odh-model-controller-858dbf95b8-l9d5p" (UID: "ef58c87a-100a-4044-9bfe-1763cf75e42f") : secret "odh-model-controller-webhook-cert" not found May 21 14:47:40.107452 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:40.107396 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5w58\" (UniqueName: \"kubernetes.io/projected/ef58c87a-100a-4044-9bfe-1763cf75e42f-kube-api-access-f5w58\") pod \"odh-model-controller-858dbf95b8-l9d5p\" (UID: \"ef58c87a-100a-4044-9bfe-1763cf75e42f\") " pod="opendatahub/odh-model-controller-858dbf95b8-l9d5p" May 21 14:47:40.600269 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:40.600232 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ef58c87a-100a-4044-9bfe-1763cf75e42f-cert\") pod \"odh-model-controller-858dbf95b8-l9d5p\" (UID: \"ef58c87a-100a-4044-9bfe-1763cf75e42f\") " pod="opendatahub/odh-model-controller-858dbf95b8-l9d5p" May 21 14:47:40.600446 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:47:40.600383 2573 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found May 21 14:47:40.600494 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:47:40.600456 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef58c87a-100a-4044-9bfe-1763cf75e42f-cert podName:ef58c87a-100a-4044-9bfe-1763cf75e42f nodeName:}" failed. No retries permitted until 2026-05-21 14:47:41.60043949 +0000 UTC m=+374.338694998 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ef58c87a-100a-4044-9bfe-1763cf75e42f-cert") pod "odh-model-controller-858dbf95b8-l9d5p" (UID: "ef58c87a-100a-4044-9bfe-1763cf75e42f") : secret "odh-model-controller-webhook-cert" not found May 21 14:47:41.612584 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:41.612529 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ef58c87a-100a-4044-9bfe-1763cf75e42f-cert\") pod \"odh-model-controller-858dbf95b8-l9d5p\" (UID: \"ef58c87a-100a-4044-9bfe-1763cf75e42f\") " pod="opendatahub/odh-model-controller-858dbf95b8-l9d5p" May 21 14:47:41.614927 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:41.614901 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ef58c87a-100a-4044-9bfe-1763cf75e42f-cert\") pod \"odh-model-controller-858dbf95b8-l9d5p\" (UID: \"ef58c87a-100a-4044-9bfe-1763cf75e42f\") " pod="opendatahub/odh-model-controller-858dbf95b8-l9d5p" May 21 14:47:41.790144 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:41.790102 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-l9d5p" May 21 14:47:41.915039 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:41.915006 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-l9d5p"] May 21 14:47:41.917926 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:47:41.917882 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef58c87a_100a_4044_9bfe_1763cf75e42f.slice/crio-6f3c4751074794405c51a6de7949c7809719474ba99831cae9d25bcd604f0ac8 WatchSource:0}: Error finding container 6f3c4751074794405c51a6de7949c7809719474ba99831cae9d25bcd604f0ac8: Status 404 returned error can't find the container with id 6f3c4751074794405c51a6de7949c7809719474ba99831cae9d25bcd604f0ac8 May 21 14:47:42.860639 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:42.860594 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-l9d5p" event={"ID":"ef58c87a-100a-4044-9bfe-1763cf75e42f","Type":"ContainerStarted","Data":"6f3c4751074794405c51a6de7949c7809719474ba99831cae9d25bcd604f0ac8"} May 21 14:47:44.868430 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:44.868392 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-l9d5p" event={"ID":"ef58c87a-100a-4044-9bfe-1763cf75e42f","Type":"ContainerStarted","Data":"3455dae6ac21e25686c54305a265cb93556b3ba4c6c7ea6ba8466431cfc39dd2"} May 21 14:47:44.868787 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:44.868450 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-l9d5p" May 21 14:47:44.883709 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:44.883653 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/odh-model-controller-858dbf95b8-l9d5p" podStartSLOduration=3.113415308 podStartE2EDuration="5.883635288s" podCreationTimestamp="2026-05-21 14:47:39 +0000 UTC" firstStartedPulling="2026-05-21 14:47:41.919295038 +0000 UTC m=+374.657550546" lastFinishedPulling="2026-05-21 14:47:44.689515011 +0000 UTC m=+377.427770526" observedRunningTime="2026-05-21 14:47:44.883524052 +0000 UTC m=+377.621779584" watchObservedRunningTime="2026-05-21 14:47:44.883635288 +0000 UTC m=+377.621890819" May 21 14:47:45.293215 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:45.293183 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-drdqg"] May 21 14:47:45.296510 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:45.296487 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-drdqg" May 21 14:47:45.298765 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:45.298737 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" May 21 14:47:45.298876 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:45.298771 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-5kgb4\"" May 21 14:47:45.304505 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:45.304116 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-drdqg"] May 21 14:47:45.341612 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:45.341581 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d59dd77e-7924-4cf3-855d-33ed5a8d0229-cert\") pod \"kserve-controller-manager-856948b99f-drdqg\" (UID: \"d59dd77e-7924-4cf3-855d-33ed5a8d0229\") " pod="opendatahub/kserve-controller-manager-856948b99f-drdqg" May 21 14:47:45.341773 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:45.341621 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r28f9\" (UniqueName: \"kubernetes.io/projected/d59dd77e-7924-4cf3-855d-33ed5a8d0229-kube-api-access-r28f9\") pod \"kserve-controller-manager-856948b99f-drdqg\" (UID: \"d59dd77e-7924-4cf3-855d-33ed5a8d0229\") " pod="opendatahub/kserve-controller-manager-856948b99f-drdqg" May 21 14:47:45.442261 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:45.442226 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d59dd77e-7924-4cf3-855d-33ed5a8d0229-cert\") pod \"kserve-controller-manager-856948b99f-drdqg\" (UID: \"d59dd77e-7924-4cf3-855d-33ed5a8d0229\") " pod="opendatahub/kserve-controller-manager-856948b99f-drdqg" May 21 14:47:45.442261 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:45.442267 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r28f9\" (UniqueName: \"kubernetes.io/projected/d59dd77e-7924-4cf3-855d-33ed5a8d0229-kube-api-access-r28f9\") pod \"kserve-controller-manager-856948b99f-drdqg\" (UID: \"d59dd77e-7924-4cf3-855d-33ed5a8d0229\") " pod="opendatahub/kserve-controller-manager-856948b99f-drdqg" May 21 14:47:45.442451 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:47:45.442402 2573 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found May 21 14:47:45.442519 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:47:45.442478 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d59dd77e-7924-4cf3-855d-33ed5a8d0229-cert podName:d59dd77e-7924-4cf3-855d-33ed5a8d0229 nodeName:}" failed. No retries permitted until 2026-05-21 14:47:45.94245673 +0000 UTC m=+378.680712244 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d59dd77e-7924-4cf3-855d-33ed5a8d0229-cert") pod "kserve-controller-manager-856948b99f-drdqg" (UID: "d59dd77e-7924-4cf3-855d-33ed5a8d0229") : secret "kserve-webhook-server-cert" not found May 21 14:47:45.451185 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:45.451162 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r28f9\" (UniqueName: \"kubernetes.io/projected/d59dd77e-7924-4cf3-855d-33ed5a8d0229-kube-api-access-r28f9\") pod \"kserve-controller-manager-856948b99f-drdqg\" (UID: \"d59dd77e-7924-4cf3-855d-33ed5a8d0229\") " pod="opendatahub/kserve-controller-manager-856948b99f-drdqg" May 21 14:47:45.871710 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:45.871674 2573 generic.go:358] "Generic (PLEG): container finished" podID="ef58c87a-100a-4044-9bfe-1763cf75e42f" containerID="3455dae6ac21e25686c54305a265cb93556b3ba4c6c7ea6ba8466431cfc39dd2" exitCode=1 May 21 14:47:45.872193 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:45.871754 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-l9d5p" event={"ID":"ef58c87a-100a-4044-9bfe-1763cf75e42f","Type":"ContainerDied","Data":"3455dae6ac21e25686c54305a265cb93556b3ba4c6c7ea6ba8466431cfc39dd2"} May 21 14:47:45.872193 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:45.872130 2573 scope.go:117] "RemoveContainer" containerID="3455dae6ac21e25686c54305a265cb93556b3ba4c6c7ea6ba8466431cfc39dd2" May 21 14:47:45.946700 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:45.946670 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d59dd77e-7924-4cf3-855d-33ed5a8d0229-cert\") pod \"kserve-controller-manager-856948b99f-drdqg\" (UID: \"d59dd77e-7924-4cf3-855d-33ed5a8d0229\") " pod="opendatahub/kserve-controller-manager-856948b99f-drdqg" May 21 14:47:45.946865 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:47:45.946840 2573 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found May 21 14:47:45.946926 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:47:45.946916 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d59dd77e-7924-4cf3-855d-33ed5a8d0229-cert podName:d59dd77e-7924-4cf3-855d-33ed5a8d0229 nodeName:}" failed. No retries permitted until 2026-05-21 14:47:46.946895306 +0000 UTC m=+379.685150818 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d59dd77e-7924-4cf3-855d-33ed5a8d0229-cert") pod "kserve-controller-manager-856948b99f-drdqg" (UID: "d59dd77e-7924-4cf3-855d-33ed5a8d0229") : secret "kserve-webhook-server-cert" not found May 21 14:47:46.876308 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:46.876266 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-l9d5p" event={"ID":"ef58c87a-100a-4044-9bfe-1763cf75e42f","Type":"ContainerStarted","Data":"78ee180afe1ad87c0a9de2732ad1e9108dd6b7375d47a268c337efa7480e4e74"} May 21 14:47:46.876690 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:46.876400 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-l9d5p" May 21 14:47:46.955492 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:46.955457 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d59dd77e-7924-4cf3-855d-33ed5a8d0229-cert\") pod \"kserve-controller-manager-856948b99f-drdqg\" (UID: \"d59dd77e-7924-4cf3-855d-33ed5a8d0229\") " pod="opendatahub/kserve-controller-manager-856948b99f-drdqg" May 21 14:47:46.957799 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:46.957775 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d59dd77e-7924-4cf3-855d-33ed5a8d0229-cert\") pod \"kserve-controller-manager-856948b99f-drdqg\" (UID: \"d59dd77e-7924-4cf3-855d-33ed5a8d0229\") " pod="opendatahub/kserve-controller-manager-856948b99f-drdqg" May 21 14:47:47.108165 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:47.108128 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-drdqg" May 21 14:47:47.241900 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:47.241870 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-drdqg"] May 21 14:47:47.244984 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:47:47.244953 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd59dd77e_7924_4cf3_855d_33ed5a8d0229.slice/crio-c7801d8eb57ce8d2fd7bc9efd8460da70a7298137b3d426ba7e09ffbe65cb391 WatchSource:0}: Error finding container c7801d8eb57ce8d2fd7bc9efd8460da70a7298137b3d426ba7e09ffbe65cb391: Status 404 returned error can't find the container with id c7801d8eb57ce8d2fd7bc9efd8460da70a7298137b3d426ba7e09ffbe65cb391 May 21 14:47:47.880087 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:47.880046 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-drdqg" event={"ID":"d59dd77e-7924-4cf3-855d-33ed5a8d0229","Type":"ContainerStarted","Data":"c7801d8eb57ce8d2fd7bc9efd8460da70a7298137b3d426ba7e09ffbe65cb391"} May 21 14:47:50.890673 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:50.890637 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-drdqg" event={"ID":"d59dd77e-7924-4cf3-855d-33ed5a8d0229","Type":"ContainerStarted","Data":"a464944c66c82a3023209276b8c1d3f60dbc5f17042c3082617b368101f95a32"} May 21 14:47:50.891127 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:50.890753 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-856948b99f-drdqg" May 21 14:47:50.909670 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:50.909612 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-856948b99f-drdqg" podStartSLOduration=3.228797432 podStartE2EDuration="5.90959485s" podCreationTimestamp="2026-05-21 14:47:45 +0000 UTC" firstStartedPulling="2026-05-21 14:47:47.246868681 +0000 UTC m=+379.985124191" lastFinishedPulling="2026-05-21 14:47:49.9276661 +0000 UTC m=+382.665921609" observedRunningTime="2026-05-21 14:47:50.907841959 +0000 UTC m=+383.646097490" watchObservedRunningTime="2026-05-21 14:47:50.90959485 +0000 UTC m=+383.647850381" May 21 14:47:51.113897 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:51.113860 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-fg76x"] May 21 14:47:51.117270 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:51.117244 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-fg76x" May 21 14:47:51.120302 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:51.120274 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" May 21 14:47:51.120450 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:51.120333 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-wx57h\"" May 21 14:47:51.120450 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:51.120274 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" May 21 14:47:51.130306 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:51.130279 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-fg76x"] May 21 14:47:51.190277 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:51.190169 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xk47j\" (UniqueName: \"kubernetes.io/projected/3900d91e-fb8d-4235-a71f-faadba1f7ed2-kube-api-access-xk47j\") pod \"servicemesh-operator3-55f49c5f94-fg76x\" (UID: \"3900d91e-fb8d-4235-a71f-faadba1f7ed2\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-fg76x" May 21 14:47:51.190277 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:51.190261 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/3900d91e-fb8d-4235-a71f-faadba1f7ed2-operator-config\") pod \"servicemesh-operator3-55f49c5f94-fg76x\" (UID: \"3900d91e-fb8d-4235-a71f-faadba1f7ed2\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-fg76x" May 21 14:47:51.290624 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:51.290586 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/3900d91e-fb8d-4235-a71f-faadba1f7ed2-operator-config\") pod \"servicemesh-operator3-55f49c5f94-fg76x\" (UID: \"3900d91e-fb8d-4235-a71f-faadba1f7ed2\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-fg76x" May 21 14:47:51.290798 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:51.290644 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xk47j\" (UniqueName: \"kubernetes.io/projected/3900d91e-fb8d-4235-a71f-faadba1f7ed2-kube-api-access-xk47j\") pod \"servicemesh-operator3-55f49c5f94-fg76x\" (UID: \"3900d91e-fb8d-4235-a71f-faadba1f7ed2\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-fg76x" May 21 14:47:51.293126 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:51.293107 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/3900d91e-fb8d-4235-a71f-faadba1f7ed2-operator-config\") pod \"servicemesh-operator3-55f49c5f94-fg76x\" (UID: \"3900d91e-fb8d-4235-a71f-faadba1f7ed2\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-fg76x" May 21 14:47:51.299963 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:51.299931 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xk47j\" (UniqueName: \"kubernetes.io/projected/3900d91e-fb8d-4235-a71f-faadba1f7ed2-kube-api-access-xk47j\") pod \"servicemesh-operator3-55f49c5f94-fg76x\" (UID: \"3900d91e-fb8d-4235-a71f-faadba1f7ed2\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-fg76x" May 21 14:47:51.427042 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:51.426984 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-fg76x" May 21 14:47:51.570059 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:51.570028 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-fg76x"] May 21 14:47:51.573037 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:47:51.572981 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3900d91e_fb8d_4235_a71f_faadba1f7ed2.slice/crio-7f6df61a9df8a5ec7b02775bcf5213118d570fa23c084bccf0634e7a392909f4 WatchSource:0}: Error finding container 7f6df61a9df8a5ec7b02775bcf5213118d570fa23c084bccf0634e7a392909f4: Status 404 returned error can't find the container with id 7f6df61a9df8a5ec7b02775bcf5213118d570fa23c084bccf0634e7a392909f4 May 21 14:47:51.895456 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:51.895420 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-fg76x" event={"ID":"3900d91e-fb8d-4235-a71f-faadba1f7ed2","Type":"ContainerStarted","Data":"7f6df61a9df8a5ec7b02775bcf5213118d570fa23c084bccf0634e7a392909f4"} May 21 14:47:55.909107 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:55.909071 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-fg76x" event={"ID":"3900d91e-fb8d-4235-a71f-faadba1f7ed2","Type":"ContainerStarted","Data":"8964ac83c25d49b6021c6033f8e3e3db878258cb2ad08cb20e0ba38f95d7eb43"} May 21 14:47:55.909485 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:55.909294 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-fg76x" May 21 14:47:55.930172 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:55.930102 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-fg76x" podStartSLOduration=1.61507413 podStartE2EDuration="4.930086944s" podCreationTimestamp="2026-05-21 14:47:51 +0000 UTC" firstStartedPulling="2026-05-21 14:47:51.579794426 +0000 UTC m=+384.318049935" lastFinishedPulling="2026-05-21 14:47:54.89480724 +0000 UTC m=+387.633062749" observedRunningTime="2026-05-21 14:47:55.928296931 +0000 UTC m=+388.666552463" watchObservedRunningTime="2026-05-21 14:47:55.930086944 +0000 UTC m=+388.668342475" May 21 14:47:57.882587 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:47:57.882553 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-858dbf95b8-l9d5p" May 21 14:48:06.915496 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:48:06.915453 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-fg76x" May 21 14:48:21.901834 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:48:21.901803 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-856948b99f-drdqg" May 21 14:48:22.182885 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:48:22.182796 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-ct6m6"] May 21 14:48:22.185168 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:48:22.185140 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-ct6m6" May 21 14:48:22.187598 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:48:22.187572 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" May 21 14:48:22.187743 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:48:22.187597 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" May 21 14:48:22.187743 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:48:22.187597 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" May 21 14:48:22.187743 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:48:22.187650 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-mqt2d\"" May 21 14:48:22.187900 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:48:22.187885 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" May 21 14:48:22.198865 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:48:22.198843 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-ct6m6"] May 21 14:48:22.341044 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:48:22.341003 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a312e0e0-ebb8-4329-a857-419e3c5ac505-istio-token\") pod \"istiod-openshift-gateway-798958bb55-ct6m6\" (UID: \"a312e0e0-ebb8-4329-a857-419e3c5ac505\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-ct6m6" May 21 14:48:22.341236 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:48:22.341052 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a312e0e0-ebb8-4329-a857-419e3c5ac505-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-ct6m6\" (UID: \"a312e0e0-ebb8-4329-a857-419e3c5ac505\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-ct6m6" May 21 14:48:22.341236 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:48:22.341094 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a312e0e0-ebb8-4329-a857-419e3c5ac505-local-certs\") pod \"istiod-openshift-gateway-798958bb55-ct6m6\" (UID: \"a312e0e0-ebb8-4329-a857-419e3c5ac505\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-ct6m6" May 21 14:48:22.341236 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:48:22.341131 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a312e0e0-ebb8-4329-a857-419e3c5ac505-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-ct6m6\" (UID: \"a312e0e0-ebb8-4329-a857-419e3c5ac505\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-ct6m6" May 21 14:48:22.341236 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:48:22.341207 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlxk8\" (UniqueName: \"kubernetes.io/projected/a312e0e0-ebb8-4329-a857-419e3c5ac505-kube-api-access-rlxk8\") pod \"istiod-openshift-gateway-798958bb55-ct6m6\" (UID: \"a312e0e0-ebb8-4329-a857-419e3c5ac505\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-ct6m6" May 21 14:48:22.341390 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:48:22.341238 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a312e0e0-ebb8-4329-a857-419e3c5ac505-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-ct6m6\" (UID: \"a312e0e0-ebb8-4329-a857-419e3c5ac505\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-ct6m6" May 21 14:48:22.341390 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:48:22.341288 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a312e0e0-ebb8-4329-a857-419e3c5ac505-cacerts\") pod \"istiod-openshift-gateway-798958bb55-ct6m6\" (UID: \"a312e0e0-ebb8-4329-a857-419e3c5ac505\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-ct6m6" May 21 14:48:22.442429 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:48:22.442327 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rlxk8\" (UniqueName: \"kubernetes.io/projected/a312e0e0-ebb8-4329-a857-419e3c5ac505-kube-api-access-rlxk8\") pod \"istiod-openshift-gateway-798958bb55-ct6m6\" (UID: \"a312e0e0-ebb8-4329-a857-419e3c5ac505\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-ct6m6" May 21 14:48:22.442429 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:48:22.442366 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a312e0e0-ebb8-4329-a857-419e3c5ac505-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-ct6m6\" (UID: \"a312e0e0-ebb8-4329-a857-419e3c5ac505\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-ct6m6" May 21 14:48:22.442429 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:48:22.442425 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a312e0e0-ebb8-4329-a857-419e3c5ac505-cacerts\") pod \"istiod-openshift-gateway-798958bb55-ct6m6\" (UID: \"a312e0e0-ebb8-4329-a857-419e3c5ac505\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-ct6m6" May 21 14:48:22.442709 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:48:22.442460 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a312e0e0-ebb8-4329-a857-419e3c5ac505-istio-token\") pod \"istiod-openshift-gateway-798958bb55-ct6m6\" (UID: \"a312e0e0-ebb8-4329-a857-419e3c5ac505\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-ct6m6" May 21 14:48:22.442709 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:48:22.442685 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a312e0e0-ebb8-4329-a857-419e3c5ac505-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-ct6m6\" (UID: \"a312e0e0-ebb8-4329-a857-419e3c5ac505\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-ct6m6" May 21 14:48:22.442789 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:48:22.442726 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a312e0e0-ebb8-4329-a857-419e3c5ac505-local-certs\") pod \"istiod-openshift-gateway-798958bb55-ct6m6\" (UID: \"a312e0e0-ebb8-4329-a857-419e3c5ac505\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-ct6m6" May 21 14:48:22.442789 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:48:22.442766 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a312e0e0-ebb8-4329-a857-419e3c5ac505-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-ct6m6\" (UID: \"a312e0e0-ebb8-4329-a857-419e3c5ac505\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-ct6m6" May 21 14:48:22.443177 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:48:22.443152 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a312e0e0-ebb8-4329-a857-419e3c5ac505-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-ct6m6\" (UID: \"a312e0e0-ebb8-4329-a857-419e3c5ac505\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-ct6m6" May 21 14:48:22.445190 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:48:22.445158 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a312e0e0-ebb8-4329-a857-419e3c5ac505-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-ct6m6\" (UID: \"a312e0e0-ebb8-4329-a857-419e3c5ac505\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-ct6m6" May 21 14:48:22.445308 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:48:22.445262 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a312e0e0-ebb8-4329-a857-419e3c5ac505-local-certs\") pod \"istiod-openshift-gateway-798958bb55-ct6m6\" (UID: \"a312e0e0-ebb8-4329-a857-419e3c5ac505\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-ct6m6" May 21 14:48:22.445447 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:48:22.445432 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a312e0e0-ebb8-4329-a857-419e3c5ac505-cacerts\") pod \"istiod-openshift-gateway-798958bb55-ct6m6\" (UID: \"a312e0e0-ebb8-4329-a857-419e3c5ac505\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-ct6m6" May 21 14:48:22.445484 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:48:22.445450 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a312e0e0-ebb8-4329-a857-419e3c5ac505-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-ct6m6\" (UID: \"a312e0e0-ebb8-4329-a857-419e3c5ac505\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-ct6m6" May 21 14:48:22.449672 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:48:22.449640 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlxk8\" (UniqueName: \"kubernetes.io/projected/a312e0e0-ebb8-4329-a857-419e3c5ac505-kube-api-access-rlxk8\") pod \"istiod-openshift-gateway-798958bb55-ct6m6\" (UID: \"a312e0e0-ebb8-4329-a857-419e3c5ac505\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-ct6m6" May 21 14:48:22.449672 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:48:22.449664 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a312e0e0-ebb8-4329-a857-419e3c5ac505-istio-token\") pod \"istiod-openshift-gateway-798958bb55-ct6m6\" (UID: \"a312e0e0-ebb8-4329-a857-419e3c5ac505\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-ct6m6" May 21 14:48:22.494859 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:48:22.494820 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-ct6m6" May 21 14:48:22.634023 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:48:22.633972 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-ct6m6"] May 21 14:48:22.635787 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:48:22.635752 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda312e0e0_ebb8_4329_a857_419e3c5ac505.slice/crio-bd7adc31ead2011c98e2b34842f634a10fb02468b3266be06056a0f542169f0b WatchSource:0}: Error finding container bd7adc31ead2011c98e2b34842f634a10fb02468b3266be06056a0f542169f0b: Status 404 returned error can't find the container with id bd7adc31ead2011c98e2b34842f634a10fb02468b3266be06056a0f542169f0b May 21 14:48:22.993420 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:48:22.993372 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-ct6m6" event={"ID":"a312e0e0-ebb8-4329-a857-419e3c5ac505","Type":"ContainerStarted","Data":"bd7adc31ead2011c98e2b34842f634a10fb02468b3266be06056a0f542169f0b"} May 21 14:48:25.283952 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:48:25.283907 2573 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} May 21 14:48:25.284273 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:48:25.284021 2573 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} May 21 14:48:26.005623 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:48:26.005586 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-ct6m6" event={"ID":"a312e0e0-ebb8-4329-a857-419e3c5ac505","Type":"ContainerStarted","Data":"4f4e0cd3c21e8a967f062951477d115c9ac585f7172040db9c2abbd517a0a7ed"} May 21 14:48:26.006088 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:48:26.005960 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-ct6m6" May 21 14:48:26.007321 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:48:26.007283 2573 patch_prober.go:28] interesting pod/istiod-openshift-gateway-798958bb55-ct6m6 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= May 21 14:48:26.007445 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:48:26.007354 2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-ct6m6" podUID="a312e0e0-ebb8-4329-a857-419e3c5ac505" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 21 14:48:26.031559 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:48:26.031493 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-ct6m6" podStartSLOduration=1.385918437 podStartE2EDuration="4.031473927s" podCreationTimestamp="2026-05-21 14:48:22 +0000 UTC" firstStartedPulling="2026-05-21 14:48:22.638111995 +0000 UTC m=+415.376367504" lastFinishedPulling="2026-05-21 14:48:25.283667486 +0000 UTC m=+418.021922994" observedRunningTime="2026-05-21 14:48:26.02925817 +0000 UTC m=+418.767513701" watchObservedRunningTime="2026-05-21 14:48:26.031473927 +0000 UTC m=+418.769729455" May 21 14:48:27.014734 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:48:27.014700 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-ct6m6" May 21 14:49:10.380832 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:10.380793 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9t2t2"] May 21 14:49:10.388758 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:10.388736 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9t2t2" May 21 14:49:10.391359 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:10.391329 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 21 14:49:10.391359 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:10.391353 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-wn52m\"" May 21 14:49:10.391560 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:10.391342 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 21 14:49:10.403634 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:10.398274 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9t2t2"] May 21 14:49:10.437928 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:10.437893 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x74hc\" (UniqueName: \"kubernetes.io/projected/fc414ba3-dfe6-429e-802b-a3d485328aba-kube-api-access-x74hc\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-9t2t2\" (UID: \"fc414ba3-dfe6-429e-802b-a3d485328aba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9t2t2" May 21 14:49:10.438097 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:10.437936 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc414ba3-dfe6-429e-802b-a3d485328aba-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-9t2t2\" (UID: \"fc414ba3-dfe6-429e-802b-a3d485328aba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9t2t2" May 21 14:49:10.539332 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:10.539286 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x74hc\" (UniqueName: \"kubernetes.io/projected/fc414ba3-dfe6-429e-802b-a3d485328aba-kube-api-access-x74hc\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-9t2t2\" (UID: \"fc414ba3-dfe6-429e-802b-a3d485328aba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9t2t2" May 21 14:49:10.539332 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:10.539336 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc414ba3-dfe6-429e-802b-a3d485328aba-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-9t2t2\" (UID: \"fc414ba3-dfe6-429e-802b-a3d485328aba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9t2t2" May 21 14:49:10.539711 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:10.539694 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc414ba3-dfe6-429e-802b-a3d485328aba-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-9t2t2\" (UID: \"fc414ba3-dfe6-429e-802b-a3d485328aba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9t2t2" May 21 14:49:10.548791 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:10.548755 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x74hc\" (UniqueName: \"kubernetes.io/projected/fc414ba3-dfe6-429e-802b-a3d485328aba-kube-api-access-x74hc\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-9t2t2\" (UID: \"fc414ba3-dfe6-429e-802b-a3d485328aba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9t2t2" May 21 14:49:10.701496 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:10.701385 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9t2t2" May 21 14:49:10.836334 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:10.836298 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9t2t2"] May 21 14:49:10.842348 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:49:10.842308 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc414ba3_dfe6_429e_802b_a3d485328aba.slice/crio-706b90575ddc99dfbd5cf104fe4364685ae7abd85a5ce11c87b67412cc40e06b WatchSource:0}: Error finding container 706b90575ddc99dfbd5cf104fe4364685ae7abd85a5ce11c87b67412cc40e06b: Status 404 returned error can't find the container with id 706b90575ddc99dfbd5cf104fe4364685ae7abd85a5ce11c87b67412cc40e06b May 21 14:49:11.157574 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:11.157532 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9t2t2" event={"ID":"fc414ba3-dfe6-429e-802b-a3d485328aba","Type":"ContainerStarted","Data":"706b90575ddc99dfbd5cf104fe4364685ae7abd85a5ce11c87b67412cc40e06b"} May 21 14:49:16.175823 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:16.175788 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9t2t2" event={"ID":"fc414ba3-dfe6-429e-802b-a3d485328aba","Type":"ContainerStarted","Data":"0912ba62fb552aedb7640888ff3dcc44e8e313f7911cacd9d1d9937cace195ee"} May 21 14:49:16.176235 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:16.175901 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9t2t2" May 21 14:49:16.198288 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:16.198187 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9t2t2" podStartSLOduration=1.101049465 podStartE2EDuration="6.198172739s" podCreationTimestamp="2026-05-21 14:49:10 +0000 UTC" firstStartedPulling="2026-05-21 14:49:10.84444532 +0000 UTC m=+463.582700829" lastFinishedPulling="2026-05-21 14:49:15.941568585 +0000 UTC m=+468.679824103" observedRunningTime="2026-05-21 14:49:16.19607966 +0000 UTC m=+468.934335190" watchObservedRunningTime="2026-05-21 14:49:16.198172739 +0000 UTC m=+468.936428269" May 21 14:49:27.184313 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:27.184278 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9t2t2" May 21 14:49:28.132888 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:28.132855 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4grfb"] May 21 14:49:28.136106 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:28.136088 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4grfb" May 21 14:49:28.148523 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:28.148493 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4grfb"] May 21 14:49:28.295554 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:28.295516 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/34f92c44-51dc-42ad-9a6d-aceb7adb6822-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-4grfb\" (UID: \"34f92c44-51dc-42ad-9a6d-aceb7adb6822\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4grfb" May 21 14:49:28.295554 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:28.295554 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g96rg\" (UniqueName: \"kubernetes.io/projected/34f92c44-51dc-42ad-9a6d-aceb7adb6822-kube-api-access-g96rg\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-4grfb\" (UID: \"34f92c44-51dc-42ad-9a6d-aceb7adb6822\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4grfb" May 21 14:49:28.396973 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:28.396871 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/34f92c44-51dc-42ad-9a6d-aceb7adb6822-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-4grfb\" (UID: \"34f92c44-51dc-42ad-9a6d-aceb7adb6822\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4grfb" May 21 14:49:28.396973 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:28.396917 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g96rg\" (UniqueName: \"kubernetes.io/projected/34f92c44-51dc-42ad-9a6d-aceb7adb6822-kube-api-access-g96rg\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-4grfb\" (UID: \"34f92c44-51dc-42ad-9a6d-aceb7adb6822\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4grfb" May 21 14:49:28.397269 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:28.397246 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/34f92c44-51dc-42ad-9a6d-aceb7adb6822-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-4grfb\" (UID: \"34f92c44-51dc-42ad-9a6d-aceb7adb6822\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4grfb" May 21 14:49:28.404752 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:28.404724 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g96rg\" (UniqueName: \"kubernetes.io/projected/34f92c44-51dc-42ad-9a6d-aceb7adb6822-kube-api-access-g96rg\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-4grfb\" (UID: \"34f92c44-51dc-42ad-9a6d-aceb7adb6822\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4grfb" May 21 14:49:28.446703 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:28.446653 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4grfb" May 21 14:49:28.585592 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:28.585559 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4grfb"] May 21 14:49:28.588313 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:49:28.588279 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34f92c44_51dc_42ad_9a6d_aceb7adb6822.slice/crio-058cb954ae76d663502c083431d561ae04116f160ceeb44571e7a13e75abaead WatchSource:0}: Error finding container 058cb954ae76d663502c083431d561ae04116f160ceeb44571e7a13e75abaead: Status 404 returned error can't find the container with id 058cb954ae76d663502c083431d561ae04116f160ceeb44571e7a13e75abaead May 21 14:49:28.853092 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:28.853055 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9t2t2"] May 21 14:49:28.853403 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:28.853345 2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9t2t2" podUID="fc414ba3-dfe6-429e-802b-a3d485328aba" containerName="manager" containerID="cri-o://0912ba62fb552aedb7640888ff3dcc44e8e313f7911cacd9d1d9937cace195ee" gracePeriod=2 May 21 14:49:28.855331 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:28.855275 2573 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9t2t2"] May 21 14:49:28.855513 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:28.855480 2573 status_manager.go:895] "Failed to get status for pod" podUID="fc414ba3-dfe6-429e-802b-a3d485328aba" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9t2t2" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-9t2t2\" is forbidden: User \"system:node:ip-10-0-134-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-244.ec2.internal' and this object" May 21 14:49:28.866845 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:28.866818 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-6kxgg"] May 21 14:49:28.867202 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:28.867184 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc414ba3-dfe6-429e-802b-a3d485328aba" containerName="manager" May 21 14:49:28.867202 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:28.867204 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc414ba3-dfe6-429e-802b-a3d485328aba" containerName="manager" May 21 14:49:28.867340 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:28.867295 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="fc414ba3-dfe6-429e-802b-a3d485328aba" containerName="manager" May 21 14:49:28.871205 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:28.871186 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-6kxgg" May 21 14:49:28.873545 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:28.873321 2573 status_manager.go:895] "Failed to get status for pod" podUID="fc414ba3-dfe6-429e-802b-a3d485328aba" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9t2t2" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-9t2t2\" is forbidden: User \"system:node:ip-10-0-134-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-244.ec2.internal' and this object" May 21 14:49:28.875028 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:28.874988 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4grfb"] May 21 14:49:28.877918 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:28.877885 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-6kxgg"] May 21 14:49:28.889809 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:28.889781 2573 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4grfb"] May 21 14:49:28.898871 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:28.898807 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-24fh5"] May 21 14:49:28.899109 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:28.899095 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34f92c44-51dc-42ad-9a6d-aceb7adb6822" containerName="manager" May 21 14:49:28.899109 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:28.899110 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="34f92c44-51dc-42ad-9a6d-aceb7adb6822" containerName="manager" May 21 14:49:28.899235 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:28.899176 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="34f92c44-51dc-42ad-9a6d-aceb7adb6822" containerName="manager" May 21 14:49:28.901925 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:28.901906 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-24fh5" May 21 14:49:28.904309 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:28.904283 2573 status_manager.go:895] "Failed to get status for pod" podUID="fc414ba3-dfe6-429e-802b-a3d485328aba" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9t2t2" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-9t2t2\" is forbidden: User \"system:node:ip-10-0-134-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-244.ec2.internal' and this object" May 21 14:49:28.916907 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:28.916881 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-24fh5"] May 21 14:49:29.000654 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:29.000620 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78vkx\" (UniqueName: \"kubernetes.io/projected/ca429100-2a0c-41bd-922e-4fb3f98cee98-kube-api-access-78vkx\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-6kxgg\" (UID: \"ca429100-2a0c-41bd-922e-4fb3f98cee98\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-6kxgg" May 21 14:49:29.000812 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:29.000663 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbrv9\" (UniqueName: \"kubernetes.io/projected/10ba635e-2207-4d7a-a397-35ef76003904-kube-api-access-vbrv9\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-24fh5\" (UID: \"10ba635e-2207-4d7a-a397-35ef76003904\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-24fh5" May 21 14:49:29.000812 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:29.000685 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/10ba635e-2207-4d7a-a397-35ef76003904-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-24fh5\" (UID: \"10ba635e-2207-4d7a-a397-35ef76003904\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-24fh5" May 21 14:49:29.000881 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:29.000809 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ca429100-2a0c-41bd-922e-4fb3f98cee98-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-6kxgg\" (UID: \"ca429100-2a0c-41bd-922e-4fb3f98cee98\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-6kxgg" May 21 14:49:29.075455 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:29.075431 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9t2t2" May 21 14:49:29.077780 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:29.077749 2573 status_manager.go:895] "Failed to get status for pod" podUID="fc414ba3-dfe6-429e-802b-a3d485328aba" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9t2t2" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-9t2t2\" is forbidden: User \"system:node:ip-10-0-134-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-244.ec2.internal' and this object" May 21 14:49:29.101695 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:29.101652 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-78vkx\" (UniqueName: \"kubernetes.io/projected/ca429100-2a0c-41bd-922e-4fb3f98cee98-kube-api-access-78vkx\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-6kxgg\" (UID: \"ca429100-2a0c-41bd-922e-4fb3f98cee98\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-6kxgg" May 21 14:49:29.101848 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:29.101701 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vbrv9\" (UniqueName: \"kubernetes.io/projected/10ba635e-2207-4d7a-a397-35ef76003904-kube-api-access-vbrv9\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-24fh5\" (UID: \"10ba635e-2207-4d7a-a397-35ef76003904\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-24fh5" May 21 14:49:29.101848 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:29.101733 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/10ba635e-2207-4d7a-a397-35ef76003904-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-24fh5\" (UID: \"10ba635e-2207-4d7a-a397-35ef76003904\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-24fh5" May 21 14:49:29.101848 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:29.101800 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ca429100-2a0c-41bd-922e-4fb3f98cee98-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-6kxgg\" (UID: \"ca429100-2a0c-41bd-922e-4fb3f98cee98\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-6kxgg" May 21 14:49:29.102224 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:29.102201 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/10ba635e-2207-4d7a-a397-35ef76003904-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-24fh5\" (UID: \"10ba635e-2207-4d7a-a397-35ef76003904\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-24fh5" May 21 14:49:29.102273 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:29.102201 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ca429100-2a0c-41bd-922e-4fb3f98cee98-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-6kxgg\" (UID: \"ca429100-2a0c-41bd-922e-4fb3f98cee98\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-6kxgg" May 21 14:49:29.109840 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:29.109813 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-78vkx\" (UniqueName: \"kubernetes.io/projected/ca429100-2a0c-41bd-922e-4fb3f98cee98-kube-api-access-78vkx\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-6kxgg\" (UID: \"ca429100-2a0c-41bd-922e-4fb3f98cee98\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-6kxgg" May 21 14:49:29.109942 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:29.109813 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbrv9\" (UniqueName: \"kubernetes.io/projected/10ba635e-2207-4d7a-a397-35ef76003904-kube-api-access-vbrv9\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-24fh5\" (UID: \"10ba635e-2207-4d7a-a397-35ef76003904\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-24fh5" May 21 14:49:29.202541 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:29.202438 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc414ba3-dfe6-429e-802b-a3d485328aba-extensions-socket-volume\") pod \"fc414ba3-dfe6-429e-802b-a3d485328aba\" (UID: \"fc414ba3-dfe6-429e-802b-a3d485328aba\") " May 21 14:49:29.202697 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:29.202546 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x74hc\" (UniqueName: \"kubernetes.io/projected/fc414ba3-dfe6-429e-802b-a3d485328aba-kube-api-access-x74hc\") pod \"fc414ba3-dfe6-429e-802b-a3d485328aba\" (UID: \"fc414ba3-dfe6-429e-802b-a3d485328aba\") " May 21 14:49:29.202820 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:29.202796 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc414ba3-dfe6-429e-802b-a3d485328aba-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "fc414ba3-dfe6-429e-802b-a3d485328aba" (UID: "fc414ba3-dfe6-429e-802b-a3d485328aba"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 14:49:29.204681 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:29.204660 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc414ba3-dfe6-429e-802b-a3d485328aba-kube-api-access-x74hc" (OuterVolumeSpecName: "kube-api-access-x74hc") pod "fc414ba3-dfe6-429e-802b-a3d485328aba" (UID: "fc414ba3-dfe6-429e-802b-a3d485328aba"). InnerVolumeSpecName "kube-api-access-x74hc". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 14:49:29.223407 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:49:29.223375 2573 kuberuntime_manager.go:623] "Missing actuated resource record" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4grfb" container="manager" May 21 14:49:29.224466 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:29.224443 2573 generic.go:358] "Generic (PLEG): container finished" podID="fc414ba3-dfe6-429e-802b-a3d485328aba" containerID="0912ba62fb552aedb7640888ff3dcc44e8e313f7911cacd9d1d9937cace195ee" exitCode=0 May 21 14:49:29.224612 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:29.224486 2573 scope.go:117] "RemoveContainer" containerID="0912ba62fb552aedb7640888ff3dcc44e8e313f7911cacd9d1d9937cace195ee" May 21 14:49:29.224612 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:29.224495 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9t2t2" May 21 14:49:29.225515 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:29.225492 2573 status_manager.go:895] "Failed to get status for pod" podUID="34f92c44-51dc-42ad-9a6d-aceb7adb6822" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4grfb" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-4grfb\" is forbidden: User \"system:node:ip-10-0-134-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-244.ec2.internal' and this object" May 21 14:49:29.227456 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:29.227425 2573 status_manager.go:895] "Failed to get status for pod" podUID="fc414ba3-dfe6-429e-802b-a3d485328aba" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9t2t2" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-9t2t2\" is forbidden: User \"system:node:ip-10-0-134-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-244.ec2.internal' and this object" May 21 14:49:29.229655 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:29.229623 2573 status_manager.go:895] "Failed to get status for pod" podUID="34f92c44-51dc-42ad-9a6d-aceb7adb6822" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4grfb" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-4grfb\" is forbidden: User \"system:node:ip-10-0-134-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-244.ec2.internal' and this object" May 21 14:49:29.231684 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:29.231663 2573 status_manager.go:895] "Failed to get status for pod" podUID="fc414ba3-dfe6-429e-802b-a3d485328aba" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9t2t2" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-9t2t2\" is forbidden: User \"system:node:ip-10-0-134-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-244.ec2.internal' and this object" May 21 14:49:29.233750 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:29.233734 2573 scope.go:117] "RemoveContainer" containerID="0912ba62fb552aedb7640888ff3dcc44e8e313f7911cacd9d1d9937cace195ee" May 21 14:49:29.234036 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:49:29.233985 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0912ba62fb552aedb7640888ff3dcc44e8e313f7911cacd9d1d9937cace195ee\": container with ID starting with 0912ba62fb552aedb7640888ff3dcc44e8e313f7911cacd9d1d9937cace195ee not found: ID does not exist" containerID="0912ba62fb552aedb7640888ff3dcc44e8e313f7911cacd9d1d9937cace195ee" May 21 14:49:29.234103 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:29.234043 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0912ba62fb552aedb7640888ff3dcc44e8e313f7911cacd9d1d9937cace195ee"} err="failed to get container status \"0912ba62fb552aedb7640888ff3dcc44e8e313f7911cacd9d1d9937cace195ee\": rpc error: code = NotFound desc = could not find container \"0912ba62fb552aedb7640888ff3dcc44e8e313f7911cacd9d1d9937cace195ee\": container with ID starting with 0912ba62fb552aedb7640888ff3dcc44e8e313f7911cacd9d1d9937cace195ee not found: ID does not exist" May 21 14:49:29.235116 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:29.235100 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-6kxgg" May 21 14:49:29.235861 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:29.235836 2573 status_manager.go:895] "Failed to get status for pod" podUID="34f92c44-51dc-42ad-9a6d-aceb7adb6822" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4grfb" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-4grfb\" is forbidden: User \"system:node:ip-10-0-134-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-244.ec2.internal' and this object" May 21 14:49:29.237580 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:29.237543 2573 status_manager.go:895] "Failed to get status for pod" podUID="fc414ba3-dfe6-429e-802b-a3d485328aba" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9t2t2" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-9t2t2\" is forbidden: User \"system:node:ip-10-0-134-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-244.ec2.internal' and this object" May 21 14:49:29.243164 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:29.243137 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-24fh5" May 21 14:49:29.303582 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:29.303411 2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc414ba3-dfe6-429e-802b-a3d485328aba-extensions-socket-volume\") on node \"ip-10-0-134-244.ec2.internal\" DevicePath \"\"" May 21 14:49:29.303582 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:29.303443 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x74hc\" (UniqueName: \"kubernetes.io/projected/fc414ba3-dfe6-429e-802b-a3d485328aba-kube-api-access-x74hc\") on node \"ip-10-0-134-244.ec2.internal\" DevicePath \"\"" May 21 14:49:29.398661 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:29.398621 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-6kxgg"] May 21 14:49:29.402039 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:49:29.402003 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca429100_2a0c_41bd_922e_4fb3f98cee98.slice/crio-60af48077a1bd4310734b507f4c2a1b9579d2c0302738179bb094a2e447fbfcb WatchSource:0}: Error finding container 60af48077a1bd4310734b507f4c2a1b9579d2c0302738179bb094a2e447fbfcb: Status 404 returned error can't find the container with id 60af48077a1bd4310734b507f4c2a1b9579d2c0302738179bb094a2e447fbfcb May 21 14:49:29.420113 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:29.420083 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-24fh5"] May 21 14:49:29.425518 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:49:29.425478 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10ba635e_2207_4d7a_a397_35ef76003904.slice/crio-faffe744d9c71995c8b208ae00ec519a7c43aa308b2369042f40046cce8d1c5a WatchSource:0}: Error finding container faffe744d9c71995c8b208ae00ec519a7c43aa308b2369042f40046cce8d1c5a: Status 404 returned error can't find the container with id faffe744d9c71995c8b208ae00ec519a7c43aa308b2369042f40046cce8d1c5a May 21 14:49:29.818475 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:29.818397 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc414ba3-dfe6-429e-802b-a3d485328aba" path="/var/lib/kubelet/pods/fc414ba3-dfe6-429e-802b-a3d485328aba/volumes" May 21 14:49:30.230183 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:30.230149 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-24fh5" event={"ID":"10ba635e-2207-4d7a-a397-35ef76003904","Type":"ContainerStarted","Data":"7c8a9c8a1949e2747c944d6163f97a0a81bd885dfa73e9e81da5d2733c465ae8"} May 21 14:49:30.230183 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:30.230189 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-24fh5" event={"ID":"10ba635e-2207-4d7a-a397-35ef76003904","Type":"ContainerStarted","Data":"faffe744d9c71995c8b208ae00ec519a7c43aa308b2369042f40046cce8d1c5a"} May 21 14:49:30.230445 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:30.230232 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-24fh5" May 21 14:49:30.231658 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:30.231624 2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4grfb" podUID="34f92c44-51dc-42ad-9a6d-aceb7adb6822" containerName="manager" containerID="cri-o://7e7a0b6d95b643e9ba7f56f6f3497be9ef0a912b6cbe1af68d8f9fd27e2d77bb" gracePeriod=2 May 21 14:49:30.233117 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:30.233089 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-6kxgg" event={"ID":"ca429100-2a0c-41bd-922e-4fb3f98cee98","Type":"ContainerStarted","Data":"aecaafe5d1409782d1e963e44c10bb17e022e0129df74115f8efe7dd9a651a12"} May 21 14:49:30.233252 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:30.233123 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-6kxgg" event={"ID":"ca429100-2a0c-41bd-922e-4fb3f98cee98","Type":"ContainerStarted","Data":"60af48077a1bd4310734b507f4c2a1b9579d2c0302738179bb094a2e447fbfcb"} May 21 14:49:30.233252 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:30.233195 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-6kxgg" May 21 14:49:30.251751 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:30.251701 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-24fh5" podStartSLOduration=2.251681919 podStartE2EDuration="2.251681919s" podCreationTimestamp="2026-05-21 14:49:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 14:49:30.249703912 +0000 UTC m=+482.987959444" watchObservedRunningTime="2026-05-21 14:49:30.251681919 +0000 UTC m=+482.989937451" May 21 14:49:30.274721 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:30.274669 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-6kxgg" podStartSLOduration=2.274649156 podStartE2EDuration="2.274649156s" podCreationTimestamp="2026-05-21 14:49:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 14:49:30.273927982 +0000 UTC m=+483.012183553" watchObservedRunningTime="2026-05-21 14:49:30.274649156 +0000 UTC m=+483.012904688" May 21 14:49:30.471500 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:30.471479 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4grfb" May 21 14:49:30.473737 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:30.473708 2573 status_manager.go:895] "Failed to get status for pod" podUID="34f92c44-51dc-42ad-9a6d-aceb7adb6822" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4grfb" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-4grfb\" is forbidden: User \"system:node:ip-10-0-134-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-244.ec2.internal' and this object" May 21 14:49:30.615023 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:30.614913 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g96rg\" (UniqueName: \"kubernetes.io/projected/34f92c44-51dc-42ad-9a6d-aceb7adb6822-kube-api-access-g96rg\") pod \"34f92c44-51dc-42ad-9a6d-aceb7adb6822\" (UID: \"34f92c44-51dc-42ad-9a6d-aceb7adb6822\") " May 21 14:49:30.615023 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:30.614985 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/34f92c44-51dc-42ad-9a6d-aceb7adb6822-extensions-socket-volume\") pod \"34f92c44-51dc-42ad-9a6d-aceb7adb6822\" (UID: \"34f92c44-51dc-42ad-9a6d-aceb7adb6822\") " May 21 14:49:30.615326 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:30.615299 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34f92c44-51dc-42ad-9a6d-aceb7adb6822-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "34f92c44-51dc-42ad-9a6d-aceb7adb6822" (UID: "34f92c44-51dc-42ad-9a6d-aceb7adb6822"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 14:49:30.617028 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:30.616985 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34f92c44-51dc-42ad-9a6d-aceb7adb6822-kube-api-access-g96rg" (OuterVolumeSpecName: "kube-api-access-g96rg") pod "34f92c44-51dc-42ad-9a6d-aceb7adb6822" (UID: "34f92c44-51dc-42ad-9a6d-aceb7adb6822"). InnerVolumeSpecName "kube-api-access-g96rg". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 14:49:30.715919 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:30.715885 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g96rg\" (UniqueName: \"kubernetes.io/projected/34f92c44-51dc-42ad-9a6d-aceb7adb6822-kube-api-access-g96rg\") on node \"ip-10-0-134-244.ec2.internal\" DevicePath \"\"" May 21 14:49:30.715919 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:30.715916 2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/34f92c44-51dc-42ad-9a6d-aceb7adb6822-extensions-socket-volume\") on node \"ip-10-0-134-244.ec2.internal\" DevicePath \"\"" May 21 14:49:31.238399 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:31.238361 2573 generic.go:358] "Generic (PLEG): container finished" podID="34f92c44-51dc-42ad-9a6d-aceb7adb6822" containerID="7e7a0b6d95b643e9ba7f56f6f3497be9ef0a912b6cbe1af68d8f9fd27e2d77bb" exitCode=0 May 21 14:49:31.238589 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:31.238428 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4grfb" May 21 14:49:31.238589 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:31.238454 2573 scope.go:117] "RemoveContainer" containerID="7e7a0b6d95b643e9ba7f56f6f3497be9ef0a912b6cbe1af68d8f9fd27e2d77bb" May 21 14:49:31.240653 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:31.240621 2573 status_manager.go:895] "Failed to get status for pod" podUID="34f92c44-51dc-42ad-9a6d-aceb7adb6822" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4grfb" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-4grfb\" is forbidden: User \"system:node:ip-10-0-134-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-244.ec2.internal' and this object" May 21 14:49:31.246856 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:31.246841 2573 scope.go:117] "RemoveContainer" containerID="7e7a0b6d95b643e9ba7f56f6f3497be9ef0a912b6cbe1af68d8f9fd27e2d77bb" May 21 14:49:31.247121 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:49:31.247100 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e7a0b6d95b643e9ba7f56f6f3497be9ef0a912b6cbe1af68d8f9fd27e2d77bb\": container with ID starting with 7e7a0b6d95b643e9ba7f56f6f3497be9ef0a912b6cbe1af68d8f9fd27e2d77bb not found: ID does not exist" containerID="7e7a0b6d95b643e9ba7f56f6f3497be9ef0a912b6cbe1af68d8f9fd27e2d77bb" May 21 14:49:31.247184 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:31.247130 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e7a0b6d95b643e9ba7f56f6f3497be9ef0a912b6cbe1af68d8f9fd27e2d77bb"} err="failed to get container status \"7e7a0b6d95b643e9ba7f56f6f3497be9ef0a912b6cbe1af68d8f9fd27e2d77bb\": rpc error: code = NotFound desc = could not find container \"7e7a0b6d95b643e9ba7f56f6f3497be9ef0a912b6cbe1af68d8f9fd27e2d77bb\": container with ID starting with 7e7a0b6d95b643e9ba7f56f6f3497be9ef0a912b6cbe1af68d8f9fd27e2d77bb not found: ID does not exist" May 21 14:49:31.248865 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:31.248844 2573 status_manager.go:895] "Failed to get status for pod" podUID="34f92c44-51dc-42ad-9a6d-aceb7adb6822" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4grfb" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-4grfb\" is forbidden: User \"system:node:ip-10-0-134-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-244.ec2.internal' and this object" May 21 14:49:31.817835 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:31.817805 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34f92c44-51dc-42ad-9a6d-aceb7adb6822" path="/var/lib/kubelet/pods/34f92c44-51dc-42ad-9a6d-aceb7adb6822/volumes" May 21 14:49:41.241365 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:41.241331 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-24fh5" May 21 14:49:41.241776 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:41.241385 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-6kxgg" May 21 14:49:41.315346 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:41.315310 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-6kxgg"] May 21 14:49:41.315591 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:41.315565 2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-6kxgg" podUID="ca429100-2a0c-41bd-922e-4fb3f98cee98" containerName="manager" containerID="cri-o://aecaafe5d1409782d1e963e44c10bb17e022e0129df74115f8efe7dd9a651a12" gracePeriod=10 May 21 14:49:41.520200 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:41.520108 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-c8n8s"] May 21 14:49:41.523819 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:41.523802 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-c8n8s" May 21 14:49:41.538097 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:41.538057 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-c8n8s"] May 21 14:49:41.584554 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:41.584525 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-6kxgg" May 21 14:49:41.701687 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:41.701650 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ca429100-2a0c-41bd-922e-4fb3f98cee98-extensions-socket-volume\") pod \"ca429100-2a0c-41bd-922e-4fb3f98cee98\" (UID: \"ca429100-2a0c-41bd-922e-4fb3f98cee98\") " May 21 14:49:41.701687 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:41.701707 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-78vkx\" (UniqueName: \"kubernetes.io/projected/ca429100-2a0c-41bd-922e-4fb3f98cee98-kube-api-access-78vkx\") pod \"ca429100-2a0c-41bd-922e-4fb3f98cee98\" (UID: \"ca429100-2a0c-41bd-922e-4fb3f98cee98\") " May 21 14:49:41.701882 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:41.701853 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbp9k\" (UniqueName: \"kubernetes.io/projected/5a0ec8b9-b26b-4df7-9248-03755639d10a-kube-api-access-mbp9k\") pod \"kuadrant-operator-controller-manager-55c7f4c975-c8n8s\" (UID: \"5a0ec8b9-b26b-4df7-9248-03755639d10a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-c8n8s" May 21 14:49:41.701985 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:41.701954 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5a0ec8b9-b26b-4df7-9248-03755639d10a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-c8n8s\" (UID: \"5a0ec8b9-b26b-4df7-9248-03755639d10a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-c8n8s" May 21 14:49:41.702192 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:41.702172 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca429100-2a0c-41bd-922e-4fb3f98cee98-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ca429100-2a0c-41bd-922e-4fb3f98cee98" (UID: "ca429100-2a0c-41bd-922e-4fb3f98cee98"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 14:49:41.704033 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:41.703988 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca429100-2a0c-41bd-922e-4fb3f98cee98-kube-api-access-78vkx" (OuterVolumeSpecName: "kube-api-access-78vkx") pod "ca429100-2a0c-41bd-922e-4fb3f98cee98" (UID: "ca429100-2a0c-41bd-922e-4fb3f98cee98"). InnerVolumeSpecName "kube-api-access-78vkx". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 14:49:41.802779 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:41.802666 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mbp9k\" (UniqueName: \"kubernetes.io/projected/5a0ec8b9-b26b-4df7-9248-03755639d10a-kube-api-access-mbp9k\") pod \"kuadrant-operator-controller-manager-55c7f4c975-c8n8s\" (UID: \"5a0ec8b9-b26b-4df7-9248-03755639d10a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-c8n8s" May 21 14:49:41.802779 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:41.802749 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5a0ec8b9-b26b-4df7-9248-03755639d10a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-c8n8s\" (UID: \"5a0ec8b9-b26b-4df7-9248-03755639d10a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-c8n8s" May 21 14:49:41.802983 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:41.802787 2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ca429100-2a0c-41bd-922e-4fb3f98cee98-extensions-socket-volume\") on node \"ip-10-0-134-244.ec2.internal\" DevicePath \"\"" May 21 14:49:41.802983 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:41.802797 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-78vkx\" (UniqueName: \"kubernetes.io/projected/ca429100-2a0c-41bd-922e-4fb3f98cee98-kube-api-access-78vkx\") on node \"ip-10-0-134-244.ec2.internal\" DevicePath \"\"" May 21 14:49:41.803162 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:41.803145 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5a0ec8b9-b26b-4df7-9248-03755639d10a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-c8n8s\" (UID: \"5a0ec8b9-b26b-4df7-9248-03755639d10a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-c8n8s" May 21 14:49:41.812362 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:41.812330 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbp9k\" (UniqueName: \"kubernetes.io/projected/5a0ec8b9-b26b-4df7-9248-03755639d10a-kube-api-access-mbp9k\") pod \"kuadrant-operator-controller-manager-55c7f4c975-c8n8s\" (UID: \"5a0ec8b9-b26b-4df7-9248-03755639d10a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-c8n8s" May 21 14:49:41.834316 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:41.834265 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-c8n8s" May 21 14:49:41.974423 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:41.974396 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-c8n8s"] May 21 14:49:41.977524 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:49:41.977492 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a0ec8b9_b26b_4df7_9248_03755639d10a.slice/crio-18eed346a03b42c359816fa18e0075c5b3453f2aded399e81e88339f8a8f6652 WatchSource:0}: Error finding container 18eed346a03b42c359816fa18e0075c5b3453f2aded399e81e88339f8a8f6652: Status 404 returned error can't find the container with id 18eed346a03b42c359816fa18e0075c5b3453f2aded399e81e88339f8a8f6652 May 21 14:49:42.279064 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:42.278978 2573 generic.go:358] "Generic (PLEG): container finished" podID="ca429100-2a0c-41bd-922e-4fb3f98cee98" containerID="aecaafe5d1409782d1e963e44c10bb17e022e0129df74115f8efe7dd9a651a12" exitCode=0 May 21 14:49:42.279064 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:42.279060 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-6kxgg" May 21 14:49:42.279064 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:42.279061 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-6kxgg" event={"ID":"ca429100-2a0c-41bd-922e-4fb3f98cee98","Type":"ContainerDied","Data":"aecaafe5d1409782d1e963e44c10bb17e022e0129df74115f8efe7dd9a651a12"} May 21 14:49:42.279637 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:42.279099 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-6kxgg" event={"ID":"ca429100-2a0c-41bd-922e-4fb3f98cee98","Type":"ContainerDied","Data":"60af48077a1bd4310734b507f4c2a1b9579d2c0302738179bb094a2e447fbfcb"} May 21 14:49:42.279637 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:42.279122 2573 scope.go:117] "RemoveContainer" containerID="aecaafe5d1409782d1e963e44c10bb17e022e0129df74115f8efe7dd9a651a12" May 21 14:49:42.280693 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:42.280668 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-c8n8s" event={"ID":"5a0ec8b9-b26b-4df7-9248-03755639d10a","Type":"ContainerStarted","Data":"7cf5d0ef8e673e3c6e4f71d33b3680860a4f811d7b71969a27d173ef70b01f7f"} May 21 14:49:42.280821 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:42.280700 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-c8n8s" event={"ID":"5a0ec8b9-b26b-4df7-9248-03755639d10a","Type":"ContainerStarted","Data":"18eed346a03b42c359816fa18e0075c5b3453f2aded399e81e88339f8a8f6652"} May 21 14:49:42.280821 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:42.280770 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-c8n8s" May 21 14:49:42.287830 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:42.287811 2573 scope.go:117] "RemoveContainer" containerID="aecaafe5d1409782d1e963e44c10bb17e022e0129df74115f8efe7dd9a651a12" May 21 14:49:42.288456 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:49:42.288435 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aecaafe5d1409782d1e963e44c10bb17e022e0129df74115f8efe7dd9a651a12\": container with ID starting with aecaafe5d1409782d1e963e44c10bb17e022e0129df74115f8efe7dd9a651a12 not found: ID does not exist" containerID="aecaafe5d1409782d1e963e44c10bb17e022e0129df74115f8efe7dd9a651a12" May 21 14:49:42.288507 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:42.288465 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aecaafe5d1409782d1e963e44c10bb17e022e0129df74115f8efe7dd9a651a12"} err="failed to get container status \"aecaafe5d1409782d1e963e44c10bb17e022e0129df74115f8efe7dd9a651a12\": rpc error: code = NotFound desc = could not find container \"aecaafe5d1409782d1e963e44c10bb17e022e0129df74115f8efe7dd9a651a12\": container with ID starting with aecaafe5d1409782d1e963e44c10bb17e022e0129df74115f8efe7dd9a651a12 not found: ID does not exist" May 21 14:49:42.298932 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:42.298897 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-6kxgg"] May 21 14:49:42.303280 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:42.303247 2573 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-6kxgg"] May 21 14:49:42.323685 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:42.323628 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-c8n8s" podStartSLOduration=1.323610036 podStartE2EDuration="1.323610036s" podCreationTimestamp="2026-05-21 14:49:41 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 14:49:42.322492218 +0000 UTC m=+495.060747750" watchObservedRunningTime="2026-05-21 14:49:42.323610036 +0000 UTC m=+495.061865566" May 21 14:49:43.817292 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:43.817254 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca429100-2a0c-41bd-922e-4fb3f98cee98" path="/var/lib/kubelet/pods/ca429100-2a0c-41bd-922e-4fb3f98cee98/volumes" May 21 14:49:53.288132 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:53.288100 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-c8n8s" May 21 14:49:53.337397 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:53.337359 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-24fh5"] May 21 14:49:53.337657 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:53.337627 2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-24fh5" podUID="10ba635e-2207-4d7a-a397-35ef76003904" containerName="manager" containerID="cri-o://7c8a9c8a1949e2747c944d6163f97a0a81bd885dfa73e9e81da5d2733c465ae8" gracePeriod=10 May 21 14:49:53.590387 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:53.590360 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-24fh5" May 21 14:49:53.694645 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:53.694607 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vbrv9\" (UniqueName: \"kubernetes.io/projected/10ba635e-2207-4d7a-a397-35ef76003904-kube-api-access-vbrv9\") pod \"10ba635e-2207-4d7a-a397-35ef76003904\" (UID: \"10ba635e-2207-4d7a-a397-35ef76003904\") " May 21 14:49:53.694834 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:53.694667 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/10ba635e-2207-4d7a-a397-35ef76003904-extensions-socket-volume\") pod \"10ba635e-2207-4d7a-a397-35ef76003904\" (UID: \"10ba635e-2207-4d7a-a397-35ef76003904\") " May 21 14:49:53.695078 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:53.695053 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10ba635e-2207-4d7a-a397-35ef76003904-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "10ba635e-2207-4d7a-a397-35ef76003904" (UID: "10ba635e-2207-4d7a-a397-35ef76003904"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 14:49:53.696827 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:53.696795 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10ba635e-2207-4d7a-a397-35ef76003904-kube-api-access-vbrv9" (OuterVolumeSpecName: "kube-api-access-vbrv9") pod "10ba635e-2207-4d7a-a397-35ef76003904" (UID: "10ba635e-2207-4d7a-a397-35ef76003904"). InnerVolumeSpecName "kube-api-access-vbrv9". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 14:49:53.796006 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:53.795950 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vbrv9\" (UniqueName: \"kubernetes.io/projected/10ba635e-2207-4d7a-a397-35ef76003904-kube-api-access-vbrv9\") on node \"ip-10-0-134-244.ec2.internal\" DevicePath \"\"" May 21 14:49:53.796006 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:53.795986 2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/10ba635e-2207-4d7a-a397-35ef76003904-extensions-socket-volume\") on node \"ip-10-0-134-244.ec2.internal\" DevicePath \"\"" May 21 14:49:54.322320 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:54.322279 2573 generic.go:358] "Generic (PLEG): container finished" podID="10ba635e-2207-4d7a-a397-35ef76003904" containerID="7c8a9c8a1949e2747c944d6163f97a0a81bd885dfa73e9e81da5d2733c465ae8" exitCode=0 May 21 14:49:54.322812 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:54.322365 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-24fh5" event={"ID":"10ba635e-2207-4d7a-a397-35ef76003904","Type":"ContainerDied","Data":"7c8a9c8a1949e2747c944d6163f97a0a81bd885dfa73e9e81da5d2733c465ae8"} May 21 14:49:54.322812 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:54.322382 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-24fh5" May 21 14:49:54.322812 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:54.322408 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-24fh5" event={"ID":"10ba635e-2207-4d7a-a397-35ef76003904","Type":"ContainerDied","Data":"faffe744d9c71995c8b208ae00ec519a7c43aa308b2369042f40046cce8d1c5a"} May 21 14:49:54.322812 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:54.322425 2573 scope.go:117] "RemoveContainer" containerID="7c8a9c8a1949e2747c944d6163f97a0a81bd885dfa73e9e81da5d2733c465ae8" May 21 14:49:54.331961 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:54.331941 2573 scope.go:117] "RemoveContainer" containerID="7c8a9c8a1949e2747c944d6163f97a0a81bd885dfa73e9e81da5d2733c465ae8" May 21 14:49:54.332308 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:49:54.332287 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c8a9c8a1949e2747c944d6163f97a0a81bd885dfa73e9e81da5d2733c465ae8\": container with ID starting with 7c8a9c8a1949e2747c944d6163f97a0a81bd885dfa73e9e81da5d2733c465ae8 not found: ID does not exist" containerID="7c8a9c8a1949e2747c944d6163f97a0a81bd885dfa73e9e81da5d2733c465ae8" May 21 14:49:54.332370 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:54.332318 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c8a9c8a1949e2747c944d6163f97a0a81bd885dfa73e9e81da5d2733c465ae8"} err="failed to get container status \"7c8a9c8a1949e2747c944d6163f97a0a81bd885dfa73e9e81da5d2733c465ae8\": rpc error: code = NotFound desc = could not find container \"7c8a9c8a1949e2747c944d6163f97a0a81bd885dfa73e9e81da5d2733c465ae8\": container with ID starting with 7c8a9c8a1949e2747c944d6163f97a0a81bd885dfa73e9e81da5d2733c465ae8 not found: ID does not exist" May 21 14:49:54.342927 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:54.342900 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-24fh5"] May 21 14:49:54.347187 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:54.347159 2573 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-24fh5"] May 21 14:49:55.817464 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:49:55.817418 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="10ba635e-2207-4d7a-a397-35ef76003904" path="/var/lib/kubelet/pods/10ba635e-2207-4d7a-a397-35ef76003904/volumes" May 21 14:50:12.477775 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:12.477739 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-zph6g"] May 21 14:50:12.478218 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:12.478027 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca429100-2a0c-41bd-922e-4fb3f98cee98" containerName="manager" May 21 14:50:12.478218 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:12.478039 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca429100-2a0c-41bd-922e-4fb3f98cee98" containerName="manager" May 21 14:50:12.478218 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:12.478056 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10ba635e-2207-4d7a-a397-35ef76003904" containerName="manager" May 21 14:50:12.478218 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:12.478061 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="10ba635e-2207-4d7a-a397-35ef76003904" containerName="manager" May 21 14:50:12.478218 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:12.478113 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="ca429100-2a0c-41bd-922e-4fb3f98cee98" containerName="manager" May 21 14:50:12.478218 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:12.478120 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="10ba635e-2207-4d7a-a397-35ef76003904" containerName="manager" May 21 14:50:12.482395 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:12.482373 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-zph6g" May 21 14:50:12.484777 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:12.484755 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" May 21 14:50:12.484885 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:12.484799 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-87hpf\"" May 21 14:50:12.488210 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:12.488180 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-zph6g"] May 21 14:50:12.539724 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:12.539690 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqckw\" (UniqueName: \"kubernetes.io/projected/77e9b5f0-4671-4d61-8a56-aface9ebbf4a-kube-api-access-bqckw\") pod \"limitador-limitador-7d549b5b-zph6g\" (UID: \"77e9b5f0-4671-4d61-8a56-aface9ebbf4a\") " pod="kuadrant-system/limitador-limitador-7d549b5b-zph6g" May 21 14:50:12.539854 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:12.539812 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/77e9b5f0-4671-4d61-8a56-aface9ebbf4a-config-file\") pod \"limitador-limitador-7d549b5b-zph6g\" (UID: \"77e9b5f0-4671-4d61-8a56-aface9ebbf4a\") " pod="kuadrant-system/limitador-limitador-7d549b5b-zph6g" May 21 14:50:12.581058 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:12.580990 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-zph6g"] May 21 14:50:12.640942 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:12.640904 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bqckw\" (UniqueName: \"kubernetes.io/projected/77e9b5f0-4671-4d61-8a56-aface9ebbf4a-kube-api-access-bqckw\") pod \"limitador-limitador-7d549b5b-zph6g\" (UID: \"77e9b5f0-4671-4d61-8a56-aface9ebbf4a\") " pod="kuadrant-system/limitador-limitador-7d549b5b-zph6g" May 21 14:50:12.641158 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:12.641044 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/77e9b5f0-4671-4d61-8a56-aface9ebbf4a-config-file\") pod \"limitador-limitador-7d549b5b-zph6g\" (UID: \"77e9b5f0-4671-4d61-8a56-aface9ebbf4a\") " pod="kuadrant-system/limitador-limitador-7d549b5b-zph6g" May 21 14:50:12.641650 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:12.641626 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/77e9b5f0-4671-4d61-8a56-aface9ebbf4a-config-file\") pod \"limitador-limitador-7d549b5b-zph6g\" (UID: \"77e9b5f0-4671-4d61-8a56-aface9ebbf4a\") " pod="kuadrant-system/limitador-limitador-7d549b5b-zph6g" May 21 14:50:12.648408 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:12.648379 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqckw\" (UniqueName: \"kubernetes.io/projected/77e9b5f0-4671-4d61-8a56-aface9ebbf4a-kube-api-access-bqckw\") pod \"limitador-limitador-7d549b5b-zph6g\" (UID: \"77e9b5f0-4671-4d61-8a56-aface9ebbf4a\") " pod="kuadrant-system/limitador-limitador-7d549b5b-zph6g" May 21 14:50:12.794281 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:12.794176 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-zph6g" May 21 14:50:12.925721 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:12.925543 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-zph6g"] May 21 14:50:13.389696 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:13.389650 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-zph6g" event={"ID":"77e9b5f0-4671-4d61-8a56-aface9ebbf4a","Type":"ContainerStarted","Data":"773094d25e118bcf9b5d0066233fa8dded985c0e46add2a597c71bd40ec3faa3"} May 21 14:50:16.404096 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:16.404056 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-zph6g" event={"ID":"77e9b5f0-4671-4d61-8a56-aface9ebbf4a","Type":"ContainerStarted","Data":"9eb6284ac5db4f41dab6436fa95369dd2ea5ffcd9e9aa238dd0a1d105f4f8255"} May 21 14:50:16.404577 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:16.404173 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-zph6g" May 21 14:50:16.419882 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:16.419819 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-zph6g" podStartSLOduration=1.78045282 podStartE2EDuration="4.41980351s" podCreationTimestamp="2026-05-21 14:50:12 +0000 UTC" firstStartedPulling="2026-05-21 14:50:12.932067841 +0000 UTC m=+525.670323350" lastFinishedPulling="2026-05-21 14:50:15.571418531 +0000 UTC m=+528.309674040" observedRunningTime="2026-05-21 14:50:16.418496347 +0000 UTC m=+529.156751891" watchObservedRunningTime="2026-05-21 14:50:16.41980351 +0000 UTC m=+529.158059041" May 21 14:50:27.408952 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:27.408920 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-zph6g" May 21 14:50:27.817715 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:27.817684 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-zph6g"] May 21 14:50:27.817966 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:27.817917 2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-zph6g" podUID="77e9b5f0-4671-4d61-8a56-aface9ebbf4a" containerName="limitador" containerID="cri-o://9eb6284ac5db4f41dab6436fa95369dd2ea5ffcd9e9aa238dd0a1d105f4f8255" gracePeriod=30 May 21 14:50:28.361150 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:28.361124 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-zph6g" May 21 14:50:28.444497 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:28.444400 2573 generic.go:358] "Generic (PLEG): container finished" podID="77e9b5f0-4671-4d61-8a56-aface9ebbf4a" containerID="9eb6284ac5db4f41dab6436fa95369dd2ea5ffcd9e9aa238dd0a1d105f4f8255" exitCode=0 May 21 14:50:28.444497 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:28.444472 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-zph6g" May 21 14:50:28.444972 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:28.444492 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-zph6g" event={"ID":"77e9b5f0-4671-4d61-8a56-aface9ebbf4a","Type":"ContainerDied","Data":"9eb6284ac5db4f41dab6436fa95369dd2ea5ffcd9e9aa238dd0a1d105f4f8255"} May 21 14:50:28.444972 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:28.444533 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-zph6g" event={"ID":"77e9b5f0-4671-4d61-8a56-aface9ebbf4a","Type":"ContainerDied","Data":"773094d25e118bcf9b5d0066233fa8dded985c0e46add2a597c71bd40ec3faa3"} May 21 14:50:28.444972 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:28.444558 2573 scope.go:117] "RemoveContainer" containerID="9eb6284ac5db4f41dab6436fa95369dd2ea5ffcd9e9aa238dd0a1d105f4f8255" May 21 14:50:28.452060 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:28.452037 2573 scope.go:117] "RemoveContainer" containerID="9eb6284ac5db4f41dab6436fa95369dd2ea5ffcd9e9aa238dd0a1d105f4f8255" May 21 14:50:28.452344 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:50:28.452321 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9eb6284ac5db4f41dab6436fa95369dd2ea5ffcd9e9aa238dd0a1d105f4f8255\": container with ID starting with 9eb6284ac5db4f41dab6436fa95369dd2ea5ffcd9e9aa238dd0a1d105f4f8255 not found: ID does not exist" containerID="9eb6284ac5db4f41dab6436fa95369dd2ea5ffcd9e9aa238dd0a1d105f4f8255" May 21 14:50:28.452410 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:28.452356 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9eb6284ac5db4f41dab6436fa95369dd2ea5ffcd9e9aa238dd0a1d105f4f8255"} err="failed to get container status \"9eb6284ac5db4f41dab6436fa95369dd2ea5ffcd9e9aa238dd0a1d105f4f8255\": rpc error: code = NotFound desc = could not find container \"9eb6284ac5db4f41dab6436fa95369dd2ea5ffcd9e9aa238dd0a1d105f4f8255\": container with ID starting with 9eb6284ac5db4f41dab6436fa95369dd2ea5ffcd9e9aa238dd0a1d105f4f8255 not found: ID does not exist" May 21 14:50:28.479702 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:28.479670 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/77e9b5f0-4671-4d61-8a56-aface9ebbf4a-config-file\") pod \"77e9b5f0-4671-4d61-8a56-aface9ebbf4a\" (UID: \"77e9b5f0-4671-4d61-8a56-aface9ebbf4a\") " May 21 14:50:28.479831 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:28.479724 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bqckw\" (UniqueName: \"kubernetes.io/projected/77e9b5f0-4671-4d61-8a56-aface9ebbf4a-kube-api-access-bqckw\") pod \"77e9b5f0-4671-4d61-8a56-aface9ebbf4a\" (UID: \"77e9b5f0-4671-4d61-8a56-aface9ebbf4a\") " May 21 14:50:28.480068 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:28.480047 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77e9b5f0-4671-4d61-8a56-aface9ebbf4a-config-file" (OuterVolumeSpecName: "config-file") pod "77e9b5f0-4671-4d61-8a56-aface9ebbf4a" (UID: "77e9b5f0-4671-4d61-8a56-aface9ebbf4a"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 14:50:28.481752 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:28.481731 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77e9b5f0-4671-4d61-8a56-aface9ebbf4a-kube-api-access-bqckw" (OuterVolumeSpecName: "kube-api-access-bqckw") pod "77e9b5f0-4671-4d61-8a56-aface9ebbf4a" (UID: "77e9b5f0-4671-4d61-8a56-aface9ebbf4a"). InnerVolumeSpecName "kube-api-access-bqckw". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 14:50:28.581089 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:28.581046 2573 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/77e9b5f0-4671-4d61-8a56-aface9ebbf4a-config-file\") on node \"ip-10-0-134-244.ec2.internal\" DevicePath \"\"" May 21 14:50:28.581089 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:28.581083 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bqckw\" (UniqueName: \"kubernetes.io/projected/77e9b5f0-4671-4d61-8a56-aface9ebbf4a-kube-api-access-bqckw\") on node \"ip-10-0-134-244.ec2.internal\" DevicePath \"\"" May 21 14:50:28.763970 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:28.763920 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-zph6g"] May 21 14:50:28.765477 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:28.765453 2573 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-zph6g"] May 21 14:50:29.817400 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:29.817364 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77e9b5f0-4671-4d61-8a56-aface9ebbf4a" path="/var/lib/kubelet/pods/77e9b5f0-4671-4d61-8a56-aface9ebbf4a/volumes" May 21 14:50:33.459258 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:33.459224 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-68c4fbbd6f-4stt6"] May 21 14:50:33.459690 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:33.459520 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77e9b5f0-4671-4d61-8a56-aface9ebbf4a" containerName="limitador" May 21 14:50:33.459690 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:33.459535 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="77e9b5f0-4671-4d61-8a56-aface9ebbf4a" containerName="limitador" May 21 14:50:33.459690 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:33.459613 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="77e9b5f0-4671-4d61-8a56-aface9ebbf4a" containerName="limitador" May 21 14:50:33.464145 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:33.464121 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-4stt6" May 21 14:50:33.466411 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:33.466386 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-tmk7c\"" May 21 14:50:33.466411 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:33.466387 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" May 21 14:50:33.473987 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:33.470744 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-4stt6"] May 21 14:50:33.621855 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:33.621814 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4x4g\" (UniqueName: \"kubernetes.io/projected/289fa814-048a-4018-93a6-eda2431e210b-kube-api-access-v4x4g\") pod \"postgres-68c4fbbd6f-4stt6\" (UID: \"289fa814-048a-4018-93a6-eda2431e210b\") " pod="opendatahub/postgres-68c4fbbd6f-4stt6" May 21 14:50:33.622059 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:33.621872 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/289fa814-048a-4018-93a6-eda2431e210b-data\") pod \"postgres-68c4fbbd6f-4stt6\" (UID: \"289fa814-048a-4018-93a6-eda2431e210b\") " pod="opendatahub/postgres-68c4fbbd6f-4stt6" May 21 14:50:33.722529 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:33.722435 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v4x4g\" (UniqueName: \"kubernetes.io/projected/289fa814-048a-4018-93a6-eda2431e210b-kube-api-access-v4x4g\") pod \"postgres-68c4fbbd6f-4stt6\" (UID: \"289fa814-048a-4018-93a6-eda2431e210b\") " pod="opendatahub/postgres-68c4fbbd6f-4stt6" May 21 14:50:33.722529 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:33.722510 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/289fa814-048a-4018-93a6-eda2431e210b-data\") pod \"postgres-68c4fbbd6f-4stt6\" (UID: \"289fa814-048a-4018-93a6-eda2431e210b\") " pod="opendatahub/postgres-68c4fbbd6f-4stt6" May 21 14:50:33.722846 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:33.722829 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/289fa814-048a-4018-93a6-eda2431e210b-data\") pod \"postgres-68c4fbbd6f-4stt6\" (UID: \"289fa814-048a-4018-93a6-eda2431e210b\") " pod="opendatahub/postgres-68c4fbbd6f-4stt6" May 21 14:50:33.730762 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:33.730721 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4x4g\" (UniqueName: \"kubernetes.io/projected/289fa814-048a-4018-93a6-eda2431e210b-kube-api-access-v4x4g\") pod \"postgres-68c4fbbd6f-4stt6\" (UID: \"289fa814-048a-4018-93a6-eda2431e210b\") " pod="opendatahub/postgres-68c4fbbd6f-4stt6" May 21 14:50:33.781346 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:33.781309 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-4stt6" May 21 14:50:33.917940 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:33.917911 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-4stt6"] May 21 14:50:33.920598 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:50:33.920561 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod289fa814_048a_4018_93a6_eda2431e210b.slice/crio-22123eb3f13970ccfa710164fcac5cb6be2c230c956ac76144cf42c597e53dac WatchSource:0}: Error finding container 22123eb3f13970ccfa710164fcac5cb6be2c230c956ac76144cf42c597e53dac: Status 404 returned error can't find the container with id 22123eb3f13970ccfa710164fcac5cb6be2c230c956ac76144cf42c597e53dac May 21 14:50:34.467642 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:34.467603 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-4stt6" event={"ID":"289fa814-048a-4018-93a6-eda2431e210b","Type":"ContainerStarted","Data":"22123eb3f13970ccfa710164fcac5cb6be2c230c956ac76144cf42c597e53dac"} May 21 14:50:39.485910 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:39.485870 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-4stt6" event={"ID":"289fa814-048a-4018-93a6-eda2431e210b","Type":"ContainerStarted","Data":"cebc4352f0b6023278dffd88566aecea63bf30db0f0e08f0536bf861d28bbdc8"} May 21 14:50:39.486317 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:39.485980 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-68c4fbbd6f-4stt6" May 21 14:50:39.504152 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:39.504103 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/postgres-68c4fbbd6f-4stt6" podStartSLOduration=1.611712067 podStartE2EDuration="6.50408752s" podCreationTimestamp="2026-05-21 14:50:33 +0000 UTC" firstStartedPulling="2026-05-21 14:50:33.922085385 +0000 UTC m=+546.660340894" lastFinishedPulling="2026-05-21 14:50:38.814460835 +0000 UTC m=+551.552716347" observedRunningTime="2026-05-21 14:50:39.502304071 +0000 UTC m=+552.240559602" watchObservedRunningTime="2026-05-21 14:50:39.50408752 +0000 UTC m=+552.242343051" May 21 14:50:45.518186 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:45.518157 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-68c4fbbd6f-4stt6" May 21 14:50:51.199624 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:51.199583 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-qwb7m"] May 21 14:50:51.206260 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:51.206236 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68fb5d86bc-qwb7m" May 21 14:50:51.208581 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:51.208558 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-qsb46\"" May 21 14:50:51.208726 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:51.208559 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" May 21 14:50:51.214231 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:51.214203 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-qwb7m"] May 21 14:50:51.273721 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:51.273688 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tlcn\" (UniqueName: \"kubernetes.io/projected/3c7f0d40-973c-492e-beb2-53ee2613c801-kube-api-access-2tlcn\") pod \"maas-controller-68fb5d86bc-qwb7m\" (UID: \"3c7f0d40-973c-492e-beb2-53ee2613c801\") " pod="opendatahub/maas-controller-68fb5d86bc-qwb7m" May 21 14:50:51.339251 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:51.339212 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-f47856db8-v7fm4"] May 21 14:50:51.343511 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:51.343487 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f47856db8-v7fm4" May 21 14:50:51.349211 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:51.349184 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-f47856db8-v7fm4"] May 21 14:50:51.374706 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:51.374669 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dr7q\" (UniqueName: \"kubernetes.io/projected/221baf01-d25a-4f5f-9797-81e0db8e4b0d-kube-api-access-2dr7q\") pod \"maas-controller-f47856db8-v7fm4\" (UID: \"221baf01-d25a-4f5f-9797-81e0db8e4b0d\") " pod="opendatahub/maas-controller-f47856db8-v7fm4" May 21 14:50:51.374864 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:51.374754 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2tlcn\" (UniqueName: \"kubernetes.io/projected/3c7f0d40-973c-492e-beb2-53ee2613c801-kube-api-access-2tlcn\") pod \"maas-controller-68fb5d86bc-qwb7m\" (UID: \"3c7f0d40-973c-492e-beb2-53ee2613c801\") " pod="opendatahub/maas-controller-68fb5d86bc-qwb7m" May 21 14:50:51.382908 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:51.382880 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tlcn\" (UniqueName: \"kubernetes.io/projected/3c7f0d40-973c-492e-beb2-53ee2613c801-kube-api-access-2tlcn\") pod \"maas-controller-68fb5d86bc-qwb7m\" (UID: \"3c7f0d40-973c-492e-beb2-53ee2613c801\") " pod="opendatahub/maas-controller-68fb5d86bc-qwb7m" May 21 14:50:51.475756 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:51.475666 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2dr7q\" (UniqueName: \"kubernetes.io/projected/221baf01-d25a-4f5f-9797-81e0db8e4b0d-kube-api-access-2dr7q\") pod \"maas-controller-f47856db8-v7fm4\" (UID: \"221baf01-d25a-4f5f-9797-81e0db8e4b0d\") " pod="opendatahub/maas-controller-f47856db8-v7fm4" May 21 14:50:51.485863 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:51.485840 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dr7q\" (UniqueName: \"kubernetes.io/projected/221baf01-d25a-4f5f-9797-81e0db8e4b0d-kube-api-access-2dr7q\") pod \"maas-controller-f47856db8-v7fm4\" (UID: \"221baf01-d25a-4f5f-9797-81e0db8e4b0d\") " pod="opendatahub/maas-controller-f47856db8-v7fm4" May 21 14:50:51.489237 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:51.489212 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-qwb7m"] May 21 14:50:51.489453 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:51.489439 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68fb5d86bc-qwb7m" May 21 14:50:51.545907 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:51.545741 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6f8d89fdcd-k5g59"] May 21 14:50:51.551730 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:51.551701 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f8d89fdcd-k5g59" May 21 14:50:51.560577 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:51.560547 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6f8d89fdcd-k5g59"] May 21 14:50:51.577158 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:51.577128 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpnbg\" (UniqueName: \"kubernetes.io/projected/24688022-cab8-42b2-99d7-8890a4d6bd2b-kube-api-access-dpnbg\") pod \"maas-controller-6f8d89fdcd-k5g59\" (UID: \"24688022-cab8-42b2-99d7-8890a4d6bd2b\") " pod="opendatahub/maas-controller-6f8d89fdcd-k5g59" May 21 14:50:51.621494 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:51.621467 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-qwb7m"] May 21 14:50:51.623978 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:50:51.623951 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c7f0d40_973c_492e_beb2_53ee2613c801.slice/crio-c9aa7b42c17d579efcbb84b1891cfc461697729bce6a9a26bd721991df46143c WatchSource:0}: Error finding container c9aa7b42c17d579efcbb84b1891cfc461697729bce6a9a26bd721991df46143c: Status 404 returned error can't find the container with id c9aa7b42c17d579efcbb84b1891cfc461697729bce6a9a26bd721991df46143c May 21 14:50:51.655218 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:51.655192 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f47856db8-v7fm4" May 21 14:50:51.678386 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:51.678359 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dpnbg\" (UniqueName: \"kubernetes.io/projected/24688022-cab8-42b2-99d7-8890a4d6bd2b-kube-api-access-dpnbg\") pod \"maas-controller-6f8d89fdcd-k5g59\" (UID: \"24688022-cab8-42b2-99d7-8890a4d6bd2b\") " pod="opendatahub/maas-controller-6f8d89fdcd-k5g59" May 21 14:50:51.686820 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:51.686793 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpnbg\" (UniqueName: \"kubernetes.io/projected/24688022-cab8-42b2-99d7-8890a4d6bd2b-kube-api-access-dpnbg\") pod \"maas-controller-6f8d89fdcd-k5g59\" (UID: \"24688022-cab8-42b2-99d7-8890a4d6bd2b\") " pod="opendatahub/maas-controller-6f8d89fdcd-k5g59" May 21 14:50:51.776857 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:51.776819 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-f47856db8-v7fm4"] May 21 14:50:51.779798 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:50:51.779770 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod221baf01_d25a_4f5f_9797_81e0db8e4b0d.slice/crio-e53a0410655e38a7a49c187380f816fb6680edd9d395c239b0c253c073fbb106 WatchSource:0}: Error finding container e53a0410655e38a7a49c187380f816fb6680edd9d395c239b0c253c073fbb106: Status 404 returned error can't find the container with id e53a0410655e38a7a49c187380f816fb6680edd9d395c239b0c253c073fbb106 May 21 14:50:51.865733 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:51.865686 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f8d89fdcd-k5g59" May 21 14:50:51.989150 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:51.989072 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6f8d89fdcd-k5g59"] May 21 14:50:51.991843 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:50:51.991815 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24688022_cab8_42b2_99d7_8890a4d6bd2b.slice/crio-e72d61d9be98eb4f53ccd03899d25831d71ac6241dedb09655732fc13969c3cc WatchSource:0}: Error finding container e72d61d9be98eb4f53ccd03899d25831d71ac6241dedb09655732fc13969c3cc: Status 404 returned error can't find the container with id e72d61d9be98eb4f53ccd03899d25831d71ac6241dedb09655732fc13969c3cc May 21 14:50:52.536775 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:52.536731 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f8d89fdcd-k5g59" event={"ID":"24688022-cab8-42b2-99d7-8890a4d6bd2b","Type":"ContainerStarted","Data":"e72d61d9be98eb4f53ccd03899d25831d71ac6241dedb09655732fc13969c3cc"} May 21 14:50:52.540401 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:52.540368 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68fb5d86bc-qwb7m" event={"ID":"3c7f0d40-973c-492e-beb2-53ee2613c801","Type":"ContainerStarted","Data":"c9aa7b42c17d579efcbb84b1891cfc461697729bce6a9a26bd721991df46143c"} May 21 14:50:52.548955 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:52.548893 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f47856db8-v7fm4" event={"ID":"221baf01-d25a-4f5f-9797-81e0db8e4b0d","Type":"ContainerStarted","Data":"e53a0410655e38a7a49c187380f816fb6680edd9d395c239b0c253c073fbb106"} May 21 14:50:55.561781 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:55.561739 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f47856db8-v7fm4" event={"ID":"221baf01-d25a-4f5f-9797-81e0db8e4b0d","Type":"ContainerStarted","Data":"6613879482d1cf529832c4fc4ab0605ad63d25e497518bccf77b139755a006b7"} May 21 14:50:55.562376 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:55.561845 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-f47856db8-v7fm4" May 21 14:50:55.563332 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:55.563302 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f8d89fdcd-k5g59" event={"ID":"24688022-cab8-42b2-99d7-8890a4d6bd2b","Type":"ContainerStarted","Data":"a47b15fc7a09b2d3bdd74662d6297a52cc57df7735029db1508a7998655fd7b3"} May 21 14:50:55.563467 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:55.563399 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6f8d89fdcd-k5g59" May 21 14:50:55.564581 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:55.564563 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68fb5d86bc-qwb7m" event={"ID":"3c7f0d40-973c-492e-beb2-53ee2613c801","Type":"ContainerStarted","Data":"29783d12aee96fe3f3cb24c9941b07c6d13c770cdc61f79abd62723843c15203"} May 21 14:50:55.564685 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:55.564652 2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-68fb5d86bc-qwb7m" podUID="3c7f0d40-973c-492e-beb2-53ee2613c801" containerName="manager" containerID="cri-o://29783d12aee96fe3f3cb24c9941b07c6d13c770cdc61f79abd62723843c15203" gracePeriod=30 May 21 14:50:55.564750 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:55.564693 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-68fb5d86bc-qwb7m" May 21 14:50:55.576938 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:55.576898 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-f47856db8-v7fm4" podStartSLOduration=1.435987468 podStartE2EDuration="4.576884002s" podCreationTimestamp="2026-05-21 14:50:51 +0000 UTC" firstStartedPulling="2026-05-21 14:50:51.781122842 +0000 UTC m=+564.519378351" lastFinishedPulling="2026-05-21 14:50:54.92201937 +0000 UTC m=+567.660274885" observedRunningTime="2026-05-21 14:50:55.57620893 +0000 UTC m=+568.314464461" watchObservedRunningTime="2026-05-21 14:50:55.576884002 +0000 UTC m=+568.315139535" May 21 14:50:55.592960 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:55.592912 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-6f8d89fdcd-k5g59" podStartSLOduration=1.653837257 podStartE2EDuration="4.59289713s" podCreationTimestamp="2026-05-21 14:50:51 +0000 UTC" firstStartedPulling="2026-05-21 14:50:51.993205698 +0000 UTC m=+564.731461211" lastFinishedPulling="2026-05-21 14:50:54.932265575 +0000 UTC m=+567.670521084" observedRunningTime="2026-05-21 14:50:55.591958086 +0000 UTC m=+568.330213616" watchObservedRunningTime="2026-05-21 14:50:55.59289713 +0000 UTC m=+568.331152665" May 21 14:50:55.607520 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:55.607478 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-68fb5d86bc-qwb7m" podStartSLOduration=1.310463903 podStartE2EDuration="4.607468033s" podCreationTimestamp="2026-05-21 14:50:51 +0000 UTC" firstStartedPulling="2026-05-21 14:50:51.625154875 +0000 UTC m=+564.363410384" lastFinishedPulling="2026-05-21 14:50:54.922158996 +0000 UTC m=+567.660414514" observedRunningTime="2026-05-21 14:50:55.605800933 +0000 UTC m=+568.344056466" watchObservedRunningTime="2026-05-21 14:50:55.607468033 +0000 UTC m=+568.345723564" May 21 14:50:55.807310 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:55.807287 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68fb5d86bc-qwb7m" May 21 14:50:55.915517 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:55.915487 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2tlcn\" (UniqueName: \"kubernetes.io/projected/3c7f0d40-973c-492e-beb2-53ee2613c801-kube-api-access-2tlcn\") pod \"3c7f0d40-973c-492e-beb2-53ee2613c801\" (UID: \"3c7f0d40-973c-492e-beb2-53ee2613c801\") " May 21 14:50:55.917619 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:55.917590 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c7f0d40-973c-492e-beb2-53ee2613c801-kube-api-access-2tlcn" (OuterVolumeSpecName: "kube-api-access-2tlcn") pod "3c7f0d40-973c-492e-beb2-53ee2613c801" (UID: "3c7f0d40-973c-492e-beb2-53ee2613c801"). InnerVolumeSpecName "kube-api-access-2tlcn". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 14:50:56.016299 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:56.016262 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2tlcn\" (UniqueName: \"kubernetes.io/projected/3c7f0d40-973c-492e-beb2-53ee2613c801-kube-api-access-2tlcn\") on node \"ip-10-0-134-244.ec2.internal\" DevicePath \"\"" May 21 14:50:56.569254 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:56.569222 2573 generic.go:358] "Generic (PLEG): container finished" podID="3c7f0d40-973c-492e-beb2-53ee2613c801" containerID="29783d12aee96fe3f3cb24c9941b07c6d13c770cdc61f79abd62723843c15203" exitCode=0 May 21 14:50:56.569743 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:56.569275 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68fb5d86bc-qwb7m" May 21 14:50:56.569743 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:56.569305 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68fb5d86bc-qwb7m" event={"ID":"3c7f0d40-973c-492e-beb2-53ee2613c801","Type":"ContainerDied","Data":"29783d12aee96fe3f3cb24c9941b07c6d13c770cdc61f79abd62723843c15203"} May 21 14:50:56.569743 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:56.569356 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68fb5d86bc-qwb7m" event={"ID":"3c7f0d40-973c-492e-beb2-53ee2613c801","Type":"ContainerDied","Data":"c9aa7b42c17d579efcbb84b1891cfc461697729bce6a9a26bd721991df46143c"} May 21 14:50:56.569743 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:56.569385 2573 scope.go:117] "RemoveContainer" containerID="29783d12aee96fe3f3cb24c9941b07c6d13c770cdc61f79abd62723843c15203" May 21 14:50:56.578206 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:56.578185 2573 scope.go:117] "RemoveContainer" containerID="29783d12aee96fe3f3cb24c9941b07c6d13c770cdc61f79abd62723843c15203" May 21 14:50:56.578461 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:50:56.578440 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29783d12aee96fe3f3cb24c9941b07c6d13c770cdc61f79abd62723843c15203\": container with ID starting with 29783d12aee96fe3f3cb24c9941b07c6d13c770cdc61f79abd62723843c15203 not found: ID does not exist" containerID="29783d12aee96fe3f3cb24c9941b07c6d13c770cdc61f79abd62723843c15203" May 21 14:50:56.578526 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:56.578470 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29783d12aee96fe3f3cb24c9941b07c6d13c770cdc61f79abd62723843c15203"} err="failed to get container status \"29783d12aee96fe3f3cb24c9941b07c6d13c770cdc61f79abd62723843c15203\": rpc error: code = NotFound desc = could not find container \"29783d12aee96fe3f3cb24c9941b07c6d13c770cdc61f79abd62723843c15203\": container with ID starting with 29783d12aee96fe3f3cb24c9941b07c6d13c770cdc61f79abd62723843c15203 not found: ID does not exist" May 21 14:50:56.590143 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:56.590118 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-qwb7m"] May 21 14:50:56.594162 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:56.594141 2573 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-qwb7m"] May 21 14:50:57.817796 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:50:57.817764 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c7f0d40-973c-492e-beb2-53ee2613c801" path="/var/lib/kubelet/pods/3c7f0d40-973c-492e-beb2-53ee2613c801/volumes" May 21 14:51:06.575340 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:06.575307 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6f8d89fdcd-k5g59" May 21 14:51:06.575832 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:06.575367 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-f47856db8-v7fm4" May 21 14:51:06.634307 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:06.634272 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-f47856db8-v7fm4"] May 21 14:51:06.634508 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:06.634482 2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-f47856db8-v7fm4" podUID="221baf01-d25a-4f5f-9797-81e0db8e4b0d" containerName="manager" containerID="cri-o://6613879482d1cf529832c4fc4ab0605ad63d25e497518bccf77b139755a006b7" gracePeriod=30 May 21 14:51:06.824899 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:06.824865 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-fc5c64594-jfl5b"] May 21 14:51:06.825321 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:06.825301 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c7f0d40-973c-492e-beb2-53ee2613c801" containerName="manager" May 21 14:51:06.825403 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:06.825325 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c7f0d40-973c-492e-beb2-53ee2613c801" containerName="manager" May 21 14:51:06.825442 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:06.825428 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="3c7f0d40-973c-492e-beb2-53ee2613c801" containerName="manager" May 21 14:51:06.829230 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:06.829196 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-fc5c64594-jfl5b" May 21 14:51:06.836031 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:06.835986 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-fc5c64594-jfl5b"] May 21 14:51:06.885442 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:06.885418 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f47856db8-v7fm4" May 21 14:51:06.897530 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:06.897504 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctfrc\" (UniqueName: \"kubernetes.io/projected/36b704a6-2ace-4b4b-ae1c-dfddbe4ccd17-kube-api-access-ctfrc\") pod \"maas-controller-fc5c64594-jfl5b\" (UID: \"36b704a6-2ace-4b4b-ae1c-dfddbe4ccd17\") " pod="opendatahub/maas-controller-fc5c64594-jfl5b" May 21 14:51:06.998377 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:06.998345 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2dr7q\" (UniqueName: \"kubernetes.io/projected/221baf01-d25a-4f5f-9797-81e0db8e4b0d-kube-api-access-2dr7q\") pod \"221baf01-d25a-4f5f-9797-81e0db8e4b0d\" (UID: \"221baf01-d25a-4f5f-9797-81e0db8e4b0d\") " May 21 14:51:06.998559 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:06.998461 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ctfrc\" (UniqueName: \"kubernetes.io/projected/36b704a6-2ace-4b4b-ae1c-dfddbe4ccd17-kube-api-access-ctfrc\") pod \"maas-controller-fc5c64594-jfl5b\" (UID: \"36b704a6-2ace-4b4b-ae1c-dfddbe4ccd17\") " pod="opendatahub/maas-controller-fc5c64594-jfl5b" May 21 14:51:07.000405 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:07.000375 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/221baf01-d25a-4f5f-9797-81e0db8e4b0d-kube-api-access-2dr7q" (OuterVolumeSpecName: "kube-api-access-2dr7q") pod "221baf01-d25a-4f5f-9797-81e0db8e4b0d" (UID: "221baf01-d25a-4f5f-9797-81e0db8e4b0d"). InnerVolumeSpecName "kube-api-access-2dr7q". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 14:51:07.005973 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:07.005946 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctfrc\" (UniqueName: \"kubernetes.io/projected/36b704a6-2ace-4b4b-ae1c-dfddbe4ccd17-kube-api-access-ctfrc\") pod \"maas-controller-fc5c64594-jfl5b\" (UID: \"36b704a6-2ace-4b4b-ae1c-dfddbe4ccd17\") " pod="opendatahub/maas-controller-fc5c64594-jfl5b" May 21 14:51:07.099835 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:07.099747 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2dr7q\" (UniqueName: \"kubernetes.io/projected/221baf01-d25a-4f5f-9797-81e0db8e4b0d-kube-api-access-2dr7q\") on node \"ip-10-0-134-244.ec2.internal\" DevicePath \"\"" May 21 14:51:07.142526 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:07.142488 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-fc5c64594-jfl5b" May 21 14:51:07.263932 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:07.263785 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-fc5c64594-jfl5b"] May 21 14:51:07.266609 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:51:07.266575 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36b704a6_2ace_4b4b_ae1c_dfddbe4ccd17.slice/crio-c572e1a3acfe1654ae76b42b57c380c571e194d7ed7f371eb352e1bdea9fbe83 WatchSource:0}: Error finding container c572e1a3acfe1654ae76b42b57c380c571e194d7ed7f371eb352e1bdea9fbe83: Status 404 returned error can't find the container with id c572e1a3acfe1654ae76b42b57c380c571e194d7ed7f371eb352e1bdea9fbe83 May 21 14:51:07.610055 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:07.610022 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-fc5c64594-jfl5b" event={"ID":"36b704a6-2ace-4b4b-ae1c-dfddbe4ccd17","Type":"ContainerStarted","Data":"c572e1a3acfe1654ae76b42b57c380c571e194d7ed7f371eb352e1bdea9fbe83"} May 21 14:51:07.611090 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:07.611066 2573 generic.go:358] "Generic (PLEG): container finished" podID="221baf01-d25a-4f5f-9797-81e0db8e4b0d" containerID="6613879482d1cf529832c4fc4ab0605ad63d25e497518bccf77b139755a006b7" exitCode=0 May 21 14:51:07.611171 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:07.611127 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f47856db8-v7fm4" May 21 14:51:07.611171 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:07.611147 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f47856db8-v7fm4" event={"ID":"221baf01-d25a-4f5f-9797-81e0db8e4b0d","Type":"ContainerDied","Data":"6613879482d1cf529832c4fc4ab0605ad63d25e497518bccf77b139755a006b7"} May 21 14:51:07.611237 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:07.611182 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f47856db8-v7fm4" event={"ID":"221baf01-d25a-4f5f-9797-81e0db8e4b0d","Type":"ContainerDied","Data":"e53a0410655e38a7a49c187380f816fb6680edd9d395c239b0c253c073fbb106"} May 21 14:51:07.611237 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:07.611198 2573 scope.go:117] "RemoveContainer" containerID="6613879482d1cf529832c4fc4ab0605ad63d25e497518bccf77b139755a006b7" May 21 14:51:07.625783 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:07.625763 2573 scope.go:117] "RemoveContainer" containerID="6613879482d1cf529832c4fc4ab0605ad63d25e497518bccf77b139755a006b7" May 21 14:51:07.626067 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:51:07.626047 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6613879482d1cf529832c4fc4ab0605ad63d25e497518bccf77b139755a006b7\": container with ID starting with 6613879482d1cf529832c4fc4ab0605ad63d25e497518bccf77b139755a006b7 not found: ID does not exist" containerID="6613879482d1cf529832c4fc4ab0605ad63d25e497518bccf77b139755a006b7" May 21 14:51:07.626144 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:07.626075 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6613879482d1cf529832c4fc4ab0605ad63d25e497518bccf77b139755a006b7"} err="failed to get container status \"6613879482d1cf529832c4fc4ab0605ad63d25e497518bccf77b139755a006b7\": rpc error: code = NotFound desc = could not find container \"6613879482d1cf529832c4fc4ab0605ad63d25e497518bccf77b139755a006b7\": container with ID starting with 6613879482d1cf529832c4fc4ab0605ad63d25e497518bccf77b139755a006b7 not found: ID does not exist" May 21 14:51:07.636407 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:07.636384 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-f47856db8-v7fm4"] May 21 14:51:07.637802 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:07.637762 2573 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-f47856db8-v7fm4"] May 21 14:51:07.817326 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:07.817293 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="221baf01-d25a-4f5f-9797-81e0db8e4b0d" path="/var/lib/kubelet/pods/221baf01-d25a-4f5f-9797-81e0db8e4b0d/volumes" May 21 14:51:08.616945 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:08.616908 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-fc5c64594-jfl5b" event={"ID":"36b704a6-2ace-4b4b-ae1c-dfddbe4ccd17","Type":"ContainerStarted","Data":"d00411ec27e7c111c5c232ef204ba623dee5502a2af6ff9d22466a2b20c5febb"} May 21 14:51:08.617344 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:08.617060 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-fc5c64594-jfl5b" May 21 14:51:08.633499 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:08.633452 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-fc5c64594-jfl5b" podStartSLOduration=2.308848799 podStartE2EDuration="2.633438719s" podCreationTimestamp="2026-05-21 14:51:06 +0000 UTC" firstStartedPulling="2026-05-21 14:51:07.267898306 +0000 UTC m=+580.006153815" lastFinishedPulling="2026-05-21 14:51:07.592488222 +0000 UTC m=+580.330743735" observedRunningTime="2026-05-21 14:51:08.632308949 +0000 UTC m=+581.370564477" watchObservedRunningTime="2026-05-21 14:51:08.633438719 +0000 UTC m=+581.371694250" May 21 14:51:19.626762 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:19.626722 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-fc5c64594-jfl5b" May 21 14:51:19.667891 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:19.667850 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6f8d89fdcd-k5g59"] May 21 14:51:19.668233 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:19.668195 2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-6f8d89fdcd-k5g59" podUID="24688022-cab8-42b2-99d7-8890a4d6bd2b" containerName="manager" containerID="cri-o://a47b15fc7a09b2d3bdd74662d6297a52cc57df7735029db1508a7998655fd7b3" gracePeriod=30 May 21 14:51:19.907191 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:19.907167 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f8d89fdcd-k5g59" May 21 14:51:20.010958 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:20.010913 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dpnbg\" (UniqueName: \"kubernetes.io/projected/24688022-cab8-42b2-99d7-8890a4d6bd2b-kube-api-access-dpnbg\") pod \"24688022-cab8-42b2-99d7-8890a4d6bd2b\" (UID: \"24688022-cab8-42b2-99d7-8890a4d6bd2b\") " May 21 14:51:20.013004 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:20.012964 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24688022-cab8-42b2-99d7-8890a4d6bd2b-kube-api-access-dpnbg" (OuterVolumeSpecName: "kube-api-access-dpnbg") pod "24688022-cab8-42b2-99d7-8890a4d6bd2b" (UID: "24688022-cab8-42b2-99d7-8890a4d6bd2b"). InnerVolumeSpecName "kube-api-access-dpnbg". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 14:51:20.112180 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:20.112144 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dpnbg\" (UniqueName: \"kubernetes.io/projected/24688022-cab8-42b2-99d7-8890a4d6bd2b-kube-api-access-dpnbg\") on node \"ip-10-0-134-244.ec2.internal\" DevicePath \"\"" May 21 14:51:20.656346 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:20.656311 2573 generic.go:358] "Generic (PLEG): container finished" podID="24688022-cab8-42b2-99d7-8890a4d6bd2b" containerID="a47b15fc7a09b2d3bdd74662d6297a52cc57df7735029db1508a7998655fd7b3" exitCode=0 May 21 14:51:20.656760 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:20.656362 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f8d89fdcd-k5g59" event={"ID":"24688022-cab8-42b2-99d7-8890a4d6bd2b","Type":"ContainerDied","Data":"a47b15fc7a09b2d3bdd74662d6297a52cc57df7735029db1508a7998655fd7b3"} May 21 14:51:20.656760 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:20.656413 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f8d89fdcd-k5g59" event={"ID":"24688022-cab8-42b2-99d7-8890a4d6bd2b","Type":"ContainerDied","Data":"e72d61d9be98eb4f53ccd03899d25831d71ac6241dedb09655732fc13969c3cc"} May 21 14:51:20.656760 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:20.656430 2573 scope.go:117] "RemoveContainer" containerID="a47b15fc7a09b2d3bdd74662d6297a52cc57df7735029db1508a7998655fd7b3" May 21 14:51:20.656760 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:20.656385 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f8d89fdcd-k5g59" May 21 14:51:20.665204 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:20.665182 2573 scope.go:117] "RemoveContainer" containerID="a47b15fc7a09b2d3bdd74662d6297a52cc57df7735029db1508a7998655fd7b3" May 21 14:51:20.665443 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:51:20.665425 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a47b15fc7a09b2d3bdd74662d6297a52cc57df7735029db1508a7998655fd7b3\": container with ID starting with a47b15fc7a09b2d3bdd74662d6297a52cc57df7735029db1508a7998655fd7b3 not found: ID does not exist" containerID="a47b15fc7a09b2d3bdd74662d6297a52cc57df7735029db1508a7998655fd7b3" May 21 14:51:20.665519 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:20.665451 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a47b15fc7a09b2d3bdd74662d6297a52cc57df7735029db1508a7998655fd7b3"} err="failed to get container status \"a47b15fc7a09b2d3bdd74662d6297a52cc57df7735029db1508a7998655fd7b3\": rpc error: code = NotFound desc = could not find container \"a47b15fc7a09b2d3bdd74662d6297a52cc57df7735029db1508a7998655fd7b3\": container with ID starting with a47b15fc7a09b2d3bdd74662d6297a52cc57df7735029db1508a7998655fd7b3 not found: ID does not exist" May 21 14:51:20.676778 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:20.676750 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6f8d89fdcd-k5g59"] May 21 14:51:20.680241 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:20.680218 2573 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6f8d89fdcd-k5g59"] May 21 14:51:21.817176 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:21.817134 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24688022-cab8-42b2-99d7-8890a4d6bd2b" path="/var/lib/kubelet/pods/24688022-cab8-42b2-99d7-8890a4d6bd2b/volumes" May 21 14:51:25.399692 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:25.399657 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-695548857-crbvc"] May 21 14:51:25.400094 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:25.399960 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="221baf01-d25a-4f5f-9797-81e0db8e4b0d" containerName="manager" May 21 14:51:25.400094 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:25.399970 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="221baf01-d25a-4f5f-9797-81e0db8e4b0d" containerName="manager" May 21 14:51:25.400094 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:25.399982 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24688022-cab8-42b2-99d7-8890a4d6bd2b" containerName="manager" May 21 14:51:25.400094 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:25.399988 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="24688022-cab8-42b2-99d7-8890a4d6bd2b" containerName="manager" May 21 14:51:25.400094 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:25.400063 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="221baf01-d25a-4f5f-9797-81e0db8e4b0d" containerName="manager" May 21 14:51:25.400094 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:25.400071 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="24688022-cab8-42b2-99d7-8890a4d6bd2b" containerName="manager" May 21 14:51:25.406029 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:25.405984 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-695548857-crbvc" May 21 14:51:25.408330 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:25.408302 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" May 21 14:51:25.408476 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:25.408305 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-v95vv\"" May 21 14:51:25.411105 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:25.411076 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-695548857-crbvc"] May 21 14:51:25.559224 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:25.559181 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb3e2305-f02b-4169-8b99-477eaddfd8a6-maas-api-tls\") pod \"maas-api-695548857-crbvc\" (UID: \"cb3e2305-f02b-4169-8b99-477eaddfd8a6\") " pod="opendatahub/maas-api-695548857-crbvc" May 21 14:51:25.559409 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:25.559242 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbmcd\" (UniqueName: \"kubernetes.io/projected/cb3e2305-f02b-4169-8b99-477eaddfd8a6-kube-api-access-wbmcd\") pod \"maas-api-695548857-crbvc\" (UID: \"cb3e2305-f02b-4169-8b99-477eaddfd8a6\") " pod="opendatahub/maas-api-695548857-crbvc" May 21 14:51:25.660102 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:25.660009 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wbmcd\" (UniqueName: \"kubernetes.io/projected/cb3e2305-f02b-4169-8b99-477eaddfd8a6-kube-api-access-wbmcd\") pod \"maas-api-695548857-crbvc\" (UID: \"cb3e2305-f02b-4169-8b99-477eaddfd8a6\") " pod="opendatahub/maas-api-695548857-crbvc" May 21 14:51:25.660280 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:25.660143 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb3e2305-f02b-4169-8b99-477eaddfd8a6-maas-api-tls\") pod \"maas-api-695548857-crbvc\" (UID: \"cb3e2305-f02b-4169-8b99-477eaddfd8a6\") " pod="opendatahub/maas-api-695548857-crbvc" May 21 14:51:25.663041 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:25.663013 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb3e2305-f02b-4169-8b99-477eaddfd8a6-maas-api-tls\") pod \"maas-api-695548857-crbvc\" (UID: \"cb3e2305-f02b-4169-8b99-477eaddfd8a6\") " pod="opendatahub/maas-api-695548857-crbvc" May 21 14:51:25.668567 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:25.668534 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbmcd\" (UniqueName: \"kubernetes.io/projected/cb3e2305-f02b-4169-8b99-477eaddfd8a6-kube-api-access-wbmcd\") pod \"maas-api-695548857-crbvc\" (UID: \"cb3e2305-f02b-4169-8b99-477eaddfd8a6\") " pod="opendatahub/maas-api-695548857-crbvc" May 21 14:51:25.715677 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:25.715643 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-q4hsb"] May 21 14:51:25.718223 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:25.718193 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-695548857-crbvc" May 21 14:51:25.719457 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:25.719439 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-q4hsb" May 21 14:51:25.721574 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:25.721553 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" May 21 14:51:25.728180 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:25.728157 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-q4hsb"] May 21 14:51:25.861389 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:25.861361 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-695548857-crbvc"] May 21 14:51:25.861726 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:25.861712 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkb9x\" (UniqueName: \"kubernetes.io/projected/9120b9d7-4bd4-47ad-af7e-57774c3fb339-kube-api-access-gkb9x\") pod \"payload-processing-58b6c8fdc7-q4hsb\" (UID: \"9120b9d7-4bd4-47ad-af7e-57774c3fb339\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-q4hsb" May 21 14:51:25.863856 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:51:25.863819 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb3e2305_f02b_4169_8b99_477eaddfd8a6.slice/crio-40388fd958dc1b1126876d1fc8622939b9df70652df8d2edf7f0a83a59291cb0 WatchSource:0}: Error finding container 40388fd958dc1b1126876d1fc8622939b9df70652df8d2edf7f0a83a59291cb0: Status 404 returned error can't find the container with id 40388fd958dc1b1126876d1fc8622939b9df70652df8d2edf7f0a83a59291cb0 May 21 14:51:25.963127 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:25.963030 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gkb9x\" (UniqueName: \"kubernetes.io/projected/9120b9d7-4bd4-47ad-af7e-57774c3fb339-kube-api-access-gkb9x\") pod \"payload-processing-58b6c8fdc7-q4hsb\" (UID: \"9120b9d7-4bd4-47ad-af7e-57774c3fb339\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-q4hsb" May 21 14:51:25.971902 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:25.971869 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkb9x\" (UniqueName: \"kubernetes.io/projected/9120b9d7-4bd4-47ad-af7e-57774c3fb339-kube-api-access-gkb9x\") pod \"payload-processing-58b6c8fdc7-q4hsb\" (UID: \"9120b9d7-4bd4-47ad-af7e-57774c3fb339\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-q4hsb" May 21 14:51:26.048323 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:26.048286 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-q4hsb" May 21 14:51:26.177848 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:26.177813 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-q4hsb"] May 21 14:51:26.180575 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:51:26.180536 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9120b9d7_4bd4_47ad_af7e_57774c3fb339.slice/crio-0e22a003b6027a52526726e928db8c898f77e274e393e488787146b231e5c93a WatchSource:0}: Error finding container 0e22a003b6027a52526726e928db8c898f77e274e393e488787146b231e5c93a: Status 404 returned error can't find the container with id 0e22a003b6027a52526726e928db8c898f77e274e393e488787146b231e5c93a May 21 14:51:26.678868 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:26.678831 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-q4hsb" event={"ID":"9120b9d7-4bd4-47ad-af7e-57774c3fb339","Type":"ContainerStarted","Data":"0e22a003b6027a52526726e928db8c898f77e274e393e488787146b231e5c93a"} May 21 14:51:26.680278 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:26.680232 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-695548857-crbvc" event={"ID":"cb3e2305-f02b-4169-8b99-477eaddfd8a6","Type":"ContainerStarted","Data":"40388fd958dc1b1126876d1fc8622939b9df70652df8d2edf7f0a83a59291cb0"} May 21 14:51:28.688763 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:28.688721 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-q4hsb" event={"ID":"9120b9d7-4bd4-47ad-af7e-57774c3fb339","Type":"ContainerStarted","Data":"7c047db0a057a9fb7f8ff0f3841f577bfc6e8c6f24ea564f13025c5cab5158a6"} May 21 14:51:28.689250 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:28.688847 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-q4hsb" May 21 14:51:28.690031 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:28.689989 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-695548857-crbvc" event={"ID":"cb3e2305-f02b-4169-8b99-477eaddfd8a6","Type":"ContainerStarted","Data":"b36fcebaab36154f0df153ec89f3176fe19cd5b80ffde28aad5d43aff3748706"} May 21 14:51:28.690152 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:28.690099 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-695548857-crbvc" May 21 14:51:28.703441 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:28.703398 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58b6c8fdc7-q4hsb" podStartSLOduration=2.255964809 podStartE2EDuration="3.703386726s" podCreationTimestamp="2026-05-21 14:51:25 +0000 UTC" firstStartedPulling="2026-05-21 14:51:26.182381844 +0000 UTC m=+598.920637353" lastFinishedPulling="2026-05-21 14:51:27.629803746 +0000 UTC m=+600.368059270" observedRunningTime="2026-05-21 14:51:28.702826168 +0000 UTC m=+601.441081700" watchObservedRunningTime="2026-05-21 14:51:28.703386726 +0000 UTC m=+601.441642257" May 21 14:51:28.720519 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:28.720469 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-695548857-crbvc" podStartSLOduration=1.9579438310000001 podStartE2EDuration="3.720456247s" podCreationTimestamp="2026-05-21 14:51:25 +0000 UTC" firstStartedPulling="2026-05-21 14:51:25.865231391 +0000 UTC m=+598.603486900" lastFinishedPulling="2026-05-21 14:51:27.627743791 +0000 UTC m=+600.365999316" observedRunningTime="2026-05-21 14:51:28.718811103 +0000 UTC m=+601.457066634" watchObservedRunningTime="2026-05-21 14:51:28.720456247 +0000 UTC m=+601.458711779" May 21 14:51:34.698688 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:34.698657 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-695548857-crbvc" May 21 14:51:39.695907 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:39.695874 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-q4hsb" May 21 14:51:48.476726 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:48.476604 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-bzb6r"] May 21 14:51:48.479921 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:48.479903 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-bzb6r" May 21 14:51:48.482159 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:48.482134 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" May 21 14:51:48.482374 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:48.482354 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" May 21 14:51:48.483251 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:48.483234 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-fd8t9\"" May 21 14:51:48.483339 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:48.483306 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" May 21 14:51:48.487326 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:48.487305 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-bzb6r"] May 21 14:51:48.648074 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:48.648033 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/732a10c7-7add-436e-9b76-35c3cdb1c85a-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-bzb6r\" (UID: \"732a10c7-7add-436e-9b76-35c3cdb1c85a\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-bzb6r" May 21 14:51:48.648240 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:48.648096 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9w57\" (UniqueName: \"kubernetes.io/projected/732a10c7-7add-436e-9b76-35c3cdb1c85a-kube-api-access-r9w57\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-bzb6r\" (UID: \"732a10c7-7add-436e-9b76-35c3cdb1c85a\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-bzb6r" May 21 14:51:48.648240 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:48.648156 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/732a10c7-7add-436e-9b76-35c3cdb1c85a-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-bzb6r\" (UID: \"732a10c7-7add-436e-9b76-35c3cdb1c85a\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-bzb6r" May 21 14:51:48.648240 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:48.648207 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/732a10c7-7add-436e-9b76-35c3cdb1c85a-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-bzb6r\" (UID: \"732a10c7-7add-436e-9b76-35c3cdb1c85a\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-bzb6r" May 21 14:51:48.648416 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:48.648244 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/732a10c7-7add-436e-9b76-35c3cdb1c85a-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-bzb6r\" (UID: \"732a10c7-7add-436e-9b76-35c3cdb1c85a\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-bzb6r" May 21 14:51:48.648416 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:48.648282 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/732a10c7-7add-436e-9b76-35c3cdb1c85a-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-bzb6r\" (UID: \"732a10c7-7add-436e-9b76-35c3cdb1c85a\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-bzb6r" May 21 14:51:48.749483 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:48.749405 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r9w57\" (UniqueName: \"kubernetes.io/projected/732a10c7-7add-436e-9b76-35c3cdb1c85a-kube-api-access-r9w57\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-bzb6r\" (UID: \"732a10c7-7add-436e-9b76-35c3cdb1c85a\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-bzb6r" May 21 14:51:48.749629 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:48.749514 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/732a10c7-7add-436e-9b76-35c3cdb1c85a-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-bzb6r\" (UID: \"732a10c7-7add-436e-9b76-35c3cdb1c85a\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-bzb6r" May 21 14:51:48.749629 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:48.749543 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/732a10c7-7add-436e-9b76-35c3cdb1c85a-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-bzb6r\" (UID: \"732a10c7-7add-436e-9b76-35c3cdb1c85a\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-bzb6r" May 21 14:51:48.749629 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:48.749582 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/732a10c7-7add-436e-9b76-35c3cdb1c85a-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-bzb6r\" (UID: \"732a10c7-7add-436e-9b76-35c3cdb1c85a\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-bzb6r" May 21 14:51:48.749629 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:48.749622 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/732a10c7-7add-436e-9b76-35c3cdb1c85a-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-bzb6r\" (UID: \"732a10c7-7add-436e-9b76-35c3cdb1c85a\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-bzb6r" May 21 14:51:48.749805 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:48.749678 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/732a10c7-7add-436e-9b76-35c3cdb1c85a-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-bzb6r\" (UID: \"732a10c7-7add-436e-9b76-35c3cdb1c85a\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-bzb6r" May 21 14:51:48.749932 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:48.749899 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/732a10c7-7add-436e-9b76-35c3cdb1c85a-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-bzb6r\" (UID: \"732a10c7-7add-436e-9b76-35c3cdb1c85a\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-bzb6r" May 21 14:51:48.750091 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:48.749961 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/732a10c7-7add-436e-9b76-35c3cdb1c85a-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-bzb6r\" (UID: \"732a10c7-7add-436e-9b76-35c3cdb1c85a\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-bzb6r" May 21 14:51:48.750091 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:48.750024 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/732a10c7-7add-436e-9b76-35c3cdb1c85a-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-bzb6r\" (UID: \"732a10c7-7add-436e-9b76-35c3cdb1c85a\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-bzb6r" May 21 14:51:48.751795 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:48.751773 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/732a10c7-7add-436e-9b76-35c3cdb1c85a-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-bzb6r\" (UID: \"732a10c7-7add-436e-9b76-35c3cdb1c85a\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-bzb6r" May 21 14:51:48.752194 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:48.752170 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/732a10c7-7add-436e-9b76-35c3cdb1c85a-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-bzb6r\" (UID: \"732a10c7-7add-436e-9b76-35c3cdb1c85a\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-bzb6r" May 21 14:51:48.757969 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:48.757943 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9w57\" (UniqueName: \"kubernetes.io/projected/732a10c7-7add-436e-9b76-35c3cdb1c85a-kube-api-access-r9w57\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-bzb6r\" (UID: \"732a10c7-7add-436e-9b76-35c3cdb1c85a\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-bzb6r" May 21 14:51:48.790754 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:48.790712 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-bzb6r" May 21 14:51:48.923683 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:48.923635 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-bzb6r"] May 21 14:51:48.926042 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:51:48.925574 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod732a10c7_7add_436e_9b76_35c3cdb1c85a.slice/crio-62070c85c7638d0e0496d1ca612c07fa65b9c81d5948f7e1ccdae6fb6c29f48d WatchSource:0}: Error finding container 62070c85c7638d0e0496d1ca612c07fa65b9c81d5948f7e1ccdae6fb6c29f48d: Status 404 returned error can't find the container with id 62070c85c7638d0e0496d1ca612c07fa65b9c81d5948f7e1ccdae6fb6c29f48d May 21 14:51:48.928770 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:48.928752 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 14:51:49.771847 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:49.771804 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-bzb6r" event={"ID":"732a10c7-7add-436e-9b76-35c3cdb1c85a","Type":"ContainerStarted","Data":"62070c85c7638d0e0496d1ca612c07fa65b9c81d5948f7e1ccdae6fb6c29f48d"} May 21 14:51:54.793473 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:51:54.793382 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-bzb6r" event={"ID":"732a10c7-7add-436e-9b76-35c3cdb1c85a","Type":"ContainerStarted","Data":"f1f7c89d919e0f0678bc80e834be17bdff1cef78fa373804352c02123ace246d"} May 21 14:52:00.816419 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:52:00.816383 2573 generic.go:358] "Generic (PLEG): container finished" podID="732a10c7-7add-436e-9b76-35c3cdb1c85a" containerID="f1f7c89d919e0f0678bc80e834be17bdff1cef78fa373804352c02123ace246d" exitCode=0 May 21 14:52:00.816806 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:52:00.816457 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-bzb6r" event={"ID":"732a10c7-7add-436e-9b76-35c3cdb1c85a","Type":"ContainerDied","Data":"f1f7c89d919e0f0678bc80e834be17bdff1cef78fa373804352c02123ace246d"} May 21 14:52:02.823975 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:52:02.823937 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-bzb6r" event={"ID":"732a10c7-7add-436e-9b76-35c3cdb1c85a","Type":"ContainerStarted","Data":"7b91ca17c9a16e0b01c3d55114aea24c3d033c5cc2dde4308feaecc5a2abc8eb"} May 21 14:52:02.824485 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:52:02.824238 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-bzb6r" May 21 14:52:02.849046 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:52:02.848980 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-bzb6r" podStartSLOduration=1.632757916 podStartE2EDuration="14.848963845s" podCreationTimestamp="2026-05-21 14:51:48 +0000 UTC" firstStartedPulling="2026-05-21 14:51:48.928931474 +0000 UTC m=+621.667186991" lastFinishedPulling="2026-05-21 14:52:02.145137395 +0000 UTC m=+634.883392920" observedRunningTime="2026-05-21 14:52:02.846550362 +0000 UTC m=+635.584805897" watchObservedRunningTime="2026-05-21 14:52:02.848963845 +0000 UTC m=+635.587219376" May 21 14:52:13.842496 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:52:13.842461 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-bzb6r" May 21 14:52:28.082333 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:52:28.082291 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-p4hpr"] May 21 14:52:28.123322 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:52:28.123292 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-p4hpr"] May 21 14:52:28.123486 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:52:28.123410 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-p4hpr" May 21 14:52:28.125771 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:52:28.125745 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" May 21 14:52:28.285522 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:52:28.285487 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f10e2bc7-886d-4e99-a52c-f3e909fa759e-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-p4hpr\" (UID: \"f10e2bc7-886d-4e99-a52c-f3e909fa759e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-p4hpr" May 21 14:52:28.285522 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:52:28.285535 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f10e2bc7-886d-4e99-a52c-f3e909fa759e-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-p4hpr\" (UID: \"f10e2bc7-886d-4e99-a52c-f3e909fa759e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-p4hpr" May 21 14:52:28.285777 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:52:28.285557 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skpcr\" (UniqueName: \"kubernetes.io/projected/f10e2bc7-886d-4e99-a52c-f3e909fa759e-kube-api-access-skpcr\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-p4hpr\" (UID: \"f10e2bc7-886d-4e99-a52c-f3e909fa759e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-p4hpr" May 21 14:52:28.285777 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:52:28.285623 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f10e2bc7-886d-4e99-a52c-f3e909fa759e-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-p4hpr\" (UID: \"f10e2bc7-886d-4e99-a52c-f3e909fa759e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-p4hpr" May 21 14:52:28.285777 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:52:28.285641 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f10e2bc7-886d-4e99-a52c-f3e909fa759e-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-p4hpr\" (UID: \"f10e2bc7-886d-4e99-a52c-f3e909fa759e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-p4hpr" May 21 14:52:28.285777 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:52:28.285689 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f10e2bc7-886d-4e99-a52c-f3e909fa759e-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-p4hpr\" (UID: \"f10e2bc7-886d-4e99-a52c-f3e909fa759e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-p4hpr" May 21 14:52:28.386693 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:52:28.386654 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f10e2bc7-886d-4e99-a52c-f3e909fa759e-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-p4hpr\" (UID: \"f10e2bc7-886d-4e99-a52c-f3e909fa759e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-p4hpr" May 21 14:52:28.386693 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:52:28.386697 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f10e2bc7-886d-4e99-a52c-f3e909fa759e-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-p4hpr\" (UID: \"f10e2bc7-886d-4e99-a52c-f3e909fa759e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-p4hpr" May 21 14:52:28.386915 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:52:28.386727 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f10e2bc7-886d-4e99-a52c-f3e909fa759e-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-p4hpr\" (UID: \"f10e2bc7-886d-4e99-a52c-f3e909fa759e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-p4hpr" May 21 14:52:28.386915 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:52:28.386745 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-skpcr\" (UniqueName: \"kubernetes.io/projected/f10e2bc7-886d-4e99-a52c-f3e909fa759e-kube-api-access-skpcr\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-p4hpr\" (UID: \"f10e2bc7-886d-4e99-a52c-f3e909fa759e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-p4hpr" May 21 14:52:28.386915 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:52:28.386783 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f10e2bc7-886d-4e99-a52c-f3e909fa759e-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-p4hpr\" (UID: \"f10e2bc7-886d-4e99-a52c-f3e909fa759e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-p4hpr" May 21 14:52:28.386915 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:52:28.386802 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f10e2bc7-886d-4e99-a52c-f3e909fa759e-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-p4hpr\" (UID: \"f10e2bc7-886d-4e99-a52c-f3e909fa759e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-p4hpr" May 21 14:52:28.387175 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:52:28.387149 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f10e2bc7-886d-4e99-a52c-f3e909fa759e-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-p4hpr\" (UID: \"f10e2bc7-886d-4e99-a52c-f3e909fa759e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-p4hpr" May 21 14:52:28.387224 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:52:28.387171 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f10e2bc7-886d-4e99-a52c-f3e909fa759e-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-p4hpr\" (UID: \"f10e2bc7-886d-4e99-a52c-f3e909fa759e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-p4hpr" May 21 14:52:28.387300 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:52:28.387247 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f10e2bc7-886d-4e99-a52c-f3e909fa759e-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-p4hpr\" (UID: \"f10e2bc7-886d-4e99-a52c-f3e909fa759e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-p4hpr" May 21 14:52:28.389151 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:52:28.389128 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f10e2bc7-886d-4e99-a52c-f3e909fa759e-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-p4hpr\" (UID: \"f10e2bc7-886d-4e99-a52c-f3e909fa759e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-p4hpr" May 21 14:52:28.389342 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:52:28.389315 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f10e2bc7-886d-4e99-a52c-f3e909fa759e-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-p4hpr\" (UID: \"f10e2bc7-886d-4e99-a52c-f3e909fa759e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-p4hpr" May 21 14:52:28.393922 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:52:28.393899 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-skpcr\" (UniqueName: \"kubernetes.io/projected/f10e2bc7-886d-4e99-a52c-f3e909fa759e-kube-api-access-skpcr\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-p4hpr\" (UID: \"f10e2bc7-886d-4e99-a52c-f3e909fa759e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-p4hpr" May 21 14:52:28.432960 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:52:28.432927 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-p4hpr" May 21 14:52:28.568554 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:52:28.568519 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-p4hpr"] May 21 14:52:28.572638 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:52:28.572604 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf10e2bc7_886d_4e99_a52c_f3e909fa759e.slice/crio-fb6611a48b0b32bbb540f14c3a8a69cdfcd8676c1eb8875ea613ebd74b2b7eb6 WatchSource:0}: Error finding container fb6611a48b0b32bbb540f14c3a8a69cdfcd8676c1eb8875ea613ebd74b2b7eb6: Status 404 returned error can't find the container with id fb6611a48b0b32bbb540f14c3a8a69cdfcd8676c1eb8875ea613ebd74b2b7eb6 May 21 14:52:28.918798 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:52:28.918705 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-p4hpr" event={"ID":"f10e2bc7-886d-4e99-a52c-f3e909fa759e","Type":"ContainerStarted","Data":"7119a7ecd527a628c3dc3a41ade1abd80cdd96bd2ed258df0204a2cc71929deb"} May 21 14:52:28.918798 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:52:28.918745 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-p4hpr" event={"ID":"f10e2bc7-886d-4e99-a52c-f3e909fa759e","Type":"ContainerStarted","Data":"fb6611a48b0b32bbb540f14c3a8a69cdfcd8676c1eb8875ea613ebd74b2b7eb6"} May 21 14:52:37.954443 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:52:37.954406 2573 generic.go:358] "Generic (PLEG): container finished" podID="f10e2bc7-886d-4e99-a52c-f3e909fa759e" containerID="7119a7ecd527a628c3dc3a41ade1abd80cdd96bd2ed258df0204a2cc71929deb" exitCode=0 May 21 14:52:37.954867 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:52:37.954470 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-p4hpr" event={"ID":"f10e2bc7-886d-4e99-a52c-f3e909fa759e","Type":"ContainerDied","Data":"7119a7ecd527a628c3dc3a41ade1abd80cdd96bd2ed258df0204a2cc71929deb"} May 21 14:52:38.960292 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:52:38.960250 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-p4hpr" event={"ID":"f10e2bc7-886d-4e99-a52c-f3e909fa759e","Type":"ContainerStarted","Data":"dc52fb5b2a89f04f98d06034c528514d7c938b24490175ba0ca0d0754124d107"} May 21 14:52:38.960667 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:52:38.960445 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-p4hpr" May 21 14:52:38.977695 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:52:38.977644 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-p4hpr" podStartSLOduration=10.66879415 podStartE2EDuration="10.977631679s" podCreationTimestamp="2026-05-21 14:52:28 +0000 UTC" firstStartedPulling="2026-05-21 14:52:37.955208043 +0000 UTC m=+670.693463552" lastFinishedPulling="2026-05-21 14:52:38.264045569 +0000 UTC m=+671.002301081" observedRunningTime="2026-05-21 14:52:38.975880949 +0000 UTC m=+671.714136482" watchObservedRunningTime="2026-05-21 14:52:38.977631679 +0000 UTC m=+671.715887211" May 21 14:52:43.880686 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:52:43.880649 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxq7wz"] May 21 14:52:43.883898 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:52:43.883875 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxq7wz" May 21 14:52:43.886303 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:52:43.886282 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" May 21 14:52:43.894656 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:52:43.894633 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxq7wz"] May 21 14:52:44.023591 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:52:44.023552 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a9329d4-8f8d-4a9c-901c-745311b1472d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxq7wz\" (UID: \"0a9329d4-8f8d-4a9c-901c-745311b1472d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxq7wz" May 21 14:52:44.023780 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:52:44.023613 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0a9329d4-8f8d-4a9c-901c-745311b1472d-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxq7wz\" (UID: \"0a9329d4-8f8d-4a9c-901c-745311b1472d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxq7wz" May 21 14:52:44.023780 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:52:44.023640 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ff5jh\" (UniqueName: \"kubernetes.io/projected/0a9329d4-8f8d-4a9c-901c-745311b1472d-kube-api-access-ff5jh\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxq7wz\" (UID: \"0a9329d4-8f8d-4a9c-901c-745311b1472d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxq7wz" May 21 14:52:44.023780 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:52:44.023665 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a9329d4-8f8d-4a9c-901c-745311b1472d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxq7wz\" (UID: \"0a9329d4-8f8d-4a9c-901c-745311b1472d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxq7wz" May 21 14:52:44.023780 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:52:44.023701 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a9329d4-8f8d-4a9c-901c-745311b1472d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxq7wz\" (UID: \"0a9329d4-8f8d-4a9c-901c-745311b1472d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxq7wz" May 21 14:52:44.023780 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:52:44.023722 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a9329d4-8f8d-4a9c-901c-745311b1472d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxq7wz\" (UID: \"0a9329d4-8f8d-4a9c-901c-745311b1472d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxq7wz" May 21 14:52:44.124330 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:52:44.124288 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a9329d4-8f8d-4a9c-901c-745311b1472d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxq7wz\" (UID: \"0a9329d4-8f8d-4a9c-901c-745311b1472d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxq7wz" May 21 14:52:44.124542 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:52:44.124362 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0a9329d4-8f8d-4a9c-901c-745311b1472d-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxq7wz\" (UID: \"0a9329d4-8f8d-4a9c-901c-745311b1472d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxq7wz" May 21 14:52:44.124542 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:52:44.124392 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ff5jh\" (UniqueName: \"kubernetes.io/projected/0a9329d4-8f8d-4a9c-901c-745311b1472d-kube-api-access-ff5jh\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxq7wz\" (UID: \"0a9329d4-8f8d-4a9c-901c-745311b1472d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxq7wz" May 21 14:52:44.124542 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:52:44.124430 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a9329d4-8f8d-4a9c-901c-745311b1472d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxq7wz\" (UID: \"0a9329d4-8f8d-4a9c-901c-745311b1472d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxq7wz" May 21 14:52:44.124542 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:52:44.124479 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a9329d4-8f8d-4a9c-901c-745311b1472d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxq7wz\" (UID: \"0a9329d4-8f8d-4a9c-901c-745311b1472d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxq7wz" May 21 14:52:44.124542 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:52:44.124509 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a9329d4-8f8d-4a9c-901c-745311b1472d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxq7wz\" (UID: \"0a9329d4-8f8d-4a9c-901c-745311b1472d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxq7wz" May 21 14:52:44.124814 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:52:44.124762 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a9329d4-8f8d-4a9c-901c-745311b1472d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxq7wz\" (UID: \"0a9329d4-8f8d-4a9c-901c-745311b1472d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxq7wz" May 21 14:52:44.124868 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:52:44.124808 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0a9329d4-8f8d-4a9c-901c-745311b1472d-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxq7wz\" (UID: \"0a9329d4-8f8d-4a9c-901c-745311b1472d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxq7wz" May 21 14:52:44.124913 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:52:44.124882 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a9329d4-8f8d-4a9c-901c-745311b1472d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxq7wz\" (UID: \"0a9329d4-8f8d-4a9c-901c-745311b1472d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxq7wz" May 21 14:52:44.126781 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:52:44.126753 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a9329d4-8f8d-4a9c-901c-745311b1472d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxq7wz\" (UID: \"0a9329d4-8f8d-4a9c-901c-745311b1472d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxq7wz" May 21 14:52:44.127039 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:52:44.127021 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a9329d4-8f8d-4a9c-901c-745311b1472d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxq7wz\" (UID: \"0a9329d4-8f8d-4a9c-901c-745311b1472d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxq7wz" May 21 14:52:44.132272 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:52:44.132217 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ff5jh\" (UniqueName: \"kubernetes.io/projected/0a9329d4-8f8d-4a9c-901c-745311b1472d-kube-api-access-ff5jh\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxq7wz\" (UID: \"0a9329d4-8f8d-4a9c-901c-745311b1472d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxq7wz" May 21 14:52:44.195490 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:52:44.195450 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxq7wz" May 21 14:52:44.329903 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:52:44.329849 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxq7wz"] May 21 14:52:44.332197 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:52:44.332164 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a9329d4_8f8d_4a9c_901c_745311b1472d.slice/crio-f11c5c7315b19bf86ef347287ce4deca0bbf85577c4799d0a477a1e427d0e418 WatchSource:0}: Error finding container f11c5c7315b19bf86ef347287ce4deca0bbf85577c4799d0a477a1e427d0e418: Status 404 returned error can't find the container with id f11c5c7315b19bf86ef347287ce4deca0bbf85577c4799d0a477a1e427d0e418 May 21 14:52:44.982683 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:52:44.982644 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxq7wz" event={"ID":"0a9329d4-8f8d-4a9c-901c-745311b1472d","Type":"ContainerStarted","Data":"3d595a009a23fa61857f5492272c478a92995aa1a08306e628c76ec4aa17f075"} May 21 14:52:44.982683 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:52:44.982687 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxq7wz" event={"ID":"0a9329d4-8f8d-4a9c-901c-745311b1472d","Type":"ContainerStarted","Data":"f11c5c7315b19bf86ef347287ce4deca0bbf85577c4799d0a477a1e427d0e418"} May 21 14:52:49.978092 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:52:49.978054 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-p4hpr" May 21 14:52:51.014251 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:52:51.014218 2573 generic.go:358] "Generic (PLEG): container finished" podID="0a9329d4-8f8d-4a9c-901c-745311b1472d" containerID="3d595a009a23fa61857f5492272c478a92995aa1a08306e628c76ec4aa17f075" exitCode=0 May 21 14:52:51.014654 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:52:51.014265 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxq7wz" event={"ID":"0a9329d4-8f8d-4a9c-901c-745311b1472d","Type":"ContainerDied","Data":"3d595a009a23fa61857f5492272c478a92995aa1a08306e628c76ec4aa17f075"} May 21 14:52:52.019618 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:52:52.019534 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxq7wz" event={"ID":"0a9329d4-8f8d-4a9c-901c-745311b1472d","Type":"ContainerStarted","Data":"143e528983857b03f1c80a27e8add3e9aaff871d78053cd3551d17068f5263e1"} May 21 14:52:52.020016 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:52:52.019756 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxq7wz" May 21 14:52:52.035463 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:52:52.035418 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxq7wz" podStartSLOduration=8.399394353 podStartE2EDuration="9.035405018s" podCreationTimestamp="2026-05-21 14:52:43 +0000 UTC" firstStartedPulling="2026-05-21 14:52:51.014939461 +0000 UTC m=+683.753194972" lastFinishedPulling="2026-05-21 14:52:51.650950124 +0000 UTC m=+684.389205637" observedRunningTime="2026-05-21 14:52:52.03469079 +0000 UTC m=+684.772946318" watchObservedRunningTime="2026-05-21 14:52:52.035405018 +0000 UTC m=+684.773660548" May 21 14:53:03.034930 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:53:03.034899 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxq7wz" May 21 14:54:24.686017 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:54:24.681878 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-fc5c64594-jfl5b"] May 21 14:54:24.686017 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:54:24.682396 2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-fc5c64594-jfl5b" podUID="36b704a6-2ace-4b4b-ae1c-dfddbe4ccd17" containerName="manager" containerID="cri-o://d00411ec27e7c111c5c232ef204ba623dee5502a2af6ff9d22466a2b20c5febb" gracePeriod=30 May 21 14:54:24.930462 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:54:24.930439 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-fc5c64594-jfl5b" May 21 14:54:25.067268 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:54:25.067162 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ctfrc\" (UniqueName: \"kubernetes.io/projected/36b704a6-2ace-4b4b-ae1c-dfddbe4ccd17-kube-api-access-ctfrc\") pod \"36b704a6-2ace-4b4b-ae1c-dfddbe4ccd17\" (UID: \"36b704a6-2ace-4b4b-ae1c-dfddbe4ccd17\") " May 21 14:54:25.069311 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:54:25.069285 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36b704a6-2ace-4b4b-ae1c-dfddbe4ccd17-kube-api-access-ctfrc" (OuterVolumeSpecName: "kube-api-access-ctfrc") pod "36b704a6-2ace-4b4b-ae1c-dfddbe4ccd17" (UID: "36b704a6-2ace-4b4b-ae1c-dfddbe4ccd17"). InnerVolumeSpecName "kube-api-access-ctfrc". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 14:54:25.168068 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:54:25.168030 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ctfrc\" (UniqueName: \"kubernetes.io/projected/36b704a6-2ace-4b4b-ae1c-dfddbe4ccd17-kube-api-access-ctfrc\") on node \"ip-10-0-134-244.ec2.internal\" DevicePath \"\"" May 21 14:54:25.342952 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:54:25.342855 2573 generic.go:358] "Generic (PLEG): container finished" podID="36b704a6-2ace-4b4b-ae1c-dfddbe4ccd17" containerID="d00411ec27e7c111c5c232ef204ba623dee5502a2af6ff9d22466a2b20c5febb" exitCode=0 May 21 14:54:25.342952 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:54:25.342923 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-fc5c64594-jfl5b" May 21 14:54:25.343170 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:54:25.342945 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-fc5c64594-jfl5b" event={"ID":"36b704a6-2ace-4b4b-ae1c-dfddbe4ccd17","Type":"ContainerDied","Data":"d00411ec27e7c111c5c232ef204ba623dee5502a2af6ff9d22466a2b20c5febb"} May 21 14:54:25.343170 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:54:25.343017 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-fc5c64594-jfl5b" event={"ID":"36b704a6-2ace-4b4b-ae1c-dfddbe4ccd17","Type":"ContainerDied","Data":"c572e1a3acfe1654ae76b42b57c380c571e194d7ed7f371eb352e1bdea9fbe83"} May 21 14:54:25.343170 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:54:25.343041 2573 scope.go:117] "RemoveContainer" containerID="d00411ec27e7c111c5c232ef204ba623dee5502a2af6ff9d22466a2b20c5febb" May 21 14:54:25.352489 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:54:25.352418 2573 scope.go:117] "RemoveContainer" containerID="d00411ec27e7c111c5c232ef204ba623dee5502a2af6ff9d22466a2b20c5febb" May 21 14:54:25.352889 ip-10-0-134-244 kubenswrapper[2573]: E0521 14:54:25.352868 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d00411ec27e7c111c5c232ef204ba623dee5502a2af6ff9d22466a2b20c5febb\": container with ID starting with d00411ec27e7c111c5c232ef204ba623dee5502a2af6ff9d22466a2b20c5febb not found: ID does not exist" containerID="d00411ec27e7c111c5c232ef204ba623dee5502a2af6ff9d22466a2b20c5febb" May 21 14:54:25.352974 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:54:25.352901 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d00411ec27e7c111c5c232ef204ba623dee5502a2af6ff9d22466a2b20c5febb"} err="failed to get container status \"d00411ec27e7c111c5c232ef204ba623dee5502a2af6ff9d22466a2b20c5febb\": rpc error: code = NotFound desc = could not find container \"d00411ec27e7c111c5c232ef204ba623dee5502a2af6ff9d22466a2b20c5febb\": container with ID starting with d00411ec27e7c111c5c232ef204ba623dee5502a2af6ff9d22466a2b20c5febb not found: ID does not exist" May 21 14:54:25.363929 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:54:25.363899 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-fc5c64594-jfl5b"] May 21 14:54:25.367245 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:54:25.367220 2573 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-fc5c64594-jfl5b"] May 21 14:54:25.817565 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:54:25.817517 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36b704a6-2ace-4b4b-ae1c-dfddbe4ccd17" path="/var/lib/kubelet/pods/36b704a6-2ace-4b4b-ae1c-dfddbe4ccd17/volumes" May 21 14:54:26.113484 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:54:26.113403 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-fc5c64594-xxm24"] May 21 14:54:26.113791 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:54:26.113777 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36b704a6-2ace-4b4b-ae1c-dfddbe4ccd17" containerName="manager" May 21 14:54:26.113833 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:54:26.113793 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="36b704a6-2ace-4b4b-ae1c-dfddbe4ccd17" containerName="manager" May 21 14:54:26.113867 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:54:26.113848 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="36b704a6-2ace-4b4b-ae1c-dfddbe4ccd17" containerName="manager" May 21 14:54:26.116479 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:54:26.116461 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-fc5c64594-xxm24" May 21 14:54:26.118481 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:54:26.118458 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-qsb46\"" May 21 14:54:26.124586 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:54:26.124561 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-fc5c64594-xxm24"] May 21 14:54:26.279441 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:54:26.279397 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2b6mv\" (UniqueName: \"kubernetes.io/projected/0ae770b1-c3ca-4b3e-b8a8-e53553f4d157-kube-api-access-2b6mv\") pod \"maas-controller-fc5c64594-xxm24\" (UID: \"0ae770b1-c3ca-4b3e-b8a8-e53553f4d157\") " pod="opendatahub/maas-controller-fc5c64594-xxm24" May 21 14:54:26.380737 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:54:26.380710 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2b6mv\" (UniqueName: \"kubernetes.io/projected/0ae770b1-c3ca-4b3e-b8a8-e53553f4d157-kube-api-access-2b6mv\") pod \"maas-controller-fc5c64594-xxm24\" (UID: \"0ae770b1-c3ca-4b3e-b8a8-e53553f4d157\") " pod="opendatahub/maas-controller-fc5c64594-xxm24" May 21 14:54:26.388595 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:54:26.388561 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2b6mv\" (UniqueName: \"kubernetes.io/projected/0ae770b1-c3ca-4b3e-b8a8-e53553f4d157-kube-api-access-2b6mv\") pod \"maas-controller-fc5c64594-xxm24\" (UID: \"0ae770b1-c3ca-4b3e-b8a8-e53553f4d157\") " pod="opendatahub/maas-controller-fc5c64594-xxm24" May 21 14:54:26.427445 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:54:26.427400 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-fc5c64594-xxm24" May 21 14:54:26.559972 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:54:26.559941 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-fc5c64594-xxm24"] May 21 14:54:26.562519 ip-10-0-134-244 kubenswrapper[2573]: W0521 14:54:26.562490 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ae770b1_c3ca_4b3e_b8a8_e53553f4d157.slice/crio-5d86faf25181552ab50d73dcca0bc5fce2a324dc362fd83ac6d2cdcdaa09493c WatchSource:0}: Error finding container 5d86faf25181552ab50d73dcca0bc5fce2a324dc362fd83ac6d2cdcdaa09493c: Status 404 returned error can't find the container with id 5d86faf25181552ab50d73dcca0bc5fce2a324dc362fd83ac6d2cdcdaa09493c May 21 14:54:27.352572 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:54:27.352462 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-fc5c64594-xxm24" event={"ID":"0ae770b1-c3ca-4b3e-b8a8-e53553f4d157","Type":"ContainerStarted","Data":"9ad8243f16fc0ea82abae25b6beefd0cda4f434283e763ed2296800d1bf149cd"} May 21 14:54:27.352572 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:54:27.352505 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-fc5c64594-xxm24" event={"ID":"0ae770b1-c3ca-4b3e-b8a8-e53553f4d157","Type":"ContainerStarted","Data":"5d86faf25181552ab50d73dcca0bc5fce2a324dc362fd83ac6d2cdcdaa09493c"} May 21 14:54:27.352572 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:54:27.352559 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-fc5c64594-xxm24" May 21 14:54:27.367120 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:54:27.367072 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-fc5c64594-xxm24" podStartSLOduration=1.031290284 podStartE2EDuration="1.367059334s" podCreationTimestamp="2026-05-21 14:54:26 +0000 UTC" firstStartedPulling="2026-05-21 14:54:26.564144458 +0000 UTC m=+779.302399966" lastFinishedPulling="2026-05-21 14:54:26.899913495 +0000 UTC m=+779.638169016" observedRunningTime="2026-05-21 14:54:27.365535439 +0000 UTC m=+780.103790969" watchObservedRunningTime="2026-05-21 14:54:27.367059334 +0000 UTC m=+780.105314884" May 21 14:54:38.360087 ip-10-0-134-244 kubenswrapper[2573]: I0521 14:54:38.360049 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-fc5c64594-xxm24" May 21 15:04:38.210927 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:04:38.210883 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-c8n8s"] May 21 15:04:38.213553 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:04:38.211228 2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-c8n8s" podUID="5a0ec8b9-b26b-4df7-9248-03755639d10a" containerName="manager" containerID="cri-o://7cf5d0ef8e673e3c6e4f71d33b3680860a4f811d7b71969a27d173ef70b01f7f" gracePeriod=10 May 21 15:04:39.166824 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:04:39.166795 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-c8n8s" May 21 15:04:39.264078 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:04:39.264040 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5a0ec8b9-b26b-4df7-9248-03755639d10a-extensions-socket-volume\") pod \"5a0ec8b9-b26b-4df7-9248-03755639d10a\" (UID: \"5a0ec8b9-b26b-4df7-9248-03755639d10a\") " May 21 15:04:39.264579 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:04:39.264131 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mbp9k\" (UniqueName: \"kubernetes.io/projected/5a0ec8b9-b26b-4df7-9248-03755639d10a-kube-api-access-mbp9k\") pod \"5a0ec8b9-b26b-4df7-9248-03755639d10a\" (UID: \"5a0ec8b9-b26b-4df7-9248-03755639d10a\") " May 21 15:04:39.264579 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:04:39.264510 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a0ec8b9-b26b-4df7-9248-03755639d10a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "5a0ec8b9-b26b-4df7-9248-03755639d10a" (UID: "5a0ec8b9-b26b-4df7-9248-03755639d10a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 15:04:39.266231 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:04:39.266208 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a0ec8b9-b26b-4df7-9248-03755639d10a-kube-api-access-mbp9k" (OuterVolumeSpecName: "kube-api-access-mbp9k") pod "5a0ec8b9-b26b-4df7-9248-03755639d10a" (UID: "5a0ec8b9-b26b-4df7-9248-03755639d10a"). InnerVolumeSpecName "kube-api-access-mbp9k". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 15:04:39.365085 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:04:39.364984 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mbp9k\" (UniqueName: \"kubernetes.io/projected/5a0ec8b9-b26b-4df7-9248-03755639d10a-kube-api-access-mbp9k\") on node \"ip-10-0-134-244.ec2.internal\" DevicePath \"\"" May 21 15:04:39.365085 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:04:39.365033 2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5a0ec8b9-b26b-4df7-9248-03755639d10a-extensions-socket-volume\") on node \"ip-10-0-134-244.ec2.internal\" DevicePath \"\"" May 21 15:04:39.432480 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:04:39.432443 2573 generic.go:358] "Generic (PLEG): container finished" podID="5a0ec8b9-b26b-4df7-9248-03755639d10a" containerID="7cf5d0ef8e673e3c6e4f71d33b3680860a4f811d7b71969a27d173ef70b01f7f" exitCode=0 May 21 15:04:39.432650 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:04:39.432517 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-c8n8s" May 21 15:04:39.432650 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:04:39.432534 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-c8n8s" event={"ID":"5a0ec8b9-b26b-4df7-9248-03755639d10a","Type":"ContainerDied","Data":"7cf5d0ef8e673e3c6e4f71d33b3680860a4f811d7b71969a27d173ef70b01f7f"} May 21 15:04:39.432650 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:04:39.432583 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-c8n8s" event={"ID":"5a0ec8b9-b26b-4df7-9248-03755639d10a","Type":"ContainerDied","Data":"18eed346a03b42c359816fa18e0075c5b3453f2aded399e81e88339f8a8f6652"} May 21 15:04:39.432650 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:04:39.432604 2573 scope.go:117] "RemoveContainer" containerID="7cf5d0ef8e673e3c6e4f71d33b3680860a4f811d7b71969a27d173ef70b01f7f" May 21 15:04:39.440924 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:04:39.440906 2573 scope.go:117] "RemoveContainer" containerID="7cf5d0ef8e673e3c6e4f71d33b3680860a4f811d7b71969a27d173ef70b01f7f" May 21 15:04:39.441190 ip-10-0-134-244 kubenswrapper[2573]: E0521 15:04:39.441171 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7cf5d0ef8e673e3c6e4f71d33b3680860a4f811d7b71969a27d173ef70b01f7f\": container with ID starting with 7cf5d0ef8e673e3c6e4f71d33b3680860a4f811d7b71969a27d173ef70b01f7f not found: ID does not exist" containerID="7cf5d0ef8e673e3c6e4f71d33b3680860a4f811d7b71969a27d173ef70b01f7f" May 21 15:04:39.441267 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:04:39.441197 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cf5d0ef8e673e3c6e4f71d33b3680860a4f811d7b71969a27d173ef70b01f7f"} err="failed to get container status \"7cf5d0ef8e673e3c6e4f71d33b3680860a4f811d7b71969a27d173ef70b01f7f\": rpc error: code = NotFound desc = could not find container \"7cf5d0ef8e673e3c6e4f71d33b3680860a4f811d7b71969a27d173ef70b01f7f\": container with ID starting with 7cf5d0ef8e673e3c6e4f71d33b3680860a4f811d7b71969a27d173ef70b01f7f not found: ID does not exist" May 21 15:04:39.452890 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:04:39.452867 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-c8n8s"] May 21 15:04:39.455979 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:04:39.455956 2573 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-c8n8s"] May 21 15:04:39.817015 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:04:39.816975 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a0ec8b9-b26b-4df7-9248-03755639d10a" path="/var/lib/kubelet/pods/5a0ec8b9-b26b-4df7-9248-03755639d10a/volumes" May 21 15:05:44.367808 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:05:44.367765 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-mvxpv"] May 21 15:05:44.368427 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:05:44.368337 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a0ec8b9-b26b-4df7-9248-03755639d10a" containerName="manager" May 21 15:05:44.368427 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:05:44.368360 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a0ec8b9-b26b-4df7-9248-03755639d10a" containerName="manager" May 21 15:05:44.368551 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:05:44.368457 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="5a0ec8b9-b26b-4df7-9248-03755639d10a" containerName="manager" May 21 15:05:44.371322 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:05:44.371297 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-mvxpv" May 21 15:05:44.373680 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:05:44.373658 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 21 15:05:44.373823 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:05:44.373674 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-wn52m\"" May 21 15:05:44.373823 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:05:44.373743 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 21 15:05:44.381361 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:05:44.381336 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-mvxpv"] May 21 15:05:44.416271 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:05:44.416217 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6f3411b1-da6b-491e-9094-18b62963b030-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-mvxpv\" (UID: \"6f3411b1-da6b-491e-9094-18b62963b030\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-mvxpv" May 21 15:05:44.416452 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:05:44.416300 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zh74\" (UniqueName: \"kubernetes.io/projected/6f3411b1-da6b-491e-9094-18b62963b030-kube-api-access-6zh74\") pod \"kuadrant-operator-controller-manager-55c7f4c975-mvxpv\" (UID: \"6f3411b1-da6b-491e-9094-18b62963b030\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-mvxpv" May 21 15:05:44.516896 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:05:44.516853 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6f3411b1-da6b-491e-9094-18b62963b030-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-mvxpv\" (UID: \"6f3411b1-da6b-491e-9094-18b62963b030\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-mvxpv" May 21 15:05:44.517146 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:05:44.516910 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6zh74\" (UniqueName: \"kubernetes.io/projected/6f3411b1-da6b-491e-9094-18b62963b030-kube-api-access-6zh74\") pod \"kuadrant-operator-controller-manager-55c7f4c975-mvxpv\" (UID: \"6f3411b1-da6b-491e-9094-18b62963b030\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-mvxpv" May 21 15:05:44.517362 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:05:44.517337 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6f3411b1-da6b-491e-9094-18b62963b030-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-mvxpv\" (UID: \"6f3411b1-da6b-491e-9094-18b62963b030\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-mvxpv" May 21 15:05:44.524792 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:05:44.524766 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zh74\" (UniqueName: \"kubernetes.io/projected/6f3411b1-da6b-491e-9094-18b62963b030-kube-api-access-6zh74\") pod \"kuadrant-operator-controller-manager-55c7f4c975-mvxpv\" (UID: \"6f3411b1-da6b-491e-9094-18b62963b030\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-mvxpv" May 21 15:05:44.681979 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:05:44.681936 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-mvxpv" May 21 15:05:44.847427 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:05:44.847391 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-mvxpv"] May 21 15:05:44.851192 ip-10-0-134-244 kubenswrapper[2573]: W0521 15:05:44.851161 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f3411b1_da6b_491e_9094_18b62963b030.slice/crio-578ee4617d183d3ddd2b3cfbd5587c401470fac44cba9ca2cedb10ce0fd8d408 WatchSource:0}: Error finding container 578ee4617d183d3ddd2b3cfbd5587c401470fac44cba9ca2cedb10ce0fd8d408: Status 404 returned error can't find the container with id 578ee4617d183d3ddd2b3cfbd5587c401470fac44cba9ca2cedb10ce0fd8d408 May 21 15:05:44.854379 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:05:44.854356 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 15:05:45.668652 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:05:45.668606 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-mvxpv" event={"ID":"6f3411b1-da6b-491e-9094-18b62963b030","Type":"ContainerStarted","Data":"6688435c82d7deea82a41c401c74bb2f87ffbb37d969bccafe1652dbea03033e"} May 21 15:05:45.668652 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:05:45.668650 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-mvxpv" event={"ID":"6f3411b1-da6b-491e-9094-18b62963b030","Type":"ContainerStarted","Data":"578ee4617d183d3ddd2b3cfbd5587c401470fac44cba9ca2cedb10ce0fd8d408"} May 21 15:05:45.669194 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:05:45.668683 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-mvxpv" May 21 15:05:45.686857 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:05:45.686805 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-mvxpv" podStartSLOduration=1.68679095 podStartE2EDuration="1.68679095s" podCreationTimestamp="2026-05-21 15:05:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 15:05:45.685664795 +0000 UTC m=+1458.423920363" watchObservedRunningTime="2026-05-21 15:05:45.68679095 +0000 UTC m=+1458.425046481" May 21 15:05:56.675252 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:05:56.675219 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-mvxpv" May 21 15:15:29.770738 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:15:29.770710 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-drdqg_d59dd77e-7924-4cf3-855d-33ed5a8d0229/manager/0.log" May 21 15:15:29.902721 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:15:29.902686 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-695548857-crbvc_cb3e2305-f02b-4169-8b99-477eaddfd8a6/maas-api/0.log" May 21 15:15:30.267958 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:15:30.267926 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-fc5c64594-xxm24_0ae770b1-c3ca-4b3e-b8a8-e53553f4d157/manager/0.log" May 21 15:15:30.396640 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:15:30.396609 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-l9d5p_ef58c87a-100a-4044-9bfe-1763cf75e42f/manager/1.log" May 21 15:15:30.777324 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:15:30.777287 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f7cd99cbc-v4296_7f729679-bcfb-4879-8c55-f9c9b1df85e1/manager/0.log" May 21 15:15:30.904049 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:15:30.904019 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-4stt6_289fa814-048a-4018-93a6-eda2431e210b/postgres/0.log" May 21 15:15:32.765165 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:15:32.765132 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-mvxpv_6f3411b1-da6b-491e-9094-18b62963b030/manager/0.log" May 21 15:15:33.470458 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:15:33.470415 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-ct6m6_a312e0e0-ebb8-4329-a857-419e3c5ac505/discovery/0.log" May 21 15:15:33.686018 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:15:33.685972 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-74bcf6bb97-nx2js_aedb1754-31e0-4198-8edc-e2a4764cfcf2/kube-auth-proxy/0.log" May 21 15:15:33.916784 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:15:33.916752 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-q4hsb_9120b9d7-4bd4-47ad-af7e-57774c3fb339/payload-processing/0.log" May 21 15:15:34.756134 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:15:34.756103 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxq7wz_0a9329d4-8f8d-4a9c-901c-745311b1472d/main/0.log" May 21 15:15:34.764705 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:15:34.764676 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxq7wz_0a9329d4-8f8d-4a9c-901c-745311b1472d/storage-initializer/0.log" May 21 15:15:34.871027 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:15:34.870965 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-bzb6r_732a10c7-7add-436e-9b76-35c3cdb1c85a/storage-initializer/0.log" May 21 15:15:34.877555 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:15:34.877532 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-bzb6r_732a10c7-7add-436e-9b76-35c3cdb1c85a/main/0.log" May 21 15:15:34.984981 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:15:34.984945 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-p4hpr_f10e2bc7-886d-4e99-a52c-f3e909fa759e/storage-initializer/0.log" May 21 15:15:34.991407 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:15:34.991383 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-p4hpr_f10e2bc7-886d-4e99-a52c-f3e909fa759e/main/0.log" May 21 15:15:41.454417 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:15:41.454373 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-ttwzv_5c6a4608-495d-4cdb-8b1f-2df7cfa2b0d3/global-pull-secret-syncer/0.log" May 21 15:15:41.558627 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:15:41.558596 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-kbq62_97c0df6c-a20d-40ac-b07b-4337c1e00cff/konnectivity-agent/0.log" May 21 15:15:41.658396 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:15:41.658367 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-244.ec2.internal_f76149253834985fa6424385c0e68027/haproxy/0.log" May 21 15:15:46.483540 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:15:46.483447 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-mvxpv_6f3411b1-da6b-491e-9094-18b62963b030/manager/0.log" May 21 15:15:48.366943 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:15:48.366911 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7lffp_a932471e-6ff7-4ce5-8085-f42b6d02acb9/node-exporter/0.log" May 21 15:15:48.388813 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:15:48.388783 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7lffp_a932471e-6ff7-4ce5-8085-f42b6d02acb9/kube-rbac-proxy/0.log" May 21 15:15:48.407058 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:15:48.407037 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7lffp_a932471e-6ff7-4ce5-8085-f42b6d02acb9/init-textfile/0.log" May 21 15:15:50.253639 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:15:50.253600 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gccz6/perf-node-gather-daemonset-klt7q"] May 21 15:15:50.256747 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:15:50.256728 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gccz6/perf-node-gather-daemonset-klt7q" May 21 15:15:50.259088 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:15:50.259064 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gccz6\"/\"openshift-service-ca.crt\"" May 21 15:15:50.259226 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:15:50.259132 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gccz6\"/\"kube-root-ca.crt\"" May 21 15:15:50.260008 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:15:50.259970 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-gccz6\"/\"default-dockercfg-chtxw\"" May 21 15:15:50.263407 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:15:50.263376 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gccz6/perf-node-gather-daemonset-klt7q"] May 21 15:15:50.339055 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:15:50.338985 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/99b58231-b5fc-499a-b0aa-a51b51358724-proc\") pod \"perf-node-gather-daemonset-klt7q\" (UID: \"99b58231-b5fc-499a-b0aa-a51b51358724\") " pod="openshift-must-gather-gccz6/perf-node-gather-daemonset-klt7q" May 21 15:15:50.339055 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:15:50.339057 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/99b58231-b5fc-499a-b0aa-a51b51358724-sys\") pod \"perf-node-gather-daemonset-klt7q\" (UID: \"99b58231-b5fc-499a-b0aa-a51b51358724\") " pod="openshift-must-gather-gccz6/perf-node-gather-daemonset-klt7q" May 21 15:15:50.339295 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:15:50.339106 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/99b58231-b5fc-499a-b0aa-a51b51358724-lib-modules\") pod \"perf-node-gather-daemonset-klt7q\" (UID: \"99b58231-b5fc-499a-b0aa-a51b51358724\") " pod="openshift-must-gather-gccz6/perf-node-gather-daemonset-klt7q" May 21 15:15:50.339295 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:15:50.339150 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/99b58231-b5fc-499a-b0aa-a51b51358724-podres\") pod \"perf-node-gather-daemonset-klt7q\" (UID: \"99b58231-b5fc-499a-b0aa-a51b51358724\") " pod="openshift-must-gather-gccz6/perf-node-gather-daemonset-klt7q" May 21 15:15:50.339295 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:15:50.339175 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7p7h8\" (UniqueName: \"kubernetes.io/projected/99b58231-b5fc-499a-b0aa-a51b51358724-kube-api-access-7p7h8\") pod \"perf-node-gather-daemonset-klt7q\" (UID: \"99b58231-b5fc-499a-b0aa-a51b51358724\") " pod="openshift-must-gather-gccz6/perf-node-gather-daemonset-klt7q" May 21 15:15:50.440508 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:15:50.440464 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/99b58231-b5fc-499a-b0aa-a51b51358724-podres\") pod \"perf-node-gather-daemonset-klt7q\" (UID: \"99b58231-b5fc-499a-b0aa-a51b51358724\") " pod="openshift-must-gather-gccz6/perf-node-gather-daemonset-klt7q" May 21 15:15:50.440695 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:15:50.440517 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7p7h8\" (UniqueName: \"kubernetes.io/projected/99b58231-b5fc-499a-b0aa-a51b51358724-kube-api-access-7p7h8\") pod \"perf-node-gather-daemonset-klt7q\" (UID: \"99b58231-b5fc-499a-b0aa-a51b51358724\") " pod="openshift-must-gather-gccz6/perf-node-gather-daemonset-klt7q" May 21 15:15:50.440695 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:15:50.440583 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/99b58231-b5fc-499a-b0aa-a51b51358724-proc\") pod \"perf-node-gather-daemonset-klt7q\" (UID: \"99b58231-b5fc-499a-b0aa-a51b51358724\") " pod="openshift-must-gather-gccz6/perf-node-gather-daemonset-klt7q" May 21 15:15:50.440695 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:15:50.440623 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/99b58231-b5fc-499a-b0aa-a51b51358724-sys\") pod \"perf-node-gather-daemonset-klt7q\" (UID: \"99b58231-b5fc-499a-b0aa-a51b51358724\") " pod="openshift-must-gather-gccz6/perf-node-gather-daemonset-klt7q" May 21 15:15:50.440695 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:15:50.440650 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/99b58231-b5fc-499a-b0aa-a51b51358724-podres\") pod \"perf-node-gather-daemonset-klt7q\" (UID: \"99b58231-b5fc-499a-b0aa-a51b51358724\") " pod="openshift-must-gather-gccz6/perf-node-gather-daemonset-klt7q" May 21 15:15:50.440695 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:15:50.440668 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/99b58231-b5fc-499a-b0aa-a51b51358724-lib-modules\") pod \"perf-node-gather-daemonset-klt7q\" (UID: \"99b58231-b5fc-499a-b0aa-a51b51358724\") " pod="openshift-must-gather-gccz6/perf-node-gather-daemonset-klt7q" May 21 15:15:50.440881 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:15:50.440700 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/99b58231-b5fc-499a-b0aa-a51b51358724-proc\") pod \"perf-node-gather-daemonset-klt7q\" (UID: \"99b58231-b5fc-499a-b0aa-a51b51358724\") " pod="openshift-must-gather-gccz6/perf-node-gather-daemonset-klt7q" May 21 15:15:50.440881 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:15:50.440720 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/99b58231-b5fc-499a-b0aa-a51b51358724-sys\") pod \"perf-node-gather-daemonset-klt7q\" (UID: \"99b58231-b5fc-499a-b0aa-a51b51358724\") " pod="openshift-must-gather-gccz6/perf-node-gather-daemonset-klt7q" May 21 15:15:50.440881 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:15:50.440784 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/99b58231-b5fc-499a-b0aa-a51b51358724-lib-modules\") pod \"perf-node-gather-daemonset-klt7q\" (UID: \"99b58231-b5fc-499a-b0aa-a51b51358724\") " pod="openshift-must-gather-gccz6/perf-node-gather-daemonset-klt7q" May 21 15:15:50.448308 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:15:50.448277 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7p7h8\" (UniqueName: \"kubernetes.io/projected/99b58231-b5fc-499a-b0aa-a51b51358724-kube-api-access-7p7h8\") pod \"perf-node-gather-daemonset-klt7q\" (UID: \"99b58231-b5fc-499a-b0aa-a51b51358724\") " pod="openshift-must-gather-gccz6/perf-node-gather-daemonset-klt7q" May 21 15:15:50.568125 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:15:50.568021 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gccz6/perf-node-gather-daemonset-klt7q" May 21 15:15:50.703432 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:15:50.703406 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gccz6/perf-node-gather-daemonset-klt7q"] May 21 15:15:50.706327 ip-10-0-134-244 kubenswrapper[2573]: W0521 15:15:50.706297 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod99b58231_b5fc_499a_b0aa_a51b51358724.slice/crio-8c81ac108c50cd55099599680465d6c31dee2c087dcaebba446b944b82228938 WatchSource:0}: Error finding container 8c81ac108c50cd55099599680465d6c31dee2c087dcaebba446b944b82228938: Status 404 returned error can't find the container with id 8c81ac108c50cd55099599680465d6c31dee2c087dcaebba446b944b82228938 May 21 15:15:50.708392 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:15:50.708370 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 15:15:50.712424 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:15:50.712393 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gccz6/perf-node-gather-daemonset-klt7q" event={"ID":"99b58231-b5fc-499a-b0aa-a51b51358724","Type":"ContainerStarted","Data":"8c81ac108c50cd55099599680465d6c31dee2c087dcaebba446b944b82228938"} May 21 15:15:51.716831 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:15:51.716791 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gccz6/perf-node-gather-daemonset-klt7q" event={"ID":"99b58231-b5fc-499a-b0aa-a51b51358724","Type":"ContainerStarted","Data":"fe654b2eea76cd802f89940d2cbce557fad97815269d65b403e659b79d23394e"} May 21 15:15:51.717333 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:15:51.716946 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-gccz6/perf-node-gather-daemonset-klt7q" May 21 15:15:51.732478 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:15:51.732425 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-gccz6/perf-node-gather-daemonset-klt7q" podStartSLOduration=1.7324082939999998 podStartE2EDuration="1.732408294s" podCreationTimestamp="2026-05-21 15:15:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 15:15:51.73019157 +0000 UTC m=+2064.468447102" watchObservedRunningTime="2026-05-21 15:15:51.732408294 +0000 UTC m=+2064.470663826" May 21 15:15:52.384801 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:15:52.384770 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nhgp4_e9d6b052-42ec-4661-b823-05dd64d61de4/dns/0.log" May 21 15:15:52.403290 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:15:52.403269 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nhgp4_e9d6b052-42ec-4661-b823-05dd64d61de4/kube-rbac-proxy/0.log" May 21 15:15:52.446063 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:15:52.446035 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-k2p4j_591d522c-4c95-4b9c-852b-f84095cc2525/dns-node-resolver/0.log" May 21 15:15:52.944929 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:15:52.944900 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nfd4x_19eadc83-10b5-48f6-ad02-e8540668c1cc/node-ca/0.log" May 21 15:15:53.855894 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:15:53.855849 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-ct6m6_a312e0e0-ebb8-4329-a857-419e3c5ac505/discovery/0.log" May 21 15:15:53.895824 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:15:53.895792 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-74bcf6bb97-nx2js_aedb1754-31e0-4198-8edc-e2a4764cfcf2/kube-auth-proxy/0.log" May 21 15:15:54.013028 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:15:54.012980 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-q4hsb_9120b9d7-4bd4-47ad-af7e-57774c3fb339/payload-processing/0.log" May 21 15:15:54.524501 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:15:54.524466 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8kdcz_cf5c512d-d3b8-4cf0-9b13-2e99eeac6432/serve-healthcheck-canary/0.log" May 21 15:15:55.026869 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:15:55.026838 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-24hvv_57a7acb8-a711-41c2-be8f-c046a2d124cb/kube-rbac-proxy/0.log" May 21 15:15:55.044230 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:15:55.044204 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-24hvv_57a7acb8-a711-41c2-be8f-c046a2d124cb/exporter/0.log" May 21 15:15:55.062227 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:15:55.062198 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-24hvv_57a7acb8-a711-41c2-be8f-c046a2d124cb/extractor/0.log" May 21 15:15:56.979655 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:15:56.979618 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-drdqg_d59dd77e-7924-4cf3-855d-33ed5a8d0229/manager/0.log" May 21 15:15:57.007367 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:15:57.007340 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-695548857-crbvc_cb3e2305-f02b-4169-8b99-477eaddfd8a6/maas-api/0.log" May 21 15:15:57.115352 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:15:57.115324 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-fc5c64594-xxm24_0ae770b1-c3ca-4b3e-b8a8-e53553f4d157/manager/0.log" May 21 15:15:57.133103 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:15:57.133075 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-l9d5p_ef58c87a-100a-4044-9bfe-1763cf75e42f/manager/0.log" May 21 15:15:57.146412 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:15:57.146388 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-l9d5p_ef58c87a-100a-4044-9bfe-1763cf75e42f/manager/1.log" May 21 15:15:57.223674 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:15:57.223641 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f7cd99cbc-v4296_7f729679-bcfb-4879-8c55-f9c9b1df85e1/manager/0.log" May 21 15:15:57.241686 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:15:57.241610 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-4stt6_289fa814-048a-4018-93a6-eda2431e210b/postgres/0.log" May 21 15:15:57.730069 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:15:57.730038 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-gccz6/perf-node-gather-daemonset-klt7q" May 21 15:15:58.373351 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:15:58.373317 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-bfc7f696d-f5249_d352108a-a320-429f-bca2-f833fe652419/openshift-lws-operator/0.log" May 21 15:16:04.161763 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:16:04.161730 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2cg2c_34972f99-075d-486d-8b03-5efb08d79649/kube-multus-additional-cni-plugins/0.log" May 21 15:16:04.181534 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:16:04.181506 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2cg2c_34972f99-075d-486d-8b03-5efb08d79649/egress-router-binary-copy/0.log" May 21 15:16:04.200560 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:16:04.200531 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2cg2c_34972f99-075d-486d-8b03-5efb08d79649/cni-plugins/0.log" May 21 15:16:04.218360 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:16:04.218341 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2cg2c_34972f99-075d-486d-8b03-5efb08d79649/bond-cni-plugin/0.log" May 21 15:16:04.236422 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:16:04.236400 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2cg2c_34972f99-075d-486d-8b03-5efb08d79649/routeoverride-cni/0.log" May 21 15:16:04.256082 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:16:04.256053 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2cg2c_34972f99-075d-486d-8b03-5efb08d79649/whereabouts-cni-bincopy/0.log" May 21 15:16:04.277167 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:16:04.277142 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2cg2c_34972f99-075d-486d-8b03-5efb08d79649/whereabouts-cni/0.log" May 21 15:16:04.619472 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:16:04.619389 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-r6dl7_a65a2fdc-9089-4fb7-a01e-908858343c61/kube-multus/0.log" May 21 15:16:04.712733 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:16:04.712702 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-tft6b_646e1e59-0917-4626-8e22-158fec29f33f/network-metrics-daemon/0.log" May 21 15:16:04.731277 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:16:04.731249 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-tft6b_646e1e59-0917-4626-8e22-158fec29f33f/kube-rbac-proxy/0.log" May 21 15:16:05.495216 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:16:05.495189 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5t966_43f110a5-d9cb-4410-91e4-c3da71193c3c/ovn-controller/0.log" May 21 15:16:05.520446 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:16:05.520418 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5t966_43f110a5-d9cb-4410-91e4-c3da71193c3c/ovn-acl-logging/0.log" May 21 15:16:05.538273 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:16:05.538249 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5t966_43f110a5-d9cb-4410-91e4-c3da71193c3c/kube-rbac-proxy-node/0.log" May 21 15:16:05.556956 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:16:05.556927 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5t966_43f110a5-d9cb-4410-91e4-c3da71193c3c/kube-rbac-proxy-ovn-metrics/0.log" May 21 15:16:05.572775 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:16:05.572751 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5t966_43f110a5-d9cb-4410-91e4-c3da71193c3c/northd/0.log" May 21 15:16:05.597430 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:16:05.597406 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5t966_43f110a5-d9cb-4410-91e4-c3da71193c3c/nbdb/0.log" May 21 15:16:05.615607 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:16:05.615569 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5t966_43f110a5-d9cb-4410-91e4-c3da71193c3c/sbdb/0.log" May 21 15:16:05.717878 ip-10-0-134-244 kubenswrapper[2573]: I0521 15:16:05.717842 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5t966_43f110a5-d9cb-4410-91e4-c3da71193c3c/ovnkube-controller/0.log"